[Release] IRC daemon plugin is now out of beta

[cvium]

My bad, the body of the message is enter #ahd-announce my_nick my_passkey.

You dont "join" the ahd-announce channel per-se. You send the invite-command to the AHDBot and when it receives this it invites you in.

What I meant is that the irc_bot cannot know whether the invite bot will force-join you or simply allow you to enter by giving you a vhost. Therefore it simply tries to join the channel until it succeeds.

[her0wh1m]

Understood thanks.

I also needed to change the invite_nickname to AHDBot. Now its working well.

Thanks for your help on this. Will write a tutorial at AHD, trying and get a few more people using this.

[Dramos]

Thanks a lot for the plugin cvlum, I was using a custom eggrop bot using flexget injects to do something similar to this till I found this plugin. Just have one question, with the 'task_re' setting, is it possible to supress/change the log level of the 'Entry 'xxx' did not match any task regexp.' messages going to the logs? This is currently logged at the info level.

[cvium]

done in next release

[Dramos]

Thanks cvlum.

[abandonow]

Not sure if I should post here, or make a new thread. But I'm having issues with getting cookies to work.

This is the output I get when cookie does not work:

2019-06-30 13:31 DEBUG    download      irc-tv-dl       Downloading url 'https://www.tracker.org/download.php?id=111111111&name=<torrent_name>.torrent'
2019-06-30 13:31 DEBUG    utils.requests irc-tv-dl       GETing URL https://www.tracker.org/download.php?id=111111111&name=<torrent_name>.torrent with args () and kwargs {'auth': None, 'headers': {'User-Agent': 'FlexGet/2.21.10 (www.flexget.com)', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive'}, 'allow_redirects': True, 'timeout': 30}
2019-06-30 13:31 DEBUG    download      irc-tv-dl       Got 503 response from server. Saving error page.
2019-06-30 13:31 ERROR    download      irc-tv-dl       Error retrieving <torrent_name>, the error page has been saved to /config/received/irc-tv-dl/<torrent_name>.error
2019-06-30 13:31 WARNING  download      irc-tv-dl       RequestException 503 Server Error: Service Temporarily Unavailable for url: https://www.tracker.org/login.php?returnto=%2Fdownload.php%3Fid%3D111111111%26name%3D<torrent_name>.torrent, while downloading https://www.tracker.org/download.php?id=111111111&name=<torrent_name>.torrent
2019-06-30 13:31 DEBUG    entry         irc-tv-dl       Marking entry '<torrent_name>' as failed
2019-06-30 13:31 ERROR    entry         irc-tv-dl       Failed <torrent_name> (Network error during request: 503 Server Error: Service Temporarily Unavailable for url: https://www.tracker.org/login.php?returnto=%2Fdownload.php%3Fid%3D111111111%26name%3D<torrent_name>.torrent)
2019-06-30 13:31 VERBOSE  task          irc-tv-dl       FAILED: `<torrent_name>` by download plugin because network error during request: 503 Server Error: Service Temporarily Unavailable for url: https://www.tracker.org/login.php?returnto=%2Fdownload.php%3Fid%3D111111111%26name%3D<torrent_name>.torrent

Relevant config snippets:

tasks:
  irc-tv-dl:
    manual: yes
    accept_all: yes
    download: /data/tv

irc:  
  tracker:
    tracker_file: '/config/trackers/tracker-name.tracker'
    nickname: '{? irc.nickname ?}'
    nickserv_password: '{? irc.nickserv_password ?}'
    cookie: '{? irc.tracker.cookie ?}'
    server: 'irc.tracker.org'
    port: 7000
    use_ssl: yes
    channels: ['#tracker','#tracker.Announce']
    task:
      irc-tv-dl

cookie variable:

  tracker:
    cookie: uid=11111;pass=329djksa9030292kljsa9ssaj93

If I use the headers plugin in my task it works:

   headers:
      User-Agent: '{? useragent ?}'
      Cookie: '{? irc.tracker.cookie ?}'

Snippet from when it works:

     2019-06-30 14:03 DEBUG    headers       irc-tv-dl       headers to add: {'User-Agent': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0', 'Cookie': 'uid=11111;pass=329djksa9030292kljsa9ssaj93'}
     2019-06-30 14:03 VERBOSE  task          irc-tv-dl       ACCEPTED: `<torrent_name>` by accept_all plugin
     2019-06-30 14:03 DEBUG    urlrewriter   irc-tv-dl       Checking 1 entries
     2019-06-30 14:03 INFO     download      irc-tv-dl       Downloading: <torrent_name>
     2019-06-30 14:03 DEBUG    download      irc-tv-dl       Downloading url 'https://www.tracker.org/download.php?id=111111&name=<torrent_name>.torrent'

The only workaround that I can think of, and to avoid sending the cookie to all, would be to make a separate task for that specific tracker. But if possible I would rather fix it correctly. The task with accept_all is just to test.

Any pointers on what I'm doing wrong?

EDIT:
Additional question:

On another tracker their download URLs ends with ".torrent?passkey=XXX", which seems to cause problems when downloading. Flexget thinks it's an HTML page. Trying the same URL in browser works fine.

2019-06-30 14:33 VERBOSE  irc                           IRC message in #announce generated an entry: <Entry(title=<release-name>,state=undecided)>
2019-06-30 14:33 DEBUG    irc                           Entry: <Entry(title=<release-name>,state=undecided)>
2019-06-30 14:33 DEBUG    irc                           Injecting 1 entries into tasks irc-tv-dl
2019-06-30 14:33 DEBUG    manager       irc-tv-dl       Not running db cleanup, last run 2019-06-29 00:24:36
2019-06-30 14:33 DEBUG    task          irc-tv-dl       executing irc-tv-dl
2019-06-30 14:33 DEBUG    task          irc-tv-dl       Disabling input phase
2019-06-30 14:33 DEBUG    template      irc-tv-dl       Merging template global into task irc-tv-dl
2019-06-30 14:33 DEBUG    include       irc-tv-dl       Merging /config/reject.yml into task irc-tv-dl
2019-06-30 14:33 VERBOSE  task          irc-tv-dl       ACCEPTED: `<release-name>` by accept_all plugin
2019-06-30 14:33 DEBUG    urlrewriter   irc-tv-dl       Checking 1 entries
2019-06-30 14:33 INFO     download      irc-tv-dl       Downloading: <release-name>
2019-06-30 14:33 DEBUG    download      irc-tv-dl       Downloading url 'https://tracker.org/download.php/2MwI3Ss/<release-name>.torrent?passkey=181821kjadskaj2q912ksajdlkjas9a22211'
2019-06-30 14:33 DEBUG    utils.requests irc-tv-dl       GETing URL https://tracker.org/download.php/2MwI3Ss/<release-name>.torrent?passkey=181821kjadskaj2q912ksajdlkjas9a22211 with args () and kwargs {'auth': None, 'headers': {'User-Agent': 'FlexGet/2.21.10 (www.flexget.com)', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive'}, 'allow_redirects': True, 'timeout': 30}
2019-06-30 14:33 DEBUG    download      irc-tv-dl       <release-name> field file set to: /config/temp/tmpx6aio071/5158b3723cf8737452fefe98a003c279
2019-06-30 14:33 DEBUG    download      irc-tv-dl       Mimetype guess for text/html is ['.htm', '.html']
2019-06-30 14:33 DEBUG    download      irc-tv-dl       No filename - setting from url: <release-name>.torrent?passkey=181821kjadskaj2q912ksajdlkjas9a22211
2019-06-30 14:33 DEBUG    download      irc-tv-dl       Finishing download_entry() with filename <release-name>.torrent?passkey=181821kjadskaj2q912ksajdlkjas9a22211
2019-06-30 14:33 DEBUG    download      irc-tv-dl       removing temp file /config/temp/tmpx6aio071/5158b3723cf8737452fefe98a003c279 from <release-name>
2019-06-30 14:33 DEBUG    entry         irc-tv-dl       Marking entry '<release-name>' as failed
2019-06-30 14:33 ERROR    entry         irc-tv-dl       Failed <release-name> (Unexpected html content received from `https://tracker.org/download.php/2MwI3Ss/<release-name>.torrent?passkey=181821kjadskaj2q912ksajdlkjas9a22211` - maybe a login page?)
2019-06-30 14:33 VERBOSE  task          irc-tv-dl       FAILED: `<release-name>` by download plugin because unexpected html content received from `https://tracker.org/download.php/2MwI3Ss/<release-name>.torrent?passkey=181821kjadskaj2q912ksajdlkjas9a22211` - maybe a login page?
2019-06-30 14:33 VERBOSE  details       irc-tv-dl       Summary - Accepted: 0 (Rejected: 0 Undecided: 0 Failed: 1)
2019-06-30 14:33 DEBUG    notify_entry  irc-tv-dl       No entries to notify about.