Page 16 of 55

Re: Media Rover

Posted: October 13th, 2009, 1:33 pm
by Lockzi
How do I disable the download of HD episodes?
I currently get double episodes, one SD and one HD?

Re: Media Rover

Posted: October 13th, 2009, 4:41 pm
by qrb123
Lockzi wrote: How do I disable the download of HD episodes?
I currently get double episodes, one SD and one HD?
I am not sure you can with the RSS sources posted in your conf file a few pages back, though I am not familiar with all of those sites.  

You have to keep the HD ones out of the RSS feed, so if those sites allow you to do a custom search and save the RSS feed for that search, then it will work.  

It's easy to do just that with newzbin, as you can customize the rss feed.  Not sure if you use newzbin or not.

Re: Media Rover

Posted: October 13th, 2009, 6:31 pm
by qrb123
*Edit - Nevermind I got it working

Re: Media Rover

Posted: October 14th, 2009, 1:44 am
by kierse
Hey everyone,

I just pushed some code that should address the download / scheduling problems users have reported regarding daily episodes.  There were two separate problems:

1. When I originally wrote the tvnzb and mytvnzb source plugins, I used the data contained in the nzb description field to determine the episode details.  I did this because the data contained in the description field is generally a little more ordered and easier to parse (or so I thought).  It turns out that this worked well for series type episodes but not so well for daily episodes.  The title of daily nzbs correctly contained the broadcast date (which is necessary in determining if an nzb is for a daily or series episode) however the description contained the season and episode number.  Therefore, Media Rover was getting a season and episode number when it should have been getting a broadcast date.  This obviously caused problems when MR was attempting to identify existing episodes on disk and when sorting the episode once it had been downloaded.  I've updated the plugins to use the title field when gathering episode data which should fix this problem.

2. Tvnzb seems to post nzbs using a shortened series name.  For example, if a series is called "The Super Terrific Happy Hour with John Doe", Tvnzb might call it "John Doe".  Obviously this caused problems when identifying existing episodes on disk and when sorting downloaded episodes.  Furthermore, if you use multiple sources from which Media Rover can identify potential downloads, you will likely see duplicates.  To address this problem, I have introduced the concept of series aliases.  This basically allows the user to list alternate names for a series that might appear in an nzb title.  Using our example above:

folder on disk
c:\tv\The Super Terrific Happy Hour with John Doe

aliases defined in config file:

[tv]
  [[filter]]
      [[[ The Super Terrific Happy Hour with John Doe ]]]
        alias = "John Doe", "Super Terrific Happy Hour with John Doe"

...would result in nzbs containing any one of the aliases to be downloaded (assuming it passes all other predownload checks):

        "The.Super.Terrific.Happy.Hour.with.John.Doe.2009.10.12.some.guest.nzb"
        "Super.Terrific.Happy.Hour.with.John.Doe.2009.10.12.some.guest.nzb"
        "john.doe.2009.10.12.some.guest.nzb"

Hopefully this will address any outstanding issues related to downloading daily episodes.  Please let me know if you have any problems with the changes or if the problem persists.

Also, to all of you waiting for a solution to the duplicate downloads issue: I'm still working on it.  A couple of users have sent me logs and specific examples of which I am going through now.  Hopefully they'll contain enough info for me to figure out whats going on.

Kierse

Re: Media Rover

Posted: October 14th, 2009, 3:26 am
by rollingeyeball
Sounds like you've been quite busy Kierse. Thanks for the progress :)

Regarding the alises, and parsing in general - do symbols make an impact?
For egample, some shows might be err
Series:Spinoff town
But on disk / the folder name might be Series Spinoff town

Also, capitals?

And again, kind of on the same subject, I get a fair few BEWARE OF DUPLICATES YOU HAVE BEEN WARNED messages (For different shows than dupes I get, oddly)
that are mostly (admittedly i have some spanning 2 disks) partial names.
For eg media rover detects and wanrs me about my legally bought and backed up season of stargate sg1. I also have stargate atlantis, but not two folders of either.

WOW. Overuse of .. lots of things. I'm incredibly tired, wooo

Re: Media Rover

Posted: October 15th, 2009, 1:11 am
by kierse
rollingeyeball wrote: Regarding the alises, and parsing in general - do symbols make an impact?
For egample, some shows might be err
Series:Spinoff town
But on disk / the folder name might be Series Spinoff town

Also, capitals?
You won't need an alias in either of those cases.  Media Rover does the following when comparing series names:

1. convert to lowercase
2. strip out any characters that aren't letters or numbers
3. compare

The only time you would need an alias is if there are extra letters or numbers.  So, if you named your series folder on disk like "Series Spinoff" but the show appears in nzbs as "The Series Spinoff", you would need to declare and alias
rollingeyeball wrote: And again, kind of on the same subject, I get a fair few BEWARE OF DUPLICATES YOU HAVE BEEN WARNED messages (For different shows than dupes I get, oddly)
that are mostly (admittedly i have some spanning 2 disks) partial names.
Media Rover spits out the duplicate series warning when if encounters two series with the same sanitized name.  It gets a sanitized name by following the steps listed above: lowercase and strip out anything that isn't alphanumeric.  So, if you have a series folder "Series_" and another "Series", Media Rover will think they are the same and spit out an error.  I personally haven't run into any problems with this approach but its possible it could cause problems with strangely named series.  Let me know if you've got an example and I'll change how that code works.
rollingeyeball wrote: For eg media rover detects and wanrs me about my legally bought and backed up season of stargate sg1. I also have stargate atlantis, but not two folders of either.
That seems odd, and it gives you duplicate warnings for both?

Kierse

Re: Media Rover

Posted: October 15th, 2009, 1:25 am
by rollingeyeball
PM sent with further info and logs :D

Re: Media Rover

Posted: October 15th, 2009, 1:46 am
by kierse
Hi everyone,

As I go through some of the recent questions its apparent that people are still having problems getting Media Rover up and running for the first time.  I'm working on getting that damn UI done but time has been short lately and things haven't been progressing quite as quickly as I would have liked.  With than in mind, I put an example config file up on the wiki that demonstrates how to create series filters as well as define sources and queues.  You can find the example at http://wiki.github.com/kierse/mediarover/config-example

New users should be able to take the example, set the tv_root, set the queue properties,and have a working configuration.

Kierse

Re: Media Rover

Posted: October 15th, 2009, 8:37 am
by Goriem
kierse wrote: Hey everyone,

I just pushed some code that should address the download / scheduling problems users have reported regarding daily episodes.  There were two separate problems:

1. When I originally wrote the tvnzb and mytvnzb source plugins, I used the data contained in the nzb description field to determine the episode details.  I did this because the data contained in the description field is generally a little more ordered and easier to parse (or so I thought).  It turns out that this worked well for series type episodes but not so well for daily episodes.  The title of daily nzbs correctly contained the broadcast date (which is necessary in determining if an nzb is for a daily or series episode) however the description contained the season and episode number.  Therefore, Media Rover was getting a season and episode number when it should have been getting a broadcast date.  This obviously caused problems when MR was attempting to identify existing episodes on disk and when sorting the episode once it had been downloaded.  I've updated the plugins to use the title field when gathering episode data which should fix this problem.

2. Tvnzb seems to post nzbs using a shortened series name.  For example, if a series is called "The Super Terrific Happy Hour with John Doe", Tvnzb might call it "John Doe".  Obviously this caused problems when identifying existing episodes on disk and when sorting downloaded episodes.  Furthermore, if you use multiple sources from which Media Rover can identify potential downloads, you will likely see duplicates.  To address this problem, I have introduced the concept of series aliases.  This basically allows the user to list alternate names for a series that might appear in an nzb title.  Using our example above:

folder on disk
c:\tv\The Super Terrific Happy Hour with John Doe

aliases defined in config file:

[tv]
   [[filter]]
      [[[ The Super Terrific Happy Hour with John Doe ]]]
         alias = "John Doe", "Super Terrific Happy Hour with John Doe"

...would result in nzbs containing any one of the aliases to be downloaded (assuming it passes all other predownload checks):

         "The.Super.Terrific.Happy.Hour.with.John.Doe.2009.10.12.some.guest.nzb"
         "Super.Terrific.Happy.Hour.with.John.Doe.2009.10.12.some.guest.nzb"
         "john.doe.2009.10.12.some.guest.nzb"

Hopefully this will address any outstanding issues related to downloading daily episodes.  Please let me know if you have any problems with the changes or if the problem persists.

Also, to all of you waiting for a solution to the duplicate downloads issue: I'm still working on it.  A couple of users have sent me logs and specific examples of which I am going through now.  Hopefully they'll contain enough info for me to figure out whats going on.

Kierse
Sounds like you're busy indeed

Hvow might one get a hand on this "updated" code? just d/l the same zip from www.mediarover.tv ?

Re: Media Rover

Posted: October 15th, 2009, 11:33 pm
by audiophile
Looks like a great start to what could eventually become a replacement for my current configuration of using mytvnzb.foechoer.be RSS feeds and letting sab do the rest.  I haven't tried it yet, but tomorrow when I'm a bit more awake I'll look into it.  What are your opinions regarding Media Rover vs the foechoer method?  Am I missing something? 

Re: Media Rover

Posted: October 16th, 2009, 1:08 am
by rollingeyeball
What are your opinions regarding Media Rover vs the foechoer method?  Am I missing something?
Probably :P Otherwise you'd already be using it. MediaRover is most definitely a better option than .. anything else.

Your biggest differences will be zero dupes (or.. there abouts, lol)
And after the initial config, total automation. You can start a new series and media rover will 'notice' and get future (and past) episodes if and when they're posted

Re: Media Rover

Posted: October 16th, 2009, 8:06 am
by makkonen
Just found this page. Great looking project... I wish I hadn't spent so much time getting my rss feeds in sab all dialed in perfectly last week, or I'd have definitely gone with this more elegant option. As it stands, I'm just using it to sort a couple daily shows that sab's built-in episode sorting can't handle.

I'm surprised no one's asked this (at least, I'm pretty sure no one has -- I just skimmed all 16 pages of the thread, because my search-fu was not getting me anywhere), but, as far as episode sorting goes... can we turn off the season folders?

I tried just setting season = '' in the templates, but that freaked the script out (it tried to create a directory with the same name as an existing one) and it errored out. And there isn't even an option for tweaking the year format for daily shows. Couldn't get rid of that '2009/' no matter what I tried. I'm not missing anything, am I?

Anyway, even with having go drill down an extra folder, it works way better than my old solution -- manually dragging and dropping (and being lazy enough to not care that things were a mess). So, even though I'm using only about 1/10 of the functionality, I'm a convert. Thanks!

Re: Media Rover

Posted: October 16th, 2009, 5:03 pm
by Goriem
audiophile wrote: Looks like a great start to what could eventually become a replacement for my current configuration of using mytvnzb.foechoer.be RSS feeds and letting sab do the rest.  I haven't tried it yet, but tomorrow when I'm a bit more awake I'll look into it.  What are your opinions regarding Media Rover vs the foechoer method?  Am I missing something? 
hm, for one, mediarover keeps an eye on what files you have and dont have, so it only d/l's missing episodes
And at least in my setup, i have a server that D/L's the episodes, and then all episodes are placed on another server, mediarovers sort script moves my d/l into place after completed d/l, and cleans up after it self = complete automation.

Mind you - i Still use the "Foechoer" method for ongoing series, and then i add specialised feeds into mediarover that "looks out" for missing seasons / episodes where needed.

Re: Media Rover

Posted: October 16th, 2009, 7:19 pm
by kierse
Hi Lockzi,

You can ignore the following error:
Lockzi wrote: 2009-10-10 13:25 ERROR - episode 'xxxx- 2x03' does not exist on disk - error.py:45
Media Rover generates it when it doesn't find an episode on disk which means it'll probably try and download it.  The one you need to worry about is the following error:
Lockzi wrote: 2009-10-10 12:40 ERROR - unexpected response received from queue, unable to schedule item 'xxxx 9x03' for download - error.py:45
this means Media Rover was not able to schedule the nzb for download with SABnzbd for some reason.  Here's what you'll need to do to figure out whats going wrong:

1. open logging.conf (located in the MR config directory)
2. update the line "level = INFO" to be "level = DEBUG" for both the [handler_logfile] and [handler_screen] subsections.
3. save your changes
4. run MR

These changes will increase the amount of data MR logs to the log file and to the screen. You should start seeing a line similar to the following (when MR schedules an nzb for download):

Code: Select all

2009-10-10 13:25 DEBUG - add to queue request: http://localhost:8080/.....
The url in the log line is the actual command being sent to SABnzbd to add the nzb to the queue.  If you enter the url into your browser you should get a helpful message.  Give that a whirl and let me know what the response message is
Lockzi wrote: How do I disable the download of HD episodes?
I currently get double episodes, one SD and one HD?
I'm currently tracking down a bug that is resulting in periodic duplicate downloads so this could be the source of your problem.  If you are getting a lot of duplicates, I'm guessing you've got another problem.  After you change the logging level (as described above) post the log data and I'll have a look.

Kierse

Re: Media Rover

Posted: October 16th, 2009, 7:27 pm
by kierse
Ghosttt wrote:

Code: Select all

2009-10-13 11:46 ERROR - unexpected response received from queue, unable to schedule item 'xxxx 7x04' for download - error.py:45
Hey Ghosttt,

You seem to be having the same problem as Lockzi: communication with SABnzbd is failing.  Increase your logging threshold and try manually adding an nzb to the SABnzbd queue (see previous post).  Let me know what response you get when adding the nzb.

Kierse