Media Rover

[rollingeyeball]

parsing the nzb title is never going to be a reliable solution.

Can you explain a bit more? I'm not requesting or suggesting it because in my opinion it'd be pretty unnecessary, but surely you can parse the nzb title for
GERMAN/GER/
I can't imagine any decent source not having those indicators.


Hehe, If you wanted reeaallly reliable/fancy/pedantic you could implement NFO parsing once a download has started to confirm codec and language and the name and all of that.


There are _soooo_ many useless ideas in my head. I want to learn python.

I need to re-download and reconfigure MR now. I haven't looked at it for a while. 100% reliable though. Thanks again Kierse



EDIT:

I just found an issue- not so much a bug with queue checking.
When I have files downloading, adding new files takes quite a while because my entire connection is already maxed. Sab always takes AGGESSS to fetch the details of a new file from newzbin. Sometimes only when post processing for the previous file has started, it is able to fetch the next ep from newzbin properly.

So.. This poses an issue with the queue checking
I just woke up to 6 files from a series I already have queued. It didn't recognise it as on disk, I suppose because I have 2 watched directories, and shamefully this series is in both.
Luckily only one episode was actually downloading.  The rest were still being fetched by SAB, they were actually queued several times too.
I doubt there's a way to fix this, but be wary everyone,  :-\

[kierse]

Hey Kierse, thanks for the reply!

Know exactly how you feel on the work and family front - that's why I don't have time to spend figuring the setup out lol.

I am definitely interested in using what you have got so far - new seasons are just around the corner, and I have a two week holiday in Jamaica coming up - would be nice to set it and forget it while away 

Ugly I can happily deal with!

Hey SteveMc,

I've got a couple of minor things to work out but I'll try and release what code I've got in the next day or so.

Kier

[kierse]

Can you explain a bit more? I'm not requesting or suggesting it because in my opinion it'd be pretty unnecessary, but surely you can parse the nzb title for
GERMAN/GER/
I can't imagine any decent source not having those indicators.

To be honest with you, I haven't spent much time looking into this type of filtering.  You are correct though in saying it should be easy to parse for GERMAN/GER etc.  The problem (as I see it) is that I already parse the nzb name in order to identify series/season/episode.  Unless the indexing site follows a published naming pattern (like newzbin), its difficult to know for example where the series name ends and the language starts, especially if the language isn't always specified.  I suppose I could pick a couple common languages and try to identify them, but again if there isn't a known location where this info will be placed I would have to search the entire nzb name which could lead to false positives.

If this is something people are really interested in, I could definitely look into it further though.

Hehe, If you wanted reeaallly reliable/fancy/pedantic you could implement NFO parsing once a download has started to confirm codec and language and the name and all of that.

Good idea, the NFO would probably be more reliable than parsing the nzb name.  A couple of problems though:

1. not every nzb comes with an NFO
2. MR doesn't get run until the download is complete. 

Parsing the NFO could be one of the steps the sorting script does though.  If it parses the NFO and determines that the language is unacceptable, it could just log an error and delete the download.  Definitely something to think about.

I just found an issue- not so much a bug with queue checking.
When I have files downloading, adding new files takes quite a while because my entire connection is already maxed. Sab always takes AGGESSS to fetch the details of a new file from newzbin. Sometimes only when post processing for the previous file has started, it is able to fetch the next ep from newzbin properly.

So.. This poses an issue with the queue checking
I just woke up to 6 files from a series I already have queued. It didn't recognise it as on disk, I suppose because I have 2 watched directories, and shamefully this series is in both.

Hmm, its likely because you have the same series in two watched directories.  Did you check to see if duplicate episodes were under the same watched directory?

I'm planning on adding the ability to have a series spread out across several watched directories in the very near future.  It should be trivial to enhance MR to accomplish this and it will make life easier for everyone.

Kierse

[qrb123]

What do you have as your RSS feeds?

I was just trying to start out simple with this one:

# tvnzb.com RSS feeds go here
[[ tvnzb ]]

url = http://www.tvnzb.com/tvnzb_new.rss

Thanks

Same issue I had setting this up

What you need to do is the following

# tvnzb.com RSS feeds go here
[[ tvnzb ]]
[[[ Whatever you want to name this feed ]]]
url = http://www.tvnzb.com/tvnzb_new.rss


IE: Under the [[ tvnzb ]] and before the URL, you need to have [[[ Whatever you want ]]]

[qrb123]

If this is something people are really interested in, I could definitely look into it further though.

Since it was me to ask the question, I will be the one to kill it.  I no longer need this,  your previous explanation was enough for me to figure out I needed to use newzbin searches to make rss feeds that only included the languages, as well as other attributes I prefer.  Once I did this, things got great.  I have some shows I want coming in HD, others that I don't care about as much coming in SD to conserve disk space.  All shows coming in my preferred language.  

There is absolutely no need to spend a single second on this in my opinion.  

While it only took me a few hours to understand how this software works, and now I can add a show in about 2 minutes. I think your best  focus as to development time, is working on what you already are working on - a Web GUI to make this simple for anyone...  Everyone needs to be running this, and making it simple to use will ensure they do.

The core product at this point is absolutely amazing in my opinion.  Over the last few days I have tried to beat the ever living shit out of it, believe me I tried.  I am likely going to receive a warning from my ISP as in the last few days I have more than quadrupled my total allowed bandwidth for the whole month, just playing with this thing. I was downloading things I did not even want, just to delete them, just to test it out and it has yet to fail.  It keeps on trucking no matter what.  

I have it running now as a cron job every 10 minutes, and I am blown away by the fact that if a show airs at 10pm, it's on usenet and on my setup at home no later than 12pm.  This kicks the piss out of paying for cable and tivo!!!!  (Of course I am only downloading freely available shows from NASA and or PBS)

This kicks ass, and more importantly - YOU KICK ASS for making this, and sharing with the world.  

I firmly believe that this technology you have created once it's fully mature, should be incorporated with, and ship standard with sabnzbd.  It's just way too good of a feature to be left out on it's own, only to be discovered by those who sign up to this forum.  It's your baby, and not sure how you would feel about that, but I for one would love to see this one sucked up and part of SABNZBD as a standard install.    

Just thinking out loud here - but if it were part of sab - think of the possibilities - a simple search on newzbin, and then the firefox sab plugin (once updated) would present another choice other than it's SAB icon - something like "Subscribe to show" pops up a screen asking what seasons you want or other filters -- and the rest happens automagicaly....  

[rollingeyeball]

IE: Under the [[ tvnzb ]] and before the URL, you need to have [[[ Whatever you want ]]]

Without spaces though, I think. Use underscores to be sure

Kierse, I'd be interested in trying out the experimental/early GUI whenever you're ready to release a working version
You should post screenshots of it too. Teaser pics are always fun [/quote]

Hmm, its likely because you have the same series in two watched directories.  Did you check to see if duplicate episodes were under the same watched directory?
I'm planning on adding the ability to have a series spread out across several watched directories in the very near future.  It should be trivial to enhance MR to accomplish this and it will make life easier for everyone.

The same series _is_ in two directories, but no dupe episodes, no

...adding the ability...

That sounds GREAT!

This kicks ass, and more importantly - YOU KICK ASS for making this, and sharing with the world.  

This. I have a big ol' mancrush on you for being so awesome I think.  Is that weird?

I firmly believe that this technology you have created once it's fully mature, should be incorporated with, and ship standard with sabnzbd.  It's just way too good of a feature to be left out on it's own, only to be discovered by those who sign up to this forum.  It's your baby, and not sure how you would feel about that, but I for one would love to see this one sucked up and part of SABNZBD as a standard install.    

Just thinking out loud here - but if it were part of sab - think of the possibilities - a simple search on newzbin, and then the firefox sab plugin (once updated) would present another choice other than it's SAB icon - something like "Subscribe to show" pops up a screen asking what seasons you want or other filters -- and the rest happens automagicaly....  

I agree with this too. Media Rover is by far the best app/system for automagically getting TV shows.
There have been many other apps (and still are) that have the same idea, but MR just .. wins.
It'd be awesome if at some point in the future MR was somehow integrated with SAB. Two great apps merged would dominate the world..

Also, out of curiosity- how much use do you get out of MR personally Kierse?

[yeahbut]

Thanks guys, that fixed it...

[qrb123]

Thanks guys, that fixed it...

Glad you are up and going!!!

[qrb123]

IE: Under the [[ tvnzb ]] and before the URL, you need to have [[[ Whatever you want ]]]

Without spaces though, I think. Use underscores to be sure

I just checked my.conf file, all my entries except one have spaces and they work

[rollingeyeball]

That's good to know qrb. Thanks

[kierse]

I am likely going to receive a warning from my ISP as in the last few days I have more than quadrupled my total allowed bandwidth for the whole month, just playing with this thing. I was downloading things I did not even want, just to delete them, just to test it out and it has yet to fail.  It keeps on trucking no matter what. 

Awesome!  Glad to hear that MR is working well for you!

...Of course I am only downloading freely available shows from NASA and or PBS...

Wow!  You like NASA and PBS shows too?!  I thought I was the only one...

I firmly believe that this technology you have created once it's fully mature, should be incorporated with, and ship standard with sabnzbd.  It's just way too good of a feature to be left out on it's own, only to be discovered by those who sign up to this forum.  It's your baby, and not sure how you would feel about that, but I for one would love to see this one sucked up and part of SABNZBD as a standard install.   

I agree with this too. Media Rover is by far the best app/system for automagically getting TV shows.
There have been many other apps (and still are) that have the same idea, but MR just .. wins.
It'd be awesome if at some point in the future MR was somehow integrated with SAB. Two great apps merged would dominate the world..

Interesting idea guys, I've never considered the possibility of joining forces with SAB.  I am definitely interested in forming a closer relationship with the SAB development team though.

I think your best  focus as to development time, is working on what you already are working on - a Web GUI to make this simple for anyone...

Kierse, I'd be interested in trying out the experimental/early GUI whenever you're ready to release a working version
You should post screenshots of it too. Teaser pics are always fun

Alrighty, I think its time for a GUI update!

As of last night, I have a fully (well 99%) functional web based UI.  It allows a user to configure all aspects of Media Rover through their friendly neighbourhood web browser.  A few details:

- built using Cherrypy, the same web framework/server that SABnzbd uses.  I'm hopeful this will mean no additional software will need to be installed to use the UI.  More on this later
- it has a skinnable interface.  This means that someone who actually cares about UI design can build their own look and feel.

When picking technology for the UI, I choose to use the Cherrypy web framework/server and the Cheetah template engine because they were what SAB used.  More importantly, for Windows and Mac users, these libraries were bundled with the SABnzbd application.  I had hoped to make use of the existing libraries and allow users to run the UI without needing to install any additional software.  Unfortunately, I didn't think to actually verify that this was doable before starting development.  Thus far I've been having difficulties making use of these external libraries.  If worse comes to worse, users will need to install these two products in order to run the UI.  Not a big deal but not what I had hoped for either.

Anyway, I will release what UI code I have written thus far.  It should work out of the box for Linux users but will require some additional work by Windows and Mac users.  I'll try and get that code pushed to the github servers sometime tonight or tomorrow morning.  Shortly after I release the code, I will start posting instructions on getting it up and running.

Kierse

[kierse]

Also, out of curiosity- how much use do you get out of MR personally Kierse?

Believe it or not, I wasn't actually watching all that much tv before I started work on MR.  Now that its working fairly well, I find that I am downloading and watching a lot more tv than I used to.  Its so damn easy now to get a new show that I seem to be doing it more and more.  Plus, now that my wife has started using it for a large portion of the tv she watches, we're depending on it more and more.  If I'm not careful, I like qrb123, might draw the attention of my ISP for bandwidth usage 

Kierse

[rollingeyeball]

Alrighty, I think its time for a GUI update!

As of last night, I have a fully (well 99%) functional web based UI.  It allows a user to configure all aspects of Media Rover through their friendly neighbourhood web browser.  A few details:

- built using Cherrypy, the same web framework/server that SABnzbd uses.  I'm hopeful this will mean no additional software will need to be installed to use the UI.  More on this later
- it has a skinnable interface.  This means that someone who actually cares about UI design can build their own look and feel.

When picking technology for the UI, I choose to use the Cherrypy web framework/server and the Cheetah template engine because they were what SAB used.  More importantly, for Windows and Mac users, these libraries were bundled with the SABnzbd application.  I had hoped to make use of the existing libraries and allow users to run the UI without needing to install any additional software.  Unfortunately, I didn't think to actually verify that this was doable before starting development.  Thus far I've been having difficulties making use of these external libraries.  If worse comes to worse, users will need to install these two products in order to run the UI.  Not a big deal but not what I had hoped for either.

Skinnable sounds good

Umm, regarding installing/making use of libraries, how does SAB use them? When you install sab, does it automatically install the required libraries too? If it's integrated or silent, no users will care.
Installing manually, or requiring a seperate downloador whatever may be troublesome for some I suppose, so i see your hesitation is going that route.

I'm sure you'll figure it all out, good luck

I'll go check github in a minute

Believe it or not, I wasn't actually watching all that much tv before I started work on MR.

Haha, that's very believable! So media Rover has officially inspire you to download. That's an impressive statement

[rollingeyeball]

I see github updates !

[kierse]

As some of you may have noticed, I finally pushed the UI code to the github servers last night.  Before I cause a stampede there are a few caveats that should be mentioned:

1. As I've previously mentioned, it is very basic and no where near done.  So if you manage to get it running, please don't expect much at this point
2. As mentioned here (http://forums.sabnzbd.org/http://forums ... 908#p17908), I've run into problems getting the new UI to run on Windows and Mac OSX.  I've made some recent progress and I'm hopeful I will have a workable solution very soon (more on this below).  Note: this problem should not affect those running Linux.
3. There is currently no easy way to configure the web server without modifying code.  The default port that Cherrypy (the web server) listens for requests is 8080, unfortunately this is the same port that SABnzbd runs on.  If you try and run the new UI on the same machine that SAB is running it won't be able to start.

Umm, regarding installing/making use of libraries, how does SAB use them? When you install sab, does it automatically install the required libraries too? If it's integrated or silent, no users will care.
Installing manually, or requiring a seperate downloador whatever may be troublesome for some I suppose, so i see your hesitation is going that route.

SABnzbd is bundled (for Windows and Mac OSX) with all the third party requirements that it needs to run (this includes Cherrypy and Cheetah which are required for the new UI).  As I mentioned before, my intention was to try and make use of these bundled libraries so that the user wouldn't a) have to install any additional software, and b) install something that was already on their computer.

The good news is that I have been able to get the UI working on both Windows and OSX (using the bundled libraries) with a little work.  Once I determined what the problem was, it was fairly trivial to get it up and running.  My next step will be to get it running using independent copies of Cherrypy and Cheetah.  I will be posting instructions detailing both methods.

Here's the plan going forward:

1. move the web server configuration to a file on disk
2. publish steps necessary to get UI up and running using both methods discussed above
3. continue with UI development

I also might spend some time looking into a bundled/binary solution similar to what SAB does on Windows and OSX although at this point it will likely be low priority.

Kierse