MovieGrabber - Completely Automated Movie Downloader

[taoman]

hi taoman, your in luck, i too am running an openelec system (zotac id41 to be exact) so i can def answer your question :-)

Im running Openelec and im confused where exactly I should download and run this program from. Would I drop it into the 'addons' folder?

im going to assume you have a windows box as well as your openelec device.

ok you can basically run moviegrabber from any folder in "/storage" by default openelec creates a load of samba shares which can be accessed from \\<openelecipaddress> from windows explorer (put in the address bar), you should then see a load of shares, such as ConfigFiles, Downloads, Emulators etc, you can then unzip moviegrabber to any of these shares, i personally use "Downloads" as its not generally used by xbmc/openelec.

once you've unzipped moviegrabber you then need to enable ssh (if not already done), this can be done by creating an empty file named "ssh_enable" and placing this file in the "ConfigFiles" share, then reboot openelec.

once rebooted grab yourself a copy of putty (http://www.chiark.greenend.org.uk/~sgta ... nload.html) this requires no install, just double click the exe, then enter in the ip address of your openelec device in the host name and select "ssh" and click on "open" then login with username root password openelec.

once logged in type "cd downloads" (case sensitive) and then type "ls -al" to see a directory listing, you should see the unzipped moviegrabber install, so again cd to the folder e.g. "cd MovieGrabber" then simply type "python ./MovieGrabber.py -d" this will then start moviegrabber and you should then be able to access it from any external machine by going to http://<openelecipaddress>:9191 e.g. "http://192.168.1.2:9191"

if you want to make moviegrabber start automatically on boot then copy the command "python /storage/downloads/<unzippedfoldername>/MovieGrabber.py -d" in the file at \\<openelecipaddress>\ConfigFiles\autostart.sh you can do this using notepad on your windows box, or use nano via ssh.

i hope this helps, there is one issue with this and thats that PIL doesnt work correctly, this is due to openelec being a stripped down os and thus is missing some libraries required by PIL, so you wont see posters in history/queue, but apart from that it works just fine :-).

bit of a long post but its essentially dead easy, should have it running within 5 mins, let me know how you get on.

binhex.

Wow awesome reply binhex, much appreciate your time! Got it up and running in 10 minutes. Loving it. Thanks you and have an awesome day!

[binhex]

no probs taoman, glad it worked, hope you enjoy moviegrabber :-)

[c0ld]

Seems to me as if the 'Good definitions' list is completely redundant. It just needs a list of preferred genres and bad genres, and everything else should automatically be treated as acceptable. Also, it would be a lot more user friendly, imo, if it skipped the 'intro' pages that contain a single line of text and just went straight to the queue and history list directly from the main menu. The intro text could be included at the top of the list if needed.

[redcell]

the nzbs.org site has changed, so in order for moviegrabber to work with nzbs.org it needs some code changes

[binhex]

the nzbs.org site has changed, so in order for moviegrabber to work with nzbs.org it needs some code changes

hi redcell, just done a quick check and moviegrabber still works fine with the new newznab based nzbs.org website, i can view posts in history and queue and can release queued items to sabnzbd+ with no error, what makes you think its not working?.

i have actually coded and tested moviegrabber against the beta.nzbs.org website which im assuming is now the live website, this is basically a newznab website, so just choose newznab from the configuration/website and then fill in the details and it will work.

just to conclude, either configure for nzbs or configure for newznab, im assuming at some point the old rss feeds will be switched off so you wont be able to use index site "nzbs" from that point onwards.

binhex.

[redcell]

before today I was running your previous script: auto movie downloader under linux as a cronjob, but that stopped working, also when changing the config for the new nzbs.org wich is a newznab site now to newznab instead of nzbs, it gave errors: Newznab Site Down or Nzb's Site Down.

So I gave MovieGrabber a try but it basicly has the same errors: from the logfile: /opt/moviegrabber/moviegrabber.log:

2012-05-10 12:38:49,207 WARNING NZB's HTTP error, response - 503
2012-05-10 12:39:27,656 WARNING NZB's HTTP error, response - 403
2012-05-10 12:44:05,187 WARNING NZB's HTTP error, response - 403
2012-05-10 12:59:39,098 WARNING NZB's HTTP error, response - 403
2012-05-10 13:21:25,987 WARNING NZB's HTTP error, response - 403
2012-05-10 13:58:06,715 WARNING NZB's HTTP error, response - 403
2012-05-10 14:04:48,527 WARNING NZB's HTTP error, response - 403
2012-05-10 14:34:08,335 WARNING NZB's HTTP error, response - 403
2012-05-10 14:36:08,147 WARNING NZB's HTTP error, response - 403
2012-05-10 14:36:16,900 WARNING NZB's HTTP error, response - 403
2012-05-10 15:17:01,173 WARNING NZB's HTTP error, response - 403
2012-05-10 15:19:29,535 WARNING NZB's HTTP error, response - 403
2012-05-10 16:16:56,003 WARNING NZB's HTTP error, response - 403
2012-05-10 17:16:50,844 WARNING NZB's HTTP error, response - 403
2012-05-10 17:50:26,634 WARNING NZB's URL error, response - timed out
2012-05-10 17:54:15,513 WARNING Newznab URL error, response - timed out
2012-05-10 18:02:45,224 WARNING Newznab URL error, response - timed out

It somehow can't connect to the nzbs.org site altough the site is up and running because i can open it with my browser.

I remember like more then one year ago In order for the auto movie downloader script to run under linux I had to make some code changes myself for it to run.

could it be that MovieGrabber also needs some changes to properly run under linux?

[binhex]

So I gave MovieGrabber a try but it basicly has the same errors: from the logfile: /opt/moviegrabber/moviegrabber.log:

2012-05-10 12:38:49,207 WARNING NZB's HTTP error, response - 503
2012-05-10 18:02:45,224 WARNING Newznab URL error, response - timed out

could it be that MovieGrabber also needs some changes to properly run under linux?

hi redcell, ok i see you tried both nzbs and newznab as your index site.

firstly the 403 error means forbidden, my guess is that either the nzbs.org site was not correctly running at that time or that you have your credentials wrong, keep in mind that moviegrabber has the nzbs id and hash key in seperate fields, so for instance if your nzbs key looked like this:-

&i=123456&h=3234hjnhk2323423hjkh3k23 then you would fill in your "id" as 123456 and "hash key" as 3234hjnhk2323423hjkh3k23 in moviegrabber.

ok onto newznab, this looks like an incorrectly defined host, make sure you set the "hostname" as https://www.nzbs.org/ and set the "port" to 443 you would then get your "api/rss key" from your profile on the site (link is top right).

ive tested both the new nzbs newznab based website and using the older site credentials, which for the time being still work also, so im confident its either a credentials and/or misconfigured host thats causing the issue. if youve done the above and your still getting issues then pm me your config.ini and i will take a look.

edit - sorry forgot to reply to your question, nope there are no edits of the source code required to get moviegrabber to work on windows, linux or osx :-)

binhex.

[redcell]

thanx for all your help btw.

since you mentioned pm-ing you the config file

I studied en made some changes to the config file, and now everything works lol

apparently the separator symbol I used was causing the problem in the config file lol

what is the correct separator symbol?

for example:

movies_downloaded_dir =

I used "," to separate the different folders

what is the correct seperator used for:

fav_actor =
fav_dir =

in your previous script auto movie downloader it was the "|" symbol

I kept it empty so it wouldn't cause any errors.

[binhex]

hi redcell, the separator for actors and directors is the same as for the folders, i.e. ","

quick hint, you can do mouse hover over "(?)" in the configuration section to see tips :-)

[annaj]

I am also having an issue with nzbs.org; getting the HTTP 403 error.

This is the address from the log:
https://nzbs.org/rss.php?q=+1080p&catid ... =1&num=100

When I put that into my browser, it redirects me to:
https://nzbs.org/classic/rss.php?q=+108 ... =1&num=100
which give me a blank page.

I tried editing moviegrabber.py so that the address would match one that would work based on NZBs rss instructions & works when I use my browser.
I came up with:
http://nzbs.org/rss?t=2000&lang=EN&fmt= ... xx&r=xxxxx

this seems to work as the log shows that it finds the posts, but then I end up with:
2012-05-11 12:19:03,378 INFO Post release group AVG
2012-05-11 12:19:03,380 INFO Post download link xxxxx
2012-05-11 12:19:03,382 INFO Post size not found
2012-05-11 12:19:03,383 INFO Post date not found
2012-05-11 12:19:03,385 INFO Post id not found
2012-05-11 12:19:03,390 INFO Post nfo not found
2012-05-11 12:19:03,390 INFO Post details not found

it doesn't find any details and so doesn't process it; they don't even end up in my history as skipped.
I'm running OSX lion, and am using moviegrabber 2.1.9

[binhex]

hi annaj, ive tested this again and see no issues, i have tested the url you posted below inputting my id and hash key and it returns the normal rss feed, are you sure you have the correct id and hash key for your account? keep in mind you need the id and hash from the OLD nzbs website NOT the new newznab based nzbs.org website (see further below for details).

This is the address from the log:
https://nzbs.org/rss.php?q=+1080p&catid ... =1&num=100

you can still access the old style nzbs.org site (now called classic) by going to the following url:-

https://nzbs.org/classic/user.php?action=profile

this will show your current profile (once logged in of course) including the all important ID and Hash values.

[hotmetal]

i will be looking at post processing in 2.2.0, any requests for post processing please let me know, my current list of ideas are as follows:-

- rename movie files
- move folder to movie collection (or based on genre to particular folder)
- delete small files based on extension and/or file size
- move metadata (if enabled) into folder
- send xbmc notification message for movie (cannot be done until frodo)
- run xbmc library update
- download imdb poster, rename, resize, and move to movie folder

Pondering about post processing, I was wondering if it would be possible to leave the original directory names intact so that when items are downloaded, it still includes the group that released it, eg:

The.Change-Up.UNRATED.1080p.BluRay.x264-BLOW
The.Double.x264.1080p.SimplyReleases-Toppers
The.Entitled.2011.x264.1080p.(DD5.1).NL.Subs.DMT
The.Girl.With.The.Dragon.Tattoo.2011.1080p.BluRay.x264-SPARKS
The.Hangover.Part.II.2011.BluRay.1080p.DTS.X264

It makes life easier when downloading a copy from a group that is out of sync (or has hardcoded subtitles etc). Now that i think about it, It might not have to be done in post processing but before it gets sent to sabnzbd?

Regards,
Hot

[neo_x]

hi binhex


Please note we are all waiting anxiously for the only feature still needed


DONATIONS!!!


(even if its anonymous beer or milk - )


feedback : - working very well on my collection - couldn't ask for something better

neo_x

PS

one feature request :

lets say i have Couchpotato (CP) and movie grabber running (yes i know -need to choose my side )
i recently went crazy and went through the whole trakt.tv website, generating a list of ~400 movies i wanted. thus CP downloaded all the
NZB's it could find. ( keeping in mind that CP doesnt process the NZB name - ie it stays for example "Lords of Dogtown 2005 UNRATED DVDRip XviD DiAMOND"
Now i sit with a HUGE que of downloads, that will take more than a month or two to finish.

Can you adjust movie grabber so that it parses the files in the NZB downloaded/backup folder into usable names before comparing them to the RSS feed? ( if it's already doing that - awesome )


thank you

[pilGrim]

Hi Binhex,

Quick note on my earlier suggestion that trailer support was of more interest than moving files to appropriate folder, I did not realize xbmc has much better support for streaming trailers now, so no need for me to download them after each download. so I do agree that moving files would be great to make it just about 100% hands off, especially now that I don't have to get trailers manually. :-)

that all said, is anyone having issues with NZBMatrix or NZB.su? I can't get either one to update properly. I use NZBs.org, which works great, but as they do not accept new members, I have set friends up with NZBMatrix and history view is not updating. Also same with NZB.su.

Maybe I am missing something in the setup?

TIA

[binhex]

hi neo_x, thanks for your kind words, glad mg is working well, and yes i will have to get onto donations at some point :-).

onto your request/question - im afraid mpoviegrabber doesn't do this right now, it would be fairly tricky to extract the exact movie title from the original post name. i think a better approach would be to rename your folders and/or files to the correct imdb title names, i could look into creating a separate script to do this but it wouldn't be for some time.