nzbmatrix.com/nzbs.org/newznab automated movie downloader

[my4pm]

it shouldnt be a massive problem to code this, what i would prefer to do is just do a regex to cover for various seperators, namely spaces, underscores, and periods, i could also allow any text prefixing or appending to the title, so for example this would match the movie inception:-

a.load.of.crap.at.the.front.of.the.movie.title.inception.dvdrip.xvid.good1

please note this would still only be against the foldername NOT the filename at this point, i will have a go at coding it up today.

folder name is what I'm looking for. I actually prefer to keep the filename original (as created by the poster), it makes it easier to find a subtitle that matches since the people who make those, give it the same name as the movie filename.

So what you are suggesting would actually be perfect.

[binhex]

Haha, it's nice talking directly to devs....they added a way to subtract terms from your search, they said it will be using '--' for the subtraction.

I'm gonna get the new version via SVN shortly, so you should be able to test it out sometime this afternoon if you are so inclined

agentgreen - sounds good let me know once you got it up and running, it should be easy to test.

I'm SVN'd up and I tested a search on my site using -- and it definitely didn't return those results, so it should be good to go.

yep works fine :-), if you can try nudging the developers into doing the following as well 

language filter - either scraping for the language on the imdb website or looking for it in the post name and allowing the user to specify in their profile or via the api which language they wish to accept

multi match on post title - for example you may want to download both 720p and 1080p movies, so having the ability to say match on 720p OR 1080p in the post title would be great, perhaps a search term of "+-" as a suggestion, i dunno just an idea.

[agentgreen]

Both are good options to add, I ping them and see what they say.

Can I modify my config to include the new -- search filter or is a coding change necessary?

[splnut]

Doesnt seem like this is downloading all the movies that fit the imdb criteria. Can someone look at this for me? Also can someone explain the cache log? There are quite a bit of movies listed in that log that were never downloaded. It has only sent 3 .nzbs to the watch folder.

Code: Select all

#-----------------------------------------------------------------
#---------- PLEASE EDIT Definitions BELOW BEFORE RUNNING----------
#-----------------------------------------------------------------

#----------------- Sabnzbd Folder Definitions ------------

#put your own folder names below as specified in sabnzbd+ (windows users - use \\ to seperate folders in path)
watch_dir="/mnt/disk1/downloads/watch/Movies/"
nzb_dir="/mnt/disk1/.custom/sabnzbd/sabnzbd"
completed_dir="/mnt/disk1/downloads/complete/"

#----------------- Movies Already Downloaded -------------

#define whether checking of downloaded movies is enabled or not
#valid values:- yes, no
enable_downloaded="yes"

#put your own root folder(s) below to specify the location of movies you have already downloaded (can span multiple drives) (windows users - use \\ to seperate folders in path)
movies_downloaded_dir1="/mnt/user/Movies/"


#----------------- Movies To Replace --------------------

#define whether checking of movies to replace is enabled or not
#valid values:- yes, no
enable_replace="no"

#put your own root folder(s) below to specify the location of movies you want to replace (can span multiple drives) (windows users - use \\ to seperate folders in path)
movies_to_replace_dir1="C:\\Example\\Folder3\\"
movies_to_replace_dir2="C:\\Example\\Folder4\\"

#----------------- IMDB Good Definitions -----------------

#define the accepted genres (use | to seperate items)
#valid values:- Action, Adventure, Animation, Biography, Comedy, Crime, Documentary, Drama, Family, Fantasy, Film-Noir, Game-Show, History, Horror, Music, Musical, Mystery, News, Reality-TV, Romance, Sci-Fi, Short, Sport, Talk-Show, Thriller, War, Western
good_genre="Action|Adventure|Animation|Biography|Comedy|Crime|Documentary|Drama|Family|Fantasy|History|Horror|Mystery|Romance|Sci-Fi|Sport|Thriller|War|Western"

#define the minimum rating for accepted genres (must be greater than good_preferred_ratings)
#valid values:- 0.1 to 9.9
good_general_ratings=6.8

#define the minimum number of votes to download
#valid values:- 1000 to 99999
good_votes=4000

#define the minimum year to download (must be less than queue_date)
#valid values:- 1900 to 2999
good_date=2009

#----------------- IMDB Favorite Definitions --------------

#define whether Favorite Director/Actor/Title is enabled or not
#valid values:- yes, no
enable_favorites="no"

#define the favorite Director List (use | to seperate items)
fav_dir="Directors Name"

#define the favorite actor list (use | to seperate items)
fav_actor="Will Smith|Emma Stone|Jennifer Anniston|Katherine Heigl"

#define the favorite character list (use | to seperate items)
fav_char="Characters Name"

#define the favorite title list (use | to seperate items)
fav_title="Movie Title"

#----------------- IMDB Preferred Definitions -------------

#define whether preferred genres/ratings is enabled or not
#valid values:- yes, no
enable_preferred="no"

#define the preferred genres (use | to seperate items) - will download movie if good_preferred_genre AND good_preferred_ratings match
#valid values:- Action, Adventure, Animation, Biography, Comedy, Crime, Documentary, Drama, Family, Fantasy, Film-Noir, Game-Show, History, Horror, Music, Musical, Mystery, News, Reality-TV, Romance, Sci-Fi, Short, Sport, Talk-Show, Thriller, War, Western
good_preferred_genre="Comedy"

#define the minimum rating for preferred genres (must be less than good_general_ratings) - will download movie if good_preferred_genre AND good_preferred_ratings match
#valid values:- 0.1 to 9.9
good_preferred_ratings=6.5

#----------------- IMDB Queue Definitions -----------------

#define whether queuing is enabled or not
#valid values:- yes, no
enable_queuing="no"

#define the queue folder to store downloaded nzb files (windows users - use \\ to seperate folders in path)
queue_dir="/mnt/disk1/downloads/watch/"

#define the queued genres (use | to seperate items) - will queue movie if either queue_genre OR queue_date match
#valid values:- Action, Adventure, Animation, Biography, Comedy, Crime, Documentary, Drama, Family, Fantasy, Film-Noir, Game-Show, History, Horror, Music, Musical, Mystery, News, Reality-TV, Romance, Sci-Fi, Short, Sport, Talk-Show, Thriller, War, Western
queue_genre="Queue Genre"

#define the maximum year to queue (must be greater than good_date) - will queue movie if queue_genre OR queue_date match
#valid values:- 1900 to 2999
queue_date=2050

#----------------- IMDB Bad Definitions -------------------

#define the rejected genres (use | to seperate items) - will reject movie if either bad_genre OR bad_title match
#valid values:- Action, Adventure, Animation, Biography, Comedy, Crime, Documentary, Drama, Family, Fantasy, Film-Noir, Game-Show, History, Horror, Music, Musical, Mystery, News, Reality-TV, Romance, Sci-Fi, Short, Sport, Talk-Show, Thriller, War, Western
bad_genre="Musical"

#define the rejected titles (use | to seperate items) - will reject movie if either bad_genre OR bad_title match
bad_title="Bad Title"

#-------------- Freecovers Coverart Definitions -----------

#define downloading of coverart (for use with media browser)
#valid values:- yes, no
enable_coverart="no"

#define whehter you are a freecovers gold member or not (requires payment)
#valid values:- yes, no
freecovers_goldmember="no"

#define the metadata folder to store mymovies.xml files (windows users - use \\ to seperate folders in path)
coverart_dir="C:\\Sabnzbd\\Coverart\\"

#define the search category for freecovers
#valid values:- 1=dvd covers, 20=blurary covers, 21=hddvd covers
freecovers_search_category="1"

#define freecovers login credentials (requires registration)
freecovers_loginname="Login"
freecovers_password="Password"

#------------------ Metadata Definitions -------------------

#define writing of metadata (for use with media browser)
#valid values:- yes, no
enable_metadata="no"

#define the metadata folder to store mymovies.xml files (windows users - use \\ to seperate folders in path)
metadata_dir="C:\\Sabnzbd\\Metadata\\"

#----------------- Trailer Download Definitions ------------

#define downloading of trailers
#valid values:- yes, no
enable_trailer_downloads="yes"

#define the folder to store trailer downloads (windows users - use \\ to seperate folders in path)
trailer_dir="/mnt/disk1/downloads/complete/Trailer/"

#define the preferred trailer size to download
#valid values:- high, med, low
preferred_trailer_size="high"

#define the alternative trailer size to download (used if preferred_trailer_size is not available)
#valid values:- high, med, low
alternative_trailer_size="med"

#------------------ E-mail Definitions ---------------------

#define sending email notification of jobs queued/downloading
#valid values:- yes, no
enable_email_notify="no"

#define smtp mail server hostname
email_server=""

#define smtp mail server port number
email_server_port=465

#define whether smtp mail server requires TLS (SSL)
#valid values:- yes, no
email_server_ssl="yes"

#define your username
email_username=""

#define your password
email_password=""

#define your from email address
email_from=""

#define your to email address
email_to=""

#------------------ Output Definitions ----------------------

#define whether completed movie output folder will have "(year)" appended
#valid values:- yes, no
append_year_to_title="no"

#------------------ Index Site Definitions ------------------

#define the indexing site used to download nzb's
#valid values:- nzbs, nzbmatrix, nzbsu
index_site="nzbmatrix"

#------------------ NZBMatrix Index Definitions -------------

#nzbmatrix account details
#specify account username and password
nzbmatrix_username=""
nzbmatrix_password=""

#nzbmatrix filter category
#valid values:- 54 = brrips, 42 = hd/x264, 2 = divx/xvid, 1 = dvd, movies-all = all formats
nzbmatrix_cat="movies-all"

#nzbmatrix filter language
#valid values:- 0 = any language, 1 = english or unknown only
nzbmatrix_lang="1"

#nzbmatrix filter search terms
#valid values:- "+" = term MUST exist in title, "+-" = term MAY exist in title, "-" = term must NOT exist in title
#example:- This will match bluray movies in 720p or 1080p format and ignore any hdtv, telecine, telesync encoded #movies "+bluray +-720p +-1080P -hdtv -tc -ts"
nzbmatrix_search="+720p -hdtv -tc -ts"

#nzbmatrix filter min size in MB
#valid values:- must be less than nzbmatrix_maxsize
nzbmatrix_minsize="3500"

#nzbmatrix filter max size in MB
#valid values:- must be greater than nzbmatrix_minsize, or "0" to ignore
nzbmatrix_maxsize="0"

#nzbmatrix maximum nzb's downloaded in 24 hours
#valid values:- 1 to 50
nzbmatrix_maxnzbs_downloaded=50

#define the rejected nzbmatrix report numbers, useful for incorrect/bad encodes (use | to seperate items)
#valid values:- numeric post id e.g. "1234567"
nzbmatrix_badreport="1234567"

#------------------ NZBs Index Definitions -----------------

#nzbs account details
#specify account direct download key (can be found here http://www.nzbs.org/index.php?action=rss)
nzbs_key="&i=12345&h=123456789"

#nzbs filter category
#valid values:- 4 = hd/x264, 2 = divx/xvid, 9 = dvd, movies-all = all formats
nzbs_cat="movies-all"

#nzbs filter search terms
#valid values:- "+" = term MUST exist in title, "-" = term must NOT exist in title
#example:- This will match bluray movies in 720p format and ignore any hdtv, telecine, telesync encoded movies "+bluray +720p -hdtv -telecine -telesynC"
nzbs_search="+dvdrip +xvid"

#nzbs filter min size in MB
#valid values:- must be less than nzbs_maxsize
nzbs_minsize=700

#nzbs filter max size in MB
#valid values:- must be greater than nzbs_minsize, or "0" to ignore
nzbs_maxsize=0

#define the rejected nzbs report numbers, useful for incorrect/bad encodes (use | to seperate items)
#valid values:- numeric post id shown in rss feed e.g. "1234567"
nzbs_badreport="1234567"

#------------------ NZB.SU Index Definitions -----------------

#nzbsu account details
#specify account direct download key (can be found here http://nzb.su/profile)
nzbsu_key="abc123456789"

#nzbsu filter category
#valid values:- 2040 = hd/x264, 2030 = divx/xvid, 2020 = other, 2010 = foreign, movies-all = all formats
nzbsu_cat="movies-all"

#nzbsu filter search terms
#valid values:- "+" = term MUST exist in title
#example:- This will match bluray movies in 720p format "+bluray +720p"
nzbsu_search="+dvdrip +xvid"

#nzbsu filter min size in MB
#valid values:- must be less than nzbs_maxsize
nzbsu_minsize=700

#nzbsu filter max size in MB
#valid values:- must be greater than nzbs_minsize, or "0" to ignore
nzbsu_maxsize=0

#define the rejected nzbs report numbers, useful for incorrect/bad encodes (use | to seperate items)
#valid values:- numeric post id shown in rss feed e.g. "1234567"
nzbsu_badreport="1234567"

#------------------- Logging Definitions --------------------

#define logging to console or file (if no then logs to console)
#valid values:- yes, no
console_log_to_file="yes"

#put your own foldernames below to specify location of log files (windows users - use \\ to seperate folders in path)
errorlog_dir="/mnt/disk1/.custom/Downloader/errors/"
warninglog_dir="/mnt/disk1/.custom/Downloader/errors/"
cachelog_dir="/mnt/disk1/.custom/Downloader/errors/"
consolelog_dir="/mnt/disk1/.custom/Downloader/errors/"

#put your own commandline exectuable below for notification of errors (default uses "msg")
error_alert=""

[J03 8LACK]

Doesn't seem like this is downloading all the movies that fit the IMDB criteria. Can someone look at this for me? Also can someone explain the cache log? There are quite a bit of movies listed in that log that were never downloaded. It has only sent 3 .nzbs to the watch folder.

Hi splnut,
Here is a break down of the errors you will see in the console.log and how you would correct them. The cache is just a list of nzb's that are from the RSS feed search you created by setting up the #------------------ NZBMatrix Index Definitions --------------- or whatever site you are using.

Debug: File System Check Movie Exists In HD Downloaded Folder  --- movie already has been downloaded
Debug: Exception Movie Exists In SD Downloaded Folder --- movie already has been downloaded
Debug: File System Check Movie Exists In Completed Folder --- movie already has been downloaded
Debug: File System Check NZB Exists In NZB Folder --- Movie’s NZB file has already been downloaded
Debug: File System Check NZB Exists In Watch Folder --- Movie’s NZB file is already in the watch folder
Debug: File System Check NZB Exists In Queue Folder --- Movie’s NZB file is already in the Queue Folder

Debug: Exception Movie Title Is In Bad List
Movie Title is an unwanted movie and is in the Bad list
#define the rejected titles (use | to separate items) - will reject movie if either bad_genre OR bad_title match
bad_title="Bad Title"

Debug: Exception Movie Includes Favorite Director
Doesn’t meet all IMDB Good Definitions but is a favorite Director so it downloaded it

Debug: Exception Movie Includes Favorite Actor
Doesn’t meet all IMDB Good Definitions but is a favorite Actor so it downloaded it

Debug: Exception Movie Includes Favorite Character
Doesn’t meet all IMDB Good Definitions but is a favorite Character so it downloaded it

Debug: Exception Movie Includes Favorite Title
Doesn’t meet all IMDB Good Definitions but is a favorite Title so it downloaded it

change the above Exceptions here in the config.ini
#----------------- IMDB Favorite Definitions --------------

#define whether Favorite Director/Actor/Title is enabled or not
#valid values:- yes, no
enable_favorites="no"

#define the favorite Director List (use | to separate items)
fav_dir="Directors Name"

#define the favorite actor list (use | to separate items)
fav_actor="Will Smith|Emma Stone|Jennifer Anniston|Katherine Heigl"

#define the favorite character list (use | to separate items)
fav_char="Characters Name"

#define the favorite title list (use | to separate items)
fav_title="Movie Title"




Debug: IMDB Website Check Rating Below Threshold
The movie is below the IMDB rating Threshold -- lower good_general_ratings
#define the minimum rating for accepted genres (must be greater than good_preferred_ratings)
#valid values:- 0.1 to 9.9
good_general_ratings=6.8

Debug: IMDB Website Check Votes Below Threshold
The movie is below the IMDB Votes Threshold -- lower good_votes
#define the minimum number of votes to download
#valid values:- 1000 to 99999
good_votes=4000

Debug: IMDB Website Check Genre Is Not In Good List
The movie is not in your accepted genres -- add another good_genre.
#define the accepted genres (use | to separate items)
#valid values:- Action, Adventure, Animation, Biography, Comedy, Crime, Documentary, Drama, Family, Fantasy, Film-Noir, Game-Show, History, Horror, Music, Musical, Mystery, News, Reality-TV, Romance, Sci-Fi, Short, Sport, Talk-Show, Thriller, War, Western
good_genre="Action|Adventure|Animation|Biography|Comedy|Crime|Documentary|Drama|Family|Fantasy|History|Horror|Mystery|Romance|Sci-Fi|Sport|Thriller|War|Western"

Debug: IMDB Website Check Genre Is In Bad List
The Movie is in the Bad Genre list --- remove the bad genre
#define the rejected genres (use | to separate items) - will reject movie if either bad_genre OR bad_title match
#valid values:- Action, Adventure, Animation, Biography, Comedy, Crime, Documentary, Drama, Family, Fantasy, Film-Noir, Game-Show, History, Horror, Music, Musical, Mystery, News, Reality-TV, Romance, Sci-Fi, Short, Sport, Talk-Show, Thriller, War, Western
bad_genre="Musical"


Debug: IMDB Website Check Release Date Below Threshold
The Movie is older the minimum year  --- lower good_date
#define the minimum year to download (must be less than queue_date)
#valid values:- 1900 to 2999
good_date=2009


Debug: System Duplicate/Existing Movie in Cache
The movie has already been cached if you have changed any of the settings above and you are checking if it is corrected you will need to delete the cache or open the cache log and delete the movie name you are testing and save.


So Splnut  the movies are not downloading mostly because of these two errors
Debug: IMDB Website Check Rating Below Threshold
Debug: IMDB Website Check Votes Below Threshold

so change some settings and clear/delete your auto_movie_downloader_cache_nzbmatrix.log

[binhex]

nice post J03!  , splnut if you still think its not downloading when you think it should be then pm me an example movie title (dont post it on here its against forum rules), let me know either way if it was just a misconfigured config.ini or whether you believe it to be a bug.

[splnut]

That just cleared up everything for me. Thanks. Now that I understand what the cache file is, I have it taken care of. Thanks for everyone help.

[agentgreen]

hey binhex, long time no problems

hows the gui coming along? Need any testers?

[binhex]

hey binhex, long time no problems

hows the gui coming along? Need any testers?

hi agentgreen, im afraid progress is very slow right now as i have been suffering with illness  >:( but fear not i am getting back on the project and will try and make some headway into getting at least an alpha version coded, i may well take up your offer of doing some testing for me  ;D

just for some more info im basing the gui on sabnzbd+ classic theme keeping it clean and fast, using the same modules too - cheetah and cherrypy, figured i know the coders of sab def know what their doing so im just following their lead  :)

one other thing i need your help guys, if this gui really does see the light of day then i want to give it a name as it will of moved from a script to a webapp, we got sickbeard and couchpotato so need something catchy, only thing i have come up with so far is "marvin" as in the paranoid android :-)

[agentgreen]

hey binhex, long time no problems

hows the gui coming along? Need any testers?

hi agentgreen, im afraid progress is very slow right now as i have been suffering with illness  >:( but fear not i am getting back on the project and will try and make some headway into getting at least an alpha version coded, i may well take up your offer of doing some testing for me  ;D

just for some more info im basing the gui on sabnzbd+ classic theme keeping it clean and fast, using the same modules too - cheetah and cherrypy, figured i know the coders of sab def know what their doing so im just following their lead  :)

one other thing i need your help guys, if this gui really does see the light of day then i want to give it a name as it will of moved from a script to a webapp, we got sickbeard and couchpotato so need something catchy, only thing i have come up with so far is "marvin" as in the paranoid android :-)

Here are a couple I came up with:

SockMonkey
The Fetcher
Download-a-Saurus
Movie Match Maker
Raging Ape
Platypus

[binhex]

new version just uploaded, this is the last cli version, next version will have a web interface :-).

enjoy.

binhex.

[agentgreen]

new version just uploaded, this is the last cli version, next version will have a web interface :-).

enjoy.

binhex.

Thanks for the new release. Guess i need to update my newznab install

Can't wait for the web gui!

[indomiti]

Got it working on Linux, seems to be running fine! Thanks

[J03 8LACK]

Hey Binhex,

Seeing some errors not sure if its code or IMDB site

Error
30/04/2011 11:14:29 Warning IMDB JSON Down

Any ideas

J03

[binhex]

Hey Binhex,

Seeing some errors not sure if its code or IMDB site

Error
30/04/2011 11:14:29 Warning IMDB JSON Down

Any ideas

J03

Hi joe I've taken a look at this its due to imdb changing their json feed link.unfortunately it looks like they now implement a session  key :-( I'm not sure if there is a way around this yet if any coders out there have any suggestions I would love to hear them :-)