LazyLibrarian: Automate your ebook/author collection

[LibrarianMike]

Is that the entire log? It doesn't look like the search nzb function is being called.

[FatGiant]

2012-12-02 23:12:34 INFO lazylibrarian is up to date
2012-12-02 23:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 23:12:32 INFO Retrieving latest version information from github
2012-12-02 21:12:34 INFO lazylibrarian is up to date
2012-12-02 21:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 21:12:32 INFO Retrieving latest version information from github
2012-12-02 19:12:34 INFO lazylibrarian is up to date
2012-12-02 19:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 19:12:32 INFO Retrieving latest version information from github
2012-12-02 17:12:34 INFO lazylibrarian is up to date
2012-12-02 17:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 17:12:32 INFO Retrieving latest version information from github
2012-12-02 15:12:34 INFO lazylibrarian is up to date
2012-12-02 15:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 15:12:32 INFO Retrieving latest version information from github
2012-12-02 14:57:19 INFO Processing complete: Added 1 books to the database
2012-12-02 14:57:19 INFO Processing books for author with ID: 6432444
2012-12-02 14:57:18 INFO Processing info for authorID: 6432444
2012-12-02 14:57:13 INFO Found author: Tom Aston with GoodReads-id: 6432444
2012-12-02 14:57:12 INFO Searching for author with name: {'id': 'Tom Aston'}
2012-12-02 14:57:05 INFO Found 2 results
2012-12-02 14:57:04 INFO Searching for author at: http://www.goodreads.com/search.xml?q=T ... 7omh74ZZ6Q
2012-12-02 14:57:04 INFO Tom Aston
2012-12-02 14:55:48 INFO Removing author: 4043
2012-12-02 14:55:43 INFO Removing author: 874602
2012-12-02 14:55:36 INFO Removing author: 4443809
2012-12-02 14:55:31 INFO Removing author: 3619
2012-12-02 14:55:25 INFO Removing author: 205
2012-12-02 14:55:19 INFO Removing author: 32278
2012-12-02 14:55:12 INFO Removing author: 83359
2012-12-02 14:55:06 INFO Removing author: 32252
2012-12-02 14:55:00 INFO Removing author: 26
2012-12-02 13:12:34 INFO lazylibrarian is up to date
2012-12-02 13:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 13:12:32 INFO Retrieving latest version information from github
2012-12-02 11:12:34 INFO lazylibrarian is up to date
2012-12-02 11:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 11:12:32 INFO Retrieving latest version information from github
2012-12-02 09:12:33 INFO lazylibrarian is up to date
2012-12-02 09:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 09:12:32 INFO Retrieving latest version information from github
2012-12-02 07:12:33 INFO lazylibrarian is up to date
2012-12-02 07:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 07:12:32 INFO Retrieving latest version information from github
2012-12-02 05:12:34 INFO lazylibrarian is up to date
2012-12-02 05:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 05:12:32 INFO Retrieving latest version information from github
2012-12-02 03:12:34 INFO lazylibrarian is up to date
2012-12-02 03:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 03:12:32 INFO Retrieving latest version information from github
2012-12-02 01:12:34 INFO lazylibrarian is up to date
2012-12-02 01:12:33 INFO Comparing currently installed version with latest github version
2012-12-02 01:12:32 INFO Retrieving latest version information from github
2012-12-02 01:11:32 INFO Starting LazyLibrarian on port: 5299
2012-12-02 01:11:32 INFO Checking database
2012-12-02 01:11:32 INFO lazylibrarian is up to date
2012-12-02 01:11:31 INFO Comparing currently installed version with latest github version
2012-12-02 01:11:30 INFO Retrieving latest version information from github

The above is what shows on the Log Tab.

This are the latest entries into the log file:

02-Dec-2012 23:12:32 - DEBUG :: SEARCHBOOKS : Searching for: Tom Aston The Machine epub
02-Dec-2012 23:12:32 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="http://rss.nzbmatrix.com/rss.php?userna ... BMatrix</a>
02-Dec-2012 23:12:33 - DEBUG :: SEARCHBOOKS : Found 2 nzb for: Tom Aston The Machine epub
02-Dec-2012 23:12:33 - DEBUG :: SEARCHBOOKS : bookName The Machine
02-Dec-2012 23:12:33 - DEBUG :: SEARCHBOOKS : nzbName Tom Aston Ethan Stone The Machine epub
02-Dec-2012 23:12:33 - DEBUG :: SEARCHBOOKS : FOUND tom aston ethan stone the machine epub
02-Dec-2012 23:12:33 - INFO :: VERSIONCHECK : Comparing currently installed version with latest github version
02-Dec-2012 23:12:34 - INFO :: VERSIONCHECK : lazylibrarian is up to date

Removed API key and Login.

Following the http link above, I get a page with 2 links to download, both called download.php. LL finds them too, but then does nothing.

I can't explain this.

[LibrarianMike]

LL compares the titles of the downloads to the title of the book. It checks to see that all of the words in the name of the book are in the title, if so it is downloaded. If not it its supposed to tell you the book was added to the queue (which is not in your log). I'd say it must compare the names, find a match and then run into an issue before it can be downloaded. Are you using Sabnzbd or blackhole? I know it writes SAB errors to the console but perhaps it isnt writing blackhole errors.

[FatGiant]

I use both. Shouldn't I?

I have to mention that SickBeard and Couchpotato both work with the same api keys and Sab port.

[LibrarianMike]

You should have the blackhole option turned off if you want to pass the file to sab, I believe. Otherwise it will just save the nzb file to disk and not pass it to sab. In this case you would need to make sab monitor the location you selected to save the file.

[ruinit]

Running the latest clone from github and I get this.

2012-12-02 21:21:17 INFO You are running an unknown version of lazylibrarian. Run the updater to identify your version
2012-12-02 21:21:16 INFO Retrieving latest version information from github
2012-12-02 21:21:16 ERROR Couldn't find latest installed version.
2012-12-02 21:20:43 INFO Searching for +Janet +Evanovich +.
2012-12-02 21:20:43 INFO Searching for Janet Evanovich Notorious Nineteen (Stephanie Plum #19).
2012-12-02 21:17:22 INFO Searching for +Janet +Evanovich +epub.
2012-12-02 21:17:22 INFO Searching for Janet Evanovich Notorious Nineteen (Stephanie Plum #19) epub.
2012-12-02 21:16:57 INFO Processing complete: Added 93 books to the database
2012-12-02 21:16:55 INFO Processing books for author with ID: 2384
2012-12-02 21:16:53 INFO Processing info for authorID: 2384
2012-12-02 21:16:47 INFO Found author: Janet Evanovich with GoodReads-id: 2384
2012-12-02 21:16:47 INFO Searching for author with name: {'id': 'Janet Evanovich'}
2012-12-02 21:15:53 INFO Found 20 results
2012-12-02 21:15:52 INFO Searching for author at: http://www.goodreads.com/search.xml?q=J ... 7omh74ZZ6Q
2012-12-02 21:15:52 INFO Janet Evanovich
2012-12-02 21:14:48 INFO You are running an unknown version of lazylibrarian. Run the updater to identify your version
2012-12-02 21:14:47 INFO Retrieving latest version information from github

Not sure why? I have deleted folder and ran it twice, same issues.

[LibrarianMike]

What OS are you running from? Windows?
Also NewzNab may not work, I don't have an account to test it with and the way LL searches has been tailored for nzbmatrix

[ruinit]

What OS are you running from? Windows?
Also NewzNab may not work, I don't have an account to test it with and the way LL searches has been tailored for nzbmatrix

I am using on Linux based system. I was using Newznab because it is down far less often than Nzbmatrix but while trying it out the rss's for nzbmatrix were down again so it coming back can not connect. There are free newsnab services I think if you would like to try and make it work with newsnab also.

[FatGiant]

Great!!! By removing the Blackhole it suddenly downloaded the book... ))))

Now I have to fix this:

2012-12-03 20:13:06 INFO Postprocessing for The Machine has failed.
2012-12-03 20:13:06 ERROR Could not create destinationfolder or rename the downloaded ebook. Check permissions of: /media/Backup/temp/LL

What permissions should I give it?

EDIT:

Solved, the Backup unit was wrong, it's another unit.

I'm so happy I could dance... )))))))))))

[Wimma]

Have to say, great work LibrarianMike - a lot of progress recently. Well done!
I've got the basics working on linux (ubuntu 12.04 server), and I can add authors, select books, and they get downloaded to sabnzbd no worries.
Wasn't sure what to do with any categories or processing though?
I created a 'books' profile in sab to download to my e-books dir on my server, and set category in LL to 'books' also.
They do download where expected, but the naming seems to concatenate author and title for the dir.
For example, sab will be passed an entry for "Clodagh Murphy Frisky Business". Not sure if this is just the nzb title from newznab?
So in my e-books folder I get:
simon@Holly:~$ ls /mnt/disk3/e-books/ -l
total 472
drwxrwxr-x 2 simon simon 4096 Dec 4 23:06 Clodagh Murphy Frisky Business
simon@Holly:~$ ls /mnt/disk3/e-books/Clodagh\ Murphy\ Frisky\ Business/
Clodagh Murphy - Frisky Business (epub).epub
Just not sure how to get a structure like "/author/author - title.epub" or similar?
Also no closing the loop back to LL to show book as downloaded. Remains 'snatched'.
Obviously LL is doing the lookup, I'm just too stupid to join the dots here I think...
(for example, sickbeard uses a script to link with sab for this purpose - is there an equivalent method for LL?)
Thanks again.

[FatGiant]

I found that to get the books processed, I have to go to the Books tab and press Manual Process. Then that structure you want is created.

[LibrarianMike]

There is a scheduler for the processing which goes off every 30 mins or so. It will rename the book as the title it gets from goodreads. After, and only after, the book has been post processed will it be marked as downloaded.

[Wimma]

There is a scheduler for the processing which goes off every 30 mins or so. It will rename the book as the title it gets from goodreads. After, and only after, the book has been post processed will it be marked as downloaded.

Ah, thanks, missed that sorry.
But I just remoted in to home and checked - same as posted above.
Would be great if the directory name could just be the author.
I'll have to check if it's marked as downloaded tonight when I get home.
Is the only way to remove the "(epub)" in the file name to remove that search option in LL?
Cheers.

[LibrarianMike]

The post-processor should move the book from the downloaded location to the new location you specified. It should then put it in a folder with the authors name. Inside of that folder you will have a list of folders with the titles of the books you have downloaded. Inside these folders will be a file (named the title of the book) with the extension epub. If this isn't what you see, odds are your config hasn't been set up properly.

[LibrarianMike]

I have just committed an update which should now retrieve the languages of each book. The books that show up in the author page will default to your preferred language. There are buttons in the navigation for viewing the other languages of an authors books. Unfortunately, this functionality comes at the cost of speed as an API call is required for each book an author has (increasing the time taken to import book information by 2-10 seconds per total number of an authors books).
In future I will also add the ability to change the languages of books manually (as some books do not have a recorded language on goodreads). Finally, I have added the option for people to use their own goodreads api key, however, this is not required.