LazyLibrarian: Automate your ebook/author collection

[Wimma]

The post-processor should move the book from the downloaded location to the new location you specified. It should then put it in a folder with the authors name. Inside of that folder you will have a list of folders with the titles of the books you have downloaded. Inside these folders will be a file (named the title of the book) with the extension epub. If this isn't what you see, odds are your config hasn't been set up properly.

Prob fair assumption.
What do I need set? I've changed the download dir to the usual, and destination to my e-books dir in LL, and removed any changes from sab.
Next book I added went to default download dir.

Edit: I hit manual post process, and logs showed:
2012-12-05 21:18:35 INFO 1 books are downloaded and processed.
2012-12-05 21:18:35 INFO Successfully processed: Cecelia Ahern - One Hundred Names
but buggered if I can find it now!?
not in download dir or destination dir ?? (I didn't check the box to keep original files)

Edit 2: added another new book, and almost worked! sab downloaded to /mnt/disk2/Downloads (default, as set in LL under 'Directory')
then saw log had:
2012-12-05 22:13:34 INFO Postprocessing for Promises to Keep has failed.
2012-12-05 22:08:34 INFO 1 books are downloaded and processed.
2012-12-05 22:08:34 INFO Successfully processed: Jane Green - Promises to Keep
So checked my /mnt/disk3/e-books dir (as set in LL 'Destination')
simon@Holly:~$ ls /mnt/disk3/e-books/ -l
total 464
drwx------ 3 simon simon 4096 Dec 5 22:08 Jane Green
good! but:
simon@Holly:~$ ls /mnt/disk3/e-books/Jane\ Green/ -l
total 4
drwxrwxr-x 2 simon simon 4096 Dec 5 22:08 Promises to Keep
and further:
simon@Holly:~$ ls /mnt/disk3/e-books/Jane\ Green/Promises\ to\ Keep/
metadata.opf Promises to Keep.
given I cleared the ebook format in LL, I assume it added no extension?

I tried with another book, and again log showed:
2012-12-05 22:18:37 INFO Postprocessing for Then Came You has failed.
but looks ok now:
simon@Holly:~$ ls /mnt/disk3/e-books/Jennifer\ Weiner/
Then Came You
simon@Holly:~$ ls /mnt/disk3/e-books/Jennifer\ Weiner/Then\ Came\ You
cover.jpg Jennifer Weiner - Then Came You (mobi).mobi metadata.opf

this appears all good!!

Wrt latest updates:

Also updated, then added a few more authors, and found they do take longer to scan, and page refreshes a few times while doing so.
Vast majority of books were only visible under the unknown button in the new bar however, very few under eng.
ie Jane Green. 44 books none shown default screen as language was set to 'en' by default, so had to change to 'eng'.
So listed then 37 if I hit unknown, only 5 under eng, 1 tur (math seems odd too!)

Edit: authors I added before the last update show no books now too (though totalbooks still indicates a proper amount, I assume)
There's no new menu bar here to select language, so guess it's looking for the default language only?

[Wimma]

checked with another new download (LL "Ebook Format:" blank), and still multiple entries in log for post processing failures:

2012-12-05 23:00:43 INFO Postprocessing for The Making of Us has failed.

but looks to have all worked bar the extension again:

simon@Holly:~$ ls /mnt/disk3/e-books/Lisa\ Jewell/
The Making of Us
simon@Holly:~$ ls /mnt/disk3/e-books/Lisa\ Jewell/The\ Making\ of\ Us/
cover.jpg metadata.opf The Making of Us.

missing the .mobi extension only.
previous book missing extension was a .epub type, fyi.

Very close though!

Edit: when specifying epub type in LL, and fetching new book, all good!!
log:
012-12-05 23:12:36 INFO Successfully processed: Jill Mansell - To the Moon and Back
dirs:
simon@Holly:~$ ls /mnt/disk3/e-books/Jill\ Mansell/
To the Moon and Back
simon@Holly:~$ ls /mnt/disk3/e-books/Jill\ Mansell/To\ the\ Moon\ and\ Back/
cover.jpg metadata.opf To the Moon and Back.epub

Go you good thing!!
(I did a manual processing run fyi)

[LibrarianMike]

Yes I'm still yet to fix that problem.

[ruinit]

The Linux clone off of github still does not return results of any available nzb's to download for any author I chose? It seems to run a search but just stops with a very small log with no explanation for it's failure. It adds authors and books to list without trouble but that's it. I am using nzbmatrix. I can't figure out why there is not more info in the log.

edit: No idea if this will help you but here is a log of the error that pops up on my server log when searching for a book.

Traceback (most recent call last):
File "/usr/local/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/local/lib/python2.7/threading.py", line 504, in run
self.__target(*self.__args, **self.__kwargs)
File "/volume1/@appstore/lazylibrarian/lazylibrarian/searchnzb.py", line 114, in searchbook
snatch = DownloadMethod(bookid, nzbprov, nzbTitle, nzburl)
File "/volume1/@appstore/lazylibrarian/lazylibrarian/searchnzb.py", line 139, in DownloadMethod
nzbname = str.replace(nzbtitle, ' ', '_') + '.nzb'
TypeError: descriptor 'replace' requires a 'str' object but received a 'unicode'

Exception in thread SEARCHBOOKS:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/local/lib/python2.7/threading.py", line 504, in run
self.__target(*self.__args, **self.__kwargs)
File "/volume1/@appstore/lazylibrarian/lazylibrarian/searchnzb.py", line 114, in searchbook
snatch = DownloadMethod(bookid, nzbprov, nzbTitle, nzburl)
File "/volume1/@appstore/lazylibrarian/lazylibrarian/searchnzb.py", line 139, in DownloadMethod
nzbname = str.replace(nzbtitle, ' ', '_') + '.nzb'
TypeError: descriptor 'replace' requires a 'str' object but received a 'unicode'

and LL log:
2012-12-05 14:10:46 INFO Searching for Michael Connelly The Drop (Harry Bosch #15) mobi.
2012-12-05 14:10:46 INFO No nzb's found for Michael Connelly The Fifth Witness. Adding book to queue.
2012-12-05 14:10:45 INFO lazylibrarian is up to date
2012-12-05 14:10:45 INFO Searching for +Michael +Connelly +mobi.
2012-12-05 14:10:45 INFO Comparing currently installed version with latest github version
2012-12-05 14:10:45 INFO Searching for Michael Connelly The Fifth Witness (Mickey Haller #4) mobi.
2012-12-05 14:10:45 INFO Retrieving latest version information from github
2012-12-05 14:09:45 INFO Starting LazyLibrarian on port: 8082
2012-12-05 14:09:45 INFO Checking database
2012-12-05 14:09:44 INFO lazylibrarian is up to date

[LibrarianMike]

Just pushed a small update which should fix the error. It should now actually search for all of the books marked as wanted.

[ruinit]

Just pushed a small update which should fix the error. It should now actually search for all of the books marked as wanted.

Woot progress 2 Things though

2012-12-05 19:35:30 INFO NZB file saved to: /volume1/downloads/nzb/ebooks/Janet_Evanovich_Smokin_Seventeen.nzb
2012-12-05 19:25:42 INFO NZB file saved to: /volume1/downloads/nzb/ebooks/Janet_Evanovich_Finger_Lickin_Fifteen.nzb
2012-12-05 19:23:01 INFO NZB file saved to: /volume1/downloads/nzb/ebooks/Janet_Evanovich_Explosive_Eighteen.nzb

1: would not update through browser, had to get updates through git?
2: I get these errors is sab

2012-12-05 19:25:46,779 WARNING: Cannot read /volume1/downloads/nzb/ebooks/Janet_Evanovich_Finger_Lickin_Fifteen.nzb
2012-12-05 19:23:05,395 WARNING: Cannot read /volume1/downloads/nzb/ebooks/Janet_Evanovich_Explosive_Eighteen.nzb

Now downloading the same nzb's manually worked... not sure why that is. They were downloaded into the same exact directory.

Also just noticed LL doesn't seem to pull books that are brand new and in hard back. Noticed it with 2 authors right off. Not pulling them from goodreads I guess.

[LibrarianMike]

I am aware that it will only update through the browser if you are using Mac OS X or Linux. I haven't encountered this problem on OSX or Linux in some time, if your using one of these could you post a log with the error next time you see it?

I also can't say I have experienced that sab error, however, I pass the files directly to sabnzbd (with the api) as opposed to saving them to a directory.

Not pulling new books would be an issue related to how quickly goodreads updates their collection. If your saying the book is on goodreads and not LL then have you checked under another language (or 'Unknown')?

[LibrarianMike]

I have just updated LL. From now on post processed books will be marked as 'Open' instead of 'Have'. This way when you access books from devices such as the iPad, you can click 'Open' and the book will be opened using iBooks, thus removing the need to sync the book using iTunes.

[Wimma]

Does LL try to post process every 5 mins?
Can see this in my logs:

Timestamp Level Message
2012-12-06 23:11:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:11:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:11:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:11:32 INFO Postprocessing for Promises to Keep has failed.
2012-12-06 23:06:32 INFO Postprocessing for To the Moon and Back has failed.
2012-12-06 23:06:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:06:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:06:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:06:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:06:32 INFO Postprocessing for Promises to Keep has failed.
2012-12-06 23:01:32 INFO Postprocessing for To the Moon and Back has failed.
2012-12-06 23:01:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:01:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:01:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:01:32 INFO Postprocessing for The Making of Us has failed.
2012-12-06 23:01:32 INFO Postprocessing for Then Came You has failed.
2012-12-06 23:01:32 INFO Postprocessing for Then Came You has failed.

Any way to make it slow down?
Not sure I want it trying so frequently, nor why it fails.

[LibrarianMike]

By default it's every 5 mins. You can change it in the _init_.py file. The only reason for a failure would be it can't move the book. (Usually because that book is already in the directory it is trying to move it too)

[Wimma]

Yep, that's it - I had the books in the default download dir, but have since unchecked the save originals option.
I deleted the downloaded books from there.
Error log entries seemed to have ceased.
Thanks!

[tymanthius]

Just updated LL via the web interface, and it wouldn't restart.

I ssh'd into my machine (headless Ubuntu 12.04.1) and did a manual restart of the service and got this:

Code: Select all

Traceback (most recent call last):                                                                                                                     
  File "LazyLibrarian.py", line 4, in <module>                                                                                                           
     import lazylibrarian                                                                                                                               
  File "/home/tymanthius/.LazyLibrarian/lazylibrarian/__init__.py", line 62                                                                              
     <<<<<<< HEAD                                                                                                                           ^                                                                                                                                               
SyntaxError: invalid syntax

Any thoughts?

[ruinit]

This is all the log says when I try and update. This is a linux machine btw it doesn't update after the compare it says it is updating but still shows I am 2 commits behind.

2012-12-06 14:03:59 INFO Starting LazyLibrarian on port: 8082
2012-12-06 14:03:59 INFO Checking database
2012-12-06 14:03:59 INFO New version is available. You are 2 commits behind
2012-12-06 14:03:58 INFO Comparing currently installed version with latest github version
2012-12-06 14:03:58 INFO Retrieving latest version information from github

From nas

06-Dec-2012 14:46:16 - INFO :: VERSIONCHECK : New version is available. You are 2 commits behind
06-Dec-2012 14:48:04 - INFO :: MAIN : LazyLibrarian is restarting ...
06-Dec-2012 14:48:05 - INFO :: MAIN : Checking database
06-Dec-2012 14:48:05 - INFO :: MAIN : Starting LazyLibrarian on port: 8082
06-Dec-2012 14:49:05 - DEBUG :: VERSIONCHECK : Trying to execute: "git rev-parse HEAD" with shell in /volume1/@appstore/lazylibrarian
06-Dec-2012 14:49:05 - DEBUG :: VERSIONCHECK : Git output: 7b5aee3b1decb058ea218e123aa1bc0b26867af4

06-Dec-2012 14:49:05 - INFO :: VERSIONCHECK : Retrieving latest version information from github
06-Dec-2012 14:49:05 - INFO :: VERSIONCHECK : Comparing currently installed version with latest github version
06-Dec-2012 14:49:06 - INFO :: VERSIONCHECK : New version is available. You are 2 commits behind

Tried to pull also

git pull
From https://github.com/LibrarianMike/LazyLibrarian
7b5aee3..c024e05 master -> origin/master
/opt/libexec/git-core/git-pull: line 244: tr: not found
Your configuration specifies to merge with the ref 'master'
from the remote, but no such ref was fetched.

[scochr]

There are no books listed under any authors anymore. There are books listed under books. How can I fix this?

[Wimma]

There are no books listed under any authors anymore. There are books listed under books. How can I fix this?

Did you recently update to the version with search language changes?
Same happened to me.