LazyLibrarian: Automate your ebook/author collection
-
- Newbie
- Posts: 6
- Joined: January 31st, 2013, 2:29 pm
Re: LazyLibrarian: Automate your ebook/author collection
Hi
Today i tried to add a new author which worked as planned ("George R.R. Martin")
Then i tried to add "Stephen King" - i entered "King" as search term and a lot of kings showed up but when i tried to add "Stephen King" with the "add author" button i ran in a similar error (which ended in the freezing of LL - webgui was reacting but no activity in the python window)
But in my case it was:
Exception in thread DBIMPORT:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 504, in run
self.__target(*self.__args, **self.__kwargs)
File "/home/herman/LazyLibrarian-1/lazylibrarian/importer.py", line 100, in addAuthorToDB
author = GR.find_author_id()
SAME LIKE YOURS BUT:
File "/home/herman/LazyLibrarian-1/lazylibrarian/gr.py", line 37, in find_author_id
rootxml = sourcexml.getroot()
UnboundLocalError: local variable 'sourcexml' referenced before assignment
This comes from the python window - LL log states only
05-Feb-2013 22:12:22 - INFO :: DBIMPORT : Searching for author with name: {'id': 'Stephen King'}
05-Feb-2013 22:12:24 - ERROR :: DBIMPORT : Error fetching authorid: syntax error: line 1, column 0
------------
Besided that i noticed 2 more problems:
Search:
i added some books to the wanted list but search isnt downloading any nzbs -
So i checked out the log and found
05-Feb-2013 22:33:07 - DEBUG :: SEARCHBOOKS : Searching NZB's at provider https://newzb.net/ ...
05-Feb-2013 22:33:07 - INFO :: SEARCHBOOKS : Searching for Brent Weeks. at: https://newzb.net/
05-Feb-2013 22:33:12 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="https://newzb.net//api?q=Brent+Weeks&ap ... zb.net/</a>
(i changed the apikey but i double checked and its correct)
When i take the link from the logs https://newzb.net//api?q=Brent+Weeks&ap ... 1&cat=7020 and open it in the browser a XML is shown containing multiple items like:
<item>
<title>
Weeks, Brent - Night Angel Trilogy, The 03 - Beyond the Shadows
</title>
<guid isPermaLink="true">
https://newzb.net/details/093cc05208561 ... 6c99f1488b
</guid>
<link>
https://newzb.net/getnzb/093cc052085611 ... r=REPLACED
</link>
<comments>
https://newzb.net/details/093cc05208561 ... b#comments
</comments>
<pubDate>Thu, 17 Jan 2013 07:52:09 +0000</pubDate>
<category>Books > Ebook</category>
<description>
Weeks, Brent - Night Angel Trilogy, The 03 - Beyond the Shadows
</description>
<enclosure url="https://newzb.net/getnzb/093cc052085611 ... r=REPLACED" length="1385395" type="application/x-nzb"/>
<newznab:attr name="category" value="7000"/>
<newznab:attr name="category" value="7020"/>
<newznab:attr name="size" value="1385395"/>
<newznab:attr name="guid" value="093cc0520856118eb953016c99f1488b"/>
<newznab:attr name="files" value="2"/>
<newznab:attr name="poster" value=""Windsword" <[email protected]>"/>
<newznab:attr name="grabs" value="0"/>
<newznab:attr name="comments" value="0"/>
<newznab:attr name="password" value="0"/>
<newznab:attr name="usenetdate" value="Thu, 17 Jan 2013 00:20:49 +0000"/>
<newznab:attr name="group" value="alt.binaries.ebook"/>
</item>
So it seems that somehow the results arent processed correctly
Search Providers
While checking the Logs i found out that somehow the searchproviders got messed up -
i have setup 2 newznab providers with the correct api key but LL uses the api key from provider 1 for provider 2 as well although in the Webui and the config ini its stated correctly
Thanks once more for your great work
KR Camelrider
Today i tried to add a new author which worked as planned ("George R.R. Martin")
Then i tried to add "Stephen King" - i entered "King" as search term and a lot of kings showed up but when i tried to add "Stephen King" with the "add author" button i ran in a similar error (which ended in the freezing of LL - webgui was reacting but no activity in the python window)
But in my case it was:
Exception in thread DBIMPORT:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 504, in run
self.__target(*self.__args, **self.__kwargs)
File "/home/herman/LazyLibrarian-1/lazylibrarian/importer.py", line 100, in addAuthorToDB
author = GR.find_author_id()
SAME LIKE YOURS BUT:
File "/home/herman/LazyLibrarian-1/lazylibrarian/gr.py", line 37, in find_author_id
rootxml = sourcexml.getroot()
UnboundLocalError: local variable 'sourcexml' referenced before assignment
This comes from the python window - LL log states only
05-Feb-2013 22:12:22 - INFO :: DBIMPORT : Searching for author with name: {'id': 'Stephen King'}
05-Feb-2013 22:12:24 - ERROR :: DBIMPORT : Error fetching authorid: syntax error: line 1, column 0
------------
Besided that i noticed 2 more problems:
Search:
i added some books to the wanted list but search isnt downloading any nzbs -
So i checked out the log and found
05-Feb-2013 22:33:07 - DEBUG :: SEARCHBOOKS : Searching NZB's at provider https://newzb.net/ ...
05-Feb-2013 22:33:07 - INFO :: SEARCHBOOKS : Searching for Brent Weeks. at: https://newzb.net/
05-Feb-2013 22:33:12 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="https://newzb.net//api?q=Brent+Weeks&ap ... zb.net/</a>
(i changed the apikey but i double checked and its correct)
When i take the link from the logs https://newzb.net//api?q=Brent+Weeks&ap ... 1&cat=7020 and open it in the browser a XML is shown containing multiple items like:
<item>
<title>
Weeks, Brent - Night Angel Trilogy, The 03 - Beyond the Shadows
</title>
<guid isPermaLink="true">
https://newzb.net/details/093cc05208561 ... 6c99f1488b
</guid>
<link>
https://newzb.net/getnzb/093cc052085611 ... r=REPLACED
</link>
<comments>
https://newzb.net/details/093cc05208561 ... b#comments
</comments>
<pubDate>Thu, 17 Jan 2013 07:52:09 +0000</pubDate>
<category>Books > Ebook</category>
<description>
Weeks, Brent - Night Angel Trilogy, The 03 - Beyond the Shadows
</description>
<enclosure url="https://newzb.net/getnzb/093cc052085611 ... r=REPLACED" length="1385395" type="application/x-nzb"/>
<newznab:attr name="category" value="7000"/>
<newznab:attr name="category" value="7020"/>
<newznab:attr name="size" value="1385395"/>
<newznab:attr name="guid" value="093cc0520856118eb953016c99f1488b"/>
<newznab:attr name="files" value="2"/>
<newznab:attr name="poster" value=""Windsword" <[email protected]>"/>
<newznab:attr name="grabs" value="0"/>
<newznab:attr name="comments" value="0"/>
<newznab:attr name="password" value="0"/>
<newznab:attr name="usenetdate" value="Thu, 17 Jan 2013 00:20:49 +0000"/>
<newznab:attr name="group" value="alt.binaries.ebook"/>
</item>
So it seems that somehow the results arent processed correctly
Search Providers
While checking the Logs i found out that somehow the searchproviders got messed up -
i have setup 2 newznab providers with the correct api key but LL uses the api key from provider 1 for provider 2 as well although in the Webui and the config ini its stated correctly
Thanks once more for your great work
KR Camelrider
Re: LazyLibrarian: Automate your ebook/author collection
Hi There
New user here and hoping someone can help me out. Just installed LL on my mac mini but haven't been able to download any books. I have nzbs.org and nzbs.in set up as my search providers along with my API keys, but whenever I run a search (The Lost Symbol by Dan Brown which I know is on nzbs.in) nothing happens and the log gives me a 403 error saying Error 403 Opening URL...
Any help appreciated! Excited to see this up and running as I thought the project was dead when I last checked it out back in 2012.
New user here and hoping someone can help me out. Just installed LL on my mac mini but haven't been able to download any books. I have nzbs.org and nzbs.in set up as my search providers along with my API keys, but whenever I run a search (The Lost Symbol by Dan Brown which I know is on nzbs.in) nothing happens and the log gives me a 403 error saying Error 403 Opening URL...
Any help appreciated! Excited to see this up and running as I thought the project was dead when I last checked it out back in 2012.
Re: LazyLibrarian: Automate your ebook/author collection
do you have the indexer address as https:// ? thats what it was when i had this issue.
Re: LazyLibrarian: Automate your ebook/author collection
Thanks. Added https and no longer throwing an error but still not downloading the book.. I know it is available in epub format on nzbs.in but for some reason LL does not find it.
Re: LazyLibrarian: Automate your ebook/author collection
Also, meant to ask. When adding a book it seems the same book comes up multiple times. Should I add each version or do I only need to add one??? For example, Viva La Madness by J.J Connolly comes up 3 times when you search for it.
Re: LazyLibrarian: Automate your ebook/author collection
Started getting errors when trying to add a book or author. Anyone else getting this??
500 Internal Server Error
The server encountered an unexpected condition which prevented it from fulfilling the request.
Traceback (most recent call last):
File "/Applications/LazyLibrarian-1/cherrypy/_cprequest.py", line 645, in respond
response.body = self.handler()
File "/Applications/LazyLibrarian-1/cherrypy/lib/encoding.py", line 188, in __call__
self.body = self.oldhandler(*args, **kwargs)
File "/Applications/LazyLibrarian-1/cherrypy/_cpdispatch.py", line 29, in __call__
return self.callable(*self.args, **self.kwargs)
File "/Applications/LazyLibrarian-1/lazylibrarian/webServe.py", line 163, in search
searchresults = GR.find_results(name)
File "/Applications/LazyLibrarian-1/lazylibrarian/gr.py", line 243, in find_results
rootxml = sourcexml.getroot()
UnboundLocalError: local variable 'sourcexml' referenced before assignment
500 Internal Server Error
The server encountered an unexpected condition which prevented it from fulfilling the request.
Traceback (most recent call last):
File "/Applications/LazyLibrarian-1/cherrypy/_cprequest.py", line 645, in respond
response.body = self.handler()
File "/Applications/LazyLibrarian-1/cherrypy/lib/encoding.py", line 188, in __call__
self.body = self.oldhandler(*args, **kwargs)
File "/Applications/LazyLibrarian-1/cherrypy/_cpdispatch.py", line 29, in __call__
return self.callable(*self.args, **self.kwargs)
File "/Applications/LazyLibrarian-1/lazylibrarian/webServe.py", line 163, in search
searchresults = GR.find_results(name)
File "/Applications/LazyLibrarian-1/lazylibrarian/gr.py", line 243, in find_results
rootxml = sourcexml.getroot()
UnboundLocalError: local variable 'sourcexml' referenced before assignment
Re: LazyLibrarian: Automate your ebook/author collection
Just discovered this.
Has anyone gotten this to work with nzbsrus? I have https://www.nzbsrus.com in the site and my API key, but there's no spot for UserID? Keep getting 403's in the log.
Also, I have no interest in ebooks. Does this support audiobooks? Do I put mp3 in the type or how?
Thanks! Glad to see people are keeping this going.
Has anyone gotten this to work with nzbsrus? I have https://www.nzbsrus.com in the site and my API key, but there's no spot for UserID? Keep getting 403's in the log.
Also, I have no interest in ebooks. Does this support audiobooks? Do I put mp3 in the type or how?
Thanks! Glad to see people are keeping this going.
Re: LazyLibrarian: Automate your ebook/author collection
Hi
Just started LL on my NAS (Synology DS212+)
CP, and SB work perfect, so had high hopes for LL.
Until now, manually using (free) providers for eBooks:
http://binsearch.info/?q=epub&max=250&adv_age=1100 : free
https://www.nzbx.co/ : [can use uid/pwd]
That work fine and find a lot.
Cannot see how I can set these up in LL though.
'Only' Newznab with host and API.
Read that LL is based on (HeadPhones) HP, and HP can use nzbX by default now.
Also, Have issue with updating but read somewhere in this forum that's a know problem. But already noted some time ago.
Am I maybe missing a vital update for the possibility to have more provider options ?
Regards, Martin
Just started LL on my NAS (Synology DS212+)
CP, and SB work perfect, so had high hopes for LL.
Until now, manually using (free) providers for eBooks:
http://binsearch.info/?q=epub&max=250&adv_age=1100 : free
https://www.nzbx.co/ : [can use uid/pwd]
That work fine and find a lot.
Cannot see how I can set these up in LL though.
'Only' Newznab with host and API.
Read that LL is based on (HeadPhones) HP, and HP can use nzbX by default now.
Also, Have issue with updating but read somewhere in this forum that's a know problem. But already noted some time ago.
Am I maybe missing a vital update for the possibility to have more provider options ?
Regards, Martin
Re: LazyLibrarian: Automate your ebook/author collection
Hi Martin,
LL is based off Headphone code but Headphones has moved on massively since this was originally done meaning any work for new provides in Headphones does not relate to LL.
With the update issue i was looking at it but have not have time to completely finish it, hoping to get back on it at somepoint
LL is based off Headphone code but Headphones has moved on massively since this was originally done meaning any work for new provides in Headphones does not relate to LL.
With the update issue i was looking at it but have not have time to completely finish it, hoping to get back on it at somepoint
Re: LazyLibrarian: Automate your ebook/author collection
So is it supposed to DO something? I've got a few authors loaded and books marked wanted, but all I see in the log is:
2013-03-22 09:23:19 INFO Comparing currently installed version with latest github version
2013-03-22 09:23:18 INFO Retrieving latest version information from github
2013-03-22 07:23:19 INFO lazylibrarian is up to date
...
It never goes out to actually LOOK for anything?
I'm using the version from
2013-03-22 09:23:19 INFO Comparing currently installed version with latest github version
2013-03-22 09:23:18 INFO Retrieving latest version information from github
2013-03-22 07:23:19 INFO lazylibrarian is up to date
...
It never goes out to actually LOOK for anything?
I'm using the version from
-
- Newbie
- Posts: 1
- Joined: May 31st, 2012, 9:09 am
Re: LazyLibrarian: Automate your ebook/author collection
Hey everybody
So I was using Code-slave's version of LL and was getting the following error:
descriptor 'replace' requires a 'str' object but received a 'unicode'"
What I did was find the "searchnzb" file in the LL folder and used unicode.replace() instead of str.replace(),
It still just searches and searches and downloads nothing...UNTIL I re-selected the books previously marked as "Wanted" and essentially marked them as "Wanted" again.
At that point, LL was able to find and download the NZB, and finally the file.
Now, we need to figure out 2 things:
1 - how to get LL to grab the NZB without manual intervention
2 - how to get LL to search the NZB's by book title if it can't find the author. For instance, if I'm looking for a graphic novel, and we all know those aren't normally list with authors, LL pretty much passes it by.
In the Logs, I see the following:
10-Apr-2013 23:07:17 - DEBUG :: SEARCHBOOKS : Searching NZB's at provider https://myfavoriteindexer.info ...
10-Apr-2013 23:07:17 - INFO :: SEARCHBOOKS : Searching for Cullen Bunn Deadpool Kills The Marvel Universe #1.
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="https://myfavoriteindexer.info/api?q=Cu ... er.info</a>
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Newznab returned 0 results for: Cullen Bunn Deadpool Kills The Marvel Universe #1. Adding book to queue.
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Adding book Cullen Bunn Deadpool Kills The Marvel Universe #1 to queue.
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Searching NZB's at provider https://myfavoriteindexer.info ...
10-Apr-2013 23:07:19 - INFO :: SEARCHBOOKS : Searching for +Cullen +Bunn +.
10-Apr-2013 23:07:20 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="https://myfavoriteindexer.info/api?q=%2 ... er.info</a>
10-Apr-2013 23:07:20 - DEBUG :: SEARCHBOOKS : Newznab returned 0 results for: +Cullen +Bunn +. Adding book to queue.
10-Apr-2013 23:07:20 - DEBUG :: SEARCHBOOKS : Adding book +Cullen +Bunn + to queue.
using those parameters, LL will NEVER find that book.
Surely someone with the requisite brainpower can figure out how to fix this....
So I was using Code-slave's version of LL and was getting the following error:
descriptor 'replace' requires a 'str' object but received a 'unicode'"
What I did was find the "searchnzb" file in the LL folder and used unicode.replace() instead of str.replace(),
It still just searches and searches and downloads nothing...UNTIL I re-selected the books previously marked as "Wanted" and essentially marked them as "Wanted" again.
At that point, LL was able to find and download the NZB, and finally the file.
Now, we need to figure out 2 things:
1 - how to get LL to grab the NZB without manual intervention
2 - how to get LL to search the NZB's by book title if it can't find the author. For instance, if I'm looking for a graphic novel, and we all know those aren't normally list with authors, LL pretty much passes it by.
In the Logs, I see the following:
10-Apr-2013 23:07:17 - DEBUG :: SEARCHBOOKS : Searching NZB's at provider https://myfavoriteindexer.info ...
10-Apr-2013 23:07:17 - INFO :: SEARCHBOOKS : Searching for Cullen Bunn Deadpool Kills The Marvel Universe #1.
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="https://myfavoriteindexer.info/api?q=Cu ... er.info</a>
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Newznab returned 0 results for: Cullen Bunn Deadpool Kills The Marvel Universe #1. Adding book to queue.
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Adding book Cullen Bunn Deadpool Kills The Marvel Universe #1 to queue.
10-Apr-2013 23:07:19 - DEBUG :: SEARCHBOOKS : Searching NZB's at provider https://myfavoriteindexer.info ...
10-Apr-2013 23:07:19 - INFO :: SEARCHBOOKS : Searching for +Cullen +Bunn +.
10-Apr-2013 23:07:20 - DEBUG :: SEARCHBOOKS : Parsing results from <a href="https://myfavoriteindexer.info/api?q=%2 ... er.info</a>
10-Apr-2013 23:07:20 - DEBUG :: SEARCHBOOKS : Newznab returned 0 results for: +Cullen +Bunn +. Adding book to queue.
10-Apr-2013 23:07:20 - DEBUG :: SEARCHBOOKS : Adding book +Cullen +Bunn + to queue.
using those parameters, LL will NEVER find that book.
Surely someone with the requisite brainpower can figure out how to fix this....
Re: LazyLibrarian: Automate your ebook/author collection
I have created an installation package (spk) for Synology Diskstation. It contains the latest update of the herman-rogers/LazyLibrarian-1 version, including a fix for the issue in versioncheck.py with retrieving latest version information from github (https://github.com/raymccarthy/LazyLibr ... f50212d069).
Package can be found on http://synology.mdevries.org/spkrepo/packages.
Hopefully herman-rogers will include the commit from raymccarthy in the next update, otherwise the version check will fail again.
Package can be found on http://synology.mdevries.org/spkrepo/packages.
Hopefully herman-rogers will include the commit from raymccarthy in the next update, otherwise the version check will fail again.
Re: LazyLibrarian: Automate your ebook/author collection
Abandoned again? This project does not have much luck!
Re: LazyLibrarian: Automate your ebook/author collection
Hey all.
If your forking off my fork and fix something throw a pull request up. Im going to start working on this since it seems abandoned again
If your forking off my fork and fix something throw a pull request up. Im going to start working on this since it seems abandoned again