Page 1 of 1

0.6.15 - par2 never downloaded fully [solved]

Posted: February 17th, 2012, 4:22 am
by scavenger
hello all

Great job for this software, i managed to make it work on my NAS Thecus 5500 :-) (i486 slackware)

Version: 0.5.2 / 0.6.15
[*]+Cheetah-2.2.2
[*]+CherryPy-2.3.0
[*]+feedparser-4.1
[*]+pysqlite2

OS: Thecus 5500 i686 2.6.33 = slackware
[*]+busybox 1.1.0
[*]+bash version 3.00.16
[*]+OpenSSL 1.0.0g
[*]+Python 2.5
[*]+UNRAR 4.00 freeware

Install-type: NAS package
Skin : Smpl-white
Firewall Software: none
Are you using IPV6? NO
Is the issue reproducible? sure ! http://binsearch.info/?b=Bosko%2C+Buddy ... 3E&max=250[/color]


I'm facing a strange problem : whatever i check in the "switch" options page, it never download all the PAR2 files completly, so when the quickcheck fails, it won't repair the set.
If I uncheck "quickcheck", it's the same.
If I force to verify the set before post-processing, i.e. it "should" download more PAR2 files when necessary, it's the same.

Could this issue comes from the version, or the installation itself , or is it a known issue ?

THX for your answers, this software should become a great time saver to me if it works :)

regards

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 17th, 2012, 5:56 am
by sander
Well, quick and easy check: if you download the same NZB with the current version of 0.6.15 (for example on your PC/Mac), what is the result?

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 17th, 2012, 2:33 pm
by scavenger
well... it's a Thecus module package, i got it from here : http://www.10741.nl/thecus-n5200pro-sab ... le-2-00-03

but well you're right, i updated it by myself to the last release 0.6.2
i'll test some nzb and let you know.

regards

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 17th, 2012, 2:46 pm
by shypike
scavenger wrote: i updated it by myself to the last release 0.6.2
Even 0.6.2 is not supported any more, since we're now on 0.6.15

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 17th, 2012, 7:51 pm
by scavenger
??? i downloaded it from the main dl page ? ok ill check again
hmmm there's no slackware compiled official version...

btw.. i see there are many forks...
on the debian release they say SabNzbd is not developped anymore ? well i'm outdated

ok you speak of the AUR linux, which based OS is that ?

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 17th, 2012, 8:57 pm
by scavenger
well i just finish testing 0.6.15 with a nzb, still the same issue, it downloads only 2 par2 files on 9 available.
not a version issue

am i the only one facing this ?

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 18th, 2012, 12:44 am
by sander
scavenger wrote:well i just finish testing 0.6.15 with a nzb, still the same issue, it downloads only 2 par2 files on 9 available.
not a version issue

am i the only one facing this ?
Wait: what is the final result of the NZB-download: is it OK? Because: AFAIK, SABnzbd only downloads what it *needs*. So it will only download the par2-files it needs to repair.

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 18th, 2012, 4:46 pm
by scavenger
well i understand well :)

ok it happens again with Sab 0.6.15, without SSL, with using Python 2.5:

i tried this one :

REPRODUCTION: long way
[*]search for a collection on binsearch.info, composed of multiple RAR files the same size, with more than one full PAR2 file, you are SURE it's complete
[*]uncheck any repairable, needed file,: a RAR file, in order to create a custom NZB
[*]Download it. Any SVF/PAR2 check would fail for a missing file. A fail check should occurs, forcing the download of a PAR2 file.

REPRODUCTION: short way
[*]download/load a NZB collection, composed of multiple RAR files the same size, with more than one full PAR2 file, you are SURE it's complete
[*]open the download file list, cancel a RAR needed file (red cross): Any SVF/PAR2 check would fail for a missing file. A fail check should occurs, forcing the download of a PAR2 file.

default Categories = D
NOTE: my test collection is soundtrack, which miss just 1 block in one of the 8 RAR file, small PAR2 files downloaded at first are sufficient for repair
http://binsearch.info/?b=Monty_Pythons_ ... 3E&max=250


here are my switches for first try:

Enable Quick Check: NO
Enable Unrar: yes
Enable Unzip: yes
Enable Filejoin: yes
Enable TS Joining: yes
Enable Par Cleanup: yes
Fail on yEnc CRC Errors: NO
Only Get Articles for Top of Queue: yes
Post-Process Only Verified Jobs: yes
Pause job when encrypted RAR is downloaded: yes
Detect Duplicate Downloads: Discard
Enable SFV-based checks: yes
Check result of unpacking: yes
Enable folder rename: yes
Ignore Samples: yes


RESULT: Failed
Once again, it didn't download the extra PAR2 files, the SFV check failed, then the download terminate with the status "Failed"
no more PAR2 files download, it just moved in history as "Failed", everything stopped.


second try after a restart :

Enable Quick Check: yes
Enable Unrar: yes
Enable Unzip: yes
Enable Filejoin: yes
Enable TS Joining: yes
Enable Par Cleanup: yes
Fail on yEnc CRC Errors: NO
Only Get Articles for Top of Queue: yes
Post-Process Only Verified Jobs: yes
Pause job when encrypted RAR is downloaded: yes
Detect Duplicate Downloads: Discard
Enable SFV-based checks: NO
Check result of unpacking: NO
Enable folder rename: NO
Ignore Samples: yes


RESULT: Failed

Completed at 22:09:52 on Saturday 18 February 2012
Download:
Downloaded in 3 minutes 59 seconds at an average of 517 KB/s
1 articles were missing
Category:
*


then you can click on RETRY button: the other PAR2 files become "Active", then the WebUI shows they are downloaded, but looking into the working download directory, i see no PAR2 files incoming.
RESULT is then the same.

third try, same settings, same nzb all along, this time i uncheck nothing, i download all the files:

Completed at 22:32:50 on Saturday 18 February 2012
Download:
Downloaded in 3 minutes 45 seconds at an average of 548 KB/s
1 articles were missing
Category:
*


===> this is the worse: all needed files are downloaded but the biggest PAR2 files, however it says "1 article were missing", which is obviously wrong. Truth is one PAR2 block is missing. Wrong naming ?

Till now on, my only Successful downloads where those without any PAR2 check error in any files. I obtained the extraction and the deletion of the files, all good.
I'm thinking about a wrong installation or missing libraries, well something in the core files.
How can I activate a debug mode ?

logs:

i got these messages in the etc/logs/sabnzbd.error.log: could that be linked ?

/raid/data/module/SABNZBD/system/lib/python/Cheetah/Compiler.py:1522: UserWarning:
You don't have the C version of NameMapper installed! I'm disabling Cheetah's useStackFrames option as it is painfully slow with the Python version of NameMapper. You should get a copy of Cheetah with the compiled C version of NameMapper.
"\nYou don't have the C version of NameMapper installed! "


no errors in sabnzbd.log nor cherrypy.log

Re: SAB 0.5.2: par2 never downloaded fully

Posted: February 18th, 2012, 5:06 pm
by sander
I did the short method (remove rar #5 from the queue), and the download failed. Seems OK to me.

Code: Select all

ls 
__ADMIN__
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.nfo
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.par2
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.r00
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.r01
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.r02
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.r03
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.r04
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.r06
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.rar
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.vol00+01.par2
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.vol01+02.par2
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.vol03+04.par2
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.vol07+08.par2
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.vol15+16.par2
Blabla-The_Infamous_TV_Soundtrack_(1969-1974)-2009-gF__www.realmom.info__.vol31+01.par2


So, I would say rar #5 is not downloaded, and the par2 files have been downloaded. Looks OK.
Tested with SAB 0.6.15 on Ubuntu.

Re: 0.6.15 - par2 never downloaded fully

Posted: February 18th, 2012, 5:47 pm
by scavenger
well you're lucky :)

just tried with another good example : http://binsearch.info/?b=No_Ufos-Soft_C ... 3E&max=250

same issue, never download the .vol015+016 files (others than the fist two ones)

+ another new issue :
i deselected the .sfv file, and now it fails just after the download. the PAR2 check is not even tried.

Re: 0.6.15 - par2 never downloaded fully

Posted: February 18th, 2012, 6:27 pm
by shypike
Which Usenet provider do you use?
Does the history entry say anything about missing articles?

Re: 0.6.15 - par2 never downloaded fully

Posted: February 22nd, 2012, 4:58 pm
by scavenger
newshosting

hmmm...
i suspected a bad installation or a bad integration with others needed modules such as python and i guess i was right.

i completly reinstalled everything with the right python version and now i'm testing at new.
i'll let you know. thx for the help !

Re: 0.6.15 - par2 never downloaded fully

Posted: February 23rd, 2012, 3:11 pm
by scavenger
ok it was obviously the misintegration of the libraries and the python install that caused that issue.
issue solved, but thats too bad sabnzbd logs couldn't help

thks for heling !!

great software