Repair Failed, Unpacking Failed, and CRC errors

[aljohri]

"Repair failed, not enough repair blocks (x short)" | "Unpacking failed, unable to find xxx.rxx" | "Unpacking failed, CRC error"

I'm having numerous problems with downloading files (as it appears many people are having) so I will attempt to be as detailed as possible.

General Information

Version: sabnzbd+ 0.6.14
OS: Ubuntu Server 10.04.3 LTS (I SSH into the system with a Windows 7 system)
Install-type: linux-repository (using: apt-get install sabnzbdplus)
Skin: Plush - gold
Firewall Software: None
IPV6: no
Issue Reproducible?: It won't stop. (yes)

Usenet Server Information

usenet server: news.usenetserver.com (after setting the logs to debug, it seems that my computer is downloading from astraweb. Short excerpt of log follows)
port: 119
SSL: disabled
retention: 1237 days

Log Excerpt 1

2012-01-06 10:28:20,792::DEBUG::[decoder:92] Decoding <Article: article=4cd6f5a6$4$25850$c3e8da3$33a0879d@news.astraweb.com, bytes=350444, partnum=19, art_id=None>
2012-01-06 10:28:20,794::INFO::[assembler:141] <Article: article=4cd6f1d0$5$25850$c3e8da3$33a0879d@news.astraweb.com, bytes=350528, partnum=1, art_id=None> missing
2012-01-06 10:28:20,834::DEBUG::[decoder:92] Decoding <Article: article=4cd6f5a6$2$25850$c3e8da3$33a0879d@news.astraweb.com, bytes=350208, partnum=17, art_id=None>
2012-01-06 10:28:20,866::DEBUG::[decoder:92] Decoding <Article: article=4cd6f5a6$5$25850$c3e8da3$33a0879d@news.astraweb.com, bytes=350417, partnum=20, art_id=None>

Log Excerpt 2

2012-01-06 10:25:19,393::INFO::[downloader:559] Thread 7@news.usenetserver.com:119: Article 4cd6eefe$5$6066$c3e8da3$fe04f72@news.astraweb.com missing (error=430)
2012-01-06 10:25:19,396::INFO::[decoder:181] <Article: article=4cd6eefe$5$6066$c3e8da3$[email protected], bytes=1403, partnum=1, art_id=None> => missing from all servers, discarding
2012-01-06 10:25:19,396::DEBUG::[nzbstuff:203] Finishing import on tpz-entrg211-subs.rar.par2
2012-01-06 10:25:19,397::DEBUG::[__init__:802] Loading data for SABnzbd_nzf_g8QlKN from /home/atul/Downloads/incomplete/Entourage.S02.DVDRiP.XviD-Topaz/__ADMIN__/SABnzbd_nzf_g8QlKN
2012-01-06 10:25:19,399::DEBUG::[__init__:769] Saving data for SABnzbd_nzo_5czMu4 in /home/atul/Downloads/incomplete/Entourage.S02.DVDRiP.XviD-Topaz/__ADMIN__
2012-01-06 10:25:19,424::INFO::[downloader:559] Thread [email protected]:119: Article 4cd6eefa$5$12559$c3e8da3$[email protected] missing (error=430)
2012-01-06 10:25:19,463::INFO::[__init__:840] Saving data for totals9.sab in /home/atul/.sabnzbd/admin/totals9.sab
2012-01-06 10:25:19,474::INFO::[decoder:181] <Article: article=4cd6eefa$5$12559$c3e8da3$[email protected], bytes=1361, partnum=1, art_id=None> => missing from all servers, discarding

I searched for "missing from all servers, discarding" in my log file and got about 1217 hits. Is this just a problem with my server? I have filed a support request just in case.

Indexing Services
I often found switching around the order of my indexing services changed the success rate but I might be mistaken.

nzbmatrix
newzbin
nzbs'rus
sick beard index

Directory Information

Files are downloaded to /home/username/Downloads/complete/tv, movies, music etc.
Files are moved to /NAS/tv, movies, music etc. (the folders in /NAS are symbolic links to external hard drives. permissions should be set up correctly as I can access them as samba shares and the logs show no permission problems)

Other Programs
These are the other programs I'm using in conjunction with sabnzbd+ to obtain the nzb files.

Sick Beard (tv) - Except for one or two movies here and there, the majority of errors are in dozens of episodes (verging on 100's)
Couch Potato (movies)
Headphones (music)

Sabnzbd+ Settings
As per the thread "About CRC Errors" I have changed my Post-Processing Settings under "Switch" as thus:

[ ] Enable Quick Check (disabled this to force par2 check)
[X] Enable Unrar
[x] Enable Unzip
[x] Enable Filejoin
[x] Enable TS joining
[x] Enable Par Cleanup
[ ] Fail on yEnc CRC Errors
[x] Post-Process Only Verified Jobs
[x] Enable SFV-based checks
[x] Check result of unpacking (needs to be off for some file systems?? I am using ext4?)

Please let me know if you would like to me to test anything. I'd really like to get this fixed. If the problem is with the server, do I bitch at them since I already paid for a year? And what service should I buy in the future to keep this from happening?

EDIT: I noticed a post somewhere on this forum saying that if many blocks are missing its a server problem and if only few are missing its a potential sabnzbd+ problem. I have anywhere from 1-3, 9-15, or 20+ blocks missing.

[shypike]

Without going into the many possible causes,
there's one simple test.
Use an alternative program to download one of the failing NZBs.
If you get similar results, then the cause is either the NZB itself or your Usenet provider.
Most of the time the provider will deny problems, for legal reasons.

[sander]

@aljohri

I agree with Shypike's advice: try the same download with another download program (as you think it's SAB related).

An additonal method you could check: go back to the basics: get a neutral NZB from binsearch, feed it to SABnzbd and see what happens.
So: get this NZB from http://binsearch.info/?q=ubuntu+desktop ... 00&server= and see what happens when you download that. FYI: I was able to download this NZB fine.
If that works OK, you know your SAB setup is correct, and your download problem is probably related to the specific NZB. See http://wiki.sabnzbd.org/faq#toc30

[aljohri]

Thanks for the response! Can you recommend a program similar to sabnzbd+ with a remote web interface or CLI interface (for Linux/GNU distributions)?

[aljohri]

Also, what program can I use to perform manual repair in Linux/GNU distributions?

[shypike]

Thanks for the response! Can you recommend a program similar to sabnzbd+ with a remote web interface or CLI interface (for Linux/GNU distributions)?

Cannot you test it on a Windows PC? Plenty of choice there.

[sander]

Thanks for the response! Can you recommend a program similar to sabnzbd+ with a remote web interface or CLI interface (for Linux/GNU distributions)?

Uhmm. The goal of Shypike's remark to test with another program is *not* to switch to another program; it is meant to only test with another to proof what's going on as you said you suspect SABnzbd (and not the items mentioned in the FAQ I gave you).

IMHO you wont find a similar program on Linux. For testing purposes however you don't need a similar program; you only need to test once for the proof. You could try nzbget; it's quite difficult to use, but http://ipv6-or-no-ipv6.blogspot.com/201 ... -1110.html might help you. I think that after trying nzbget you will appreciate SABnzbd even more. ;-)

But: have you used my advice to download a neutral NZB like the Ubuntu download I gave you? That will only require a few mouse clicks and will give you much information ...

[aljohri]

Thanks for the response! Can you recommend a program similar to sabnzbd+ with a remote web interface or CLI interface (for Linux/GNU distributions)?

Cannot you test it on a Windows PC? Plenty of choice there.

I can't, the PC is at home and I'm currently in school 14 hours away.

Thanks for the response! Can you recommend a program similar to sabnzbd+ with a remote web interface or CLI interface (for Linux/GNU distributions)?

Uhmm. The goal of Shypike's remark to test with another program is *not* to switch to another program; it is meant to only test with another to proof what's going on as you said you suspect SABnzbd (and not the items mentioned in the FAQ I gave you).

IMHO you wont find a similar program on Linux. For testing purposes however you don't need a similar program; you only need to test once for the proof. You could try nzbget; it's quite difficult to use, but http://ipv6-or-no-ipv6.blogspot.com/201 ... -1110.html might help you. I think that after trying nzbget you will appreciate SABnzbd even more. ;-)

But: have you used my advice to download a neutral NZB like the Ubuntu download I gave you? That will only require a few mouse clicks and will give you much information ...

You misunderstood. I just needed a program with those specifications in order to test. I''ll try nzbget when I get chance.

As far as the neutral NZB, it has indeed worked (as have several other NZB's I've downloaded in the last few days) but my main problem concerned the large number of files that gave me errors. If its natural for all of these files to be having errors, why does everyone extol Usenet over torrents? Given enough seeders, torrents will download without fail as far as my limited knowledge tells me?

For example, this file has passed the SFV check yet still fails. Why is that?

Code: Select all

Repair	 [dragon.ball.z.s03e22.explosion.of.anger.ws.dvdrip.xvid-wpi.sample.avi] Verified in 1 second, all files correct
[dragon.ball.z.s03e22.explosion.of.anger.ws.dvdrip.xvid-wpi] Repair failed, not enough repair blocks (15 short)
Trying SFV verification
Verified successfully using SFV files

Unpack	 [dragon.ball.z.s03e22.explosion.of.anger.ws.dvdrip.xvid-wpi] Unpacking failed, unable to find dragon.ball.z.s03e22.explosion.of.anger.ws.dvdrip.xvid-wpi.r06

I'm not necessarily saying the problem is with sabnzbd+. I'm just trying to find a more permanent solution. I thought paying 100 dollars would give me an improvement. This is turning out to be more of a headache though. Should I try to find someone who can invite me to nzb.su? Or move back to torrents?

P.S. I do indeed appreciate sabnzbd+ quite a lot! Its worked quite fluidly with all of the other programs.

[shypike]

If you're not having a technical problem with SABnzbd, then it's likely that you just have had bad luck.
nzbmatrix and other NZB sources have mostly proper NZBs, as has nzb.su.
However, increasingly Usenet providers are hit with DMCA notifications.
Some react to that not by deleting the complete post,. but just enough to make
sure you cannot complete the job.
Also some poster do not use the normal naming convention, thus preventing SABnznd's repair of the job.
(We're looking at a solution for this.)

[semel]

dragon.ball.z.s03e22.explosion.of.anger.ws.dvdrip.xvid-wpi

ive just downloaded it on astraweb (checked only main files +par2 files)

its OK

it seems that my computer is downloading from astraweb

it doesnt download from astraweb.

These files were uploaded using astraweb server thats all

you are downloading from highwinds servers(usenetserver is a reseller)

missing from all servers

- it means there are missing files on the server either due to bad completion or due to DMCA tsakedowns which highwinds and giganews are known for

However i checked this releases on another highwinds reseller (newshosting) and it seems to be complete. Ergo its the fault of usenet server


I suggest you 3 ways:
1)get blocknews block account and set it up as a backupserver

2)get yourself astraweb or ( yearly) + blocknews block account

Set astraweb as your main server and blocknews as a backup server. The sabnzbd will download missing articles if there are any from blocknews.

3) get supernews + blocknews and do the same

[aljohri]

Wow thanks! Those sound like some very do-able solutions. Nice to understand exactly what's causing it in the very least.

And just to confirm: If I set it up blocknews as a backup server, sabnzbd will only go to it in the case that the primary server fails?

[shypike]

And just to confirm: If I set it up blocknews as a backup server, sabnzbd will only go to it in the case that the primary server fails?

Yes.
Backup servers will also be used for articles outside the retention period as set for the servers.
The retention time setting is primarily meant to save time by not asking servers
who are very unlikely to have the article.
(Keep in mind that actual server retention times are not absolute.)

[konowl]

K I'm having very similar problems to the original poster. 80% of my downloads, I would estimate, are currently failing. It will just say "failed" with 1 or 2 articles being "malformed". Log shows:

12-01-30 05:50:59,598::INFO::[decoder:109] CRC Error in <Article: article=[email protected], bytes=793152, partnum=117, art_id=None> (98F21A48 -> 1B539896).

It won't repair. I click retry and use xsuse as a backup server and still doesn't work. Have about 100 gigs of downloads that failed - still hoping to retry them, but nothing so far.

[konowl]

2 more things failed today. Getting ready to pull my hair out.

[shypike]

2 more things failed today. Getting ready to pull my hair out.

Do these jobs have extra par2 files?
Have they been downloaded?