"Badly formed yEnc article" error stops download

[ALbino]

Maybe it's a combination of all of that plus the specifically malformed NZBs you were trying? You could upload some sample NZBs here for sander to try if you want:

https://nzbcache.info/

[sander]

I would agree that it seems that the issue is not with SABnzbd and it's more likely related to OpenSSL, the USP or a combination of both. Could be I was the only person affected by this particular issue (system or ISP issue maybe?) in which case it'll be hard to replicate. The only thing that was weird to me was that the issue only started with 0.8.x releases and 0.7.x continued to work perfectly. That was the reason that I assumed the issue was related to SABnzbd but it seems I was wrong. I'll continue to monitor the situation and see if it repeats itself and try to provide more info if I can spot anything that seems relevant to the problem.

I tested with SAB 0.7.20 on Ubuntu 15.04, and do I get the CRC errors.

So I can NOT confirm what you're saying about 0.7.20 working OK

Code: Select all

2016-02-07 00:10:20,471::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,517::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,526::INFO::[decoder:121] CRC Error in [email protected] (1F6B390B -> A2880B87)
2016-02-07 00:10:20,530::INFO::[decoder:230] <Article: [email protected], bytes=259166, partnum=607, art_id=None> => missing from all servers, discarding
2016-02-07 00:10:20,556::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,598::INFO::[decoder:121] CRC Error in [email protected] (73454019 -> A641CFE9)
2016-02-07 00:10:20,599::INFO::[decoder:230] <Article: [email protected], bytes=259091, partnum=608, art_id=None> => missing from all servers, discarding
2016-02-07 00:10:20,677::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,816::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,880::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,888::INFO::[decoder:121] CRC Error in [email protected] (EC2D999E -> 165F83EB)
2016-02-07 00:10:20,889::INFO::[decoder:230] <Article: [email protected], bytes=259287, partnum=612, art_id=None> => missing from all servers, discarding
2016-02-07 00:10:20,967::DEBUG::[decoder:101] 

Code: Select all

sander@streamer1504:~/Downloads$ cat sabnzbd\ \(2\).log  | grep 02-07 |  grep -e "Starting sab" -e CRC | head
2016-02-07 00:07:11,677::INFO::[sabnzbdplus:1585] Starting sabnzbdplus-0.7.20
2016-02-07 00:07:50,457::INFO::[decoder:121] CRC Error in [email protected] (E5EF55CE -> 8726ABD6)
2016-02-07 00:07:51,478::INFO::[decoder:121] CRC Error in [email protected] (7B363549 -> E774B9F7)
2016-02-07 00:07:51,549::INFO::[decoder:121] CRC Error in [email protected] (E59B5C27 -> 2D56B55E)
2016-02-07 00:09:18,258::INFO::[decoder:121] CRC Error in [email protected] (86B45542 -> 5CA7D53C)
2016-02-07 00:09:18,627::INFO::[decoder:121] CRC Error in [email protected] (0B5230BA -> E46BA117)
2016-02-07 00:09:18,853::INFO::[decoder:121] CRC Error in [email protected] (14BC84ED -> A3B39926)
2016-02-07 00:09:19,016::INFO::[decoder:121] CRC Error in [email protected] (08B08BB8 -> 32FDB6ED)
2016-02-07 00:09:19,091::INFO::[decoder:121] CRC Error in [email protected] (D4DFA6AD -> 0BE4D41A)
2016-02-07 00:09:19,222::INFO::[decoder:121] CRC Error in [email protected] (9E822642 -> E0F7435B)

[sander]

@88keyz

Can you post your SAB logging lines with "CRC Error in" (assuming you have them)?

It could confirm my "$-sign" hypothesis.

[sander]

@shypike:

Is there a way to see a copy of each article retrieved? Is that the stuff in __ADMIN__ ? If so: are those the articles before or after decoding?

If so, we can inspect the articles (see if they are malformed) and compare them the same article retrieved from another newsserver.

Code: Select all

sander@streamer1504:~/git/sabnzbd/Downloads/incomplete/bucks/__ADMIN__$ ll
total 7596
drwxrwxr-x 2 sander sander   4096 feb  7 07:44 ./
drwxrwxr-x 3 sander sander   4096 feb  7 07:39 ../
-rw-rw-r-- 1 sander sander  14160 feb  7 07:38 bucks.nzb.gz
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article__4Ub_p
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_5tgfjQ
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_6b7E2R
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_8f5BiK
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_8J2A92
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_D811UQ
-rw------- 1 sander sander 249599 feb  7 07:39 SABnzbd_article_dMHiUm
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_dTCTyW
-rw------- 1 sander sander 249599 feb  7 07:39 SABnzbd_article_iZuUlr
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_JJBjQB
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_jJoQOE
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_kd74YP
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_kHUdmQ
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_LJsxq4
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_Mdt2Lp
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_N7kDmk
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_nmulyz
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_p0nZWV
-rw------- 1 sander sander 249600 feb  7 07:44 SABnzbd_article_pJzBNm
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_QBm3Nt
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_Qmuw51
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_ra4d34
-rw------- 1 sander sander 249600 feb  7 07:44 SABnzbd_article_rOwtg0
-rw------- 1 sander sander 249600 feb  7 07:44 SABnzbd_article_T7BO8d
-rw------- 1 sander sander 249599 feb  7 07:39 SABnzbd_article_Txjcxh
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article__uvwuX
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_w5EoUI
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_wN5Qhs
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_x1qoUw
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_yUV30i
-rw-rw-r-- 1 sander sander     27 feb  7 07:44 SABnzbd_attrib
-rw------- 1 sander sander  57989 feb  7 07:38 SABnzbd_nzf_GGXMc0
-rw------- 1 sander sander  28999 feb  7 07:38 SABnzbd_nzf_WExuf_
-rw------- 1 sander sander 156620 feb  7 07:44 SABnzbd_nzo_NDEyYk

[sander]

If useful in the future: I've enhanced decoder.py with writing the full article to disk.

However, a download from xsnews and eweka give exact the same CRC's, and the downloaded articles are the same.

No I would say it is not server dependent.

Code: Select all

sander@streamer1504:/tmp/sab-dump$ md5sum xsnews/'[email protected]'
34f014eda24d32170755257637c44e66  xsnews/[email protected]
sander@streamer1504:/tmp/sab-dump$ md5sum eweka/'[email protected]'
34f014eda24d32170755257637c44e66  eweka/[email protected]

Code: Select all

if lines:
                logme = None
                try:
                    if nzo.precheck:
                        raise BadYenc
                    register = True
                    logging.debug("Decoding %s", art_id)

                    logging.debug("SJ: article is %s", article)
                    #logging.debug("SJ: lines is %s", lines)
                    filenamearticle = "/tmp/sab-dump/" + art_id
                    logging.debug("SJ: filenamearticle is %s", filenamearticle)
		    text_file = open(filenamearticle, "w")
                    for item in lines[1:-1]:
		        text_file.write(item)
		    text_file.close()

                    data = decode(article, lines)
                    #logging.debug("SJ: after decode(), data is %s", data)
                    nzf.article_count += 1
                    found = True
                except IOError, e: