Page 1 of 2
Downloads just stop and getting 'delaying' and 'undelaying'
Posted: February 26th, 2017, 7:18 am
by Matty666
Recently (over the last few days) SABNZBD seems to not download anymore and the logs are full of:
Code: Select all
2017-02-26 23:08:02,418::DEBUG::[downloader:281] Undelaying
2017-02-26 23:08:02,418::DEBUG::[downloader:276] Delaying
2017-02-26 23:08:02,450::DEBUG::[downloader:281] Undelaying
2017-02-26 23:08:02,450::DEBUG::[downloader:276] Delaying
2017-02-26 23:08:02,480::DEBUG::[downloader:281] Undelaying
2017-02-26 23:08:02,480::DEBUG::[downloader:276] Delaying
2017-02-26 23:08:02,513::DEBUG::[downloader:281] Undelaying
Not sure what's changed to cause this, it was happening with version 1.2.0 and I just updated to 1.2.1 and it's still happening.
If I restart sabnzbd (either from the web page or from the windows service control panel) then the downloads start up again for a short while then then tail off with the delaying in the logs.
Can someone point me in the right direction of what is causing this?
I'm running on windows, and the download and complete folder speeds are: 217.4 MB/s and 124.6 MB/s respectively.
Thanks!
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 26th, 2017, 7:22 am
by safihre
What do you have set for memory?
This happens when the Decoder-Queue is full, so when the CPU cannot keep up.
Or, if Windows doesn't give enough CPU priority to the SAB service, this will also happen.
So can you try with 450M Article Cache and not run it as a service, but regularly?
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 3:18 am
by Matty666
Thanks for replying!
I have the cache memory set to 450M. Once it gets into this state it never seems to recover. I would have thought that if it was delaying for the decoder to catch up, it would eventually start again?
I switched to a different machine with a core i7 and lots of ram, so it shouldn't be struggling to keep up with the download rate, and it still happens. Even running it as the console app, rather than a windows service.
I do see a lot decoder CRC Errors in the logs... I've included an excerpt with one, although there are heaps of them.
The decoder seems to throw an error and then the whole thing stops.
Code: Select all
2017-02-27 18:02:57,687::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,798::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,910::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,917::INFO::[decoder:138] CRC Error in [email protected] (9161E3C5 -> 82FFF239)
2017-02-27 18:02:57,938::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,967::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,071::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,115::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,151::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,171::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,190::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,213::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,273::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,325::DEBUG::[decoder:108] Decoding [email protected]
Exception in thread Thread-8:
Traceback (most recent call last):
File "threading.pyo", line 801, in __bootstrap_inner
File "sabnzbd\decoder.pyo", line 137, in run
UnicodeDecodeError: 'utf8' codec can't decode byte 0xcc in position 2: invalid continuation byte
2017-02-27 18:02:58,404::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,459::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,520::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,582::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,608::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,628::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,680::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,882::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,921::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,986::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,062::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,186::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,200::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,204::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,223::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,309::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,351::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,588::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,591::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,594::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,615::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,641::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,651::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,664::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,687::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,924::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,954::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:00,105::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:00,147::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:00,963::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:01,270::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:02,275::DEBUG::[bpsmeter:268] bps: 2492318.20209
2017-02-27 18:03:07,280::DEBUG::[bpsmeter:268] bps: 1000605.9644
2017-02-27 18:03:12,288::DEBUG::[bpsmeter:268] bps: 401652.364431
2017-02-27 18:03:17,295::DEBUG::[bpsmeter:268] bps: 161226.91258
2017-02-27 18:03:22,302::DEBUG::[bpsmeter:268] bps: 64707.1924446
2017-02-27 18:03:27,309::DEBUG::[bpsmeter:268] bps: 25978.3843303
2017-02-27 18:03:32,316::DEBUG::[bpsmeter:268] bps: 10426.226536
2017-02-27 18:03:37,323::DEBUG::[bpsmeter:268] bps: 4185.18321563
2017-02-27 18:03:42,331::DEBUG::[bpsmeter:268] bps: 1679.97073168
2017-02-27 18:03:47,338::DEBUG::[bpsmeter:268] bps: 674.355532991
2017-02-27 18:03:52,345::DEBUG::[bpsmeter:268] bps: 270.692475043
2017-02-27 18:03:57,355::DEBUG::[bpsmeter:268] bps: 108.604155466
2017-02-27 18:04:02,361::DEBUG::[bpsmeter:268] bps: 43.5947067749
2017-02-27 18:04:07,368::DEBUG::[bpsmeter:268] bps: 17.5022281848
2017-02-27 18:04:12,375::DEBUG::[bpsmeter:268] bps: 7.0255543765
2017-02-27 18:04:17,381::DEBUG::[bpsmeter:268] bps: 2.82059173171
2017-02-27 18:04:22,388::DEBUG::[bpsmeter:268] bps: 1.1320228037
2017-02-27 18:04:27,394::DEBUG::[bpsmeter:268] bps: 0.454555720199
2017-02-27 18:04:32,405::DEBUG::[bpsmeter:268] bps: 0.182311025475
2017-02-27 18:04:37,413::DEBUG::[bpsmeter:268] bps: 0.0731813091756
2017-02-27 18:04:42,417::DEBUG::[bpsmeter:268] bps: 0.0293854363273
2017-02-27 18:04:47,424::DEBUG::[bpsmeter:268] bps: 0.0117975472244
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 3:30 am
by safihre
This is very strange.
Can you try a different NZB? That's an error we've never seen before in the decoder.
Also, maybe you should actually try our new 2.0.0Alpha1. We changed some things in the decoder that should fix that.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 3:18 pm
by Matty666
You're right, it was a particular nzb and once I paused that one then restarted the server it's working fine now.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 3:20 pm
by sander
Matty666 wrote:You're right, it was a particular nzb and once I paused that one then restarted the server it's working fine now.
Can you share the NZB via dropbox / pastebin / google-drive?
Because as Safihre, I'm very surprised that a Unicode problem can occur in decoding an article.
(Problems with unicode in filenames does occur, but that is something else, I would say)
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 5:22 pm
by sander
OK, thanks for the NZB.
It downloaded without problems on my SAB. So I can't reproduce your problem.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 5:26 pm
by Matty666
That's strange... it was definitely a problem on two different windows installations.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 27th, 2017, 5:56 pm
by sander
Matty666 wrote:That's strange... it was definitely a problem on two different windows installations.
Strange indeed. There is just one resulting file, with plain ASCII characters. So no unicode characters.
Back to your problem: unicode in an article?! It could be a problem on your newsserver. I don't know why SAB stumbles over it.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 28th, 2017, 4:27 am
by safihre
It's specifically the CRC code in the footer of the articles that somehow is producing unicode.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 28th, 2017, 5:51 am
by Matty666
Sorry to say that I went back to my original setup and I'm still getting the delaying problem. This is on different nzbs and there aren't any errors in the log. If I restart the service the downloads go at the normal rate for a short while then it just drops and never recovers.
Code: Select all
2017-02-28 21:33:38,431::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:38,479::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:38,494::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:38,542::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:41,213::DEBUG::[bpsmeter:268] bps: 1637452.00962
2017-02-28 21:33:43,104::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,134::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,197::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,213::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,244::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:46,229::DEBUG::[bpsmeter:268] bps: 2688586.75617
2017-02-28 21:33:50,085::DEBUG::[downloader:530] Downloader-slowdown: False
2017-02-28 21:33:51,239::DEBUG::[bpsmeter:268] bps: 2878364.454
2017-02-28 21:33:56,253::DEBUG::[bpsmeter:268] bps: 2752441.17407
2017-02-28 21:34:01,269::DEBUG::[bpsmeter:268] bps: 2953153.39204
2017-02-28 21:34:06,282::DEBUG::[bpsmeter:268] bps: 3009194.80242
2017-02-28 21:34:10,822::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:10,838::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,026::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,056::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,088::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,292::DEBUG::[bpsmeter:268] bps: 2869275.73384
2017-02-28 21:34:11,354::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,463::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,792::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:12,028::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:13,138::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:13,388::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:13,734::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,016::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,094::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,171::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,875::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,954::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:15,188::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,063::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,125::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,250::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,298::DEBUG::[bpsmeter:268] bps: 1800946.64947
2017-02-28 21:34:18,236::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:19,500::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:20,079::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:20,111::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:21,319::DEBUG::[bpsmeter:268] bps: 923440.285518
2017-02-28 21:34:21,413::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:22,334::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:23,256::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:24,052::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:26,822::DEBUG::[bpsmeter:268] bps: 390317.706323
2017-02-28 21:34:28,851::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:31,851::DEBUG::[bpsmeter:268] bps: 161940.581022
2017-02-28 21:34:36,852::DEBUG::[bpsmeter:268] bps: 65058.6028827
2017-02-28 21:34:41,854::DEBUG::[bpsmeter:268] bps: 26141.2357697
2017-02-28 21:34:47,855::DEBUG::[bpsmeter:268] bps: 8753.18820823
2017-02-28 21:34:52,861::DEBUG::[bpsmeter:268] bps: 3513.61082976
2017-02-28 21:34:58,861::DEBUG::[bpsmeter:268] bps: 1176.70115773
2017-02-28 21:35:04,861::DEBUG::[bpsmeter:268] bps: 394.074836881
2017-02-28 21:35:09,864::DEBUG::[bpsmeter:268] bps: 158.317059421
2017-02-28 21:35:14,865::DEBUG::[bpsmeter:268] bps: 63.6134739718
2017-02-28 21:35:20,865::DEBUG::[bpsmeter:268] bps: 21.3040237228
2017-02-28 21:35:25,869::DEBUG::[bpsmeter:268] bps: 8.55447982104
2017-02-28 21:35:31,869::DEBUG::[bpsmeter:268] bps: 2.86487798362
2017-02-28 21:35:36,871::DEBUG::[bpsmeter:268] bps: 1.15113831996
2017-02-28 21:35:42,871::DEBUG::[bpsmeter:268] bps: 0.385513894233
2017-02-28 21:35:47,871::DEBUG::[bpsmeter:268] bps: 0.154903572402
it doesnt look like the cpu is struggling so i'm not sure why it recently has started struggling to keep up decoding.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 28th, 2017, 6:13 am
by Matty666
It does seem to be related to particular nzbs... i just paused the one that it is currently working on and restarted the service and now its completing the others ok.
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 28th, 2017, 7:55 am
by safihre
I just got another user reporting a similar thing, same thing happening in his logs:
https://forums.sabnzbd.org/viewtopic.php?f=2&t=22470
I am not sure what is going on here......
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 28th, 2017, 8:21 am
by safihre
What is your Article Cache set to? Can you try with 400M?
Re: Downloads just stop and getting 'delaying' and 'undelayi
Posted: February 28th, 2017, 3:54 pm
by Matty666
Yeah my article cache is 450M. So the nzb came from nzb.su, I just switched to the same download but got the nzb from oznzb and it worked fine. I have another nzb that has stalled, again from nzb.su, I'm just trying what I think is the same nzb from oznzb to see if it succeeds.