Downloads just stop and getting 'delaying' and 'undelaying'

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Downloads just stop and getting 'delaying' and 'undelaying'

Post by Matty666 »

Recently (over the last few days) SABNZBD seems to not download anymore and the logs are full of:

Code: Select all

2017-02-26 23:08:02,418::DEBUG::[downloader:281] Undelaying
2017-02-26 23:08:02,418::DEBUG::[downloader:276] Delaying
2017-02-26 23:08:02,450::DEBUG::[downloader:281] Undelaying
2017-02-26 23:08:02,450::DEBUG::[downloader:276] Delaying
2017-02-26 23:08:02,480::DEBUG::[downloader:281] Undelaying
2017-02-26 23:08:02,480::DEBUG::[downloader:276] Delaying
2017-02-26 23:08:02,513::DEBUG::[downloader:281] Undelaying
Not sure what's changed to cause this, it was happening with version 1.2.0 and I just updated to 1.2.1 and it's still happening.

If I restart sabnzbd (either from the web page or from the windows service control panel) then the downloads start up again for a short while then then tail off with the delaying in the logs.

Can someone point me in the right direction of what is causing this?

I'm running on windows, and the download and complete folder speeds are: 217.4 MB/s and 124.6 MB/s respectively.

Thanks!
User avatar
safihre
Administrator
Administrator
Posts: 5521
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by safihre »

What do you have set for memory?
This happens when the Decoder-Queue is full, so when the CPU cannot keep up.
Or, if Windows doesn't give enough CPU priority to the SAB service, this will also happen.

So can you try with 450M Article Cache and not run it as a service, but regularly?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by Matty666 »

Thanks for replying!

I have the cache memory set to 450M. Once it gets into this state it never seems to recover. I would have thought that if it was delaying for the decoder to catch up, it would eventually start again?

I switched to a different machine with a core i7 and lots of ram, so it shouldn't be struggling to keep up with the download rate, and it still happens. Even running it as the console app, rather than a windows service.

I do see a lot decoder CRC Errors in the logs... I've included an excerpt with one, although there are heaps of them.

The decoder seems to throw an error and then the whole thing stops.

Code: Select all

2017-02-27 18:02:57,687::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,798::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,910::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,917::INFO::[decoder:138] CRC Error in [email protected] (9161E3C5 -> 82FFF239)
2017-02-27 18:02:57,938::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:57,967::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,071::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,115::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,151::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,171::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,190::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,213::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,273::DEBUG::[decoder:108] Decoding [email protected]
2017-02-27 18:02:58,325::DEBUG::[decoder:108] Decoding [email protected]
Exception in thread Thread-8:
Traceback (most recent call last):
  File "threading.pyo", line 801, in __bootstrap_inner
  File "sabnzbd\decoder.pyo", line 137, in run
UnicodeDecodeError: 'utf8' codec can't decode byte 0xcc in position 2: invalid continuation byte

2017-02-27 18:02:58,404::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,459::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,520::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,582::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,608::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,628::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,680::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,882::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,921::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:58,986::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,062::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,186::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,200::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,204::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,223::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,309::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,351::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,588::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,591::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,594::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,615::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,641::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,651::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,664::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,687::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,924::DEBUG::[downloader:276] Delaying
2017-02-27 18:02:59,954::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:00,105::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:00,147::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:00,963::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:01,270::DEBUG::[downloader:276] Delaying
2017-02-27 18:03:02,275::DEBUG::[bpsmeter:268] bps: 2492318.20209
2017-02-27 18:03:07,280::DEBUG::[bpsmeter:268] bps: 1000605.9644
2017-02-27 18:03:12,288::DEBUG::[bpsmeter:268] bps: 401652.364431
2017-02-27 18:03:17,295::DEBUG::[bpsmeter:268] bps: 161226.91258
2017-02-27 18:03:22,302::DEBUG::[bpsmeter:268] bps: 64707.1924446
2017-02-27 18:03:27,309::DEBUG::[bpsmeter:268] bps: 25978.3843303
2017-02-27 18:03:32,316::DEBUG::[bpsmeter:268] bps: 10426.226536
2017-02-27 18:03:37,323::DEBUG::[bpsmeter:268] bps: 4185.18321563
2017-02-27 18:03:42,331::DEBUG::[bpsmeter:268] bps: 1679.97073168
2017-02-27 18:03:47,338::DEBUG::[bpsmeter:268] bps: 674.355532991
2017-02-27 18:03:52,345::DEBUG::[bpsmeter:268] bps: 270.692475043
2017-02-27 18:03:57,355::DEBUG::[bpsmeter:268] bps: 108.604155466
2017-02-27 18:04:02,361::DEBUG::[bpsmeter:268] bps: 43.5947067749
2017-02-27 18:04:07,368::DEBUG::[bpsmeter:268] bps: 17.5022281848
2017-02-27 18:04:12,375::DEBUG::[bpsmeter:268] bps: 7.0255543765
2017-02-27 18:04:17,381::DEBUG::[bpsmeter:268] bps: 2.82059173171
2017-02-27 18:04:22,388::DEBUG::[bpsmeter:268] bps: 1.1320228037
2017-02-27 18:04:27,394::DEBUG::[bpsmeter:268] bps: 0.454555720199
2017-02-27 18:04:32,405::DEBUG::[bpsmeter:268] bps: 0.182311025475
2017-02-27 18:04:37,413::DEBUG::[bpsmeter:268] bps: 0.0731813091756
2017-02-27 18:04:42,417::DEBUG::[bpsmeter:268] bps: 0.0293854363273
2017-02-27 18:04:47,424::DEBUG::[bpsmeter:268] bps: 0.0117975472244
User avatar
safihre
Administrator
Administrator
Posts: 5521
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by safihre »

This is very strange.
Can you try a different NZB? That's an error we've never seen before in the decoder.

Also, maybe you should actually try our new 2.0.0Alpha1. We changed some things in the decoder that should fix that.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by Matty666 »

You're right, it was a particular nzb and once I paused that one then restarted the server it's working fine now.
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by sander »

Matty666 wrote:You're right, it was a particular nzb and once I paused that one then restarted the server it's working fine now.
Can you share the NZB via dropbox / pastebin / google-drive?

Because as Safihre, I'm very surprised that a Unicode problem can occur in decoding an article.
(Problems with unicode in filenames does occur, but that is something else, I would say)
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by sander »

OK, thanks for the NZB.

It downloaded without problems on my SAB. So I can't reproduce your problem.
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by Matty666 »

That's strange... it was definitely a problem on two different windows installations.
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by sander »

Matty666 wrote:That's strange... it was definitely a problem on two different windows installations.
Strange indeed. There is just one resulting file, with plain ASCII characters. So no unicode characters.

Back to your problem: unicode in an article?! It could be a problem on your newsserver. I don't know why SAB stumbles over it.
User avatar
safihre
Administrator
Administrator
Posts: 5521
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by safihre »

It's specifically the CRC code in the footer of the articles that somehow is producing unicode.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by Matty666 »

Sorry to say that I went back to my original setup and I'm still getting the delaying problem. This is on different nzbs and there aren't any errors in the log. If I restart the service the downloads go at the normal rate for a short while then it just drops and never recovers.

Code: Select all

2017-02-28 21:33:38,431::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:38,479::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:38,494::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:38,542::INFO::[downloader:686] Connecting [email protected] finished
2017-02-28 21:33:41,213::DEBUG::[bpsmeter:268] bps: 1637452.00962
2017-02-28 21:33:43,104::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,134::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,197::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,213::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:43,244::DEBUG::[decoder:108] Decoding [email protected]
2017-02-28 21:33:46,229::DEBUG::[bpsmeter:268] bps: 2688586.75617
2017-02-28 21:33:50,085::DEBUG::[downloader:530] Downloader-slowdown: False
2017-02-28 21:33:51,239::DEBUG::[bpsmeter:268] bps: 2878364.454
2017-02-28 21:33:56,253::DEBUG::[bpsmeter:268] bps: 2752441.17407
2017-02-28 21:34:01,269::DEBUG::[bpsmeter:268] bps: 2953153.39204
2017-02-28 21:34:06,282::DEBUG::[bpsmeter:268] bps: 3009194.80242
2017-02-28 21:34:10,822::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:10,838::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,026::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,056::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,088::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,292::DEBUG::[bpsmeter:268] bps: 2869275.73384
2017-02-28 21:34:11,354::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,463::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:11,792::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:12,028::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:13,138::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:13,388::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:13,734::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,016::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,094::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,171::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,875::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:14,954::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:15,188::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,063::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,125::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,250::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:16,298::DEBUG::[bpsmeter:268] bps: 1800946.64947
2017-02-28 21:34:18,236::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:19,500::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:20,079::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:20,111::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:21,319::DEBUG::[bpsmeter:268] bps: 923440.285518
2017-02-28 21:34:21,413::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:22,334::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:23,256::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:24,052::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:26,822::DEBUG::[bpsmeter:268] bps: 390317.706323
2017-02-28 21:34:28,851::DEBUG::[downloader:276] Delaying
2017-02-28 21:34:31,851::DEBUG::[bpsmeter:268] bps: 161940.581022
2017-02-28 21:34:36,852::DEBUG::[bpsmeter:268] bps: 65058.6028827
2017-02-28 21:34:41,854::DEBUG::[bpsmeter:268] bps: 26141.2357697
2017-02-28 21:34:47,855::DEBUG::[bpsmeter:268] bps: 8753.18820823
2017-02-28 21:34:52,861::DEBUG::[bpsmeter:268] bps: 3513.61082976
2017-02-28 21:34:58,861::DEBUG::[bpsmeter:268] bps: 1176.70115773
2017-02-28 21:35:04,861::DEBUG::[bpsmeter:268] bps: 394.074836881
2017-02-28 21:35:09,864::DEBUG::[bpsmeter:268] bps: 158.317059421
2017-02-28 21:35:14,865::DEBUG::[bpsmeter:268] bps: 63.6134739718
2017-02-28 21:35:20,865::DEBUG::[bpsmeter:268] bps: 21.3040237228
2017-02-28 21:35:25,869::DEBUG::[bpsmeter:268] bps: 8.55447982104
2017-02-28 21:35:31,869::DEBUG::[bpsmeter:268] bps: 2.86487798362
2017-02-28 21:35:36,871::DEBUG::[bpsmeter:268] bps: 1.15113831996
2017-02-28 21:35:42,871::DEBUG::[bpsmeter:268] bps: 0.385513894233
2017-02-28 21:35:47,871::DEBUG::[bpsmeter:268] bps: 0.154903572402
it doesnt look like the cpu is struggling so i'm not sure why it recently has started struggling to keep up decoding.
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by Matty666 »

It does seem to be related to particular nzbs... i just paused the one that it is currently working on and restarted the service and now its completing the others ok.
User avatar
safihre
Administrator
Administrator
Posts: 5521
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by safihre »

I just got another user reporting a similar thing, same thing happening in his logs:
https://forums.sabnzbd.org/viewtopic.php?f=2&t=22470

I am not sure what is going on here......
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
safihre
Administrator
Administrator
Posts: 5521
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by safihre »

What is your Article Cache set to? Can you try with 400M?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
Matty666
Newbie
Newbie
Posts: 13
Joined: February 26th, 2017, 6:08 am

Re: Downloads just stop and getting 'delaying' and 'undelayi

Post by Matty666 »

Yeah my article cache is 450M. So the nzb came from nzb.su, I just switched to the same download but got the nzb from oznzb and it worked fine. I have another nzb that has stalled, again from nzb.su, I'm just trying what I think is the same nzb from oznzb to see if it succeeds.
Post Reply