Large downloads drop to 0.kbs after a few minutes

[far972]

This is a very strange problem, as things worked great for about a week with the same version of the beta.

Whenever I add a nzb, regardless of how I add it, manually, couch potato, bookmark, etc...  the download starts off at max speed, about 7.0 MB/s, but then quickly drops to 0.

This happens for four different servers I have defined, two normal, two SSL.

I have reinstalled the beta two times, once with the default profile, and once with a brand new profile and the problem still exists.

My servers and bandwidth are fine as I can grab the nzb with another client and the download completes as expected at max speed, with the same servers.

Things that seem to work...

1) smaller downloads, anything under 2G
2) auto nzb adds from couch potato or sickbeard, usually happens overnight when I am asleep. (I cannot be certain that this is true 100% of the time as there have only been a few large downloads queued up overnight)

I have checked the logs, and see no errors of any kind.

I'm willing to test anything, or post additional information as needed.

[shypike]

On what kind of system?
OS? Memory? CPU?
How much in the queue?
Size above which it is noticeably slower?

[far972]

On what kind of system?
OS? Memory? CPU?

Win 7 Ultimate x64
Intel Core Duo E8500 3.17GHz
4GB RAM

How much in the queue?

Doesn't seem to matter, 1 file or many.

Size above which it is noticeably slower?

Seems to be anything over 1.5GB, that is just an estimate.  I'll run a few tests and reply back with better numbers.

Another thing I noticed, is that the number of connections during this time is really low, like 4 or 5, where I have it set at 20.  Not sure if this helps...

[far972]

Did some testing, I apologize in advance if this is too much information...  but I'm bored right now and figured I'd try to get to the bottom of this.


Speed/Hang test

9 items in queue

1st item is 9GB
Items 2-9 are 400MB or less

Item 1 is stuck at with less than 100mb left

Items 2-9, although set to active, will not initiate download.

Snippet from the logs at the time of the hang

Code: Select all

2011-03-12 14:46:45,148::DEBUG::[decoder:92] Decoding <Article: [email protected], bytes=398658, partnum=39, art_id=None>

2011-03-12 14:46:45,197::INFO::[downloader:607] Thread 29@my_server:119: server closed connection

2011-03-12 14:46:45,201::INFO::[downloader:607] Thread [email protected]_server:563: server closed connection

This repeats over and over for several hundred lines...


Paused queue item 1
Queue items 2-7 resume on their own and complete

I pause all items left in the queue to perform a test (3 total items in queue at this point)...

Check Status

Code: Select all

Latest Warnings Tab
0 Warnings
0 Cached Articles
0 Errors

Connections Tab

Code: Select all

Server: secure.my_server:563
Status: Enabled
# Connections: timed out

Server: my_server
Status: Enabled
# Connections: 0

Back to Downloads page

Resume item 1, the 9gb item
Download starts at 2.4MBs, decreases to 300 KB/s within a minute

Status-Conenctions Tab

Code: Select all

Server: secure.my_server:563

Status: Enabled

# Connections: 3

Article identifier	filename	File set
[email protected]	r15
[email protected]	sample
[email protected]	r07
[email protected]  sample
[email protected]	r16


Server: my_server

Status: Enabled

# Connections: 2

Article identifier	filename	File set
[email protected]	file.r03
[email protected]	file.r01
[email protected]	file.r04
[email protected]	file.r02
[email protected]	file.r06
[email protected]	file.r09

Check back on Download page, now there is one file left in the set, 15MB

Speed has dropped to 2 KB/s

Resume queue items 2 and 3 (originally 8 and 9)
Download speed increases to 500kbs, then starts dropping
300kbs
Increases to 1MB/s
Queue item 3 completes
Queue items 1 and 2 get stuck at 99% complete, speed now at 2KB/s

Status-Connections Tab

Code: Select all

Server: secure.my_server:563

Status: Enabled

# Connections: 1

Article identifier	filename	File set
[email protected]	file.r02
[email protected]	file.r04
[email protected]	file.r09


Server: my_server

Status: Enabled

# Connections: 3

Article identifier	filename	File set
[email protected]	file.r01
[email protected]	filer.05
[email protected]	file.r06
[email protected]	file.r05
[email protected]	file.r07
[email protected]	file.r03
[email protected]	file.r11
[email protected]	file.r21

Pause queue item 1
Restart SabNZBd
Item 2 still stuck

[shypike]

Are you using multiple servers?

[far972]

I have 4 servers set up total, during this test I had two enabled... the same provider but one SSL and one regular.

[far972]

I should mention, that this problem seems to exist with any combination of servers I have enabled....

2 different providers, SSL and regular connections for each.  I added the non-SSL servers in recently to test things.

[shypike]

SABnzbd doesn't react very well when one of the servers refuses to respond.
Any missing article will cause it to retry forever on the last server that
refuses to answer.
For this there's the "optional" setting, so an off-line server will be ignored for some time
allowing the download to continue.

What happens if you just use one enabled server?