Reducing number of connections

[ErikBrown]

Version: 0.5.2 final
OS: Windows XP pro SP3
Install-type: Windows Installer
Skin (if applicable): SMPL black
Firewall Software: none
Are you using IPV6? No
Is the issue reproducible? Yes

If the server reports that SABnzbd is using too many connections, then SABnzbd is correctly reducing the number of the connections. But with 0.5.2 final (and I think also before with the 0.5.2 beta) I see often that SABnzbd keeps the number of connections at this lowered value. It does not increase it back to the default value set in the configuration. To solve this, I use the restart option.

See the sample below where SABnzbd correctly reduced the number of connections from my default of 4 to 2 but it kept it on 2 till I restarted several hours later.

2010-05-09 01:28:16,221::ERROR::[downloader:595] Too many connections to server ssl.hitnews.eu:995
2010-05-09 01:28:16,352::ERROR::[downloader:595] Too many connections to server ssl.hitnews.eu:995
2010-05-09 23:15:29,112::INFO::[_cplogging:55] [09/May/2010:23:15:29] ENGINE Bus STOPPING

Erik

[Marcel]

Same here.



Version: 0.5.2 final
OS: Win 7 64bits
Install-type: Windows Installer
Skin: Plush.
Firewall Software: Win 7 firewall
Are you using IPV6? - IPV4
Is the issue reproducible? Yes

[shypike]

We are investigating this issue, but so far are unable to reproduce it.
As a work-around you can set some disable and enable events for your server in the scheduler.

[shypike]

Please set logging level to "Debug".
Afterwards you should see these messages in the log file.

Set planned server resume SERVERNAME in 10 mins

and about 10 minutes later

Trigger planned server resume SERVERNAME

There will be multiple messages (a pair for each superfluous connection).
It would be an issue if the "Trigger" messages are missing.

[Marcel]

Ok. I'll try.

What I did to reduce the problem was to set max connections allowed to my server a bit lower. In my case I'm using 19/20.
cya

[ErikBrown]

Dear Shypike,

I will set the debug logging level and inform you if I see the missing Trigger line.

Regards,
Erik

[Marcel]

Hi Shypike,

The error continues. No entry in log.

ty

[shypike]

Both messages are missing?
You did set level "Debug"?

[Marcel]

Yep

I set Logging "+ Debug"

I took a look on both logs:  Warnings and "Show logging"

I'll  try re-instal it.


Ty.

[ErikBrown]

I also had the error occurring twice without information shown about it in the log. The logging was set to debug and that caused the log to show info only for about 3 hours. Since the error occurred more than 3 hours before I noticed it, there was no information anymore.

Is there a way to extend the logfile size?

Erik

[Marcel]

Fresh install. Same error.

TIP: No need to restart Sabnzbd+ jut go to SERVERS tab and click "Save changes". It's a faster way to resume.

I'll try a previous version.

[shypike]

The log has a rotating system of 5 files.
sabnzbd.log is always the active one.
You can find the others files in the log folder (See Config->Folders).

My first thought was that the scheduler doesn't work properly.
However if you say that you also don't see the "Set planned server resume"
messages, then it must be something else.
I must analyse the code to see if there are alternative paths to get the
message "too many connections" without scheduling a server reset.

A work around is to set some server disable/enable events in the scheduler.
What also helps that you just lower the amount of connections.
Most of the time having very many connections will slow down rather than speed up.

Nevertheless, the behaviour of SABnzbd is very suspect here.

[ErikBrown]

Dear shypike,

The logfile indeed showed the line:

Set planned server resume SERVERNAME in 10 mins

but not the line:

Trigger planned server resume SERVERNAME

I have emailed the log to you on shypike  at  users.sourceforge.net.

See below some of the relevant lines in the log:

2010-05-14 06:05:05,233::ERROR::[downloader:595] Too many connections to server ssl.hitnews.eu:995
2010-05-14 06:05:05,334::DEBUG::[downloader:778] Set planned server resume ssl.hitnews.eu:995 in 10 mins
2010-05-14 06:05:05,375::DEBUG::[downloader:588] Server login problem: 400, 400 ssl.hitnews.eu: No more free connections for this user  - support(at)support.hitnews.eu
2010-05-14 06:05:05,384::ERROR::[downloader:595] Too many connections to server ssl.hitnews.eu:995
2010-05-14 06:05:05,484::DEBUG::[downloader:778] Set planned server resume ssl.hitnews.eu:995 in 10 mins

Regards,
ErikBrown

[shypike]

Very strange indeed.
Testing and code review has revealed no problems.
Maybe our third-party scheduling module fails sometimes (never seen that before).
I'm working on a sanity check that will be added to the periodic internal consistency check.
This should re-evaluate the server when a timer is missed.

When we have a pre-release ready for testing, I'll contact you.

[Marcel]

Hi Shypike,


News to you.

I forced a connection limit error with another app. My sever gives me 20 connections so I opened 10 in another one and started sabnzbd+ here are the results....


Multiply x 10.
2010-05-16 23:48:15,913::DEBUG::[downloader:588] Server login problem: 502, 502 Your per-user connection limit reached
2010-05-16 23:48:15,914::ERROR::[downloader:595] Too many connections to server us.news.astraweb.com:119
2010-05-16 23:48:16,013::DEBUG::[downloader:778] Set planned server resume us.news.astraweb.com:119 in 10 mins


I waited 10 min and checked the log

Multiply x 10.
2010-05-16 23:58:16,315::DEBUG::[downloader:788] Trigger planned server resume us.news.astraweb.com:119


It's now 00:13 and just the first 10 connections are downloading.
None of them restarted.


Ty Shypike,