Unexplainable memory usage

[lolbroek]

Hi there!

First let me say that sabnzbd is an awesome program which makes my nzb dreams come true
Downloading with sabnzbd *somehow* causes my computer to slowly eat up ram to the point of system halts.. The sabnzbd process acts normal according to task manager, memory and cpu usage normal.
Some baseline information:

Version:  0.4.9, 0.4.11, 0.4.12, 0.5A6
OS: Windows Vista Ultimate (x64) and now Windows 7 Ultimate (x64) copied my settings folder from %appdata% to the new pc, problem occured on both OS
Install-type: Windows Installer
Skin (if applicable): Plush
Antivirus Software: Eset NOD32 4.0.468.0
Firewall Software: COMODO firewall 3.12.111745.560
Are you using IPV6: I don't think so
Is the issue reproducible: yes
Memory cache limit: 120M
I access sabnzbd through the network and I use nzbdstatus in firefox (https://addons.mozilla.org/en-US/firefo ... 17?src=api)

I regulary get 'connection to server timed out' errors, but this might be to my isp's traffic shaping, which is driving me NUTS, I'm using ssl on port 995 but for some reason they still know and limit my download speed to 1/3 that of the advertised connection speed, downloading from the internet goes faster so they actually know its usenet, even though its encrypted  ??? Is there any way to circumvent this? I live in the Netherlands and I have UPC as isp.

If you need any more information please let me know, I've attached uploaded a .rar file to megaupload with screenshots of the resource manager and task manager for clarification in .PNG format. Download link: http://www.megaupload.com/?d=6CKHQ2PO
(on image 10b it's actually dual-core but it's cut off so you cant see that)

I already did a --clean command line parameter, so it might be something in the settings, but this should not happen Plus, I'd hate to manually input all my settings again..


I hope somebody could shed some light on this..

edit: shortly after this post the webinterface is showing some text and not making much sense, from both the localhost and from another pc in the network. However from yet another pc in the network I can still access the webinterface which tells me downloads are halted after downloading a mere 15GB (at a steady 700KB to 1MB /s, thanks to traffic shaping ). My remote desktop connection still holds but I cannot access the internet on the sabnzbd computer, ram usage still high.

[shypike]

Don't exactly recognize the memory issues, although there is a minor memory leak when parsing NZB files.
Shouldn't be an issue on your system unless you process a thousand NZB without ever restarting SABnzbd.

UPC is quite notorious. They probably know the IP addresses of the popular Usenet providers  >:(

In the restricted Alpha release of 0.5.0 there's a extra option to be more compatible with UPC
(and other oddball providers).
You need to sign-up as a Tester in the "Beta Releases" board.
After setting up 0.5.0, you  need to lookup this line in sabnzbd.ini

Code: Select all

ssl_type = v23

and change it to:

Code: Select all

ssl_type = v2

See also: http://forums.sabnzbd.org/index.php?topic=2323.0

[shypike]

I already did a --clean command line parameter, so it might be something in the settings, but this should not happen Plus, I'd hate to manually input all my settings again..

--clean doesn't remove your settings, only the queue/history/cache.

[lolbroek]

UPC is quite notorious. They probably know the IP addresses of the popular Usenet providers 

In the restricted Alpha release of 0.5.0 there's a extra option to be more compatible with UPC
(and other oddball providers).
You need to sign-up as a Tester in the "Beta Releases" board.
After setting up 0.5.0, you  need to lookup this line in sabnzbd.ini

Code: Select all

ssl_type = v23

and change it to:

Code: Select all

ssl_type = v2

See also: http://forums.sabnzbd.org/index.php?topic=2323.0

I already tried this but it didn't work for me

--clean doesn't remove your settings, only the queue/history/cache.

I know, could this be setting related? Does this classify as a memory leak? Could it be the antivirus doing something God I wish I was a programmer.

[shypike]

It's always a good idea to tell your virus scanner to keep away
from SABnzbd's download directories.
The cache and the incomplete are should not be scanned (the scanner will never find anything anyway).
It's OK to scan the final folder, although scanning ISO and VOB files is traumatic for some scanners.

I don't think this explains the memory usage.
You could try to temporarily disable the virus scanner and the software firewall.
If you have a hardware router you will be safe as long as you do not also surf the web.

BTW: you're not downloading over a WiFi connection are you?

[lolbroek]

It's always a good idea to tell your virus scanner to keep away
from SABnzbd's download directories.
The cache and the incomplete are should not be scanned (the scanner will never find anything anyway).
It's OK to scan the final folder, although scanning ISO and VOB files is traumatic for some scanners.

I don't think this explains the memory usage.
You could try to temporarily disable the virus scanner and the software firewall.
If you have a hardware router you will be safe as long as you do not also surf the web.

BTW: you're not downloading over a WiFi connection are you?

I excluded those folders from my antivirus and then completely disabled the firewall and antivirus software but the problem remains.

Ofcourse I'm not downloading over a wifi connection

[shypike]

Unless the problem is associated with specific NZB files, I'm out of options.
Several people on the team are using Win7-64 and are not reporting this kind of trouble.
So what can I say?

Are you downloading mostly 5G images or also high-def stuff in the 50G range?

[switch]

It's always a good idea to tell your virus scanner to keep away
from SABnzbd's download directories.
The cache and the incomplete are should not be scanned (the scanner will never find anything anyway).
It's OK to scan the final folder, although scanning ISO and VOB files is traumatic for some scanners.

I don't think this explains the memory usage.
You could try to temporarily disable the virus scanner and the software firewall.
If you have a hardware router you will be safe as long as you do not also surf the web.

BTW: you're not downloading over a WiFi connection are you?

I excluded those folders from my antivirus and then completely disabled the firewall and antivirus software but the problem remains.

Ofcourse I'm not downloading over a wifi connection

'Disabling' firewalls or antivirus does not actually disable them. They need to be uninstalled completely and your computer restarted for any testing to prove useful.

Unless the problem is associated with specific NZB files, I'm out of options.
Several people on the team are using Win7-64 and are not reporting this kind of trouble.
So what can I say?

Are you downloading mostly 5G images or also high-def stuff in the 50G range?

I am not sure if you know this already, but the issue is not with SABnzbd increasing in RAM, but in overall system ram increasing.

Personally I cannot think of what this could be. I would try disabling the article cache altogether (set to 0) or maybe compare the following output from command line 1 minute after downloading, then 15 minutes after:

Code: Select all

netstat -n > c:\connection_log.txt

And see if there is a significant increase in connections.