100% CPU usage on NAS while doing nothing + slow downloads

[StitchX]

Hi all,

I'm new to this forum, and i registered since i'm experiencing some bugs with sabnzbd. Hopefully we can figure out what is wrong and how to fix it. First let me describe the problem, then ill post as much relevant information as i can.

Sabnzbd is installed on a NAS, using a package. Installation is all smooth. The problem started after some downloading. Now Sabnzbd uses 100% CPU even when there is nothing downloading at all(even on pause). Also if it is downloading something, downloads are very slow; it used to be about 1.4 megs / sec; now its getting 50 to 300 kb/sec. It should be about 2.5 megs / second... yet 1.5 megs is also acceptable. The web interface is incredibly slow; not confirming that settings are saved.

So, lets solve this. Below are all specs i got, maybe a lot but hopefully some common flaws appear. Upgrading to 4.12 or 5.0 is not an option right now since the package is maintained externally and is specific.


Here are all specs i've got:

NAS:
QNAP ts 410, 800 mhz cpu, 256 meg ram, gbit ethernet

Usenet provider / internet:
25 mbit, usenet account 20 mbit. Downloading in my laptop means 2.5 megs per second.

Python:
Python 2.5.2 (r252:60911, Feb 26 2008, 18:35:46)
[GCC 3.4.4 (release) (CodeSourcery ARM 2005q3-2)] on linux2

Sabnzbd:
SABnzbd+ 0.4.11
Download Dir: 1461.82 GB - Complete Dir: 1461.82 GB - Download speed: 81.23 KB/s - Queued: 739565.80/754770.92 MB
284 articles buffered in 108912000 bytes
New release 0.4.12 available at SF.net
WARNINGS(20)!
Last warnings (clear)

2009-12-07 08:45:34,151 WARNING [downloader] Thread [email protected]:563: timed out
2009-12-07 08:45:34,159 WARNING [downloader] Thread [email protected]:563: timed out
2009-12-07 08:45:34,166 WARNING [downloader] Thread [email protected]:563: timed out

system status with TOP:
Mem: 253104K used, 2588K free, 0K shrd, 36136K buff, 10200K cached
Load average: 4.94, 4.26, 3.57    (State: S=sleeping R=running, W=waiting)

  PID USER    STATUS  RSS  PPID %CPU %MEM COMMAND
3251 admin    S      165M    1 92.7 66.3 SABnzbd.py
  459 admin    SW<        0    2  1.1  0.0 md9_raid1
5970 admin    S        936  5967  1.0  0.3 top
  498 admin    SW<        0    2  0.8  0.0 md13_raid1
  63 admin    SW<        0    2  0.8  0.0 kswapd0
5583 admin    DW        0    2  0.8  0.0 pdflush
5946 admin    R        976  4050  0.6  0.3 top
5967 admin    S      1220  1386  0.5  0.4 manaRequest.cgi

sabnzbd qnap Package forum:
http://forum.qnap.com/viewforum.php?f=133


Sabnzbd config:
[~] # cat /root/.sabnzbd/sabnzbd.ini
__version__ = 18
[misc]
log_dir = /share/Qdownload/sabnzbd/logs
auto_browser = 0
permissions = 0777
check_new_rel = 1
replace_spaces = 1
fail_on_crc = 0
enable_filejoin = 1
enable_unzip = 1
enable_unrar = 1
enable_par_cleanup = 1
par_option = ""
config_lock = 0
safe_postproc = 0
pause_on_post_processing = 0
cleanup_list = ,
ignore_samples = 0
send_group = 0
download_dir = /share/Qdownload/sabnzbd/incomplete
download_free = 3G
complete_dir = /share/Qdownload/sabnzbd/complete
script_dir = ""
nzb_backup_dir = /share/Qdownload/sabnzbd/nzb/backup
cache_dir = /share/Qdownload/sabnzbd/cache
dirscan_dir = /share/Qdownload/sabnzbd/nzb
dirscan_speed = 120
refresh_rate = 0
rss_rate = 120
bandwith_limit = 0
cache_limit = 104M
email_server = smtp.gmail.com:587
email_to = [email protected]
email_from = [email protected]
email_account = [email protected]
email_pwd =
email_endjob = 1
email_full = 0
schedlines = ,
dirscan_opts = 3
dirscan_script = ""
top_only = 1
auto_sort = 0
enable_tv_sorting = 1
tv_sort_string = %sn/Season %s/%sn - S%0sE%0e - %en.%ext
web_color = darkblue
web_color2 = ""
host = 0.0.0.0
port = 8800
web_dir = Default
web_dir2 = ""
username = admin
password =
api_key = 762acbfb6cfc43a6025d8cdc58dd135d
disable_api_key = 0
replace_illegal = 1
auto_disconnect = 1
enable_par_multicore = 1
no_dupes = 0
ionice = ""
[logging]
enable_cherrypy_logging = 1
log_level = 0
max_log_size = 5M
log_backups = 5
[newzbin]
username = TheStitch
password =
bookmarks = 0
unbookmark = 0
bookmark_rate = 60
[servers]
[[news.tweaknews.nl:563]]
host = news.tweaknews.nl
port = 563
username = stitch
password =
connections = 8
timeout = 120
fillserver = 0
ssl = 1
[rss]
[[newzbin OSX apps]]
uri = http://www.newzbin.com/browse/category/ ... &fauth=%3D
cat = apps
pp = 3
script = None
enable = 1
filter0 = "", "", "", A, *
[[newzbin Promo Only]]
uri = http://www.newzbin.com/search/query/?q= ... &fauth=%3D
cat = music
pp = 3
script = None
enable = 1
filter0 = "", "", "", A, *
[["House Music, Latest Releases"]]
uri = http://www.newzbin.com/search/query/?q= ... &fauth=%3D
cat = music
pp = 3
script = None
enable = 1
filter0 = "", "", "", A, *
[[Dutch Dance Top 30]]
uri = http://www.newzbin.com/search/query/?q= ... &fauth=%3D
cat = music
pp = 3
script = None
enable = 1
filter0 = "", "", "", A, *
[[a.b.m.jungle]]
uri = http://nzbindex.nl/rss/alt.binaries.mus ... 000&more=1
cat = ""
pp = ""
script = ""
enable = 0
filter0 = "", "", "", A, *
[categories]
[[unknown]]
newzbin = Unknown
dir = Unknown
[[anime]]
newzbin = Anime
dir = Anime
[[apps]]
newzbin = Apps
dir = Apps
[[books]]
newzbin = Books
dir = Books
[[consoles]]
newzbin = Consoles
dir = Consoles
[[emulation]]
newzbin = Emulation
dir = Emulation
[[games]]
newzbin = Games
dir = Games
[[movies]]
newzbin = Movies
dir = Movies
[[music]]
newzbin = Music
dir = Music
[[pda]]
newzbin = PDA
dir = PDA
[[resources]]
newzbin = Resources
dir = Resources
[[tv]]
newzbin = TV
dir = TV
[[d&b]]
pp = 3
dir = dnb
newzbin = dnb,

[shypike]

You can try to startup with the --clean command line option
or remove all files in the "cache" folder.
It could be a case of queue corruption.

Other than that: we know nothing of the packages created by other people.
Ask the package creator first.

We have seen reports from people having a working SABnzbd
on QNap systems.

[StitchX]

...

I logged in this morning and the cpu usage was down to normal. I also suspect it is some crap with the queue. However; problems are not yet solved:

Sabnzbd.py uses as much ram as it can eat. I don't like this since my machine is now swapping like crazy. Is this also the queue handling? Can i limit sabnzbd to 128 megs or something? Why does it eat so much ram in the first place?

[shypike]

Can i limit sabnzbd to 128 megs or something? Why does it eat so much ram in the first place?

Because the language (Python) it's written in uses quite some memory.
It needs to keep a large amount of information in memory,
especially when a large number of NZB files are in the queue.
In general we recommend 256MB memory for a system as an absolute minimun,
and even then it's hard.
We are working on reducing memory usage, but it's slow going.
Release 0.5.0 should already give an improvement.

[StitchX]

Hopefully it will. Im not ready yet to move to nzbget, so here are some ideas:
Could NZBget be something to speed things up for sabnzbd; it does the same only a little bit simpler in C.
Would the usage of a database (file) with post information speed things up?

[StitchX]

I've found the problem: the connections are stuck. Force disconnect doesn't work. Is there a way to show this to you guys? It would be nice this works in a new version on the NAS. Lemme know!

[shypike]

We cannot support NAS systems.
There too many of them and no one of the team has one anyway.
Plus they're almost impossible to debug, because of limited capacity
and lack of debugging tools.
Have you checked the forums supporting this particular NAS?

[StitchX]

Have you checked the forums supporting this particular NAS?

Yes, but support is pretty poor. I know where the problem is located, so now they've gotta fix it.

Hopefully the 0.5 release is good enough; but switching to nzbget would likely make some sense due to its built for NAS systems.

Thanks for this support, consider it closed