Crashes & Errors

[reticent]

Hey Guys,

I've run sabnzbd under windows on my fileserver for years and it was rock solid. I recently built a new Linux file server / NAS and put ubuntu 11.03 on it. I have all sorts of problems with it, it frequently crashes (daily) and I often get these error messages:

2011-08-15 15:48:13,987 ERROR: Saving /home/userX/.sabnzbd/admin/totals9.sab failed
2011-08-15 16:00:29,846 ERROR: SQL Command Failed, see log

There are also RSS saving issues as well, I dont have the error on hand but it's similar to the first one I posted. It's usually just a matter of restarting sab and it goes away for a while. It's not permission errors as they are set correctly.

I'm wondering, should I compile my own copy of Sab rather than using these packages. Are they less reliable? FYI, I'm running version 0.6.8

Cheers

[reticent]

I got this one too, which I get occasionally. Tried added a new NZB via URL:

Traceback (most recent call last):
File "/usr/share/sabnzbdplus/cherrypy/_cprequest.py", line 618, in respond
cherrypy.response.body = self.handler()
File "/usr/share/sabnzbdplus/cherrypy/_cpdispatch.py", line 25, in __call__
return self.callable(*self.args, **self.kwargs)
File "/usr/share/sabnzbdplus/sabnzbd/interface.py", line 320, in addID
raise self.add_handler(kwargs)
File "/usr/share/sabnzbdplus/sabnzbd/interface.py", line 310, in add_handler
sabnzbd.add_url(id, pp, script, cat, priority, nzbname)
File "/usr/share/sabnzbdplus/sabnzbd/__init__.py", line 448, in add_url
future_nzo = NzbQueue.do.generate_future(msg, pp, script, cat, url=url, priority=priority, nzbname=nzbname)
File "/usr/share/sabnzbdplus/sabnzbd/decorators.py", line 31, in newFunction
return f(*args, **kw)
File "/usr/share/sabnzbdplus/sabnzbd/nzbqueue.py", line 191, in generate_future
self.add(future_nzo)
File "/usr/share/sabnzbdplus/sabnzbd/decorators.py", line 31, in newFunction
return f(*args, **kw)
File "/usr/share/sabnzbdplus/sabnzbd/nzbqueue.py", line 282, in add
nzo.nzo_id = sabnzbd.get_new_id('nzo', nzo.workpath, self.__nzo_table)
File "/usr/share/sabnzbdplus/sabnzbd/decorators.py", line 31, in newFunction
return f(*args, **kw)
File "/usr/share/sabnzbdplus/sabnzbd/__init__.py", line 762, in get_new_id
raise IOError
IOError

[jcfp]

All these errors seem related to I/O operations. Are you sure the hardware is healthy, especially the hard drive? Also try debug logging, that might give us some more information for the errors in your first post.

[reticent]

I guess to answer your question from a technical perspective, I don't know if the hardware is healthy or not. In saying that, the files are being written to the system disk which the OS lives on. Assumedly if there were disk problems it wouldn't just be one app on the host that is affected. The complete/incomplete drives are being written to a md0 software raid file system and I run checks on that regularly to make sure it's happy.

Maybe I should just try deleting and trying again. I touched on the question in my original post, is there any advantage to use the deb/ubuntu packages apart from ease of use? I dont mind downloading / compiling (if neccassary, I think it's just python which you dont need to touch?) if you think this might be more reliable.

Cheers

[shypike]

It should have no bearing on the kind of problems you see,
but we do not recommend to store the "incomplete" folder on a RAID.
The associated duplication is a waste of effort for short-lived files.
We have seen reports from people with RAID5 arrays that deal badly with the
large amount of small files that SABnzbd stores in "incomplete".

[reticent]

It turns out my array is raid5 as well, so hopefully you've hit the nail on the head. I'd only put it there because I figured the copying from the incomplete to complete which be much faster if it was on the same disk. I will move the incomplete folder to the system disk and see how I fair.

appreciate the help, I'll let you know how I get on.

[shypike]

Having them on different disks is faster.
You then unpack from one disk to another, which gives you more bandwidth.

[reticent]

I changed to the system disk and added an NZB, and it downloaded and completed with no errors. I just tried adding a nzbmatrix file via URL and got screeds of errors again:

2011-08-16 16:55:15,469 ERROR: Cannot create directory /home/UserX/incomplete
2011-08-16 16:55:15,436 ERROR: Saving /home/UserX/.sabnzbd/admin/postproc1.sab failed
2011-08-16 16:55:15,435 ERROR: Saving /home/UserX/.sabnzbd/admin/watched_data.sab failed
2011-08-16 16:55:15,435 ERROR: Saving /home/UserX/.sabnzbd/admin/bookmarks.sab failed
2011-08-16 16:55:15,435 ERROR: Saving /home/UserX/.sabnzbd/admin/rss_data.sab failed
2011-08-16 16:55:15,434 ERROR: Saving /home/UserX/.sabnzbd/admin/totals9.sab failed
2011-08-16 16:55:15,434 ERROR: Saving /home/UserX/.sabnzbd/admin/queue9.sab failed
2011-08-16 16:55:14,786 ERROR: Cannot create directory /home/UserX/incomplete

The /home/UserX/incomplete dir exists and has been previously written to by sab (so permissions can't be an issue unless it's played with them!). I have 755 set as the permission setting. As for writing to the other files, why did it work the first time and not the next? All looks OK below.

-rw-r--r-- 1 UserX UserX 36K 2011-08-16 16:20 history1.db
-rw-r--r-- 1 UserX UserX 11 2011-08-16 16:20 postproc1.sab
-rw-r--r-- 1 UserX UserX 12 2011-08-16 16:20 queue9.sab
-rw-r--r-- 1 UserX UserX 1.3K 2011-08-16 16:48 rss_data.sab
-rw-r--r-- 1 UserX UserX 5 2011-07-23 22:57 running.sab
-rw------- 1 UserX UserX 631 2011-03-16 20:21 server.cert
-rw------- 1 UserX UserX 887 2011-03-16 20:21 server.key
-rw-r--r-- 1 UserX UserX 187 2011-08-16 16:20 totals9.sab
-rw-r--r-- 1 UserX UserX 14 2011-08-16 16:20 watched_data.sab

Weirdness.

[shypike]

Did you check the folder permissions and ownership?
If you ran it under different accounts, then ownership may be wrong.

[reticent]

yeah, I'm running under "UserX".

drwx------ 45 UserX UserX 20K 2011-08-16 16:14 UserX

I'm guessing that as it was able to write to that directory fine while adding an NZB manually, that can't be the issue.

UserX 4415 4.4 1.0 314964 37600 ? Sl 16:13 3:34 /usr/bin/python -OO /usr/bin/sabnzbdplus --daemon --server 192.168.0.200:2202