Page 1 of 1

RSS duplicates in 0.4.5

Posted: November 17th, 2008, 11:40 am
by def1ant
Hi all,

I noticed some earlier submissions regarding duplicates that get downloaded when RSS is enabled.  I am running 0.4.5 on my mac and end up getting dups.  The files are the exact same and the nzb files are identical.  I end up getting ShowYYY and ShowYYY.1 in my completed folder. 

The RSS feed itself seems to be ok - every time I check the feed when there are duplicates - the feed has only one entry. 

Looking at the time of the downloads, the dupes are often within 10-20 minutes of each other.  It seems like the dup starts to download even before the original completes.  Is there any tips for debugging this?  Thanks in advance.

Re: RSS duplicates in 0.4.5

Posted: November 17th, 2008, 11:41 am
by shypike
Give us the RSS URL so we can examine it ourselves.
[email protected]

Re: RSS duplicates in 0.4.5

Posted: November 17th, 2008, 11:50 am
by def1ant
Emailed link to the address. Thanks.

Re: RSS duplicates in 0.4.5

Posted: November 19th, 2008, 4:13 pm
by shypike
Rather late reply, sorry.

The only thing I can think that happened is this.
1. The feed is read and some jobs start downloading.
2. These jobs are kept in the internal admin of SABnzbd (stored in rss.sab)
3. The next  feed read has the same jobs. No problem, SABnzbd knows it has downloaded these jobs
4. The next feed read does not contain the previous jobs any more.
    Now SABnzbd removes the jobs from it's internal admin to prevent the file from growing forever.
5. The next feed read contains the previous jobs again.
    SABnzbd thinks they are new jobs and adds them to the queue.

Normally jobs will be dropped from the feed and they don't return any more.
But if a feed drops jobs sometimes and they re-appear the next time, it will not help.

The only way to prevent these double downloads is to remember the downloaded jobs forever.

So far this is speculation and so the "solution" may not even work.
The trouble is, it's almost impossible to diagnose these problems.

Maybe if it happens again, you can send the complete logging to [email protected]

There's an open ticket now asking for an option that prevents downloading the same job again if an identically
named NZB file is already in the nzb-backup folder.
This would also fix your problem.
I'll see if this can be done for release 0.4.6.

Re: RSS duplicates in 0.4.5

Posted: November 20th, 2008, 4:03 pm
by def1ant
Thank you for the detailed response. 

rss.sab is not the same as the history that is displayed in the UI is it?  The reason I ask is I have not cleared my history and it shows all my jobs including the duplicates it got.

For now, I have temporarily disabled scheduling and just click download manually.  That works fine.

Re: RSS duplicates in 0.4.5

Posted: November 20th, 2008, 4:18 pm
by shypike
rss.sab holds only the RSS items.
The history is kept in queue7.sab.

I can confirm that this one will be implemented in 0.4.6.
There's an open ticket now asking for an option that prevents downloading the same job again if an identically
named NZB file is already in the nzb-backup folder.