Page 1 of 1

RSS watch keeps getting longer

Posted: January 28th, 2009, 2:55 pm
by jeff_porter
I have 0.4.6 running on a ds107e.

The RSS feed recently seems to just get longer and longer, like its not removing old items.
If I remove the feed and re-add it, its nice and short again.

Any ideas?

Re: RSS watch keeps getting longer

Posted: January 28th, 2009, 3:07 pm
by switch
Can you please explain futher? What RSS are you talking about, the one for the history or built in RSS processing for adding nzb's. If it's the former, 0.5 will limit the history RSS feed to the last 50 items.

Re: RSS watch keeps getting longer

Posted: January 28th, 2009, 3:32 pm
by jeff_porter
its the built in built in RSS procesor.

;D

If I look at the feed after being added its say 20 items long.
If I look at it again in a few days its 50 items long.
If I look at it again in a few days its 100 items long.

If I look at the feed at that point in time in Firefox, its still 20 lines long.

It just seems to keep growing in sab.

any ideas?

Re: RSS watch keeps getting longer

Posted: February 2nd, 2009, 3:01 pm
by keefer
I am getting the same error with 0.4.6. My list is 100+ items, using a feed from newzbin. Also it adds new items out of order.  I thought it wasn't updating the list for a while. I hope there is a solution to this. 

Re: RSS watch keeps getting longer

Posted: February 2nd, 2009, 3:25 pm
by switch
Since 0.4.6 sab will keep the contents of the RSS feed over the past month I believe to stop matching any duplicates. It's not a solution I agree with and I will probably implement a better way for 0.5 such as tracking matched items in a csv file or database.

Re: RSS watch keeps getting longer

Posted: February 2nd, 2009, 8:37 pm
by keefer
thanks for the reply, I misunderstood how sabnzbd managed duplicates. I thought there was a back up folder of all the NZB files I download and it managed the queue off that.  I would rather have a long list than duplicate files, so I'll wait for a better fix in future versions.  Thanks for all the great work, I've been using since when it was still the original development of sabnzb. Its come a long way!

Re: RSS watch keeps getting longer

Posted: February 3rd, 2009, 3:55 am
by shypike
There are two duplication preventions.

One is the RSS list which protects against RSS feeds who drop shows only to restore them later.
This would lead to double downloads.
The RSS memory is invisible for the user, the Config->RSS page shows only what the current content
of the RSS feed is. So any bad behavior is caused by the RSS feed itself.

The other independent option checks a new NZB file against what is in the NZB backup folder.
It works without RSS feeds too.

Re: RSS watch keeps getting longer

Posted: February 3rd, 2009, 10:33 am
by keefer
Thanks for the clarification. That makes a lot ot sence to have both. 
shypike wrote: The RSS memory is invisible for the user, the Config->RSS page shows only what the current content
of the RSS feed is. So any bad behavior is caused by the RSS feed itself.
How is the current content different from the link to the RSS feed? When I check the RSS link (in my browser) it shows only the 20 most recent items, ordered by date, where the preview on the Config->RSS page shows a list that has grown much larger and in what seems to be a random order. It is possible these have become the same? In the past I haven't seen this before. The preview page has always been the same content as the RSS feed. 

If this doesn't take up a lot of extra memory it isn't a large issue. I can deal with a large list if it still serves it purpose and downloads correctly. Thanks for your time.

Re: RSS watch keeps getting longer

Posted: February 3rd, 2009, 3:08 pm
by shypike
It is supposed to show only the actual RSS feed content.
If it shows more, it's a bug.
It shows all the jobs in memory, allowing you to download any jobs your filtering may have missed.
I think it may be the order of the jobs that looks confusing.

I'll look further into it.

Re: RSS watch keeps getting longer

Posted: February 13th, 2009, 3:55 pm
by shypike
The next release will show the Preview with the newest job first.
(Currently it's rather unordered).