Page 1 of 1

RSS Duplicate Downloads

Posted: January 11th, 2011, 8:54 pm
by Tenny
Hey everyone, I searched a bit but found a lot of stuff related to duplicates, but nothing "like" mine I felt... Apologizes if there is one.

Anyways I use NZBMatrix for my RSS feed, and the feed is only setup with my bookmarks. I am using Sabnzbd+ 0.5.6. This began happening months back but I don't recall exactly what changed when this began happening. I do have "Prevent Duplicate Downloads" checked, but it hasn't made any dent in this.

Whenever I add something to the bookmarks, it'll download the same thing twice. I have three RSS feeds (coming from the original Bookmarks RSS feed) but I have plenty of conditions (rejects, accepts, etc). None of these duplicates are from overlapping feeds (or at least when that does happen I understand it and not looking to solve that.)

For Example...
File A

RSS Feed A will only grab things with "File A" in the name.
RSS Feed B will only grab things with "File B" in the name.

I bookmark "File A".

When I preview:
RSS Feed A: Finds it matched only once.
RSS Feed B: Finds it, but it is not matched (thus ignored).

When it gets added to the queue it is added, and downloaded. After it is finished downloading it is added again and downloaded again, so I have it twice. Folders: File A & File A.1

This problem has confused me for a few months now, and I cannot for the life of me figure out what is triggering it. This doesn't happen when things are added through Sickbeard.

Re: RSS Duplicate Downloads

Posted: January 12th, 2011, 12:57 pm
by shypike
The bookmarks are read out via their own RSS feed.
Do your other feeds match the same stuff as your bookmarks?

Re: RSS Duplicate Downloads

Posted: January 12th, 2011, 3:32 pm
by Tenny
shypike wrote: The bookmarks are read out via their own RSS feed.
Do your other feeds match the same stuff as your bookmarks?
There are no other feeds other than the bookmarks one.

Then it's added multiple times so that they are moved to the right folder.

So like
Feed1: requires "string"
Feed2: rejects "string"

Thus they aren't overlapping like that (and they end up in the correct folder). So it's not the other feed grabbing it.

Sorry I am being vague, I don't want to get anyone into trouble but if posting simple "qualities" is acceptable I am more than happy to share what I have for my feeds.

Re: RSS Duplicate Downloads

Posted: January 12th, 2011, 4:59 pm
by Tenny
pair of dimes wrote: If you look at the feed definition, in the Downloaded listing, do you see the nzb twice?

Simple solution is just to enable "Prevent Duplicate Downloads" in Config>Switches
The feed definition I gather is the "Preview" button on the RSS Tab in the config? If so, it doesn't show a duplicate there.

I also do have "Prevent Duplicate Downloads" checked.

Re: RSS Duplicate Downloads

Posted: January 12th, 2011, 5:36 pm
by shypike
You contradict yourself.
First you say you have only one feed and then you talk about "Feed1" and "Feed2".
Also reading this, confuses me:
[quote]
So like
Feed1: requires "string"
Feed2: rejects "string"
[/qoute]
Are these your filters?

Re: RSS Duplicate Downloads

Posted: January 12th, 2011, 5:40 pm
by Tenny
Sorry, I know it sounds confusing, but it really isn't. Just explaining it isn't working very well for me. 

All the "feeds" come from the Bookmark RSS feed from the site.

I just create multiple feeds based off the "bookmarks" feed. Then use Reject / Accepts / Requires to have them sorted to the right folders / post processing.

Re: RSS Duplicate Downloads

Posted: January 12th, 2011, 5:47 pm
by shypike
OK, so your filters are not accurate and cause double hits.
Don't use multiple feeds.
Just use a list of Accept filters to assign categories.
Like this:
Accept | Show 1 | Show-1-folder
Accept | Show 2 | Show-2-folder
Accept | * | Other-folder

Re: RSS Duplicate Downloads

Posted: January 14th, 2011, 4:00 pm
by Tenny
shypike wrote: OK, so your filters are not accurate and cause double hits.
Don't use multiple feeds.
Just use a list of Accept filters to assign categories.
Like this:
Accept | Show 1 | Show-1-folder
Accept | Show 2 | Show-2-folder
Accept | * | Other-folder
Ok I tried that, and I'm still getting duplicates.

Order | Type | Filter | Category | Processing | Script
0 | ACCEPT | TV | tv | default | default
1 | ACCEPT | x264 | movieshd | default | default
2 | ACCEPT | xvid | movies | default | default

And I've gotten duplicates for both Movies & MoviesHD so far.

Re: RSS Duplicate Downloads

Posted: February 19th, 2011, 1:32 am
by Stretchstrong
I'm having this exact same problem. I use my bookmarks feed from NzbMatrix, only one feed and no filters at all. When I look at the feed there's only one entry for each item but sabnzb downloads every new item twice. I've come across this problem in a number of threads. There's definitely a bug here.

Re: RSS Duplicate Downloads

Posted: February 19th, 2011, 3:55 am
by shypike
If it's a bug, there's not enough data to reproduce it.

Enable the duplicates detection in Config->Switches.
It helps to enable NZB backups too in Config->Folder.
This will at least stop the same NZB from entering twice.

Re: RSS Duplicate Downloads

Posted: February 19th, 2011, 7:35 pm
by Stretchstrong
I've checked both those options and it still doesn't help. Two downloads for every item in the feed. But only one nzb file in the nzb file backup directory.

Have you tried using an NzbMatrix bookmarks rss feed? I can give you access to mine if it'd help repo the issue.

Re: RSS Duplicate Downloads

Posted: February 20th, 2011, 3:02 am
by shypike
Stretchstrong wrote: But only one nzb file in the nzb file backup directory.
There would never be two files, the second would overwrite the first.
I have an nzbmatrix account myself, but I cannot reproduce the problem.
You might want to try the public Beta for 0.6.0 that we'll release today.

Re: RSS Duplicate Downloads

Posted: February 21st, 2011, 9:38 pm
by Stretchstrong
0.6 seems to have fixed it.