Page 1 of 1

Possible fix for downloading duplicate TV shows

Posted: April 27th, 2010, 3:28 pm
by Scytale
With the demise of TVNZB, I went to consuming an RSS feed directly from NZBMatrix.  I quickly ran into 2 major problems:

- Sometimes people post an entire season pack and it's not always easy to filter them based on a regular expression.
- Duplicates.  If a show is posted and then followed by a repack and a proper then you will get 3 copies of that show.

I think I have addressed both issues with a (somewhat complex) Yahoo Pipe.  Feel free to make a clone of mine and play around with it.  It's currently set up to use the SD TV shows feed from NZBMatrix.  It basically uses the history feed from your own SAB server to remove shows you've already downloaded.  There's an overview of how it works in the description of the pipe.

http://pipes.yahoo.com/pipes/pipe.info? ... ea9ad6fffd

Please note that I just put this together a few minutes ago, and while it seems to work, I haven't put it through any significant testing.  Post here if you find any problems and I'll update mine.

Also remember that you cannot use this pipe directly since it references my own SAB history and not yours!  You must make a clone of it and input your own SAB URL.

Re: Possible fix for downloading duplicate TV shows

Posted: April 28th, 2010, 8:50 am
by Scytale
I found and fixed a couple of bugs in my pipe.  Wow, that sounds weird.  Anyway, grab a new clone if you were trying it out.

Re: Possible fix for downloading duplicate TV shows

Posted: April 30th, 2010, 1:26 am
by Ishimaru
Testing this out as well.  Will report back with results :).

Re: Possible fix for downloading duplicate TV shows

Posted: May 2nd, 2010, 3:38 am
by dukevim
pretty clever.

Re: Possible fix for downloading duplicate TV shows

Posted: May 2nd, 2010, 4:08 am
by clobber
Out of curiosity, wouldn't the following work?

1) For your accept filters, change everything to "Show*Name*S02E*"  - that way you will only get individual episodes of the current season (assuming we are in season 2 of Show Name). This filter would not match the entire season postings. There are exceptions of course, depending on the naming.

2) Normally if there is a repack or a proper, I want to get it anyway. But if you don't, then why not just add a sabnzbd reject filter for "*repack*" and "*proper*" - Put those at the top of the list and anything matching those terms won't be downloaded.

This seems much more simple than the Yahoo Pipes solution?

Re: Possible fix for downloading duplicate TV shows

Posted: May 4th, 2010, 11:48 am
by Ishimaru
Unfortunately, this doesn't work at all, it still downloads dupes.

Re: Possible fix for downloading duplicate TV shows

Posted: May 8th, 2010, 7:44 pm
by Scytale
clobber wrote: Out of curiosity, wouldn't the following work?

1) For your accept filters, change everything to "Show*Name*S02E*"  - that way you will only get individual episodes of the current season (assuming we are in season 2 of Show Name). This filter would not match the entire season postings. There are exceptions of course, depending on the naming.

2) Normally if there is a repack or a proper, I want to get it anyway. But if you don't, then why not just add a sabnzbd reject filter for "*repack*" and "*proper*" - Put those at the top of the list and anything matching those terms won't be downloaded.

This seems much more simple than the Yahoo Pipes solution?
That would work for repacks and propers, but what about releases by other groups?  You'd have to choose a specific release group and I'm not sure how reliable that is.  You could also get some other special cases, for example, you'd get both of these:

Spartacus Blood and Sand S01E09 HDTV XviD SYS
Spartacus Blood and Sand S01E09 German Subbed HDTV XviD

My solution still isn't perfect there since it will pick only the first one - and you have to hope that's the version in your own language...  But it's working well for me so far.

Re: Possible fix for downloading duplicate TV shows

Posted: May 8th, 2010, 7:47 pm
by Scytale
Ishimaru wrote: Unfortunately, this doesn't work at all, it still downloads dupes.
It has been working quite well for me.  Did you get the clone after April 28th?  I fixed a bug on that day that would allow dupes and I don't think it will update your clone retroactively.  If you did get the new version, then post some details about what duped and what was in your history feed.  Hopefully I can fix it. 

Re: Possible fix for downloading duplicate TV shows

Posted: May 11th, 2010, 9:18 am
by jamesdew
or you could just use sickbeard

Re: Possible fix for downloading duplicate TV shows

Posted: May 11th, 2010, 3:42 pm
by jmjay
Hi guys,

I am working on a similar, but somewhat different approach.

I am facing two challenges:
a) higher number of items in the feed: I have only my HTPC which I only turn on in the evenings (CET) and with a 20/25 item RSS feed some shows are already gone :-(
b) passworded items (which seem to pop up more often these days)

I am currently going for a nzbindex.nl feed (up to 250 items) also piped through yahoo and filtered on duplicates (there). The rss feed is on alt.binaries.teevee with a filter for the real teevee poster.

Only problem now is that nzbindex has pretty shitty nzb names, but I hope to have found the spot in the python code to use the rss feed item title to fix that... as soon as I have the whole shabang going I will let you konw...

Cheers,

JMJay

Re: Possible fix for downloading duplicate TV shows

Posted: May 17th, 2010, 3:49 pm
by Scytale
jamesdew wrote: or you could just use sickbeard
Correct me if I'm wrong, but in looking at Sickbeard it seemed to require me to have some kind of folder structure for my shows where each one has its own directory.  I prefer to have them all in one folder.  Otherwise my wife has to look in 10 different folders on the media center to see which of her shows came down overnight.