multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Want something added? Ask for it here.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by shypike »

sander wrote: @shypike: some catch-all post-proces-script would be a nice feature. The script could for the existence of *.7z and do it's thing.
Just use 0.6.0 and set the script for the default category.
BTW: 0.5.6 has a default script setting in Config->Switches (almost forgot it was there).
trog
Newbie
Newbie
Posts: 5
Joined: February 6th, 2011, 11:02 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by trog »

Nice one dude!

What's involved in getting your changes merged into the main codebase?
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by shypike »

trog wrote: What's involved in getting your changes merged into the main codebase?
It's a separate script.
It cannot just be integrated. It takes quite a bit of work to embed 7zip in such a way that
it gives proper feedback in the History page.
And errors are reported properly, etc.
User avatar
john3voltas
Release Testers
Release Testers
Posts: 115
Joined: January 17th, 2008, 5:35 pm
Location: Lisbon/Portugal

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by john3voltas »

@Shypike,
But will SAB devs use sander's code to dump rar and start using 7z?
I find no problem in SAB using unrar.
It just makes me sad that unrar isn't opensource, that's all.
Cheers
SABnzbd 0.6.0Alpha11 on Fedora 14-64bit laptop.
Usenet-News, TeraNews, newszilla6.xs4all.nl and reader.ipv6.xsnews.nl.
IPv6 connections powered by Hurricane Electric.
Can pull 30Mbit nntp on a 30Mbit FTTH link.
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by sander »

trog wrote: Nice one dude!

What's involved in getting your changes merged into the main codebase?
As long as there are only few posts with .7z packing, I see little reason for putting .7z-unpacking into SAB itself. SAB is a download program, not a upload program. As long as uploaders continue to use rar, rar-unpacking in SAB is enough.

So, if you need .7z unpacking of downloads now, you can use my script.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by shypike »

john3voltas wrote: dump rar and start using 7z?
Last time I checked, unrar performance of the 7zip program
was a lot worse than the real unrar.
You can strengthen (or weaken) your argument by doing some benchmarks.
User avatar
inpheaux
Administrator
Administrator
Posts: 563
Joined: January 16th, 2008, 9:14 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by inpheaux »

Furthermore, I don't know if this is something added in the latest alphas of winrar, but the build I'm on right now can extract 7z's fine. Once that goes final we can upgrade the windows binary we ship with.

. . . unless this is just a function of winrar, and isn't available in windows unrar.

Who wants to test?
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by shypike »

unrar 4.00Beta7 does not unpack 7zip files (nor zip).
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by sander »

shypike wrote: unrar 4.00Beta7 does not unpack 7zip files (nor zip).
UNRAR 3.93 freeware (on Ubuntu) does not handle rar either.

AFAIK (please correct me if I'm wrong):
1) there is no open source rar/unrar software
2) there is no open spec of the .rar format
3) unrar is/can be freeware
4) rar is payware/shareware (even on Linux)
5) unrar freeware can not handle rar

So it makes you wonder whether all people uploading stuff also pay for their rar-payware, and why rar is so popular if 7z can handle it too.
But that's a discussion for uploaders, not for downloaders like us. Oh, one reason not to switch away from rar: I don't think my HDX1000 can handle anything else than rar.


Anyway: the current reality is:
1) 99% of the uploads are done in .rar-format, and SAB can handle that perfectly
2) the few uploads done in .7z-format can be handled by the script I wrote

So I don't think SABnzbd has to change anything.

HTH
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by shypike »

It's a bit of a mix.
Unrar is open source, but not under a FOSS licence.
You can use it freely, but not necessarily in any way you want.
The licence is good enough for SABnzbd's Windows and OSX binaries.
For Linux we leave the problem to the packagers.
The RAR format is fully documented (ultimately in the form of unrar's available source code).
The compression method itself is proprietary.
trog
Newbie
Newbie
Posts: 5
Joined: February 6th, 2011, 11:02 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by trog »

sander wrote:
trog wrote: Nice one dude!

What's involved in getting your changes merged into the main codebase?
As long as there are only few posts with .7z packing, I see little reason for putting .7z-unpacking into SAB itself. SAB is a download program, not a upload program. As long as uploaders continue to use rar, rar-unpacking in SAB is enough.

So, if you need .7z unpacking of downloads now, you can use my script.
The only reason my posts to Usenet are in .rar is because I want to make sure they're accessible - most software like sabnzbd only handles .rar files, and I don't want to make it a huge pain for people who download stuff that I post.

If sabznbd could lead the way in moving off .rar I think could more or less instantly switch my pipeline to use .7z.
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by sander »

trog wrote:
If sabznbd could lead the way in moving off .rar I think could more or less instantly switch my pipeline to use .7z.
Well ... have you tried my 7z-unpack-script? It works for me  :)
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
trog
Newbie
Newbie
Posts: 5
Joined: February 6th, 2011, 11:02 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by trog »

sander wrote:
trog wrote:
If sabznbd could lead the way in moving off .rar I think could more or less instantly switch my pipeline to use .7z.
Well ... have you tried my 7z-unpack-script? It works for me  :)
I haven't yet, but I've just modified my pipeline to post a 7z file and I'll give it a go as soon as I've done a successful post :)
User avatar
sander
Release Testers
Release Testers
Posts: 9062
Joined: January 22nd, 2008, 2:22 pm

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by sander »

trog wrote:
sander wrote:
trog wrote:
If sabznbd could lead the way in moving off .rar I think could more or less instantly switch my pipeline to use .7z.
Well ... have you tried my 7z-unpack-script? It works for me  :)
I haven't yet, but I've just modified my pipeline to post a 7z file and I'll give it a go as soon as I've done a successful post :)

Cool. Keep us posted.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
john3voltas
Release Testers
Release Testers
Posts: 115
Joined: January 17th, 2008, 5:35 pm
Location: Lisbon/Portugal

Re: multi format unpackaging: .zip, .rar, .iso, .7z, .gzip, ...

Post by john3voltas »

shypike wrote: Last time I checked, unrar performance of the 7zip program
was a lot worse than the real unrar.
You can strengthen (or weaken) your argument by doing some benchmarks.
Shypike, my point was never the performance.
I am only concerned about unrar not being FOSS, that's all.
Hey, as long as people keep posting in RAR format, I'm fine with good old unrar ;).
Cheers
SABnzbd 0.6.0Alpha11 on Fedora 14-64bit laptop.
Usenet-News, TeraNews, newszilla6.xs4all.nl and reader.ipv6.xsnews.nl.
IPv6 connections powered by Hurricane Electric.
Can pull 30Mbit nntp on a 30Mbit FTTH link.
Post Reply