Multi-Part PAR2 script behavior across large archive is slow
Posted: February 17th, 2013, 12:18 pm
I was wondering if this has been addressed before (searched but can't find a reference, so apologies if it's already be dealt with).
Currently using 0.7.11 with the multhreaded par2 (not sure the multithread version makes a difference).
It's not unusual when I download a very large archive that the Par2 files are split into different parts across the archive.
Example:
Downloading a 50GB file "sample" across 320 parts RAR. (sample.part001.rar -> sample.part320.rar)
The associated Par2 files are across 3 'parts' :
sample_part_1.par2 covers the files part001.rar to part110.rar
sample_part_2.par2 covers the files part111.rar to part220.rar
sample_part_3.par2 covers the files part221.rar to part320.rar
The behavior I'm seeing is that par2 is executed with a wildcard argument for the [files] portion of the par2 invocation:
/usr/bin/par2 r /path/.sabnzbd/Downloads/incomplete/sample/sample_part_1.par2 /path/.sabnzbd/Downloads/incomplete/sample/*
I understand that this may due to ensure proper pathing, but the resulting behavior here is that when this runs, it causes everything to stall once files not included in the part range are being scanned. If I run the par2 command like this , I see it occurring.
If I run the par2 script without the explicit wildcard [files], ( /usr/bin/par2 r /path/.sabnzbd/Downloads/incomplete/sample/sample_part_1.par2 ) it seems to work just as well and avoids scanning non-covered files, and prevents stalling.
Edit: Forgot to specify, the slowness occurs when article is missing and the archive requires repair.
Currently using 0.7.11 with the multhreaded par2 (not sure the multithread version makes a difference).
It's not unusual when I download a very large archive that the Par2 files are split into different parts across the archive.
Example:
Downloading a 50GB file "sample" across 320 parts RAR. (sample.part001.rar -> sample.part320.rar)
The associated Par2 files are across 3 'parts' :
sample_part_1.par2 covers the files part001.rar to part110.rar
sample_part_2.par2 covers the files part111.rar to part220.rar
sample_part_3.par2 covers the files part221.rar to part320.rar
The behavior I'm seeing is that par2 is executed with a wildcard argument for the [files] portion of the par2 invocation:
/usr/bin/par2 r /path/.sabnzbd/Downloads/incomplete/sample/sample_part_1.par2 /path/.sabnzbd/Downloads/incomplete/sample/*
I understand that this may due to ensure proper pathing, but the resulting behavior here is that when this runs, it causes everything to stall once files not included in the part range are being scanned. If I run the par2 command like this , I see it occurring.
If I run the par2 script without the explicit wildcard [files], ( /usr/bin/par2 r /path/.sabnzbd/Downloads/incomplete/sample/sample_part_1.par2 ) it seems to work just as well and avoids scanning non-covered files, and prevents stalling.
Edit: Forgot to specify, the slowness occurs when article is missing and the archive requires repair.