Unpack errors (7z): ERROR: Can not create file with auto name

[psycik]

I’m getting jobs fail on an invalid file in a rar.

Is there a way, a switch or something where the invalid chars are dealt with/ignored.

ERROR: Can not create file with auto name : /downloads/complete/magazines/�#001

This appears in the Sabnzbd log. One thing I noticed is it’s trying to unpack to completed category directory. So when this fails, the job doesn’t clean itself up (all the bad files I completed). And doesn’t run post processing

Example nzb name
Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1

[sander]

same as here https://www.reddit.com/r/usenet/comment ... h_invalid/ ?

Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1

Goes smootly on my Sab: a set of zip files, which are unzipped, resulting in rar files, which are unrarred, which leads a .PDF, plus some other files

No specials chars involved

[psycik]

Yeah that was also me….

So my sab is docker (linuxserver image) on Ubuntu.
I get a weird char when 7z tries to unpack.

I thought I saw a settings somewhere to use unrar instead. But can’t find it. To try.

[psycik]

So this might be ultimately on windows via cifs. I’d have to look at the underlying file systems and mounts for docker.

But that’s the only thing I can think of

[sander]

Yes, probably filesystem problem.

[psycik]

So I’ve confirmed it’s not windows via cifs. It’s an ext4 virtual disk on my Ubuntu vm

What about the disk could be wrong? This has only been happening recently In the past couple of months…..and it’s only with this type of content…and not all of them either.

So I found the switch for using 7z and turned it off. And can see some files starting with a ‘ before the file name. I wonder if that was because I added the make compatible with windows switch…

I’ll see if not using 7z makes a difference

[sander]

Interesting:

lsio sabnzbd saving within docker: all good
lsio sabnzbd saving to host filesystem (ext4): error!

Code: Select all

2023-01-28 09:02:28,733::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170b 
2023-01-28 09:02:28,735::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.1/aigs170b.zip']
2023-01-28 09:02:28,735::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-28 09:02:28,764::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs Intel(R) Celeron(R) N4120 CPU @ 1.10GHz (706A8),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.1/aigs170b.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.1/aigs170b.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-28 09:02:28,765::INFO::[newsunpack:1081] 7za return code: 2

[psycik]

So the lsio container having a volume mount is causing the problem?

So if I change to a volume mount (and shared that volume if I needed it). Then is should work?

[sander]

> So the lsio container having a volume mount is causing the problem?

Yes. But that should not happen. So more investigation is needed. I'll do that when I have time this weekend

> So if I change to a volume mount (and shared that volume if I needed it). Then is should work?

I don't understand what you mean. But: please experiment.

[psycik]

Sp at the moment I have a bind mount to a disk system that is ext4
Which if i read your message before is what I assume you meant by that.

But if I make a docker volume that is hopefully what you meant by the working unrar.

So I will have an experiment

[sander]

More weirdness:

I tried with LSIO docker on my Ubuntu, and no problem at all: four downloads went OK, and nicely land on the host filesystem.

Yesterday was on my Chromebook: within the Linux subsystem.

So options are now
* only problem on Chromebook. Different filesystem? @psycik Are you running LSIO docker on Ubuntu straight on hardware? Or VM, Windows, ChromeOS involved? So: describe your system. Plus: which version of LSIO SABnzbd: latest, or unstable, or nightly
* intermittent problem. I would have to test again on my Chromebook, but not at hand at the moment
* (unlikely) I used different NZBs.

Code: Select all

cd ~
mkdir lsio_sabnzbd_spul
sudo docker run --name=sabnzbd -p 8080:8080 -v /home/sander/lsio_sabnzbd_spul:/config -v /home/sander/lsio_sabnzbd_spul:/downloads   lscr.io/linuxserver/sabnzbd:latest

Note: LSIO sab's version is 3.6.1. Which is a bit weird as I specify lscr.io/linuxserver/sabnzbd:latest

[sander]

Ah, lscr.io/linuxserver/sabnzbd:unstable gives 3.7.2RC1
So I started that, did the same download, and ... bingo ... error:

Code: Select all

2023-01-29 10:50:25,258::DEBUG::[filesystem:495] build_filelists(): zips: ['/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170d.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170h.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170i.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170b.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170f.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170e.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170g.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170c.zip', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170a.zip']
2023-01-29 10:50:25,258::DEBUG::[filesystem:496] build_filelists(): rars: []
2023-01-29 10:50:25,258::DEBUG::[filesystem:497] build_filelists(): 7zips: []
2023-01-29 10:50:25,258::DEBUG::[filesystem:498] build_filelists(): ts: []
2023-01-29 10:50:25,258::INFO::[newsunpack:311] Unzip starting on /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost
2023-01-29 10:50:25,258::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170d 
2023-01-29 10:50:25,259::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170d.zip']
2023-01-29 10:50:25,259::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,273::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170d.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170d.zip
Type = zip
Physical Size = 10002128

Everything is Ok

Files: 3
Size:       10001704
Compressed: 10002128

2023-01-29 10:50:25,274::INFO::[newsunpack:1087] Unpacked 3 files/folders in 0 seconds
2023-01-29 10:50:25,275::DEBUG::[filesystem:902] [sabnzbd.newsunpack.unseven] Deleting file /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170d.zip
2023-01-29 10:50:25,276::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170h 
2023-01-29 10:50:25,277::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170h.zip']
2023-01-29 10:50:25,277::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,289::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 8851163 bytes (8644 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170h.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170h.zip
Type = zip
Physical Size = 8851163

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,290::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,290::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170i 
2023-01-29 10:50:25,290::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170i.zip']
2023-01-29 10:50:25,290::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,303::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170i.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170i.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,304::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,304::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170b 
2023-01-29 10:50:25,304::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170b.zip']
2023-01-29 10:50:25,304::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,316::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170b.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170b.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,316::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,316::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170f 
2023-01-29 10:50:25,317::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170f.zip']
2023-01-29 10:50:25,317::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,331::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170f.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170f.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,331::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,331::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170e 
2023-01-29 10:50:25,331::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170e.zip']
2023-01-29 10:50:25,331::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,344::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170e.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170e.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,344::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,344::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170g 
2023-01-29 10:50:25,344::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170g.zip']
2023-01-29 10:50:25,344::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,358::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170g.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170g.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,359::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,359::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170c 
2023-01-29 10:50:25,359::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170c.zip']
2023-01-29 10:50:25,359::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,372::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170c.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170c.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,373::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,373::INFO::[newsunpack:977] Starting extract on 7zip set/file: aigs170a 
2023-01-29 10:50:25,373::INFO::[misc:1166] [sabnzbd.newsunpack.seven_extract_core] Running external command: ['/usr/bin/7za', 'x', '-y', '-aou', '-ssc', '-p', '-o/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5', '/config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170a.zip']
2023-01-29 10:50:25,373::DEBUG::[misc:1167] Popen arguments: {'stdin': -1, 'stdout': -1, 'stderr': -2, 'startupinfo': None, 'creationflags': 0}
2023-01-29 10:50:25,388::DEBUG::[newsunpack:1058] 7za output: 
7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170a.zip
--
Path = /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost/aigs170a.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

2023-01-29 10:50:25,389::INFO::[newsunpack:1081] 7za return code: 2
2023-01-29 10:50:25,389::INFO::[newsunpack:318] Unzip finished on /config/Downloads/incomplete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost
2023-01-29 10:50:25,389::INFO::[postproc:430] Unpacked files ['/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r03', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_1.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r07', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_2.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.rar', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_3.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r01', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r05', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_4.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r04', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_5.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_6.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r06', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_7.nfo', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r02', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170.r00', '/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/aigs170_8.nfo']
2023-01-29 10:50:25,389::INFO::[filesystem:319] Checking if any resulting filenames need to be sanitized
2023-01-29 10:50:25,390::INFO::[postproc:434] Finished unpack_magic on Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost
2023-01-29 10:50:25,390::DEBUG::[filesystem:866] Renaming "/config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5" to "/config/Downloads/complete/_FAILED_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5"
2023-01-29 10:50:25,390::DEBUG::[filesystem:909] [sabnzbd.postproc.rename_and_collapse_folder] Removing dir /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5
2023-01-29 10:50:25,390::INFO::[nzbstuff:1797] [sabnzbd.postproc.process_job] Purging data for job Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost (delete_all_data=False)
2023-01-29 10:50:25,390::DEBUG::[articlecache:150] Purging 0 articles from the cache/disk
2023-01-29 10:50:25,391::INFO::[notifier:123] Sending notification: Download Failed - Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost (type=failed, job_cat=*)
2023-01-29 10:50:25,414::DEBUG::[sorting:611] Initial guess for Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost is MatchesDict([('title', 'Airgun Shooter No'), ('season', 1), ('episode', 70), ('year', 2023), ('other', ['Hybrid', 'Repost']), ('release_group', 'MAGAZINE.eBook-21A1'), ('type', 'episode')])
2023-01-29 10:50:25,414::DEBUG::[sorting:364] Using tv sorter for Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost
2023-01-29 10:50:25,418::INFO::[database:292] Added job Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost to history

[sander]

The versions of 7za are different:

"latest":

Code: Select all

sander@zwart2204:~$ sudo docker exec -it sabnzbd sh

root@611051767bd6:/# /usr/bin/7za

7-Zip (a) [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

unstable:

Code: Select all

sander@zwart2204:~$ sudo docker exec -it sabnzbd sh
root@1d06e32e5698:/# /usr/bin/7za 

7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Is the problem in overwriting the existing file

Code: Select all

ERROR: Can not create file with auto name : /config/Downloads/complete/_UNPACK_Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.5/file_id.diz
ERROR: E_FAIL

Switch Description
-aoa Overwrite All existing files without prompt.
-aos Skip extracting of existing files.
-aou aUto rename extracting file (for example, name.txt will be renamed to name_1.txt).
-aot auto rename existing file (for example, name.txt will be renamed to name_1.txt).

We use -aou, so it should create a new filename, but ...

[sander]

Reproducable with 7z version 17.04. Cause: 7z 17.04 does not obey the " -aou" meaning: f files exists, create a second one with underscore in it
All goes well with 7z 16.04 and 22.01, because these version do create the underscore file.

After a pure Download (no unpack) the zip files are there:

Code: Select all

root@8a04748f776d:/downloads/Downloads/complete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.7# ls -al
total 86804
drwxr-xr-x  2 abc abc     4096 Jan 29 17:12 .
drwxr-xr-x 13 abc abc     4096 Jan 29 17:12 ..
-rw-r--r--  1 abc abc     1346 Jan 29 17:12 aigs170.nfo
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170a.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170b.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170c.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170d.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170e.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170f.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170g.zip
-rw-r--r--  1 abc abc  8851163 Jan 29 17:12 aigs170h.zip
-rw-r--r--  1 abc abc 10002128 Jan 29 17:12 aigs170i.zip
-rw-r--r--  1 abc abc      313 Jan 29 17:12 file_id.diz

With 7z 17.04, SAB's standard option -aou goes wrong, because aigs170.nfo is already there. The option -aou should create a file with an underscore, but it doesn't do that, and bails out with an error:

Code: Select all

root@8a04748f776d:/downloads/Downloads/complete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.7# 7za x -y -aou -ssc -p -o. aigs170a.zip

7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: aigs170a.zip
--
Path = aigs170a.zip
Type = zip
Physical Size = 10002128

ERROR: Can not create file with auto name : ./aigs170.nfo

ERROR: E_FAIL

Archives with Errors: 1

Sub items Errors: 1

Change option to -aoa (=overwrite) goes OK:

Code: Select all

root@8a04748f776d:/downloads/Downloads/complete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.7# 7za x -y -aoa -ssc -p -o. aigs170a.zip

7-Zip (a) [64] 17.04 : Copyright (c) 1999-2021 Igor Pavlov : 2017-08-28
p7zip Version 17.04 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: aigs170a.zip
--
Path = aigs170a.zip
Type = zip
Physical Size = 10002128

Everything is Ok

Files: 3
Size:       10001704
Compressed: 10002128

With 7z 16.04 and 22.01, all goes well with -aou:

Code: Select all

sander@zwart2204:~/lsio_sabnzbd_spul/Downloads/complete/Airgun.Shooter.No.170.2023.HYBRID.MAGAZINE.eBook-21A1-xpost.7$ sudo ~/Downloads/7zz x -y -aou -ssc -p -o. aigs170a.zip

7-Zip (z) 22.01 (x64) : Copyright (c) 1999-2022 Igor Pavlov : 2022-07-15
 64-bit locale=en_US.UTF-8 Threads:4, ASM

Scanning the drive for archives:
1 file, 10002128 bytes (9768 KiB)

Extracting archive: aigs170a.zip
--
Path = aigs170a.zip
Type = zip
Physical Size = 10002128

Everything is Ok

Files: 3
Size:       10001704
Compressed: 10002128

[sander]

So ... options:

EDIT: ah, there is already an option overwrite_files in config -> special . So turn it on, and problem goes away!

https://github.com/sabnzbd/sabnzbd/blob ... 1043-L1046

Code: Select all

$ grep overwrite ~/.sabnzbd/sabnzbd.ini
overwrite_files = 0

OLD:

* do not allow 7z version 17.04 (or give a warning for this niche problem). Ask lsio to put in 16.04 or 22.01. Possibly difficult because provided by Alpine
* If 7z version 17.04 (and maybe more): within SAB, use option "-aoa"
* Always use "-aoa"
* test what 7za gives in case of existing file. If underscore is not working, fall back to -aoa
* make an user option to overrule -aou
* @psycik use latest version for now. That should work because it has 7z 16.02

EDIT:

Force install 7z 16.02:

Code: Select all

root@8a04748f776d:/# wget https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/p7zip-16.02-r4.apk
Connecting to dl-cdn.alpinelinux.org (151.101.38.133:443)
saving to 'p7zip-16.02-r4.apk'
p7zip-16.02-r4.apk   100% |**********************************************************************************************************************| 1954k  0:00:00 ETA
'p7zip-16.02-r4.apk' saved

root@8a04748f776d:/# apk add --allow-untrusted p7zip-16.02-r4.apk
(1/1) Downgrading p7zip (17.04-r2 -> 16.02-r4)
Executing busybox-1.35.0-r17.trigger
OK: 95 MiB in 63 packages
root@8a04748f776d:/config# 7za | head

7-Zip (a) [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,4 CPUs 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz (806C1),ASM,AES-NI)

Usage: 7za <command> [<switches>...] <archive_name> [<file_names>...]
       [<@listfiles...>]

<Commands>
  a : Add files to archive
  b : Benchmark