SABnzbd Forums


https://237678.vipkidinterhk.tech/

Bugs: UnicodeDecodeError: invalid continuation byte

https://237678.vipkidinterhk.tech/viewtopic.php?t=19713

Page 4 of 5

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: January 15th, 2016, 9:11 am
by Chura
Excellent work, Thanks!

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 9th, 2016, 7:30 am
by isofan
I am currently having the same problem with a fresh install of the latest 1.0.0 version on my Windows Server 2003, any way to fix this? It stops moving / repairing my files when this happens, here is a log:

How can I fix this? :(

Code: Select all

2016-04-09 13:03:29,398::INFO::[__init__:941] Saving data for postproc2.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\postproc2.sab
2016-04-09 13:03:29,398::INFO::[postproc:679] Queue has finished, launching: None (None)
2016-04-09 13:05:02,539::INFO::[dirscanner:350] Trying to import U:\NZB\mynewsprovider.S04E08{{DWVbih0WzyLhLjoesqOx}}.nzb
2016-04-09 13:05:03,539::INFO::[misc:806] Creating directories: \\?\D:\Temp\mynewsprovider.S04E08
2016-04-09 13:05:03,571::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [01/26] - "a3tq23tjslagjaslgasg.par2" - 1,56 GB - yEnc (1/1) added to queue
2016-04-09 13:05:03,586::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [02/26] - "a3tq23tjslagjaslgasg.part01.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:03,680::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [03/26] - "a3tq23tjslagjaslgasg.part02.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:03,711::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [04/26] - "a3tq23tjslagjaslgasg.part03.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:03,726::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [05/26] - "a3tq23tjslagjaslgasg.part04.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:03,898::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [06/26] - "a3tq23tjslagjaslgasg.part05.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,023::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [07/26] - "a3tq23tjslagjaslgasg.part06.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,055::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [08/26] - "a3tq23tjslagjaslgasg.part07.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,134::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [09/26] - "a3tq23tjslagjaslgasg.part08.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,180::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [10/26] - "a3tq23tjslagjaslgasg.part09.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,196::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [11/26] - "a3tq23tjslagjaslgasg.part10.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,196::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [12/26] - "a3tq23tjslagjaslgasg.part11.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,289::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [13/26] - "a3tq23tjslagjaslgasg.part12.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,384::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [14/26] - "a3tq23tjslagjaslgasg.part13.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:04,446::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [15/26] - "a3tq23tjslagjaslgasg.part14.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:05,023::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [16/26] - "a3tq23tjslagjaslgasg.part15.rar" - 1,56 GB - yEnc (1/274) added to queue
2016-04-09 13:05:05,086::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [17/26] - "a3tq23tjslagjaslgasg.part16.rar" - 1,56 GB - yEnc (1/47) added to queue
2016-04-09 13:05:05,086::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [18/26] - "a3tq23tjslagjaslgasg.vol00+01.par2" - 1,56 GB - yEnc (1/2) added to queue
2016-04-09 13:05:05,134::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [20/26] - "a3tq23tjslagjaslgasg.vol02+02.par2" - 1,56 GB - yEnc (1/4) added to queue
2016-04-09 13:05:05,134::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [19/26] - "a3tq23tjslagjaslgasg.vol01+01.par2" - 1,56 GB - yEnc (1/2) added to queue
2016-04-09 13:05:05,134::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [21/26] - "a3tq23tjslagjaslgasg.vol04+05.par2" - 1,56 GB - yEnc (1/8) added to queue
2016-04-09 13:05:05,148::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [23/26] - "a3tq23tjslagjaslgasg.vol19+10.par2" - 1,56 GB - yEnc (1/15) added to queue
2016-04-09 13:05:05,164::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [24/26] - "a3tq23tjslagjaslgasg.vol29+20.par2" - 1,56 GB - yEnc (1/29) added to queue
2016-04-09 13:05:05,164::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [22/26] - "a3tq23tjslagjaslgasg.vol09+10.par2" - 1,56 GB - yEnc (1/15) added to queue
2016-04-09 13:05:05,164::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [25/26] - "a3tq23tjslagjaslgasg.vol49+50.par2" - 1,56 GB - yEnc (1/70) added to queue
2016-04-09 13:05:05,180::INFO::[nzbstuff:479] File 9P9HmIBQa3uwQGHKfgxfaJejqIPea0 - [26/26] - "a3tq23tjslagjaslgasg.vol99+51.par2" - 1,56 GB - yEnc (1/72) added to queue
2016-04-09 13:05:05,180::INFO::[__init__:589] Backing up \\?\D:\Temp\mynewsprovider.S04E08\__ADMIN__\mynewsprovider.S04E08{{DWVbih0WzyLhLjoesqOx}}.nzb.gz
2016-04-09 13:05:05,321::INFO::[nzbqueue:250] Saving queue
2016-04-09 13:05:05,336::INFO::[__init__:941] Saving data for queue10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\queue10.sab
2016-04-09 13:05:06,336::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:05:06,336::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:05:06,336::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:05:06,351::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:05:07,414::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:05:07,414::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:05:07,414::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:05:07,414::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:05:08,009::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:05:08,009::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.par2 yenc
2016-04-09 13:08:31,308::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:08:31,323::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part01.rar yenc
2016-04-09 13:11:44,450::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:11:44,450::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part02.rar yenc
2016-04-09 13:14:58,282::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:14:58,282::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part03.rar yenc
2016-04-09 13:18:16,111::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:18:16,111::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part04.rar yenc
2016-04-09 13:20:07,207::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:20:07,505::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:20:07,676::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:20:08,676::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:20:08,691::INFO::[decoder:226] <Article: [email protected], bytes=398612, partnum=146, art_id=None> wurde auf keinem Server gefunden und daher übersprungen
2016-04-09 13:20:12,676::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:20:12,676::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:20:12,676::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:20:13,676::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:20:13,739::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:20:13,739::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:20:13,755::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:20:14,052::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:21:46,068::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:21:46,068::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part05.rar yenc
2016-04-09 13:21:50,818::INFO::[assembler:180] <Article: [email protected], bytes=398612, partnum=146, art_id=None> fehlt
2016-04-09 13:25:07,648::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:25:07,648::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part06.rar yenc
2016-04-09 13:28:20,244::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:28:20,260::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part07.rar yenc
2016-04-09 13:31:35,763::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:31:35,763::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part08.rar yenc
2016-04-09 13:34:49,687::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:34:49,687::INFO::[assembler:88] Decoding \\?\D:\Temp\mynewsprovider.S04E08\a3tq23tjslagjaslgasg.part09.rar yenc
2016-04-09 13:38:38,362::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:38:38,362::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part10.rar yenc
2016-04-09 13:41:53,770::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:41:53,770::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part11.rar yenc
2016-04-09 13:45:09,180::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:45:09,180::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part12.rar yenc
2016-04-09 13:48:22,697::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:48:22,697::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part13.rar yenc
2016-04-09 13:50:21,714::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:50:22,325::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:50:22,934::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:50:23,089::INFO::[downloader:723] Thread [email protected]: server closed connection
2016-04-09 13:50:23,105::INFO::[decoder:226] <Article: [email protected], bytes=398546, partnum=172, art_id=None> wurde auf keinem Server gefunden und daher übersprungen
2016-04-09 13:50:27,089::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:50:28,089::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:50:28,089::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:50:28,089::INFO::[downloader:444] [email protected]: Initiating connection
2016-04-09 13:50:28,184::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:50:28,292::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:50:28,292::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:50:28,325::INFO::[downloader:637] Connecting [email protected] finished
2016-04-09 13:51:41,872::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:51:41,872::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part14.rar yenc
2016-04-09 13:51:44,716::INFO::[assembler:180] <Article: [email protected], bytes=398546, partnum=172, art_id=None> fehlt
2016-04-09 13:55:00,453::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:55:00,469::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part15.rar yenc
2016-04-09 13:55:30,437::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:55:30,437::INFO::[assembler:88] Decoding \\?\D:\Temp\testfile.S04E08\a3tq23tjslagjaslgasg.part16.rar yenc
2016-04-09 13:55:31,187::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzo_ct2uce removed
2016-04-09 13:55:31,187::INFO::[nzbqueue:250] Saving queue
2016-04-09 13:55:31,187::INFO::[__init__:941] Saving data for queue10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\queue10.sab
2016-04-09 13:55:31,203::INFO::[postproc:83] Saving postproc queue
2016-04-09 13:55:31,219::INFO::[__init__:941] Saving data for postproc2.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\postproc2.sab
2016-04-09 13:55:31,219::INFO::[postproc:280] Starting PostProcessing on testfile.S04E08 => Repair:True, Unpack:True, Delete:True, Script:None, Cat:*
2016-04-09 13:55:31,219::INFO::[postproc:578] Par2 check starting on testfile.S04E08
2016-04-09 13:55:31,328::INFO::[downloader:723] Thread [email protected]: forcing disconnect
2016-04-09 13:55:31,407::INFO::[__init__:897] \\?\D:\Temp\testfile.S04E08\__ADMIN__\__verified__ missing
2016-04-09 13:55:31,407::INFO::[postproc:599] Running repair on set a3tq23tjslagjaslgasg
2016-04-09 13:55:31,421::INFO::[newsunpack:1672] Quick-check of file a3tq23tjslagjaslgasg.part14.rar failed!
2016-04-09 13:55:31,421::INFO::[newsunpack:1054] Scanning "D:\Temp\TESTFI~1.S04\QW9HYJ~1.PAR"
2016-04-09 13:55:31,437::INFO::[downloader:723] Thread [email protected]: forcing disconnect
2016-04-09 13:55:31,484::ERROR::[postproc:518] Nachbearbeitung von testfile.S04E08 fehlgeschlagen ()
2016-04-09 13:55:31,484::INFO::[postproc:520] Traceback: 
Traceback (most recent call last):
  File "sabnzbd\postproc.pyo", line 292, in process_job
  File "sabnzbd\postproc.pyo", line 602, in parring
  File "sabnzbd\newsunpack.pyo", line 1080, in par2_repair
UnicodeDecodeError: 'utf8' codec can't decode byte 0xe4 in position 28: invalid continuation byte
2016-04-09 13:55:31,484::INFO::[postproc:550] Cleaning up testfile.S04E08 (keep_basic=True)
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_vmc927 removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_9chdo_ removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_hcc5qr removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_5pb2tl removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_cvsx0g removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_f7vvq4 removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_szstjs removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_6dfrw3 removed
2016-04-09 13:55:31,484::INFO::[__init__:931] \\?\D:\Temp\testfile.S04E08\__ADMIN__\SABnzbd_nzf_oqgdjv removed
2016-04-09 13:55:31,500::INFO::[misc:1283] Cannot remove folder \\?\D:\Temp\testfile.S04E08\__ADMIN__
2016-04-09 13:55:31,500::INFO::[misc:1283] Cannot remove folder \\?\D:\Temp\testfile.S04E08\__ADMIN__
2016-04-09 13:55:31,500::INFO::[postproc:83] Saving postproc queue
2016-04-09 13:55:31,500::INFO::[__init__:941] Saving data for postproc2.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\postproc2.sab
2016-04-09 13:55:31,500::INFO::[downloader:277] Post-processing finished, resuming download
2016-04-09 13:55:31,546::INFO::[downloader:723] Thread [email protected]: forcing disconnect
2016-04-09 13:55:31,657::INFO::[downloader:723] Thread [email protected]: forcing disconnect
2016-04-09 13:55:32,500::INFO::[nzbqueue:250] Saving queue
2016-04-09 13:55:32,500::INFO::[__init__:941] Saving data for queue10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\queue10.sab
2016-04-09 13:55:32,500::INFO::[__init__:941] Saving data for totals10.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\totals10.sab
2016-04-09 13:55:32,500::INFO::[__init__:941] Saving data for rss_data.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\rss_data.sab
2016-04-09 13:55:32,500::INFO::[__init__:941] Saving data for watched_data2.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\watched_data2.sab
2016-04-09 13:55:32,500::INFO::[postproc:83] Saving postproc queue
2016-04-09 13:55:32,500::INFO::[__init__:941] Saving data for postproc2.sab in C:\Dokumente und Einstellungen\Administrator\sabnzbd\admin\postproc2.sab
2016-04-09 13:55:32,500::INFO::[postproc:679] Queue has finished, launching: None (None)

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 9th, 2016, 8:21 am
by shypike
Please send the NZB to [email protected], including the URL of this message.
ZIP (or RAR) the file so that it keeps the exact same file name as it had.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 9th, 2016, 8:53 am
by sander
@isofan

Same problem as you posted here https://forums.sabnzbd.org/viewtopic.php?f=2&t=20520 ?
I replied to that post, you did not reply, and then you posted here?

Correct?

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 9th, 2016, 10:09 am
by isofan
Nearly correct sander, I posted to both threads at the same time, I already answered in the other thread:
http://forums.sabnzbd.org/viewtopic.php ... 31#p105431

Thanks for any ideas, this is really an annoying issue.

Btw, I use a German Windows Server 2003 system, but Sabnzbd set to english if that helps.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 9th, 2016, 10:33 am
by shypike
Still, please give us the NZB.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 10th, 2016, 1:44 pm
by apollo13
Hi folks,

hit this bug today when upgrading my FreeBSD Sabnzbd 0.7.20 to 1.0.0 [a58bb38]. Logfile says:

Code: Select all

2016-04-10 15:01:33,799::INFO::[newsunpack:233] Unrar finished on /usr/local/sabnzbd/Downloads/incomplete/MAG.Computerwelt.-.April.2016
2016-04-10 15:01:33,799::ERROR::[postproc:518] Post Processing Failed for MAG.Computerwelt.-.April.2016 ()
2016-04-10 15:01:33,800::INFO::[postproc:520] Traceback: 
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/sabnzbd/postproc.py", line 354, in process_job
    unpack_error, newfiles = unpack_magic(nzo, short_path(workdir), short_complete, flag_delete, one_folder, (), (), (), (), ())
  File "/usr/local/lib/python2.7/site-packages/sabnzbd/newsunpack.py", line 270, in unpack_magic
    xjoinables, xzips, xrars, xsevens, xts, depth)
  File "/usr/local/lib/python2.7/site-packages/sabnzbd/newsunpack.py", line 208, in unpack_magic
    xjoinables, xzips, xrars, xsevens, xts = build_filelists(workdir, workdir_complete)
  File "/usr/local/lib/python2.7/site-packages/sabnzbd/newsunpack.py", line 1616, in build_filelists
    for root, dirs, files in os.walk(workdir_complete):
  File "/usr/local/lib/python2.7/os.py", line 286, in walk
    if isdir(join(top, name)):
  File "/usr/local/lib/python2.7/posixpath.py", line 73, in join
    path += '/' + b
UnicodeDecodeError: 'utf8' codec can't decode byte 0xe4 in position 36: invalid continuation byte
UTF-8 0xe4 is a german "ä" and the NZB file contains a file with "ä". Maybe this is the issue...
Sabnzbd and Freebsd is set to english with german regional settings.
I installed it with pkg and again directly from the ports tree. It seems that everything else works fine. I can even use the downloaded files, but the GUI gives an error and the directory is still named _UNPACK_...

Let me know if you need further information!

Any help would be appreciated!

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 10th, 2016, 2:48 pm
by sander
I downloaded the same NZB with my SAB 1.0.0 on Linux, and ... no problem at all.

It's about this file, I suppose:

Code: Select all

$ ls hide.me\ \ Anonymer\ VPN\ und\ Privatsphärenschutz\ der\ Extraklasse.html  | hd
00000000  68 69 64 65 2e 6d 65 20  20 41 6e 6f 6e 79 6d 65  |hide.me  Anonyme|
00000010  72 20 56 50 4e 20 75 6e  64 20 50 72 69 76 61 74  |r VPN und Privat|
00000020  73 70 68 c3 a4 72 65 6e  73 63 68 75 74 7a 20 64  |sph..renschutz d|
00000030  65 72 20 45 78 74 72 61  6b 6c 61 73 73 65 2e 68  |er Extraklasse.h|
00000040  74 6d 6c 0a                                       |tml.|
00000044
The bytes for ä is c3 a4. I yet have to check if that is OK.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 10th, 2016, 3:04 pm
by shypike
What is the encoding of your file system? UTF-8 or some 8-bit ASCII encoding?

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 11th, 2016, 11:15 am
by apollo13
Sorry, but how do I find it out? I use UFS. I can only assume that's its not UTF-8 encoded.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 11th, 2016, 12:08 pm
by sander
apollo13 wrote:Sorry, but how do I find it out? I use UFS. I can only assume that's its not UTF-8 encoded.
I found this somewhere on the web:
UFS is 8 bit clean, so you can basically use it with any 8bit character set.
No encoding is enforced and no conversion is ever applied to file names on
UFS.

If you set your locale to UTF-8, you can use unicode characters in filenames.

For instance:

% touch "⡍⠜⠇⠑⠹ ⠺⠁⠎ ⠁⠎ ⠙⠑⠁⠙ ⠁⠎ ⠁ "
% ls
⡍⠜⠇⠑⠹ ⠺⠁⠎ ⠁⠎ ⠙⠑⠁⠙ ⠁⠎ ⠁
% rm ⡍⠜⠇⠑⠹\ ⠺⠁⠎\ ⠁⠎\ ⠙⠑⠁⠙\ ⠁⠎\ ⠁\
%
So ... can you do that?

EDIT:

On my Linux:

Code: Select all

$ locale
LANG=en_US.UTF-8
LANGUAGE=en_US
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC=nl_NL.UTF-8
LC_TIME=nl_NL.UTF-8
LC_COLLATE="en_US.UTF-8"
LC_MONETARY=nl_NL.UTF-8
LC_MESSAGES="en_US.UTF-8"
LC_PAPER=nl_NL.UTF-8
LC_NAME=nl_NL.UTF-8
LC_ADDRESS=nl_NL.UTF-8
LC_TELEPHONE=nl_NL.UTF-8
LC_MEASUREMENT=nl_NL.UTF-8
LC_IDENTIFICATION=nl_NL.UTF-8
LC_ALL=
... looks good: UTF-8, thus Unicode

Code: Select all

sander@streamer1504:~/kullie$ touch "⡍⠜⠇⠑⠹ ⠺⠁⠎ ⠁⠎ ⠙⠑⠁⠙ ⠁⠎ ⠁ " 
sander@streamer1504:~/kullie$ ls
⡍⠜⠇⠑⠹ ⠺⠁⠎ ⠁⠎ ⠙⠑⠁⠙ ⠁⠎ ⠁
... looks good too.

EDIT 2:

When I change the locale / LANG to POSIX... no good:

Code: Select all

sander@streamer1504:~/kullie$ LANG=POSIX
sander@streamer1504:~/kullie$ touch "⡍⠜⠇⠑⠹ ⠺⠁⠎"
sander@streamer1504:~/kullie$ ls
??????????????? ?????????

And FWIW:

Code: Select all

$ python -c "import locale; print locale.getlocale(); locale.setlocale(locale.LC_ALL,'en_US.utf8') ; print locale.getlocale(); "

(None, None)
('en_US', 'UTF-8')

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 11th, 2016, 1:36 pm
by apollo13
Thanks for your help.

Code: Select all

$ locale
LANG=
LC_CTYPE="C"
LC_COLLATE="C"
LC_TIME="C"
LC_NUMERIC="C"
LC_MONETARY="C"
LC_MESSAGES="C"
LC_ALL=
touch is not even possible!

Code: Select all

$  " - -           touch "
-bash:  - -           touch : command not found
Could this be the cause? But what to do to mitigate this and why did it work with 0.7.20?

Edit1:
Maybe this is something for the FreeBSD sub-forum...

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 11th, 2016, 2:05 pm
by sander
Your FreeBSD has no touch?!
And as you post that error message without solving it, I'm assuming you're not an experienced FreeBSD user. Am I correct? If so, is it a NAS?


SAB 1.0.0 has introduced Unicode, and that is very probably causing these problems to occur. My hypothesis is: certain Locale setting on a *ix system, with special characters in the NZB/download, with SAB 1.0.0, can cause these problems.

I have no FreeBSD myself. I will try if I can set your Locale setting on my Linux.

I set LANG to none/empty (just like your setup), and from the terminal I ran SABnzbd.py, and download the download with the ä in one of the filenames.

EDIT:

Result:

Code: Select all

hide.me  Anonymer VPN und PrivatsphPN und Privatsph
Ouch. Not good!

With my normal Locale settings, SABnzbd downloaded this:

Code: Select all

hide.me  Anonymer VPN und Privatsphärenschutz der Extraklasse.html
... quite something else.

So ... proven that the Locale LANG setting has impact on the resulting download. >:(

The good news: we're getting closer.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 11th, 2016, 2:13 pm
by apollo13
It has touch, but the Unicode mixed it up. I meant the UTF-8 issue not the missing touch command. I'm setting the whole system to UTF-8 and will let you know the outcome.

It's not a NAS, just a plain 10.2 install.

Code: Select all

# freebsd-version 
10.2-RELEASE-p14
# uname -a
FreeBSD server 10.2-RELEASE-p9 FreeBSD 10.2-RELEASE-p9 #0: Thu Jan 14 01:32:46 UTC 2016     [email protected]:/usr/obj/usr/src/sys/GENERIC  amd64
I do think the same, it looks like a locale issue - but this could be annoying for other FreeBSD users when upgrading.

Re: Bugs: UnicodeDecodeError: invalid continuation byte

Posted: April 11th, 2016, 2:39 pm
by sander
With test-touch.py being:

Code: Select all

# -*- coding: utf-8 -*-
import sys
import os
from subprocess import call
call(["touch", "file-test-töäuchie.txt"])
call(["ls", "-l"])
I use an external command ("touch") to simulate the effect of the external command unrar.

I get these results on Linux:

Code: Select all

$ LANG=en_US.utf8 && python test-touch.py 
total 8
-rw-rw-r-- 1 sander sander   0 apr 11 21:37 file-test-töäuchie.txt
-rw-rw-r-- 1 sander sander 294 apr 11 21:35 test-touch.py
-rw-rw-r-- 1 sander sander 294 apr 11 21:34 test-touch.py~
... so: good:

Then, with LANG set to none/empty:

Code: Select all

$ LANG= && python test-touch.py 
total 8
-rw-rw-r-- 1 sander sander   0 apr 11 21:35 file-test-t????uchie.txt
-rw-rw-r-- 1 sander sander 294 apr 11 21:35 test-touch.py
-rw-rw-r-- 1 sander sander 294 apr 11 21:34 test-touch.py~
... not good.
All times are UTC-05:00
Page 4 of 5

Powered by phpBB® Forum Software © phpBB Limited