[Synology NAS] Fixed non-ASCII chars and more...(2020/09/11)

[starsys]

Hello LapinFou.

Peux tu me dire quelles sont les différences entre la version SAbnzbd de Superzebulon et Synocommunity ?
Perso tu conseilles laquelle ?
Je devrais recevoir mon NAS de retour de SAV cette semaine.
Merci.

[LapinFou]

Il n'a pas vraiment de différence, mis à part que le Package SynoCommunity inclus mon script depuis la version 0.6.15-2.

PS: Quand tout sera rentré dans l'ordre pour ton NAS, merci de poster un message pour dire si tout marche bien

[starsys]

Hello. J'ai récupéré mon NAS. tout semble marcher parfaitement.
Je vais chez mes parents cet après midi, je regarde aussi de leur coté mais y'a pas de raisons que ca marche pas. Merci encore.

[LapinFou]

Merci pour le feedback.
Heureux de savoir que le renommage fonctionne bien ainsi que, je suppose, l'indexation auto dans le DLNA.

[arto65]

Thanks a lot for that script!
I see that it would also be possible to enable full UTF8 support on the synology, but it's troublesome and has to be done after each dsm update. Your solution is easy and survives updates!
Your script is awesome, thanks again!

[LapinFou]

You're very welcome. I'm glad to see an happy user !!


You're right this issue is coming from the fact that the default system file under root is NOT UTF-8. Soon, I'll try to contact Synology to see if they can add the locale CLI for a future DSM release. And you're also right the benefit of this script is to not be deleted after a DSM upgrade.

[starsys]

Testé aussi chez mes parents : aucun soucis.

Au top !

[callten061]

that it is working thanks!!!

[LapinFou]

You are welcome !!

[LapinFou]

Edit 25th of July: added some snapshots

[LapinFou]

[Edit 16th of September: added 7z unpack capability + move to a destination folder + DLNA indexer]
[Also proposed a modified sabToSickBeard.py version in order to unpack .7z archive.]

[Raik85]

Sorry, but i don't get it and it makes me crazy ;/

Where in Line 54 can i enable DLNA indexing with synoindex?

I see some Guys have the same Question in Frensh, but i can't read it - shame on me.

My CharTranslator.py:

Code: Select all

#!/usr/local/sabnzbd/env/bin/python -OO
# -*- coding: iso-8859-15 -*-
#
# If a file has been archieved under an ISO-8859 environment and unarchived
# under an UTF8 environment, then you will get an encoding format problem.
# The file will not be readable through SAMBA.
#
# Renaming script for SABnzbd runnning under Synology NAS.
# By default the NZB software is running under UTF-8 encoding format
# in order to correctly handle the french accents (éèàç...) a SABnzbd
# post-script must be run in order to convert the file encoding.
#
# To fix this problem, you must convert the encoding format
# to the UTF8 (default Synology encoding)
# The script is trying to detect if the original file/directory are coming
# from a RAR archive. In this case the unrar command on your Syno system will
# unpack in CP437 format (DOS).
# NB: in all cases, files will be readable through samba, even if the detection
# failed. But converted characters will not be good, ex: Î? instead é
# 
# Remark: I guess it should work for any other encoding style. Just replace
# ISO-8859-15 (Western Europe) by the one coresponding to your country:  
# http://en.wikipedia.org/wiki/Character_encoding#Common_character_encodings
# 
# Done by LapinFou
#   date   | version |     comment
#--------------------------------------
# 12-04-22 |   1.0   | Initial version
# 12-04-22 |   1.1   | Change encoding to ISO-8859-15
#                    | Added CP437 special characters (0x80-0x9A)
# 12-04-24 |   1.2   | Mixed encoding is now supported
#                    | UTF-8 encoding format detected
# 12-04-24 |   1.3   | Fixed typo line 57 (test must be 0xA0, not 0xA1)
#

# get library modules
import sys, os

########################
# ----- Functions ---- #
########################

# Special character hex range:
# CP437: 0x80-0x9A (fortunately not used in ISO-8859-15)
# UTF-8: 1st hex code 0xC2-0xC3 followed by a 2nd hex code 0xA1-0xFF
# ISO-8859-15: 0xA0-0xFF
# The function will detect if fileDirName contains a special character
# If there is special character, detects if it is a UTF-8, CP437 or ISO-8859-15 encoding
def renameFunc(fullPath, fileDirName):
	encodingDetected = False
	# parsing all files/directories in odrer to detect if CP437 is used
	for Idx in range(len(fileDirName)):
		# /!\ detection is done 2char by 2char for UTF-8 special character
		if (len(fileDirName) != 1) & (Idx < (len(fileDirName) - 1)):
			# Detect UTF-8
			if ((fileDirName[Idx] == '\xC2') | (fileDirName[Idx] == '\xC3')) & ((fileDirName[Idx+1] >= '\xA0') & (fileDirName[Idx+1] <= '\xFF')):
				print os.path.join(fullPath, fileDirName) + " -> UTF-8 detected: Nothing to be done"
				encodingDetected = True
				break;
			# Detect CP437
			elif (fileDirName[Idx] >= '\x80') & (fileDirName[Idx] <= '\x9A'):
				utf8Name = fileDirName.decode('cp437')
				utf8Name = utf8Name.encode('utf-8')
				os.rename(os.path.join(fullPath, fileDirName), os.path.join(fullPath, utf8Name))
				print os.path.join(fullPath, utf8Name) + " -> CP437 detected: Renamed"
				encodingDetected = True
				break;
			# Detect ISO-8859-15
			elif (fileDirName[Idx] >= '\xA0') & (fileDirName[Idx] <= '\xFF'):
				utf8Name = fileDirName.decode('iso-8859-15')
				utf8Name = utf8Name.encode('utf-8')
				os.rename(os.path.join(fullPath, fileDirName), os.path.join(fullPath, utf8Name))
				print os.path.join(fullPath, utf8Name) + " -> ISO-8859-15 detected: Renamed"
				encodingDetected = True
				break;
		else:
			# Detect CP437
			if (fileDirName[Idx] >= '\x80') & (fileDirName[Idx] <= '\x9A'):
				utf8Name = fileDirName.decode('cp437')
				utf8Name = utf8Name.encode('utf-8')
				os.rename(os.path.join(fullPath, fileDirName), os.path.join(fullPath, utf8Name))
				print os.path.join(fullPath, utf8Name) + " -> CP437 detected: Renamed"
				encodingDetected = True
				break;
			# Detect ISO-8859-15
			elif (fileDirName[Idx] >= '\xA0') & (fileDirName[Idx] <= '\xFF'):
				utf8Name = fileDirName.decode('iso-8859-15')
				utf8Name = utf8Name.encode('utf-8')
				os.rename(os.path.join(fullPath, fileDirName), os.path.join(fullPath, utf8Name))
				print os.path.join(fullPath, utf8Name) + " -> ISO-8859-15 detected: Renamed"
				encodingDetected = True
				break;
	if (encodingDetected == False):
		print os.path.join(fullPath, fileDirName) + " -> No special characters detected: Nothing to be done"
	
	return

########################
# --- Main Program --- #
########################

# get argument: directory of the SABnzbd job
os.chdir(sys.argv[1])

# display directory of the SABnzbd job
currentFolder = os.getcwd()
print "Current folder is" + currentFolder

# rename SABnzbd job directory (coming from SABnzbd: never in CP437 format)
print "Renaming folders to UTF-8..."
renameFunc('', currentFolder)

# process each sub-folders starting from the deepest level
for dirname, dirnames, filenames in os.walk('.', topdown=False):
	for subdirname in dirnames:
		renameFunc(dirname, subdirname)
print "Folder renaming Done !"
print ""

# process each file recursively
print "Renaming files to UTF-8..."
for dirname, dirnames, filenames in os.walk('.'):
	for filename in filenames:
		renameFunc(dirname, filename)
print "Files renaming Done !"
print ""
print "Character encoding translation done!"

[LapinFou]

Hi Raik85,

Your problem is: you don't have the latest version of the script !
Please copy/paste from the first post the version 1.4.
Please be careful:
1- Don't used SELECT ALL button of this forum, otherwise a tab will be added in front of each line, and the Python script will not bet able to be launched.
2- Used an advanced editor (such as NotePad++), to ensure EOL (End OF Line) are in Unix format and not in Windows format. Otherwise, you will get an error like '-ash command can not be found'
3- Be sure the first line match where your Python command is installed.

Keep me in touch!

[Raik85]

Hervorragend!

I thank you, now it works ;-)

[LapinFou]

You're welcome!