accented letters issues

[ricorico94]

Hi,

For whatever reason, I can not "touch" remote files containing accented letters (é, â,..) to modify their timestamp. I receive an error everytime ("no such file or directory"), showing the file name with codes replacing the accented letter (ie showing "Tranchée Ã" instead of "Tranchée à" ).
note: Transferring such files is OK, but apparently losing the timestamp.

Thanks for help,
Ricorico94

[Aaron]

Hello,

I have tested with these file names on our own FTP server without issue. Would you be able to send in a copy of your FTP log when you try to connect, transfer, and then Touch? You can email it to [email protected]. Please include a link to this forum post if you email us.

[Zoë]

Thanks for the logs. This only occurs on servers PureFTPD/Pro-FTPd servers that don't use UTF-8 for filenames (fairly rare nowadays). I found the bug and it will be fixed in a future release.

[ricorico94]

Hi,

I re-initiate this topic, because I'm trying the latest release of BC3 (BC3.2.3) and because the remote server I use for backups has been upgraded (in fact, migrated to a new, more recent, server), and I still can not use BC for filenames with accented letters, despite I see UTF8 listed upon ftp connection.

I join here the messages appearing first when displaying the remote directory, and then after I right-click and Touch one file (this nclude the letter "é" ). (I did anonymize logins..)

14/01/2011 11:59:29 Stat> Connected.
14/01/2011 11:59:29 Recv> 220---------- Welcome to Pure-FTPd [privsep] [TLS] ----------
14/01/2011 11:59:29 220-You are user number 29 of 200 allowed.
14/01/2011 11:59:29 220-Local time is now 04:58. Server port: 21.
14/01/2011 11:59:29 220-IPv6 connections are also welcome on this server.
14/01/2011 11:59:29 220 You will be disconnected after 15 minutes of inactivity.
14/01/2011 11:59:29 Sent> AUTH TLS
14/01/2011 11:59:30 Recv> 234 AUTH TLS OK.
14/01/2011 11:59:30 Sent> USER someone
14/01/2011 11:59:31 Recv> 331 User someone OK. Password required
14/01/2011 11:59:31 Sent> PASS ********
14/01/2011 11:59:31 Recv> 230-User someone has group access to: www-data
14/01/2011 11:59:31 230 OK. Current directory is /
14/01/2011 11:59:31 Sent> FEAT
14/01/2011 11:59:31 Recv> 211-Extensions supported:
14/01/2011 11:59:31 EPRT
14/01/2011 11:59:31 IDLE
14/01/2011 11:59:31 MDTM
14/01/2011 11:59:31 SIZE
14/01/2011 11:59:31 REST STREAM
14/01/2011 11:59:31 MLST type*;size*;sizd*;modify*;UNIX.mode*;UNIX.uid*;UNI X.gid*;unique*;
14/01/2011 11:59:31 MLSD
14/01/2011 11:59:31 AUTH TLS
14/01/2011 11:59:31 PBSZ
14/01/2011 11:59:31 PROT
14/01/2011 11:59:31 UTF8
14/01/2011 11:59:31 TVFS
14/01/2011 11:59:31 ESTA
14/01/2011 11:59:31 PASV
14/01/2011 11:59:31 EPSV
14/01/2011 11:59:31 SPSV
14/01/2011 11:59:31 ESTP
14/01/2011 11:59:31 211 End.
14/01/2011 11:59:31 Sent> TYPE I
14/01/2011 11:59:31 Recv> 200 TYPE is now 8-bit binary
14/01/2011 11:59:31 Sent> SYST
14/01/2011 11:59:32 Recv> 215 UNIX Type: L8
14/01/2011 11:59:32 Sent> OPTS UTF8 ON
14/01/2011 11:59:32 Recv> 200 OK, UTF-8 enabled
14/01/2011 11:59:32 Sent> PWD
14/01/2011 11:59:32 Recv> 257 "/" is your current location
14/01/2011 11:59:32 Load comparison: F:\BackupDD\Fichiers Download\central-Mes documents 1998-2009 <-> ftps://someone@ols16.com/mybackups/central-Mes documents 1998-2009
14/01/2011 11:59:32 Sent> CWD /mybackups/central-Mes documents 1998-2009/XB Backup/E
14/01/2011 11:59:32 Recv> 250 OK. Current directory is /mybackups/central-Mes documents 1998-2009/XB Backup/E
14/01/2011 11:59:32 Sent> PBSZ 0
14/01/2011 11:59:33 Recv> 200 PBSZ=0
14/01/2011 11:59:33 Sent> PROT P
14/01/2011 11:59:33 Recv> 200 Data protection level set to "private"
14/01/2011 11:59:33 Sent> PASV
14/01/2011 11:59:33 Recv> 227 Entering Passive Mode (64,64,131,116,25,73)
14/01/2011 11:59:33 Sent> MLSD
14/01/2011 11:59:34 Recv> 150 Accepted data connection
14/01/2011 11:59:35 Recv> 226-Options: -a -l
14/01/2011 11:59:35 226 21 matches total

Then if I select one file to be touched, I have the following:

14/01/2011 12:01:54 Stat> Connected.
14/01/2011 12:01:54 Recv> 220---------- Welcome to Pure-FTPd [privsep] [TLS] ----------
14/01/2011 12:01:54 220-You are user number 28 of 200 allowed.
14/01/2011 12:01:54 220-Local time is now 05:00. Server port: 21.
14/01/2011 12:01:54 220-IPv6 connections are also welcome on this server.
14/01/2011 12:01:54 220 You will be disconnected after 15 minutes of inactivity.
14/01/2011 12:01:54 Sent> AUTH TLS
14/01/2011 12:01:54 Recv> 234 AUTH TLS OK.
14/01/2011 12:01:55 Sent> USER someone
14/01/2011 12:01:55 Recv> 331 User someone OK. Password required
14/01/2011 12:01:55 Sent> PASS ********
14/01/2011 12:01:56 Recv> 230-User someone has group access to: www-data
14/01/2011 12:01:56 230 OK. Current directory is /
14/01/2011 12:01:56 Sent> FEAT
14/01/2011 12:01:56 Recv> 211-Extensions supported:
14/01/2011 12:01:56 EPRT
14/01/2011 12:01:56 IDLE
14/01/2011 12:01:56 MDTM
14/01/2011 12:01:56 SIZE
14/01/2011 12:01:56 REST STREAM
14/01/2011 12:01:56 MLST type*;size*;sizd*;modify*;UNIX.mode*;UNIX.uid*;UNI X.gid*;unique*;
14/01/2011 12:01:56 MLSD
14/01/2011 12:01:56 AUTH TLS
14/01/2011 12:01:56 PBSZ
14/01/2011 12:01:56 PROT
14/01/2011 12:01:56 UTF8
14/01/2011 12:01:56 TVFS
14/01/2011 12:01:56 ESTA
14/01/2011 12:01:56 PASV
14/01/2011 12:01:56 EPSV
14/01/2011 12:01:56 SPSV
14/01/2011 12:01:56 ESTP
14/01/2011 12:01:56 211 End.
14/01/2011 12:01:56 Sent> TYPE I
14/01/2011 12:01:56 Recv> 200 TYPE is now 8-bit binary
14/01/2011 12:01:56 Sent> SYST
14/01/2011 12:01:56 Recv> 215 UNIX Type: L8
14/01/2011 12:01:56 Sent> OPTS UTF8 ON
14/01/2011 12:01:57 Recv> 200 OK, UTF-8 enabled
14/01/2011 12:01:57 Sent> PWD
14/01/2011 12:01:57 Recv> 257 "/" is your current location
14/01/2011 12:01:57 Sent> CWD /mybackups/central-Mes documents 1998-2009
14/01/2011 12:01:57 Recv> 250 OK. Current directory is /mybackups/central-Mes documents 1998-2009
14/01/2011 12:01:57 Sent> SITE UTIME 2005_1218BELLECOMBE0001 recadré.jp2 20060108224148 20060108224148 20060108224148 UTC
14/01/2011 12:01:58 Recv> 550 utime(2005_1218BELLECOMBE0001 recadré.jp2): No such file or directory
14/01/2011 12:01:58 Unable to set last modified time of ftps://someone@ols16.com/mybackups/central-Mes documents 1998-2009/2005_1218BELLECOMBE0001 recadré.jp2: utime(2005_1218BELLECOMBE0001 recadré.jp2): No such file or directory

14/01/2011 12:01:58 Failed to touch 1 items. Completed in 4,18 seconds.

When I view FTP profiles in BC3, the degault is on "Detect" and profile for this server uses defaults.

If I change "Detect" into "UTF-8" (still in default), then I touch the file and get either :

14/01/2011 12:11:11 Unable to set last modified time of ftps://[email protected]/mybackups/central-Mes documents 1998-2009/2005_1218BELLECOMBE0001 recadré.jp2: Container does not support requested file operation
14/01/2011 12:11:11 Failed to touch 1 items. Completed in 0,01 seconds.

or

14/01/2011 12:16:59 Stat> Connected.
14/01/2011 12:16:59 Recv> 220---------- Welcome to Pure-FTPd [privsep] [TLS] ----------
14/01/2011 12:16:59 220-You are user number 30 of 200 allowed.
14/01/2011 12:16:59 220-Local time is now 05:15. Server port: 21.
14/01/2011 12:16:59 220-IPv6 connections are also welcome on this server.
14/01/2011 12:16:59 220 You will be disconnected after 15 minutes of inactivity.
14/01/2011 12:16:59 Sent> AUTH TLS
14/01/2011 12:16:59 Recv> 234 AUTH TLS OK.
14/01/2011 12:17:00 Sent> USER someone
14/01/2011 12:17:00 Recv> 331 User someoneOK. Password required
14/01/2011 12:17:00 Sent> PASS ********
14/01/2011 12:17:01 Recv> 230-User someonehas group access to: www-data
14/01/2011 12:17:01 230 OK. Current directory is /
14/01/2011 12:17:01 Sent> FEAT
14/01/2011 12:17:01 Recv> 211-Extensions supported:
14/01/2011 12:17:01 EPRT
14/01/2011 12:17:01 IDLE
14/01/2011 12:17:01 MDTM
14/01/2011 12:17:01 SIZE
14/01/2011 12:17:01 REST STREAM
14/01/2011 12:17:01 MLST type*;size*;sizd*;modify*;UNIX.mode*;UNIX.uid*;UNI X.gid*;unique*;
14/01/2011 12:17:01 MLSD
14/01/2011 12:17:01 AUTH TLS
14/01/2011 12:17:01 PBSZ
14/01/2011 12:17:01 PROT
14/01/2011 12:17:01 UTF8
14/01/2011 12:17:01 TVFS
14/01/2011 12:17:01 ESTA
14/01/2011 12:17:01 PASV
14/01/2011 12:17:01 EPSV
14/01/2011 12:17:01 SPSV
14/01/2011 12:17:01 ESTP
14/01/2011 12:17:01 211 End.
14/01/2011 12:17:01 Sent> TYPE I
14/01/2011 12:17:02 Recv> 200 TYPE is now 8-bit binary
14/01/2011 12:17:02 Sent> SYST
14/01/2011 12:17:02 Recv> 215 UNIX Type: L8
14/01/2011 12:17:02 Sent> PWD
14/01/2011 12:17:02 Recv> 257 "/" is your current location
14/01/2011 12:17:02 Sent> CWD /mybackups/central-Mes documents 1998-2009
14/01/2011 12:17:02 Recv> 250 OK. Current directory is /mybackups/central-Mes documents 1998-2009
14/01/2011 12:17:02 Sent> SITE UTIME 2005_1218BELLECOMBE0001 recadré.jp2 20060108224148 20060108224148 20060108224148 UTC
14/01/2011 12:17:03 Recv> 550 utime(2005_1218BELLECOMBE0001 recadré.jp2): No such file or directory
14/01/2011 12:17:03 Unable to set last modified time of ftps://someone@ols16.com/mybackups/central-Mes documents 1998-2009/2005_1218BELLECOMBE0001 recadré.jp2: utime(2005_1218BELLECOMBE0001 recadré.jp2): No such file or directory

14/01/2011 12:17:03 Failed to touch 1 items. Completed in 3,74 seconds.

Since in your answer you had mentionned it was linked with missing UTF8 and that now I see it in connexion logs, I'm wondering if I can do something with BC3 to manipulate my files with accented letters..

br,
Ricorico

[Zoë]

Ricorico,

Are you having trouble with uploading new files or touching existing ones? Have you verified outside of FTP that the extended characters are valid (via HTTP, for example)? The reason I ask is that if you uploaded files with their names encoded as ANSI and then they were copied to another system that was expecting UTF-8, it might not have done any verification. In that case Pure-FTPd says it wants UTF-8 but actually returns filenames encoded as ANSI, so everything gets messed up. If that happens the only solutions are to try manually renaming the files, deleting and re-uploading, or running convmv on the system (using SSH or telnet).