Package: pathlesstaken
pathlesstakenProfile strings, e.g. file paths for digital preservation considerations, e.g.
characters that you want to preserve, or characters that you don't want to
preserve.pathlesstakenhas no external dependencies so you can clone this repo and
just run it. Just as long as your environment supports Python and you can
download it!Basis for this moduleThe original analysis was based around this non-recommended filenames from
Microsoft:Non-recommended names from MicrosoftThe code also contains copy Cooper Hewitt's code to enable writing of plain
text descriptions of Unicode characters. This portion of the code is licensedBSD 3-Clause "New" or "Revised" LicensePy-Unicode at Cooper HewittThe bigger project this code was developed for is still here:droid-siegfried-sqlite-analysisExample outputGiven a Unicode string:$ pathlesstaken.py ❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x2764, HEAVY BLACK HEART: ❤'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x1f496, SPARKLING HEART: 💖'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x1f499, BLUE HEART: 💙'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x1f49a, GREEN HEART: 💚'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x1f49b, YELLOW HEART: 💛'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x1f49c, PURPLE HEART: 💜'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x1f49d, HEART WITH RIBBON: 💝'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x2655, WHITE CHESS QUEEN: ♕'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x2656, WHITE CHESS ROOK: ♖'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x2657, WHITE CHESS BISHOP: ♗'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x2658, WHITE CHESS KNIGHT: ♘'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x2659, WHITE CHESS PAWN: ♙'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x265a, BLACK CHESS KING: ♚'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x265b, BLACK CHESS QUEEN: ♛'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x265c, BLACK CHESS ROOK: ♜'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x265d, BLACK CHESS BISHOP: ♝'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x265e, BLACK CHESS KNIGHT: ♞'File:'❤💖💙💚💛💜💝♕♖♗♘♙♚♛♜♝♞♟'contains,charactersoutsideofASCIIrange:'0x265f, BLACK CHESS PAWN: ♟'You can also run aprint testby running:$ pathlesstaken.py testFile: 'COM4' contains, reserved name 'COM4'
File: 'COM4.txt' contains, reserved name 'COM4'
File: 'AUX' contains, reserved name 'AUX'
File: 'CON' contains, reserved name 'CON'
File: 'space ' has a SPACE as its last character
File: 'period.' has a period '.' as its last character
File: 'ó' contains, characters outside of ASCII range: '0xf3, LATIN SMALL LETTER O WITH ACUTE: ó'
File: 'é' contains, characters outside of ASCII range: '0xe9, LATIN SMALL LETTER E WITH ACUTE: é'
File: 'ö' contains, characters outside of ASCII range: '0xf6, LATIN SMALL LETTER O WITH DIAERESIS: ö'
File: 'óéö' contains, characters outside of ASCII range: '0xf3, LATIN SMALL LETTER O WITH ACUTE: ó'
File: 'óéö' contains, characters outside of ASCII range: '0xe9, LATIN SMALL LETTER E WITH ACUTE: é'
File: 'óéö' contains, characters outside of ASCII range: '0xf6, LATIN SMALL LETTER O WITH DIAERESIS: ö'
File: 'file[bracket]one.txt' contains, non-recommended character: '0x5b, LEFT SQUARE BRACKET: ['
File: 'file[bracket]one.txt' contains, non-recommended character: '0x5d, RIGHT SQUARE BRACKET: ]'
File: 'file[two.txt' contains, non-recommended character: '0x5b, LEFT SQUARE BRACKET: ['
File: 'filethree].txt' contains, non-recommended character: '0x5d, RIGHT SQUARE BRACKET: ]'
File: '-=_|"' contains, non-recommended character: '0x7c, VERTICAL LINE: |'
File: '-=_|"' contains, non-recommended character: '0x22, QUOTATION MARK: "'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x3c, LESS-THAN SIGN: <'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x3e, GREATER-THAN SIGN: >'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x3a, COLON: :'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x22, QUOTATION MARK: "'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x2f, SOLIDUS: /'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x5c, REVERSE SOLIDUS: \'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x3f, QUESTION MARK: ?'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x2a, ASTERISK: *'
File: '(<>:"/\?*|-)' contains, non-recommended character: '0x7c, VERTICAL LINE: |'
File: '(<>:"/\?*|-)' contains, non-printable character: '0x0, <control character>'
File: '(<>:"/\?*|-)' contains, non-printable character: '0x1f, <control character>'Please let me know how it goes if you try out this code.Sister projectIf you like to understand your filepaths, but don't need all the detail,
there's a third-way, by taking a look at thefndecproject I
created in Golang and using utilities from Richard Lehane'sSiegfried. More info after the jump.DocsAll docs are available indocs.DESCRIPTION
    Module that implements checks against the Microsoft Recommendations for
    file naming, plus additional recommended analyses documented below.

    First created based on the recommendations here:
        http://msdn.microsoft.com/en-us/library/aa365247(VS.85).aspx

    First available in:
        https://github.com/exponential-decay/droid-siegfried-sqlite-analysis-engine

    Methods defined here:
     |
     |  complete_file_name_analysis(self, string, folders=False, verbose=False)
     |      Run all analyses over a string object. The analyses are as follows:
     |
     |      * detect_non_ascii_characters
     |      * detect_non_recommended_characters
     |      * detect_non_printable_characters
     |      * detect_microsoft_reserved_names
     |      * detect_spaces_at_end_of_names
     |      * detect_period_at_end_of_name
     |
     |  detect_microsoft_reserved_names(self, string)
     |      Detect names that are considered difficult on Microsoft file
     |      systems. There is a special history to these characters which can be
     |      read about on this link below:
     |
     |          * http://msdn.microsoft.com/en-us/library/aa365247(VS.85).aspx
     |
     |  detect_non_ascii_characters(self, string, folders=False)
     |      Detect characters outside of an ASCII range. These are more
     |      difficult to preserve in today's systems, even still, though it is
     |      getting easier.
     |
     |  detect_non_printable_characters(self, string, folders=False)
     |      Detect control characters below 0x20 in the ASCII table that cannot
     |      be printed. Examples include ESC (escape) or BS (backspace).
     |
     |  detect_non_recommended_characters(self, string, folders=False)
     |      Detect characters that are not particularly recommended. These
     |      characters for example a forward slash '/' often have other meanings
     |      in computer systems and can be interpreted incorrectly if not handled
     |      properly.
     |
     |  detect_period_at_end_of_name(self, string, folders=False)
     |      Detect a full-stop at the end of a name. This might indicate a
     |      missing file extension.
     |
     |  detect_spaces_at_end_of_names(self, string, folders=False)
     |      Detect spaces at the end of a string. These spaces if ignored can
     |      lead to incorrectly matching strings, e.g. 'this ' is different to
     |      'this'.
     |LicenseThis unique parts of this code is licensed usingGPLv3