neulab/tldr huggingface dataset:
v1.46 - 2019-02-09 • New backends
• Support Alibaba Cloud (Aliyun) OSS via the s3 backend (Nick Craig-Wood)
• serve dlna: serves a remove via DLNA for the local network (nicolov)
• copy, move: Restore deprecated --no-traverse flag (Nick Craig-Wood)
• This is useful for when transferring a small number of files into a large destination
• genautocomplete: Add remote path completion for bash completion (Christopher Peterson & Danil Semelenov)
• Buffer memory handling reworked to return memory to the OS better (Nick Craig-Wood)
• Buffer recycling library to replace sync.Pool
• Optionally use memory mapped memory for better memory shrinking
• Enable with --use-mmap if having memory problems - not default yet
• Parallelise reading of files specified by --files-from (Nick Craig-Wood)
• check: Add stats showing total files matched.  (Dario Guzik)
• Allow rename/delete open files under Windows (Nick Craig-Wood)
• lsjson: Use exactly the correct number of decimal places in the seconds (Nick Craig-Wood)
• Add cookie support with cmdline switch --use-cookies for all HTTP based remotes (qip)
• Warn if --checksum is set but there are no hashes available (Nick Craig-Wood)
• Rework rate limiting (pacer) to be more accurate and allow bursting (Nick Craig-Wood)
• Improve error reporting for too many/few arguments in commands (Nick Craig-Wood)
• listremotes: Remove -l short flag as it conflicts with the new global flag (weetmuts)
• Make http serving with auth generate INFO messages on auth fail (Nick Craig-Wood)
• Fix layout of stats (Nick Craig-Wood)
• Fix --progress crash under Windows Jenkins (Nick Craig-Wood)
• Fix transfer of google/onedrive docs by calling Rcat in Copy when size is -1 (Cnly)
• copyurl: Fix checking of --dry-run (Denis Skovpen)
• Check that mountpoint and local directory to mount don't overlap (Nick Craig-Wood)
• Fix mount size under 32 bit Windows (Nick Craig-Wood)
• Implement renaming of directories for backends without DirMove (Nick Craig-Wood)
• now all backends except b2 support renaming directories
• Implement --vfs-cache-max-size to limit the total size of the cache (Nick Craig-Wood)
• Add --dir-perms and --file-perms flags to set default permissions (Nick Craig-Wood)
• Fix deadlock on concurrent operations on a directory (Nick Craig-Wood)
• Fix deadlock between RWFileHandle.close and File.Remove (Nick Craig-Wood)
• Fix renaming/deleting open files with cache mode "writes" under Windows (Nick Craig-Wood)
• Fix panic on rename with --dry-run set (Nick Craig-Wood)
• Fix vfs/refresh with recurse=true needing the --fast-list flag
• Add support for -l/--links (symbolic link translation) (yair@unicorn)
• this works by showing links as link.rclonelink - see local backend docs for more info
• this errors if used with -L/--copy-links
• Fix renaming/deleting open files on Windows (Nick Craig-Wood)
• Check for maximum length before decrypting filename to fix panic (Garry McNulty)
• Allow building azureblob backend on *BSD (themylogin)
• Use the rclone HTTP client to support --dump headers, --tpslimit, etc.  (Nick Craig-Wood)
• Use the s3 pacer for 0 delay in non error conditions (Nick Craig-Wood)
• Ignore directory markers (Nick Craig-Wood)
• Stop Mkdir attempting to create existing containers (Nick Craig-Wood)
• cleanup: will remove unfinished large files >24hrs old (Garry McNulty)
• For a bucket limited application key check the bucket name (Nick Craig-Wood)
• before this, rclone would use the authorised bucket regardless of what you put on the command line
• Added --b2-disable-checksum flag (Wojciech Smigielski)
• this enables large files to be uploaded without a SHA-1 hash for speed reasons
• Set default pacer to 100ms for 10 tps (Nick Craig-Wood)
• This fits the Google defaults much better and reduces the 403 errors massively
• Add --drive-pacer-min-sleep and --drive-pacer-burst to control the pacer
• Improve ChangeNotify support for items with multiple parents (Fabian Möller)
• Fix ListR for items with multiple parents - this fixes oddities with vfs/refresh (Fabian Möller)
• Fix using --drive-impersonate and appfolders (Nick Craig-Wood)
• Fix google docs in rclone mount for some (not all) applications (Nick Craig-Wood)
• Retry-After support for Dropbox backend (Mathieu Carbou)
• Wait for 60 seconds for a connection to Close then declare it dead (Nick Craig-Wood)
• helps with indefinite hangs on some FTP servers
• Update google cloud storage endpoints (weetmuts)
• Add an example with username and password which is supported but wasn't documented (Nick Craig-Wood)
• Fix backend with --files-from and non-existent files (Nick Craig-Wood)
• Make error message more informative if authentication fails (Nick Craig-Wood)
• Resume and deduplication support (Oliver Heyme)
• Use token auth for all API requests Don't store password anymore (Sebastian Bünger)
• Add support for 2-factor authentication (Sebastian Bünger)
• Implement v2 account login which fixes logins for newer Mega accounts (Nick Craig-Wood)
• Return error if an unknown length file is attempted to be uploaded (Nick Craig-Wood)
• Add new error codes for better error reporting (Nick Craig-Wood)
• Fix broken support for "shared with me" folders (Alex Chen)
• Fix root ID not normalised (Cnly)
• Return err instead of panic on unknown-sized uploads (Cnly)
• Fix go routine leak on multipart upload errors (Nick Craig-Wood)
• Add upload chunk size/concurrency/cutoff control (Nick Craig-Wood)
• Default --qingstor-upload-concurrency to 1 to work around bug (Nick Craig-Wood)
• Implement --s3-upload-cutoff for single part uploads below this (Nick Craig-Wood)
• Change --s3-upload-concurrency default to 4 to increase performance (Nick Craig-Wood)
• Add --s3-bucket-acl to control bucket ACL (Nick Craig-Wood)
• Auto detect region for buckets on operation failure (Nick Craig-Wood)
• Add GLACIER storage class (William Cocker)
• Add Scaleway to s3 documentation (Rémy Léone)
• Add AWS endpoint eu-north-1 (weetmuts)
• Add support for PEM encrypted private keys (Fabian Möller)
• Add option to force the usage of an ssh-agent (Fabian Möller)
• Perform environment variable expansion on key-file (Fabian Möller)
• Fix rmdir on Windows based servers (e.g.  CrushFTP) (Nick Craig-Wood)
• Fix rmdir deleting directory contents on some SFTP servers (Nick Craig-Wood)
• Fix error on dangling symlinks (Nick Craig-Wood)
• Add --swift-no-chunk to disable segmented uploads in rcat/mount (Nick Craig-Wood)
• Introduce application credential auth support (kayrus)
• Fix memory usage by slimming Object (Nick Craig-Wood)
• Fix extra requests on upload (Nick Craig-Wood)
• Fix reauth on big files (Nick Craig-Wood)
• Fix poll-interval not working (Nick Craig-Wood)
• Support About which means rclone mount will show the correct disk size (Nick Craig-Wood)
• Support MD5 and SHA1 hashes with Owncloud and Nextcloud (Nick Craig-Wood)
• Fail soft on time parsing errors (Nick Craig-Wood)
• Fix infinite loop on failed directory creation (Nick Craig-Wood)
• Fix identification of directories for Bitrix Site Manager (Nick Craig-Wood)
• Fix upload of 0 length files on some servers (Nick Craig-Wood)
• Fix if MKCOL fails with 423 Locked assume the directory exists (Nick Craig-Wood)
v1.45 - 2018-11-24 • New backends
• The Yandex backend was re-written - see below for details (Sebastian Bünger)
• rcd: New command just to serve the remote control API (Nick Craig-Wood)
• The remote control API (rc) was greatly expanded to allow full control over rclone (Nick Craig-Wood)
• sensitive operations require authorization or the --rc-no-auth flag
• config/* operations to configure rclone
• options/* for reading/setting command line flags
• operations/* for all low level operations, e.g.  copy file, list directory
• sync/* for sync, copy and move
• --rc-files flag to serve files on the rc http server
• this is for building web native GUIs for rclone
• Optionally serving objects on the rc http server
• Ensure rclone fails to start up if the --rc port is in use already
• See the rc docs (https://rclone.org/rc/) for more info
• sync/copy/move
• Make --files-from only read the objects specified and don't scan directories (Nick Craig-Wood)
• This is a huge speed improvement for destinations with lots of files
• filter: Add --ignore-case flag (Nick Craig-Wood)
• ncdu: Add remove function ('d' key) (Henning Surmeier)
• rc command
• Add --json flag for structured JSON input (Nick Craig-Wood)
• Add --user and --pass flags and interpret --rc-user, --rc-pass, --rc-addr (Nick Craig-Wood)
• Require go1.8 or later for compilation (Nick Craig-Wood)
• Enable softfloat on MIPS arch (Scott Edlund)
• Integration test framework revamped with a better report and better retries (Nick Craig-Wood)
• cmd: Make --progress update the stats correctly at the end (Nick Craig-Wood)
• config: Create config directory on save if it is missing (Nick Craig-Wood)
• dedupe: Check for existing filename before renaming a dupe file (ssaqua)
• move: Don't create directories with --dry-run (Nick Craig-Wood)
• operations: Fix Purge and Rmdirs when dir is not the root (Nick Craig-Wood)
• serve http/webdav/restic: Ensure rclone exits if the port is in use (Nick Craig-Wood)
• Make --volname work for Windows and macOS (Nick Craig-Wood)
• Avoid context deadline exceeded error by setting a large TryTimeout value (brused27)
• Fix erroneous Rmdir error "directory not empty" (Nick Craig-Wood)
• Wait for up to 60s to create a just deleted container (Nick Craig-Wood)
• Add dropbox impersonate support (Jake Coggiano)
• Fix bug in --fast-list handing of empty folders (albertony)
• Fix transfer of files with + and & in (Nick Craig-Wood)
• Fix retries of upload chunks (Nick Craig-Wood)
• Set ACL for server-side copies to that provided by the user (Nick Craig-Wood)
• Fix role_arn, credential_source, ...  (Erik Swanson)
• Add config info for Wasabi's US-West endpoint (Henry Ptasinski)
• Ensure file hash checking is really disabled (Jon Fautley)
• Add pacer for retries to make swift more reliable (Nick Craig-Wood)
• Add Content-Type to PUT requests (Nick Craig-Wood)
• Fix config parsing so --webdav-user and --webdav-pass flags work (Nick Craig-Wood)
• Add RFC3339 date format (Ralf Hemberger)
• The yandex backend was re-written (Sebastian Bünger)
• This implements low level retries (Sebastian Bünger)
• Copy, Move, DirMove, PublicLink and About optional interfaces (Sebastian Bünger)
• Improved general error handling (Sebastian Bünger)
• Removed ListR for now due to inconsistent behaviour (Sebastian Bünger)
v1.44 - 2018-10-15 • New commands
• serve ftp: Add ftp server (Antoine GIRARD)
• settier: perform storage tier changes on supported remotes (sandeepkru)
• Reworked command line help
• Make default help less verbose (Nick Craig-Wood)
• Split flags up into global and backend flags (Nick Craig-Wood)
• Implement specialised help for flags and backends (Nick Craig-Wood)
• Show URL of backend help page when starting config (Nick Craig-Wood)
• stats: Long names now split in center (Joanna Marek)
• Add --log-format flag for more control over log output (dcpu)
• rc: Add support for OPTIONS and basic CORS (frenos)
• stats: show FatalErrors and NoRetryErrors in stats (Cédric Connes)
• Fix -P not ending with a new line (Nick Craig-Wood)
• config: don't create default config dir when user supplies --config (albertony)
• Don't print non-ASCII characters with --progress on windows (Nick Craig-Wood)
• Correct logs for excluded items (ssaqua)
• Remove EXPERIMENTAL tags (Nick Craig-Wood)
• Fix race condition detected by serve ftp tests (Nick Craig-Wood)
• Add vfs/poll-interval rc command (Fabian Möller)
• Enable rename for nearly all remotes using server-side Move or Copy (Nick Craig-Wood)
• Reduce directory cache cleared by poll-interval (Fabian Möller)
• Skip bad symlinks in dir listing with -L enabled (Cédric Connes)
• Preallocate files on Windows to reduce fragmentation (Nick Craig-Wood)
• Preallocate files on linux with fallocate(2) (Nick Craig-Wood)
• Add cache/fetch rc function (Fabian Möller)
• Fix worker scale down (Fabian Möller)
• Improve performance by not sending info requests for cached chunks (dcpu)
• Fix error return value of cache/fetch rc method (Fabian Möller)
• Documentation fix for cache-chunk-total-size (Anagh Kumar Baranwal)
• Preserve leading / in wrapped remote path (Fabian Möller)
• Add plex_insecure option to skip certificate validation (Fabian Möller)
• Remove entries that no longer exist in the source (dcpu)
• Fix handling of Windows network paths (Nick Craig-Wood)
• Add --azureblob-list-chunk parameter (Santiago Rodríguez)
• Implemented settier command support on azureblob remote. (sandeepkru)
• Work around SDK bug which causes errors for chunk-sized files (Nick Craig-Wood)
• Implement link sharing.  (Sebastian Bünger)
• Add --drive-import-formats - google docs can now be imported (Fabian Möller)
• Rewrite mime type and extension handling (Fabian Möller)
• Add document links (Fabian Möller)
• Add support for multipart document extensions (Fabian Möller)
• Add support for apps-script to json export (Fabian Möller)
• Fix escaped chars in documents during list (Fabian Möller)
• Add --drive-v2-download-min-size a workaround for slow downloads (Fabian Möller)
• Improve directory notifications in ChangeNotify (Fabian Möller)
• When listing team drives in config, continue on failure (Nick Craig-Wood)
• Add a small pause after failed upload before deleting file (Nick Craig-Wood)
• Fix service_account_file being ignored (Fabian Möller)
• Minor improvement in quota info (omit if unlimited) (albertony)
• Add --fast-list support (albertony)
• Add permanent delete support: --jottacloud-hard-delete (albertony)
• Add link sharing support (albertony)
• Fix handling of reserved characters.  (Sebastian Bünger)
• Fix socket leak on Object.Remove (Nick Craig-Wood)
• Rework to support Microsoft Graph (Cnly)
• NB this will require re-authenticating the remote
• Removed upload cutoff and always do session uploads (Oliver Heyme)
• Use single-part upload for empty files (Cnly)
• Fix new fields not saved when editing old config (Alex Chen)
• Fix sometimes special chars in filenames not replaced (Alex Chen)
• Ignore OneNote files by default (Alex Chen)
• Add link sharing support (jackyzy823)
• Use custom pacer, to retry operations when reasonable (Craig Miskell)
• Use configured server-side-encryption and storage class options when calling CopyObject() (Paul Kohout)
• Make --s3-v2-auth flag (Nick Craig-Wood)
• Fix v2 auth on files with spaces (Nick Craig-Wood)
• Implement union backend which reads from multiple backends (Felix Brucker)
• Implement optional interfaces (Move, DirMove, Copy, etc.) (Nick Craig-Wood)
• Fix ChangeNotify to support multiple remotes (Fabian Möller)
• Fix --backup-dir on union backend (Nick Craig-Wood)
• Add another time format (Nick Craig-Wood)
• Add workaround for missing mtime (buergi)
• Sharepoint: Renew cookies after 12hrs (Henning Surmeier)
• Remove redundant nil checks (teresy)
v1.43.1 - 2018-09-07 Point release to fix hubic and azureblob backends.
• ncdu: Return error instead of log.Fatal in Show (Fabian Möller)
• cmd: Fix crash with --progress and --stats 0 (Nick Craig-Wood)
• docs: Tidy website display (Anagh Kumar Baranwal)
• Azure Blob:
• Fix multi-part uploads.  (sandeepkru)
• Fix uploads (Nick Craig-Wood)
• Retry auth fetching if it fails to make hubic more reliable (Nick Craig-Wood)
v1.43 - 2018-09-01 • New backends
• Jottacloud (Sebastian Bünger)
• copyurl: copies a URL to a remote (Denis)
• Reworked config for backends (Nick Craig-Wood)
• All backend config can now be supplied by command line, env var or config file
• Advanced section in the config wizard for the optional items
• A large step towards rclone backends being usable in other go software
• Allow on the fly remotes with :backend: syntax
• Stats revamp
• Add --progress/-P flag to show interactive progress (Nick Craig-Wood)
• Show the total progress of the sync in the stats (Nick Craig-Wood)
• Add --stats-one-line flag for single line stats (Nick Craig-Wood)
• Added weekday schedule into --bwlimit (Mateusz)
• lsjson: Add option to show the original object IDs (Fabian Möller)
• serve webdav: Make Content-Type without reading the file and add --etag-hash (Nick Craig-Wood)
• Build macOS with native compiler (Nick Craig-Wood)
• Update to use go1.11 for the build (Nick Craig-Wood)
• Added core/stats to return the stats (reddi1)
• version --check: Prints the current release and beta versions (Nick Craig-Wood)
• Fix time to completion estimates (Nick Craig-Wood)
• Fix moving average speed for file stats (Nick Craig-Wood)
• config: Fix error reading password from piped input (Nick Craig-Wood)
• move: Fix --delete-empty-src-dirs flag to delete all empty dirs on move (ishuah)
• Implement --daemon-timeout flag for OSXFUSE (Nick Craig-Wood)
• Fix mount --daemon not working with encrypted config (Alex Chen)
• Clip the number of blocks to 2^32-1 on macOS - fixes borg backup (Nick Craig-Wood)
• Enable vfs-read-chunk-size by default (Fabian Möller)
• Add the vfs/refresh rc command (Fabian Möller)
• Add non recursive mode to vfs/refresh rc command (Fabian Möller)
• Try to seek buffer on read only files (Fabian Möller)
• Fix crash when deprecated --local-no-unicode-normalization is supplied (Nick Craig-Wood)
• Fix mkdir error when trying to copy files to the root of a drive on windows (Nick Craig-Wood)
• Fix nil pointer deref when using lsjson on cached directory (Nick Craig-Wood)
• Fix nil pointer deref for occasional crash on playback (Nick Craig-Wood)
• Fix accounting when checking hashes on upload (Nick Craig-Wood)
• Amazon Cloud Drive
• Make very clear in the docs that rclone has no ACD keys (Nick Craig-Wood)
• Add connection string and SAS URL auth (Nick Craig-Wood)
• List the container to see if it exists (Nick Craig-Wood)
• Port new Azure Blob Storage SDK (sandeepkru)
• Added blob tier, tier between Hot, Cool and Archive.  (sandeepkru)
• Remove leading / from paths (Nick Craig-Wood)
• Support Application Keys (Nick Craig-Wood)
• Fix upload of > 2GB files on 32 bit platforms (Nick Craig-Wood)
• Make --box-commit-retries flag defaulting to 100 to fix large uploads (Nick Craig-Wood)
• Add --drive-keep-revision-forever flag (lewapm)
• Handle gdocs when filtering file names in list (Fabian Möller)
• Support using --fast-list for large speedups (Fabian Möller)
• Fix Put mkParentDir failed: 521 for BunnyCDN (Nick Craig-Wood)
• Fix index out of range error with --fast-list (Nick Craig-Wood)
• Fix MD5 error check (Oliver Heyme)
• Handle empty time values (Martin Polden)
• Calculate missing MD5s (Oliver Heyme)
• Docs, fixes and tests for MD5 calculation (Nick Craig-Wood)
• Add optional MimeTyper interface.  (Sebastian Bünger)
• Implement optional About interface (for df support).  (Sebastian Bünger)
• Wait for events instead of arbitrary sleeping (Nick Craig-Wood)
• Add --mega-hard-delete flag (Nick Craig-Wood)
• Fix failed logins with upper case chars in email (Nick Craig-Wood)
• Shared folder support (Yoni Jah)
• Implement DirMove (Cnly)
• Fix rmdir sometimes deleting directories with contents (Nick Craig-Wood)
• Delete half uploaded files on upload error (Nick Craig-Wood)
• Add --s3-force-path-style (Nick Craig-Wood)
• Add support for KMS Key ID (bsteiss)
• Add storage_policy (Ruben Vandamme)
• Make it so just storage_url or auth_token can be overridden (Nick Craig-Wood)
• Fix server-side copy bug for unusual file names (Nick Craig-Wood)
• Ensure we call MKCOL with a URL with a trailing / for QNAP interop (Nick Craig-Wood)
• If root ends with / then don't check if it is a file (Nick Craig-Wood)
• Don't accept redirects when reading metadata (Nick Craig-Wood)
• Add bearer token (Macaroon) support for dCache (Nick Craig-Wood)
• Document dCache and Macaroons (Onno Zweers)
• Sharepoint recursion with different depth (Henning)
• Attempt to remove failed uploads (Nick Craig-Wood)
• Fix listing/deleting files in the root (Nick Craig-Wood)
v1.42 - 2018-06-16 • New backends
• OpenDrive (Oliver Heyme, Jakub Karlicek, ncw)
• deletefile command (Filip Bartodziej)
• copy, move: Copy single files directly, don't use --files-from work-around
• this makes them much more efficient
• Implement --max-transfer flag to quit transferring at a limit
• make exit code 8 for --max-transfer exceeded
• copy: copy empty source directories to destination (Ishuah Kariuki)
• check: Add --one-way flag (Kasper Byrdal Nielsen)
• Add siginfo handler for macOS for ctrl-T stats (kubatasiemski)
• add core/gc to run a garbage collection on demand
• enable go profiling by default on the --rc port
• return error from remote on failure
• lsf
• Add --absolute flag to add a leading / onto path names
• Add --csv flag for compliant CSV output
• Add 'm' format specifier to show the MimeType
• Implement 'i' format for showing object ID
• Add MimeType to the output
• Add ID field to output to show Object ID
• Add --retries-sleep flag (Benjamin Joseph Dag)
• Oauth tidy up web page and error handling (Henning Surmeier)
• Password prompt output with --log-file fixed for unix (Filip Bartodziej)
• Calculate ModifyWindow each time on the fly to fix various problems (Stefan Breunig)
• Only print "File.rename error" if there actually is an error (Stefan Breunig)
• Delay rename if file has open writers instead of failing outright (Stefan Breunig)
• Ensure atexit gets run on interrupt
• macOS enhancements
• Make --noappledouble --noapplexattr
• Add --volname flag and remove special chars from it
• Make Get/List/Set/Remove xattr return ENOSYS for efficiency
• Make --daemon work for macOS without CGO
• Add --vfs-read-chunk-size and --vfs-read-chunk-size-limit (Fabian Möller)
• Fix ChangeNotify for new or changed folders (Fabian Möller)
• Fix symlink/junction point directory handling under Windows
• NB you will need to add -L to your command line to copy files with reparse points
• Add non cached dirs on notifications (Remus Bunduc)
• Allow root to be expired from rc (Remus Bunduc)
• Clean remaining empty folders from temp upload path (Remus Bunduc)
• Cache lists using batch writes (Remus Bunduc)
• Use secure websockets for HTTPS Plex addresses (John Clayton)
• Reconnect plex websocket on failures (Remus Bunduc)
• Fix panic when running without plex configs (Remus Bunduc)
• Fix root folder caching (Remus Bunduc)
• Check the crypted hash of files when uploading for extra data security
• Make Dropbox for business folders accessible using an initial / in the path
• Low level retry all operations if necessary
• Add --drive-acknowledge-abuse to download flagged files
• Add --drive-alternate-export to fix large doc export
• Don't attempt to choose Team Drives when using rclone config create
• Fix change list polling with team drives
• Fix ChangeNotify for folders (Fabian Möller)
• Fix about (and df on a mount) for team drives
• Errorhandler for onedrive for business requests (Henning Surmeier)
• Adjust upload concurrency with --s3-upload-concurrency (themylogin)
• Fix --s3-chunk-size which was always using the minimum
• Add --ssh-path-override flag (Piotr Oleszczyk)
• Fix slow downloads for long latency connections
• Webdav
• Add workarounds for biz.mail.ru
• Ignore Reason-Phrase in status line to fix 4shared (Rodrigo)
• Better error message generation
v1.41 - 2018-04-28 • New backends
• Mega support added
• Webdav now supports SharePoint cookie authentication (hensur)
• link: create public link to files and folders (Stefan Breunig)
• about: gets quota info from a remote (a-roussos, ncw)
• hashsum: a generic tool for any hash to produce md5sum like output
• lsd: Add -R flag and fix and update docs for all ls commands
• ncdu: added a "refresh" key - CTRL-L (Keith Goldfarb)
• serve restic: Add append-only mode (Steve Kriss)
• serve restic: Disallow overwriting files in append-only mode (Alexander Neumann)
• serve restic: Print actual listener address (Matt Holt)
• size: Add --json flag (Matthew Holt)
• sync: implement --ignore-errors (Mateusz Pabian)
• dedupe: Add dedupe largest functionality (Richard Yang)
• fs: Extend SizeSuffix to include TB and PB for rclone about
• fs: add --dump goroutines and --dump openfiles for debugging
• rc: implement core/memstats to print internal memory usage info
• rc: new call rc/pid (Michael P.  Dubner)
• Compile
• Drop support for go1.6
• Release
• Fix make tarball (Chih-Hsuan Yen)
• filter: fix --min-age and --max-age together check
• fs: limit MaxIdleConns and MaxIdleConnsPerHost in transport
• lsd,lsf: make sure all times we output are in local time
• rc: fix setting bwlimit to unlimited
• rc: take note of the --rc-addr flag too as per the docs
• Use About to return the correct disk total/used/free (e.g.  in df)
• Set --attr-timeout default to 1s - fixes:
• rclone using too much memory
• rclone not serving files to samba
• excessive time listing directories
• Fix df -i (upstream fix)
• Filter files . and .. from directory listing
• Only make the VFS cache if --vfs-cache-mode > Off
• Add --local-no-check-updated to disable updated file checks
• Retry remove on Windows sharing violation error
• Flush the memory cache after close
• Purge file data on notification
• Always forget parent dir for notifications
• Integrate with Plex websocket
• Add rc cache/stats (seuffert)
• Add info log on notification
• Fix failure reading large directories - parse file/directory size as float
• Fix crypt+obfuscate on dropbox
• Fix repeatedly uploading the same files
• Work around strange response from box FTP server
• More workarounds for FTP servers to fix mkParentDir error
• Fix no error on listing non-existent directory
• Add service_account_credentials (Matt Holt)
• Detect bucket presence by listing it - minimises permissions needed
• Ignore zero length directory markers
• Fix directory move leaving a hardlinked directory behind
• Return proper google errors when Opening files
• When initialized with a filepath, optional features used incorrect root path (Stefan Breunig)
• Fix sync for servers which don't return Content-Length in HEAD
• Add QuickXorHash support for OneDrive for business
• Fix socket leak in multipart session upload
• Look in S3 named profile files for credentials
• Add --s3-disable-checksum to disable checksum uploading (Chris Redekop)
• Hierarchical configuration support (Giri Badanahatti)
• Add in config for all the supported S3 providers
• Add One Zone Infrequent Access storage class (Craig Rachel)
• Add --use-server-modtime support (Peter Baumgartner)
• Add --s3-chunk-size option to control multipart uploads
• Update docs to match code, fix typos and clarify disable_hashcheck prompt (Michael G.  Noll)
• Update docs with Synology quirks
• Fail soft with a debug on hash failure
• Support SharePoint cookie authentication (hensur)
• Strip leading and trailing / off root
v1.40 - 2018-03-19 • New backends
• Alias backend to create aliases for existing remote names (Fabian Möller)
• lsf: list for parsing purposes (Jakub Tasiemski)
• by default this is a simple non recursive list of files and directories
• it can be configured to add more info in an easy to parse way
• serve restic: for serving a remote as a Restic REST endpoint
• This enables restic to use any backends that rclone can access
• Thanks Alexander Neumann for help, patches and review
• rc: enable the remote control of a running rclone
• The running rclone must be started with --rc and related flags.
• Currently there is support for bwlimit, and flushing for mount and cache.
• --max-delete flag to add a delete threshold (Bjørn Erik Pedersen)
• All backends now support RangeOption for ranged Open
• cat: Use RangeOption for limited fetches to make more efficient
• cryptcheck: make reading of nonce more efficient with RangeOption
• serve http/webdav/restic
• support SSL/TLS
• add --user --pass and --htpasswd for authentication
• copy/move: detect file size change during copy/move and abort transfer (ishuah)
• cryptdecode: added option to return encrypted file names.  (ishuah)
• lsjson: add --encrypted to show encrypted name (Jakub Tasiemski)
• Add --stats-file-name-length to specify the printed file name length for stats (Will Gunn)
• Code base was shuffled and factored
• backends moved into a backend directory
• large packages split up
• See the CONTRIBUTING.md doc for info as to what lives where now
• Update to using go1.10 as the default go version
• Implement daily full integration tests (https://pub.rclone.org/integration-tests/)
• Include a source tarball and sign it and the binaries
• Sign the git tags as part of the release process
• Add .deb and .rpm packages as part of the build
• Make a beta release for all branches on the main repo (but not pull requests)
• config: fixes errors on non existing config by loading config file only on first access
• config: retry saving the config after failure (Mateusz)
• sync: when using --backup-dir don't delete files if we can't set their modtime
• this fixes odd behaviour with Dropbox and --backup-dir
• fshttp: fix idle timeouts for HTTP connections
• serve http: fix serving files with : in - fixes
• Fix --exclude-if-present to ignore directories which it doesn't have permission for (Iakov Davydov)
• Make accounting work properly with crypt and b2
• remove --no-traverse flag because it is obsolete
• Add --attr-timeout flag to control attribute caching in kernel
• this now defaults to 0 which is correct but less efficient
• see the mount docs (https://rclone.org/commands/rclone_mount/#attribute-caching) for more info
• Add --daemon flag to allow mount to run in the background (ishuah)
• Fix: Return ENOSYS rather than EIO on attempted link
• This fixes FileZilla accessing an rclone mount served over sftp.
• Fix setting modtime twice
• Mount tests now run on CI for Linux (mount & cmount)/Mac/Windows
• Many bugs fixed in the VFS layer - see below
• Many fixes for --vfs-cache-mode writes and above
• Update cached copy if we know it has changed (fixes stale data)
• Clean path names before using them in the cache
• Disable cache cleaner if --vfs-cache-poll-interval=0
• Fill and clean the cache immediately on startup
• Fix Windows opening every file when it stats the file
• Fix applying modtime for an open Write Handle
• Fix creation of files when truncating
• Write 0 bytes when flushing unwritten handles to avoid race conditions in FUSE
• Downgrade "poll-interval is not supported" message to Info
• Make OpenFile and friends return EINVAL if O_RDONLY and O_TRUNC
• Downgrade "invalid cross-device link: trying copy" to debug
• Make DirMove return fs.ErrorCantDirMove to allow fallback to Copy for cross device
• Fix race conditions updating the hashes
• Add support for polling - cache will update when remote changes on supported backends
• Reduce log level for Plex api
• Fix dir cache issue
• Implement --cache-db-wait-time flag
• Improve efficiency with RangeOption and RangeSeek
• Fix dirmove with temp fs enabled
• Notify vfs when using temp fs
• Offline uploading
• Remote control support for path flushing
• Amazon cloud drive
• Rclone no longer has any working keys - disable integration tests
• Implement DirChangeNotify to notify cache/vfs/mount of changes
• Azureblob
• Don't check for bucket/container presence if listing was OK
• this makes rclone do one less request per invocation
• Improve accounting for chunked uploads
• Fix custom oauth client parameters
• Migrate to api v3 (Fabian Möller)
• Add scope configuration and root folder selection
• Add --drive-impersonate for service accounts
• thanks to everyone who tested, explored and contributed docs
• Add --drive-use-created-date to use created date as modified date (nbuchanan)
• Request the export formats only when required
• This makes rclone quicker when there are no google docs
• Fix finding paths with latin1 chars (a workaround for a drive bug)
• Fix copying of a single Google doc file
• Fix --drive-auth-owner-only to look in all directories
• Fix handling of directories with & in
• Removed upload cutoff and always do session uploads
• this stops the creation of multiple versions on business onedrive
• Overwrite object size value with real size when reading file. (Victor)
• this fixes oddities when onedrive misreports the size of images
• Remove unused chunked upload flag and code
• Support hashes for multipart files (Chris Redekop)
• Initial support for IBM COS (S3) (Giri Badanahatti)
• Update docs to discourage use of v2 auth with CEPH and others
• Fix server-side copy and set modtime on files with + in
• Add option to disable remote hash check command execution (Jon Fautley)
• Add --sftp-ask-password flag to prompt for password when needed (Leo R.  Lundgren)
• Add set_modtime configuration option
• Fix following of symlinks
• Fix reading config file outside of Fs setup
• Fix reading $USER in username fallback not $HOME
• Fix running under crontab - Use correct OS way of reading username
• Fix refresh of authentication token
• in v1.39 a bug was introduced which ignored new tokens - this fixes it
• Fix extra HEAD transaction when uploading a new file
• Add new time formats to support mydrive.ch and others
v1.39 - 2017-12-23 • New backends
• tested with nextcloud, owncloud, put.io and others!
• cache - wraps a cache around other backends (Remus Bunduc)
• useful in combination with mount
• NB this feature is in beta so use with care
• serve command with subcommands:
• serve webdav: this implements a webdav server for any rclone remote.
• serve http: command to serve a remote over HTTP
• config: add sub commands for full config file management
• create/delete/dump/edit/file/password/providers/show/update
• touch: to create or update the timestamp of a file (Jakub Tasiemski)
• curl install for rclone (Filip Bartodziej)
• --stats now shows percentage, size, rate and ETA in condensed form (Ishuah Kariuki)
• --exclude-if-present to exclude a directory if a file is present (Iakov Davydov)
• rmdirs: add --leave-root flag (lewapm)
• move: add --delete-empty-src-dirs flag to remove dirs after move (Ishuah Kariuki)
• Add --dump flag, introduce --dump requests, responses and remove --dump-auth, --dump-filters
• Obscure X-Auth-Token: from headers when dumping too
• Document and implement exit codes for different failure modes (Ishuah Kariuki)
• Retry lots more different types of errors to make multipart transfers more reliable
• Save the config before asking for a token, fixes disappearing oauth config
• Warn the user if --include and --exclude are used together (Ernest Borowski)
• Fix duplicate files (e.g.  on Google drive) causing spurious copies
• Allow trailing and leading whitespace for passwords (Jason Rose)
• ncdu: fix crashes on empty directories
• rcat: fix goroutine leak
• moveto/copyto: Fix to allow copying to the same name
• --vfs-cache mode to make writes into mounts more reliable.
• this requires caching files on the disk (see --cache-dir)
• As this is a new feature, use with care
• Use sdnotify to signal systemd the mount is ready (Fabian Möller)
• Check if directory is not empty before mounting (Ernest Borowski)
• Add error message for cross file system moves
• Fix equality check for times
• Rework multipart upload
• buffer the chunks when uploading large files so they can be retried
• change default chunk size to 48MB now we are buffering them in memory
• retry every error after the first chunk is done successfully
• Fix error when renaming directories
• Fix crash on bad authentication
• Add service account support (Tim Cooijmans)
• Make it work properly with Digital Ocean Spaces (Andrew Starr-Bochicchio)
• Fix crash if a bad listing is received
• Add support for ECS task IAM roles (David Minor)
• Fix multipart upload retries
• Fix --hard-delete to make it work 100% of the time
• Allow authentication with storage URL and auth key (Giovanni Pizzi)
• Add new fields for swift configuration to support IBM Bluemix Swift (Pierre Carlson)
• Add OS_TENANT_ID and OS_USER_ID to config
• Allow configs with user id instead of user name
• Check if swift segments container exists before creating (John Leach)
• Fix memory leak in swift transfers (upstream fix)
• Add option to enable the use of aes128-cbc cipher (Jon Fautley)
• Fix download of large files failing with "Only one auth mechanism allowed"
• crypt
• Option to encrypt directory names or leave them intact
• Implement DirChangeNotify (Fabian Möller)
• onedrive
• Add option to choose resourceURL during setup of OneDrive Business account if more than one is available for user
v1.38 - 2017-09-30 • New backends
• Azure Blob Storage (thanks Andrei Dragomir)
• Onedrive for Business (thanks Oliver Heyme)
• QingStor from QingCloud (thanks wuyu)
• rcat - read from standard input and stream upload
• tree - shows a nicely formatted recursive listing
• cryptdecode - decode crypted file names (thanks ishuah)
• config show - print the config file
• config file - print the config file location
• Empty directories are deleted on sync
• dedupe - implement merging of duplicate directories
• check and cryptcheck made more consistent and use less memory
• cleanup for remaining remotes (thanks ishuah)
• --immutable for ensuring that files don't change (thanks Jacob McNamee)
• --user-agent option (thanks Alex McGrath Kraak)
• --disable flag to disable optional features
• --bind flag for choosing the local addr on outgoing connections
• Support for zsh auto-completion (thanks bpicode)
• Stop normalizing file names but do a normalized compare in sync
• Update to using go1.9 as the default go version
• Remove snapd build due to maintenance problems
• Improve retriable error detection which makes multipart uploads better
• Make check obey --ignore-size
• Fix bwlimit toggle in conjunction with schedules (thanks cbruegg)
• config ensures newly written config is on the same mount
• Revert to copy when moving file across file system boundaries
• --skip-links to suppress symlink warnings (thanks Zhiming Wang)
• Re-use rcat internals to support uploads from all remotes
• Fix "entry doesn't belong in directory" error
• Stop using deprecated API methods
• Fix server-side copy to empty container with --fast-list
• Change the default for --drive-use-trash to true
• Set session token when using STS (thanks Girish Ramakrishnan)
• Glacier docs and error messages (thanks Jan Varho)
• Read 1000 (not 1024) items in dir listings to fix Wasabi
• Fix SHA1 mismatch when downloading files with no SHA1
• Calculate missing hashes on the fly instead of spooling
• --b2-hard-delete to permanently delete (not hide) files (thanks John Papandriopoulos)
• Fix creating containers - no longer have to use the default container
• Optionally configure from a standard set of OpenStack environment vars
• Add endpoint_type config
• Fix bucket creation to work with limited permission users
• Implement connection pooling for multiple ssh connections
• Limit new connections per second
• Add support for MD5 and SHA1 hashes where available (thanks Christian Brüggemann)
• Fix URL encoding issues
• Fix directories with : in
• Fix panic with URL encoded content
v1.37 - 2017-07-22 • New backends
• FTP - thanks to Antonio Messina
• HTTP - thanks to Vasiliy Tolstov
• rclone ncdu - for exploring a remote with a text based user interface.
• rclone lsjson - for listing with a machine readable output
• rclone dbhashsum - to show Dropbox style hashes of files (local or Dropbox)
• Implement --fast-list flag
• This allows remotes to list recursively if they can
• This uses less transactions (important if you pay for them)
• This may or may not be quicker
• This will use more memory as it has to hold the listing in memory
• --old-sync-method deprecated - the remaining uses are covered by --fast-list
• This involved a major re-write of all the listing code
• Add --tpslimit and --tpslimit-burst to limit transactions per second
• this is useful in conjunction with rclone mount to limit external apps
• Add --stats-log-level so can see --stats without -v
• Print password prompts to stderr - Hraban Luyat
• Warn about duplicate files when syncing
• Oauth improvements
• allow auth_url and token_url to be set in the config file
• Print redirection URI if using own credentials.
• Don't Mkdir at the start of sync to save transactions
• Update build to go1.8.3
• Require go1.6 for building rclone
• Compile 386 builds with "GO386=387" for maximum compatibility
• Fix menu selection when no remotes
• Config saving reworked to not kill the file if disk gets full
• Don't delete remote if name does not change while renaming
• moveto, copyto: report transfers and checks as per move and copy
• Add --local-no-unicode-normalization flag - Bob Potter
• Now supported on Windows using cgofuse and WinFsp - thanks to Bill Zissimopoulos for much help
• Compare checksums on upload/download via FUSE
• Unmount when program ends with SIGINT (Ctrl+C) or SIGTERM - Jérôme Vizcaino
• On read only open of file, make open pending until first read
• Make --read-only reject modify operations
• Implement ModTime via FUSE for remotes that support it
• Allow modTime to be changed even before all writers are closed
• Fix panic on renames
• Fix hang on errored upload
• Report the name:root as specified by the user
• Add an "obfuscate" option for filename encryption - Stephen Harris
• Fix initialization order for token renewer
• Remove revoked credentials, allow oauth proxy config and update docs
• Reduce minimum chunk size to 5MB
• Add team drive support
• Reduce bandwidth by adding fields for partial responses - Martin Kristensen
• Implement --drive-shared-with-me flag to view shared with me files - Danny Tsai
• Add --drive-trashed-only to read only the files in the trash
• Remove obsolete --drive-full-list
• Add missing seek to start on retries of chunked uploads
• Fix stats accounting for upload
• Convert / in names to a unicode equivalent (／)
• Poll for Google Drive changes when mounted
• OneDrive
• Fix the uploading of files with spaces
• Display speeds accurately when uploading - Yoni Jah
• Swap to using http://localhost:53682/ as redirect URL - Michael Ledin
• Retry on token expired error, reset upload body on retry - Yoni Jah
• Add ability to specify location and storage class via config and command line - thanks gdm85
• Create container if necessary on server-side copy
• Increase directory listing chunk to 1000 to increase performance
• Obtain a refresh token for GCS - Steven Lu
• Fix the name reported in log messages (was empty)
• Correct error return for listing empty directory
• Rewritten to use the v2 API
• Now supports ModTime
• Can only set by uploading the file again
• If you uploaded with an old rclone, rclone may upload everything again
• Use --size-only or --checksum to avoid this
• Now supports the Dropbox content hashing scheme
• Now supports low level retries
• Work around eventual consistency in bucket creation
• Add us-east-2 (Ohio) and eu-west-2 (London) S3 regions - Zahiar Ahmed
• Swift, Hubic
• Fix zero length directory markers showing in the subdirectory listing
• this caused lots of duplicate transfers
• Fix paged directory listings
• this caused duplicate directory errors
• Make sensible error if the user forgets the container
• Add support for using ssh key files
• Fix under Windows
• Fix ssh agent on Windows
• Adapt to latest version of library - Igor Kharin
v1.36 - 2017-03-18 • New Features
• SFTP remote (Jack Schmidt)
• Re-implement sync routine to work a directory at a time reducing memory usage
• Logging revamped to be more inline with rsync - now much quieter * -v only shows transfers * -vv is for full debug * --syslog to log to syslog on capable platforms
• Implement --backup-dir and --suffix
• Implement --track-renames (initial implementation by Bjørn Erik Pedersen)
• Add time-based bandwidth limits (Lukas Loesche)
• rclone cryptcheck: checks integrity of crypt remotes
• Allow all config file variables and options to be set from environment variables
• Add --buffer-size parameter to control buffer size for copy
• Make --delete-after the default
• Add --ignore-checksum flag (fixed by Hisham Zarka)
• rclone check: Add --download flag to check all the data, not just hashes
• rclone cat: add --head, --tail, --offset, --count and --discard
• rclone config: when choosing from a list, allow the value to be entered too
• rclone config: allow rename and copy of remotes
• rclone obscure: for generating encrypted passwords for rclone's config (T.C.  Ferguson)
• Comply with XDG Base Directory specification (Dario Giovannetti)
• this moves the default location of the config file in a backwards compatible way
• Release changes
• Ubuntu snap support (Dedsec1)
• Compile with go 1.8
• MIPS/Linux big and little endian support
• Fix copyto copying things to the wrong place if the destination dir didn't exist
• Fix parsing of remotes in moveto and copyto
• Fix --delete-before deleting files on copy
• Fix --files-from with an empty file copying everything
• Fix sync: don't update mod times if --dry-run set
• Fix MimeType propagation
• Fix filters to add ** rules to directory rules
• Implement -L, --copy-links flag to allow rclone to follow symlinks
• Open files in write only mode so rclone can write to an rclone mount
• Fix unnormalised unicode causing problems reading directories
• Fix interaction between -x flag and --max-depth
• Implement proper directory handling (mkdir, rmdir, renaming)
• Make include and exclude filters apply to mount
• Implement read and write async buffers - control with --buffer-size
• Fix fsync on for directories
• Fix retry on network failure when reading off crypt
• Add --crypt-show-mapping to show encrypted file mapping
• Fix crypt writer getting stuck in a loop
• IMPORTANT this bug had the potential to cause data corruption when
• reading data from a network based remote and
• writing to a crypt on Google Drive
• Use the cryptcheck command to validate your data if you are concerned
• If syncing two crypt remotes, sync the unencrypted remote
• Fix panics on Move (rename)
• Fix panic on token expiry
• Fix inconsistent listings and rclone check
• Fix uploading empty files with go1.8
• Constrain memory usage when doing multipart uploads
• Fix upload url not being refreshed properly
• Fix Rmdir on directories with trashed files
• Fix "Ignoring unknown object" when downloading
• Add --drive-list-chunk
• Add --drive-skip-gdocs (Károly Oláh)
• Implement Move
• Fix Copy
• Fix overwrite detection in Copy
• Fix waitForJob to parse errors correctly
• Use token renewer to stop auth errors on long uploads
• Fix depth 1 directory listings
• Fix single level directory listing
• Normalise the case for single level directory listings
• Fix depth 1 listing
• Added ca-central-1 region (Jon Yergatian)
v1.35 - 2017-01-02 • New Features
• moveto and copyto commands for choosing a destination name on copy/move
• rmdirs command to recursively delete empty directories
• Allow repeated --include/--exclude/--filter options
• Only show transfer stats on commands which transfer stuff
• show stats on any command using the --stats flag
• Allow overlapping directories in move when server-side dir move is supported
• Add --stats-unit option - thanks Scott McGillivray
• Fix the config file being overwritten when two rclone instances are running
• Make rclone lsd obey the filters properly
• Fix compilation on mips
• Fix not transferring files that don't differ in size
• Fix panic on nil retry/fatal error
• Retry reads on error - should help with reliability a lot
• Report the modification times for directories from the remote
• Add bandwidth accounting and limiting (fixes --bwlimit)
• If --stats provided will show stats and which files are transferring
• Support R/W files if truncate is set.
• Implement statfs interface so df works
• Note that write is now supported on Amazon Drive
• Report number of blocks in a file - thanks Stefan Breunig
• Prevent the user pointing crypt at itself
• Fix failed to authenticate decrypted block errors
• these will now return the underlying unexpected EOF instead
• Add support for server-side move and directory move - thanks Stefan Breunig
• Fix nil pointer deref on size attribute
• Use new prefix and delimiter parameters in directory listings
• This makes --max-depth 1 dir listings as used in mount much faster
• Reauth the account while doing uploads too - should help with token expiry
• Make DirMove more efficient and complain about moving the root
• Create destination directory on Move()
v1.34 - 2016-11-06 • New Features
• Stop single file and --files-from operations iterating through the source bucket.
• Stop removing failed upload to cloud storage remotes
• Make ContentType be preserved for cloud to cloud copies
• Add support to toggle bandwidth limits via SIGUSR2 - thanks Marco Paganini
• rclone check shows count of hashes that couldn't be checked
• rclone listremotes command
• Support linux/arm64 build - thanks Fredrik Fornwall
• Remove Authorization: lines from --dump-headers output