-NEWS for rsync 2.6.3 (UNRELEASED)
-Protocol: 28 (unchanged)
-Changes since 2.6.2:
-
- SECURITY FIXES:
-
- - A bug in the sanitize_path routine (which affects a non-chrooted
- rsync daemon) could allow a user to craft a pathname that would get
- transformed into an absolute path for certain options (but not for
- file-transfer names). If you're running an rsync daemon with chroot
- disabled, *please upgrade*, ESPECIALLY if the user privs you run
- rsync under is anything above "nobody".
-
- OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
-
- - Please note that the 2-line footer (output when verbose) now uses the
- term "sent" instead of "wrote" and "received" instead of "read". If
- you are not parsing the numeric values out of this footer, a script
- would be better off using the empty line prior to the footer as the
- indicator that the verbose output is over.
-
- - The output from the --stats option was similarly affected to change
- "written" to "sent" and "read" to "received".
-
- - Rsync ensures that a filename that contains a newline gets mentioned
- with each newline transformed into a question mark (which prevents a
- filename from causing an empty line to be output).
+NEWS for rsync 3.1.0 (UNRELEASED)
+Protocol: 31 (changed)
+Changes since 3.0.4:
+
+ OUTPUT CHANGES:
+
+ - Output numbers in 3-digit groups by default (e.g. 1,234,567). See the
+ --human-readable option for a way to turn it off. See also the daemon's
+ "log format" parameter and related command-line options (including
+ --out-format) for a modifier that can be used to request digit-grouping
+ or human-readable output in log escapes. (Note that log output is
+ unchanged by default.)
+
+ - The --list-only option is now affected by the --human-readable setting.
+ It will display digit groupings by default, and unit suffixes if higher
+ levels of readability are requested. Also, the column width for the size
+ output has increased from 11 to 14 characters when human readability is
+ enabled. Use --no-h to get the old-style output and column size.
+
+ - The output of the --progress option has changed: the string "xfer" was
+ shortened to "xfr", and the string "to-check" was shortened to "to-chk",
+ both designed to make room for the (by default) wider display of file
+ size numbers without making the total line-length longer. Also, when
+ incremental recursion is enabled, the string "ir-chk" will be used
+ instead of "to-chk" up until the incremental-recursion scan is done,
+ letting you know that the value to check and the total value will still
+ be increasing as new files are found.
+
+ - Enhanced the --stats output: 1) to mention how many files were created
+ (protocol >= 28), 2) to mention how many files were deleted (a new line
+ for protocol 31, but only output when --delete is in effect), and 3) to
+ follow the file-count, created-count, and deleted-count with a subcount
+ list that shows the counts by type. The wording of the transferred count
+ has also changed so that it is clearer that it is only a count of regular
+ files.
BUG FIXES:
- - Fixed a crash bug that might appear when --delete was used and
- multiple source directories were specified.
+ - Changed the way --progress overwrites its prior output in order to make
+ it nearly impossible for the progress to get overwritten by an error.
- - Fixed the 32-bit truncation of the file length when generating the
- checksums.
+ - Fixed some rare bugs in --iconv processing that might cause a multibyte
+ character to get translated incorrectly.
- - The --backup code no longer attempts to create some directories
- over and over again (generating warnings along the way).
-
- - Fixed a bug in the reading of the secrets file (by the daemon) and
- the password file (by the client): the files no longer need to be
- terminated by a newline for their content to be read in.
-
- - If a file has a read error on the sending side or the reconstructed
- data doesn't match the expected checksum (perhaps due to the basis
- file changing during the transfer), the receiver will no longer
- retain the resulting file unless the --partial option was specified.
- (Note: for the read-error detection to work, neither side can be
- older than 2.6.3 -- older receivers will always retain the file, and
- older senders don't tell the receiver that the file had a read
- error.)
-
- - If a file gets resent in a single transfer and the --backup option
- is enabled, rsync no longer performs a duplicate backup (it used to
- overwrite the original file in the backup area).
-
- - Files specified in the daemon's "exclude" or "exclude from" config
- items are now excluded from being uploaded (assuming that the module
- allows uploading at all) in addition to the old download exclusion.
-
- - Got rid of a potential hang in the receiver when near the end of a
- phase.
-
- - When using --backup without a --backup-dir, rsync no longer preserves
- the modify time on directories. This avoids confusing NFS.
-
- - When --copy-links (-L) is specified, we now output a separate error
- for a symlink that has no referent instead of claiming that a file
- "vanished".
-
- - The --copy-links (-L) option no longer has the side-effect of telling
- the receiving side to follow symlinks. See the --keep-dirlinks
- option (mentioned below) for a way to specify that behavior.
-
- - Error messages from the daemon server's option-parsing (such as
- refused options) now get sent back to the client (the server used
- to just exit because the socket wasn't in the right state to send
- the message).
-
- - Most errors that occur during a daemon transfer are now returned to
- the user in addition to being logged (some messages are intended to
- be daemon-only).
-
- - Fixed a bug in the daemon authentication code when using one of the
- batch-processing options.
-
- - We try to work around some buggy IPv6 implementations that fail to
- implement IPV6_V6ONLY. This should fix the "address in use" error
- that some daemons get when running on an OS with a buggy IPv6
- implementation. Also, if the new code gets this error, we might
- suggest that the user specify --ipv4 or --ipv6 (if we think it will
- help).
-
- - When the remote rsync dies, make a better effort to recover any error
- messages it may have sent before dying (the local rsync used to just
- die with a socket-write error).
-
- - When using --delete and a --backup-dir that contains files that are
- hard-linked to their destination equivalents, rsync now makes sure
- that removed files really get removed (works around a really weird
- rename() behavior).
-
- - Avoid a bogus run-time complaint about a lack of 64-bit integers when
- the int64 type is defined as an off_t and it actually has 64-bits.
-
- - Added a configure check for open64() without mkstemp64() so that we
- can avoid using mkstemp() when such a combination is encountered.
- This bypasses a problem writing out large temp files on OSes such as
- AIX and HP-UX.
-
- - Fixed an age-old crash problem with --read-batch on a local copy
- (rsync was improperly assuming --whole-file for the local copy).
-
- - When --dry-run (-n) is used and the destination directory does not
- exist, rsync now produces a correct report of files that would be
- sent instead of dying with a chdir() error.
+ - Improved the propagation of abnormal-exit error messages. This should
+ help the client side to receive errors from the server when it is exiting
+ abnormally, and should also avoid dying with an "connection unexpectedly
+ closed" exit when the closed connection is really expected.
ENHANCEMENTS:
- - Added the --partial-dir=DIR option that lets you specify where to
- (temporarily) put a partially transferred file (instead of over-
- writing the destination file). E.g. --partial-dir=.rsync-partial
+ - Added the --remote-option=OPT (-M OPT) command-line option that is useful
+ for things like sending a remote --log-file=FILE or --fake-super option.
- - Added --keep-dirlinks (-K), which allows you to symlink a directory
- onto another partition on the receiving side and have rsync treat it
- as matching a normal directory from the sender.
+ - Added the --info=FLAGS and --debug=FLAGS options to allow finer-grained
+ control over what is output. Added an extra type of --progress output
+ using --info=progress2.
- - Added the --inplace option that tells rsync to write each destination
- file without using a temporary file. The matching of existing data
- in the destination file can be severely limited by this, but there
- are also cases where this is more efficient (such as appending data).
- Use only when needed (see the man page for more details).
+ - The --msgs2stderr option can help with debugging rsync by allowing the
+ debug messages to get output to stderr rather than travel via the socket
+ protocol.
- - Added the "write only" option for the daemon's config file.
+ - Added the --delete-missing-args and --ignore-missing-args options to
+ either delete or ignore user-specified files on the receiver that are
+ missing on the sender (normally the absence of user-specified files
+ generates an error).
- - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
- and documented all these options in the man page.
+ - Added a "T" (terabyte) category to the --human-readable size suffixes.
- - Improved the handling of the --bwlimit option so that it's less
- bursty, more accurate, and works properly over a larger range of
- values.
+ - Added the --usermap/--groupmap/--chown options for manipulating file
+ ownership during the copy.
- - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
- SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
+ - Added the "%C" escape to the log-output handling, which will output the
+ MD5 checksum of any transferred file, or all files if --checksum was
+ specified (when protocol 30 or above is in effect).
- - Added the --checksum-seed=N option for advanced users.
+ - Added the "reverse lookup" parameter to the rsync daemon config file to
+ allow reverse-DNS lookups to be disabled.
- - Batch writing/reading has a brand-new implementation that is simpler,
- fixes a few weird problems with the old code (such as no longer
- sprinkling the batch files into different dirs or even onto different
- systems), and is much less intrusive into the code (making it easier
- to maintain for the future). The new code generates just one data
- file instead of three, which makes it possible to read the batch via
- stdin via a remote shell. Also, the old requirement of forcing the
- same fixed checksum-seed for all batch processing has been removed.
+ - Added a way for more than one group to be specified in the daemon's
+ config file, including a way to specify that you want all of the
+ specified user's groups without having to name them. Also changed the
+ daemon to complain about an inability to set explicitly-specified uid/gid
+ values, even when not run by a super-user.
- - If an rsync daemon has a module set with "list = no" (which hides its
- presence in the list of available modules), a user that fails to
- authenticate gets the same "unknown module" error that they would get
- if the module were actually unknown (while still logging the real
- error to the daemon's log file). This prevents fishing for module
- names.
+ - Added a way to reference environment variables in a daemon's config file
+ (using %VAR% references).
- - The daemon's "refuse options" config item now allows you to match
- option names using wildcards and/or the single-letter option names.
+ - When replacing a non-dir with a symlink/hard-link/device/special-file,
+ the update should now be done in an atomic manner.
- - Each transferred file now gets its permissions and modified-time
- updated before the temp-file gets moved into place. Previously, the
- finished file would have a very brief window where its permissions
- disallowed all group and world access.
+ - Fixed a free of the wrong pointer in uncache_tmp_xattrs() (which only
+ sometimes affects an --xattr transfer when --backup is used).
- - Support for literal IPv6 addresses was added to the URL parser for the
- "rsync:" scheme (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
+ - When backing up a file, try to hard-link the file into place so that the
+ upcoming replacement of the destination file will be atomic.
- - Added the ability to parse a literal IPv6 address in an "rsync:" URL
- (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
+ - Added the ability to synchronize nano-second modified times.
- INTERNAL:
+ - Added a few more default suffixes for the "dont compress" settings.
- - Some cleanup in the exclude code has saved some per-exclude memory
- and made the code easier to maintain.
+ - Added the checking of the RSYNC_PROTECT_ARGS environment variable to allow
+ the default for the --protect-args command-line option to be overridden.
- - Improved the argv-overflow checking for a remote command that has a
- lot of args.
+ - Added some Solaris xattr code.
- - Use rsyserr() in the various places that were still calling rprintf()
- with strerror() as an arg.
+ EXTRAS:
- - If an rsync daemon is listening on multiple sockets (to handle both
- IPv4 and IPv6 to a single port), we now close all the unneeded file
- handles after we accept a connection (we used to close just one of
- them).
+ - Added an "instant-rsyncd" script to the support directory, which makes
+ it easy to configure a simple rsync daemon in the current directory.
- - Optimized the handling of larger block sizes (rsync used to slow to a
- crawl if the block size got too large).
+ - Added the "mapfrom" and "mapto" scripts to the support directory, which
+ makes it easier to do user/group mapping in a local transfer based on
+ passwd/group files from another machine.
- - Optimized away a loop in hash_search().
+ INTERNAL:
- - Some improvements to the sanitize_path() and clean_fname() functions
- makes them more efficient and produce better results (while still
- being compatible with the file-name cleaning that gets done on both
- sides when sending the file-list).
+ - The I/O code was rewritten to be simpler and do bigger buffered reads
+ over the socket. The I/O between the receiver and the generator was
+ changed to be standard multiplexed-I/O (like that over the socket).
- - Got rid of alloc_sanitize_path() after adding a destination-buffer
- arg to sanitize_path() made it possible to put all the former's
- functionality into the latter.
+ - The sender tries to use any dead time while the generator is looking for
+ files to transfer in order to do sender-side directory scanning in a more
+ parallel manner.
- BUILD CHANGES:
+ - A daemon can now inform a client about a daemon-configured timeout value
+ so that the client can assist in the keep-alive activity (protocol 31).
- - Added a "gen" target to rebuild most of the generated files,
- including configure, config.h.in, the man pages, and proto.h.
+ - The filter code received some refactoring to make it more extendable, to
+ read better, and do better sanity checking.
- - If "make proto" doesn't find some changes in the prototypes, the
- proto.h file is left untouched (its time-stamp used to always be
- updated).
+ - Really big numbers are now output using our own big-num routine rather
+ than casting them to a double and using a %.0f conversion.
- - The variable $STRIP (that is optionally set by the install-strip
- target's rule) was changed to $INSTALL_STRIP because some systems
- have $STRIP set in the environment.
+ - The pool_alloc library has received some minor improvements in alignment
+ handling.
- - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
+ - Added init_stat_x() function to avoid duplication of acl/xattr init code.
DEVELOPER RELATED:
- - The scripts in the testsuite dir were cleaned up a bit and a few
- new tests added.
-
- - Some new diffs were added to the patches dir, and some accepted
- ones were removed.
+ - Added more conditional debug output.
+ - Changed configure.in to configure.ac.