X-Git-Url: https://mattmccutchen.net/rsync/rsync.git/blobdiff_plain/9e83fa99fe5be2bdc1b448d3ded2a0a04d1e8024..ac1d2d338450eb005abf03002f5784097caf7e19:/NEWS diff --git a/NEWS b/NEWS index 640e5441..8d1fbeff 100644 --- a/NEWS +++ b/NEWS @@ -1,234 +1,179 @@ -NEWS for rsync version 2.6.0 -Protocol: 27 (changed) -Changes since version 2.5.7: +NEWS for rsync 2.6.1 (UNRELEASED) +Protocol: 28 (changed) +Changes since 2.6.0: ENHANCEMENTS: - * "ssh" is now the default remote shell for rsync. If you want to - change this, configure like this: "./configure --with-rsh=rsh". + * Lower memory use and more optimal transfer of data over + the socket (see the INTERNAL section for details). - * Added --files-from, --no-relative, --no-implied-dirs, and --from0. - Note that --from0 affects the line-ending character for all the - files read by the --*-from options. (Wayne Davison) + * The RSYNC_PROXY environment variable can now contain a + "USER:PASS@" prefix before the "HOST:PORT" information. + (Bardur Arantsson) - * Length of csum2 is now per-file starting with protocol version - 27. (J.W. Schultz) + * The --progress output now mentions how far along in the + transfer we are, including both a count of files transferred + and a percentage of the total file-count that we've processed. + It also shows better current-rate-of-transfer and remaining- + transfer-time values. - * Per-file dynamic block size is now sqrt(file length). The - per-file checksum size is determined according to an algorithm - provided by Donovan Baarda which reduces the probability of rsync - algorithm corrupting data and falling back using the whole md4 - checksums. (J.W. Schultz, Donovan Baarda) + * The configure script now accepts --with-rsyncd-conf=PATH + to override the default value of the /etc/rsyncd.conf file. - * The --stats option no longer includes the (debug) malloc summary - unless the verbose option was specified at least twice. - - * Added a new error/warning code for when files vanish from the - sending side. Made vanished source files not interfere with the - file-deletion pass when --delete-after was specified. - - * Various trailing-info sections are now preceded by a newline. + * Added a couple extra diffs in the "patches" dir, removed the + ones that got applied, and rebuilt the rest. BUG FIXES: - * Fixed several exclude/include matching bugs when using wild-cards. - This has a several user-visible effects, all of which make the - matching more consistent and intuitive. This should hopefully not - cause anyone problems since it makes the matching work more like - what people are expecting. (Wayne Davison) - - - A pattern with a "**" no longer causes a "*" to match slashes. - For example, with "/*/foo/**", "foo" must be 2 levels deep. - - - "**/foo" now matches at the base of the transfer (i.e. /foo). - - - An non-anchored wildcard term floats to match beyond the base of - the transfer. E.g. "CVS/R*" matches at the end of the path, - just like the non-wildcard term "CVS/Root" does. - - - Including a "**" in the match term causes it to be matched - against the entire path, not just the name portion, even if - there aren't any interior slashes in the term. E.g. "foo**bar" - would exclude "/path/foo-bar" (just like before) as well as - "/foo-path/baz-bar" (for instance). - - * The exclude list specified in the daemon's config file is now - properly applied to the pulled items no matter how deep the - user's file-args are in the source tree. (Wayne Davison) - - * For protocol version >= 27, mdfour_tail() is called when the - block size (including checksum_seed) is a multiple of 64. - Previously it was not called, giving the wrong MD4 checksum. - (Craig Barratt) - - * For protocol version >= 27, a 64 bit bit counter is used in - mdfour.c as required by the RFC. Previously only a 32 bit bit - counter was used, causing incorrect MD4 file checksums for - file sizes >= 512MB - 4. (Craig Barratt) - - * Fixed a crash bug when interacting with older rsync versions and - multiple files of the same name are destined for the same dir. - (Wayne Davison) - - * Keep tmp names from overflowing MAXPATHLEN. - - * Make --link-dest honor the absence of -p, -o, and -g. - - * Made rsync treat a trailing slash in the destination in a more - consistent manner. - - * Fixed file I/O error detection. (John Van Essen) - - * Fixed bogus "malformed address {hostname}" message in rsyncd log - when checking IP address against hostnames from "hosts allow" - and "hosts deny" parameters in config file. - - * Print heap statistics when verbose >= 2 instead of when >= 1. - - * Fixed a compression (-z) bug when syncing a mostly-matching file - that contains already-compressed data. (Yasuoka Masahiko and - Wayne Davison) - - * Fixed a bug in the --backup code that could cause deleted files - to not get backed up. - - * Call setgroups() in a more portable manner. - - * Improved file-related error messages to better indicate exactly - what pathname failed. (Wayne Davison) - - * Fixed some bugs in the handling of --delete and --exclude when - using the --relative (-R) option. (Wayne Davison) - - * Fixed bug that prevented regular files from replacing - special files and caused a directory in --link-dest or - --compare-dest to block the creation of a file with the - same path. A directory still cannot be replaced by a - regular file unless --delete specified. (J.W. Schultz) - - * Detect and report when open or opendir succeed but read and - readdir fail caused by network filesystems issues and truncated - files. (David Norwood, Michael Brown, J.W. Schultz) - - * Added a fix that should give ssh time to restore the tty settings - if the user presses Ctrl-C at an ssh password prompt. + * When -x (--one-file-system) is combined with -L (--copy-links) + or --copy-unsafe-links, no symlinked files are skipped, even + if the referent file is on a different filesystem. + + * The --link-dest code now works properly for a non-root user + when (1) the UIDs of the source and destination differ and -o + was specified, or (2) when the group of the source can't be + used on the destination and -g was specified. + + * Fixed a bug in the handling of -H (hard-links) that might + cause the expanded PATH/NAME value of the current item to + get overwritten (due to an expanded-name caching bug). + + * We now reset the "new data has been sent" flag at the start + of each file we send. This makes sure that an interrupted + transfer with the --partial option set doesn't keep a shorter + temp file than the current basis file when no new data has been + transfered over the wire for that file. + + * Fixed a byte-order problem in --batch-mode on big-endian + machines. (Jay Fenlason) + + * Fixed configure bug when running "./configure --disable-ipv6". + + * Fixed "make test" bug when build dir is not the source dir. + + * When using --cvs-exclude, the exclude items we get from a + directory's .cvsignore file once again only affect that one + directory (and not all following directories too). The + items are also now properly word-split and parsed without + any +/- prefix munging. + + * When specifying the USER@HOST: prefix for a file, the USER + part can now contain an '@', if needed (i.e. the last '@' + is used to find the HOST, not the first). + + * Fixed some bugs in the handling of group IDs for non-root + users: (1) It properly handles a group that the sender didn't + have a name for (it would previously skip changing the group + on any files in that group). (2) If --numeric-ids is used, + rsync no longer attempts to set groups that the user doesn't + have the permission to set. + + * Fixed the "refuse options" setting in the rsyncd.conf file. + + * Improved the -x (--one-file-system) flag's handling of any + mount-point directories we encounter. It is both more optimal + (in that it no longer does a useless scan of the contents of + the mount-point dirs) and also fixes a bug where a remapped + mount of the original filesystem could get discovered in a + subdir we should be ignoring. + + * Rsync no longer discards a double-slash at the start of a filename + when trying to open the file. It also no longer constructs names + that start with a double slash (unless the user supplied them). + + * Path-specifying options to a daemon should now work the same with + or without chroot turned on. Previously, such a option (such as + --link-dest) would get its absolute path munged into a relative + one if chroot was not on, making that setting fairly useless. + Rsync now transforms the path into one that is based on the + module's base dir when chroot is not enabled. + + * Fixed compilation problem on Tru64 Unix (having to do with + sockaddr.sa_len and sockaddr.sin_len). + + * Fixed a compatibility problem interacting with older rsync + versions that might send us an empty --suffix value without + telling us that --backup-dir was specified. + + * The "hosts allow" option for a daemon-over-remote-shell + process now has improved support for IPv6 addresses and a fix + for systems that have a length field in their socket structs. + + * Fixed the ability to request an empty backup --suffix when + sending files to an rsync daemon. INTERNAL: - * Eliminated vestigial support for old versions that we stopped - supporting. (J.W. Schultz) + * Most of the I/O is now buffered, which results in a pretty + large speedup when running under MS Windows. (Craig Barratt) - * Simplified some of the option-parsing code. (Wayne Davison) + * Optimizations to the name-handling/comparing code have made + some significant reductions in user-CPU time for large file + sets. - * Some cleanup made to the exclude code, as well as some new - defines added to enhance readability. (Wayne Davison) + * Some variable-type cleanup that makes the code more consistent. - * Changed the protocol-version code so that it can interact at a - lower protocol level than the maximum supported by both sides. - Added an undocumented option, --protocol=N, to force the value - we advertise to the other side (primarily for testing purposes). - (Wayne Davison) - - -NEWS for rsync version 2.5.7: -Protocol: 26 (unchanged) -Changes since version 2.5.6: - - SECURITY: - - * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul - Russell, Andrea Barisani) - - -NEWS for rsync version 2.5.6, aka the dwd-between-jobs release -Protocol: 26 (unchanged) -Changes since version 2.5.5: - - ENHANCEMENTS: - - * The --delete-after option now implies --delete. (Wayne Davison) - - * The --suffix option can now be used with --backup-dir. (Michael - Zimmerman) - - * Combining "::" syntax with the -rsh/-e option now uses the - specified remote-shell as a transport to talk to a (newly-spawned) - server-daemon. This allows someone to use daemon features, such - as modules, over a secure protocol, such as ssh. (JD Paul) - - * The rsync:// syntax for daemon connections is now accepted in the - destination field. - - * If the file name given to --include-from or --exclude-from is "-", - rsync will read from standard input. (J.W. Schultz) - - * New option --link-dest which is like --compare-dest except that - unchanged files are hard-linked in to the destination directory. + * Reduced memory requirements of hard link preservation. (J.W. Schultz) - * Don't report an error if an excluded file disappears during an - rsync run. (Eugene Chupriyanov and Bo Kersey) - - * Added .svn to --cvs-exclude list to support subversion. (Jon - Middleton) - - * Properly support IPv6 addresses in the rsyncd.conf "hosts allow" - and "hosts deny" fields. (Hideaki Yoshifuji) - - * Changed exclude file handling to permit DOS or MAC style line - terminations. (J.W. Schultz) - - * Ignore errors from chmod when -p/-a/--preserve-perms is not set. - (Dave Dykstra) - - BUG FIXES: - - * Fix "forward name lookup failed" errors on AIX 4.3.3. (John - L. Allen, Martin Pool) - - * Generate each file's rolling-checksum data as we send it, not - in a separate (memory-eating) pass before hand. This prevents - timeout errors on really large files. (Stefan Nehlsen) - - * Fix compilation on Tru64. (Albert Chin, Zoong Pham) - - * Better handling of some client-server errors. (Martin Pool) - - * Fixed a crash that would occur when sending a list of files that - contains a duplicate name (if it sorts to the end of the file - list) and using --delete. (Wayne Davison) - - * Fixed the file-name duplicate-removal code when dealing with multiple - dups in a row. (Wayne Davison) - - * Fixed a bug that caused rsync to lose the exit status of its child - processes and sometimes return an exit code of 0 instead of showing - an error. (David R. Staples, Dave Dykstra) - - * Fixed bug in --copy-unsafe-links that caused it to be completely - broken. (Dave Dykstra) - - * Prevent infinite recursion in cleanup code under certain circumstances. - (Sviatoslav Sviridov and Marc Espie) - - * Fixed a bug that prevented rsync from creating intervening directories - when --relative-paths/-R is set. (Craig Barratt) - - * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara) - - INTERNAL: - - * Many code cleanups and improved internal documentation. (Martin - Pool, Nelson Beebe) - - * Portability fixes. (Dave Dykstra and Wayne Davison) - - * More test cases. (Martin Pool) - - * Some test-case fixes. (Brian Poole, Wayne Davison) - - * Updated included popt to the latest vendor drop, version 1.6.4. - (Jos Backus) - - * Updated config.guess and config.sub to latest versions; this - means rsync should build on more platforms. (Paul Green) + * Implemented a new algorithm for hard-link handling that speeds + up the code significantly. (J.W. Schultz and Wayne Davison) + + * The --hard-link option now uses the first existing file in the + group of linked files as the basis for the transfer. This + prevents the sub-optimal transfer of a file's data when a new + hardlink is added on the sending side and it sorts alphabetically + earlier in the list than the files that are already present on the + receiving side. + + * Dropped support for protocol versions less than 20 + (2.3.0 released 15 Mar 1999) and activated warnings for + protocols less than 25 (2.5.0 released 23 Aug 2001) + (Wayne Davison and J.W. Schultz, severally) + + * More optimal data transmission for --hard-links (protocol 28). + + * More optimal data transmission for --checksum (protocol 28). + + * Less memory is used when --checksum is specified. + + * Less memory is used in the file list (a per-file savings). + + * The generator is now better about not modifying the file list + during the transfer in order to avoid a copy-on-write memory + bifurcation (on systems where fork() uses shared memory). + Previously, rsync's shared memory would slowly become unshared, + resulting in real memory usage nearly doubling on the receiving + side by the end of the transfer. Now, as long as permissions + are being preserved, the shared memory should remain that way + for the entire transfer. + + * Changed hardlink info and file_struct + strings to use + allocation pools. This reduces memory use for large file- + sets and permits freeing memory to the OS. (J.W. Schultz) + + * The 2 pipes used between the receiver and generator processes + (which are forked on the same machine) were reduced to 1 pipe + and the protocol improved so that (1) it is now impossible to + have the "redo" pipe fill up and hang rsync, and (2) trailing + messages from the receiver don't get lost on their way through + the generator over to the sender (the latter mainly affected + hard-link messages and verbose --stats output). + + * The reading & writing of the file-list in batch-mode is now + handled by the same code that sends & receives the list over + the wire. This makes it much easier to maintain. + + * Improved the internal uid/gid code to be more portable and + a little more optimized. + + * The device numbers sent when using --devices are now sent as + separate major/minor values with 32-bit accuracy (protocol 28). + Previously, the copied devices were sent as a single 32-bit + number. This will make inter-operation of 64-bit binaries more + compatible with their 32-bit brethren. Note that optimizations + in the binary protocol often sends the device data using fewer + bytes than before, even though more precision is now available. + + * Some cleanup of the exclude/include structures and its code + made things clearer, simpler, and more efficient.