Tweaked s### and m## to avoid vim highlighting issues.
[rsync/rsync.git] / OLDNEWS
CommitLineData
93f3fbf7
WD
1NEWS for rsync 3.0.3 (29 Jun 2008)
2Protocol: 30 (unchanged)
3Changes since 3.0.2:
4
5 BUG FIXES:
6
7 - Fixed a wildcard matching problem in the daemon when a module has
8 "use chroot" enabled.
9
10 - Fixed a crash bug in the hard-link code.
11
12 - Fixed the sending of xattr directory information when the code finds a
13 --link-dest or --copy-dest directory with unchanged xattrs -- the
14 destination directory now gets these unchanged xattrs properly applied.
15
16 - Fixed an xattr-sending glitch that could cause an "Internal abbrev"
17 error.
18
19 - Fixed the combination of --xattrs and --backup.
20
21 - The generator no longer allows a '.' dir to be excluded by a daemon-
22 exclude rule.
23
24 - Fixed deletion handling when copying a single, empty directory (with no
25 files) to a differently named, non-existent directory.
26
27 - Fixed the conversion of spaces into dashes in the %M log escape.
28
29 - Fixed several places in the code that were not returning the right
30 errno when a function failed.
31
32 - Fixed the backing up of a device or special file into a backup dir.
33
34 - Moved the setting of the socket options prior to the connect().
35
36 - If rsync exits in the middle of a --progress output, it now outputs a
37 newline to help prevent the progress line from being overwritten.
38
39 - Fixed a problem with how a destination path with a trailing slash or
40 a trailing dot-dir was compared against the daemon excludes.
41
42 - Fixed the sending of large (size > 16GB) files when talking to an older
43 rsync (protocols < 30): we now use a compatible block size limit.
44
45 - If a file's length is so huge that we overflow a checksum buffer count
46 (i.e. several hundred TB), warn the user and avoid sending an invalid
47 checksum struct over the wire.
48
49 - If a source arg is excluded, --relative no longer adds the excluded
50 arg's implied dirs to the transfer. This fix also made the exclude
51 check happen in the better place in the sending code.
52
53 - Use the overflow_exit() function for overflows, not out_of_memory().
54
55 - Improved the code to better handle a system that has only 32-bit file
56 offsets.
57
58 ENHANCEMENTS:
59
60 - The rsyncd.conf manpage now consistently refers to the parameters in
61 the daemon config file as "parameters".
62
63 - The description of the --inplace option was improved.
64
65 EXTRAS:
66
67 - Added a new script in the support directory, deny-rsync, which allows
68 an admin to (temporarily) replace the rsync command with a script that
69 sends an error message to the remote client via the rsync protocol.
70
71 DEVELOPER RELATED:
72
73 - Fixed a testcase failure if the tests are run as root and made some
74 compatibility improvements.
75
76 - Improved the daemon tests, including checking module comments, the
77 listing of files, and the ensuring that daemon excludes can't affect
78 a dot-dir arg.
79
80 - Improved some build rules for those that build in a separate directory
81 from the source, including better install rules for the man pages, and
82 the fixing of a proto.h-tstamp rule that could make the binaries get
83 rebuild without cause.
84
85 - Improved the testsuite to work around a problem with some utilities
86 (e.g. cp -p & touch -r) rounding sub-second timestamps.
87
88 - Ensure that the early patches don't cause any generated-file hunks to
89 bleed-over into patches that follow.
90
91\f
da9aefa6
WD
92NEWS for rsync 3.0.2 (8 Apr 2008)
93Protocol: 30 (unchanged)
94Changes since 3.0.1:
95
96 BUG FIXES:
97
98 - Fixed a potential buffer overflow in the xattr code.
99
100 ENHANCEMENTS:
101
102 - None.
103
104 DEVELOPER RELATED:
105
106 - The RPM spec file was improved to install more useful files.
107
108 - A few developer-oriented scripts were moved from the support dir
109 to the packaging dir.
110
111\f
0917f581
WD
112NEWS for rsync 3.0.1 (3 Apr 2008)
113Protocol: 30 (unchanged)
114Changes since 3.0.0:
115
116 NOTABLE CHANGES IN BEHAVIOR:
117
118 - Added the 'c'-flag to the itemizing of non-regular files so that the
119 itemized output doesn't get hidden if there were no attribute changes,
120 and also so that the itemizing of a --copy-links run will distinguish
121 between copying an identical non-regular file and the creation of a
122 revised version with a new value (e.g. a changed symlink referent, a
123 new device number, etc.).
124
125 BUG FIXES:
126
127 - Fixed a crash bug when a single-use rsync daemon (via remote shell) was
128 run without specifying a --config=FILE option.
129
130 - Fixed a crash when backing up a directory that has a default ACL.
131
132 - Fixed a bug in the handling of xattr values that could cause rsync to
133 not think that a file's extended attributes are up-to-date.
134
135 - Fixed the working of --fake-super with --link-dest and --xattrs.
136
137 - Fixed a hang when combining --dry-run with --remove-source-files.
138
139 - Fixed a bug with --iconv's handling of files that cannot be converted:
140 a failed name can no longer cause a transfer failure.
141
142 - Fixed the building of the rounding.h file on systems that need custom
143 CPPFLAGS to be used. Also improved the error reporting if the building
144 of rounding.h fails.
145
146 - Fixed the use of the --protect-args (-s) option when talking to a daemon.
147
148 - Fixed the --ignore-existing option's protection of files on the receiver
149 that are non-regular files on the sender (e.g. if a symlink or a dir on
150 the sender is trying to replace a file on the receiver). The reverse
151 protection (protecting a dir/symlink/device from being replaced by a
152 file) was already working.
153
154 - Fixed an assert failure if --hard-links is combined with an option that
155 can skip a file in a set of hard-linked files (i.e. --ignore-existing,
156 --append, etc.), without skipping all the files in the set.
157
158 - Avoid setting the modify time on a directory that already has the right
159 modify time set. This avoids tweaking the dir's ctime.
160
161 - Improved the daemon-exclude handling to do a better job of applying the
162 exclude rules to path entries. It also sends the user an error just as
163 if the files were actually missing (instead of silently ignoring the
164 user's args), and avoids sending the user the filter-action messages
165 for these non-user-initiated rules.
166
167 - Fixed some glitches with the dry-run code's missing-directory
168 handling, including a problem when combined with --fuzzy.
169
170 - Fixed some glitches with the skipped-directory handling.
171
172 - Fixed the 'T'-flag itemizing of symlinks when --time isn't preserved.
173
174 - Fixed a glitch in the itemizing of permissions with the -E option.
175
176 - The --append option's restricting of transfers to those that add data no
177 longer prevents the updating of non-content changes to otherwise up-to-
178 date files (i.e. those with the same content but differing permissions,
179 ownership, xattrs, etc.).
180
181 - Don't allow --fake-super to be specified with -XX (double --xattrs)
182 because the options conflict. If a daemon has "fake super" enabled,
183 it automatically downgrades a -XX request to -X.
184
185 - Fixed a couple bugs in the parsing of daemon-config excludes that could
186 make a floating exclude rule get treated as matching an absolute path.
187
188 - A daemon doesn't try to auto-refuse the "iconv" option if iconv-support
189 wasn't compiled in to the daemon (avoiding a warning in the logs).
190
191 - Fixed the inclusion of per-dir merge files from implied dirs.
192
193 - Fixed the support/rrsync script to work with the latest options that
194 rsync sends (including its flag-specifying use of -e to the server).
195
196 ENHANCEMENTS:
197
198 - Added the --old-dirs (--old-d) option to make it easier for a user to
199 ask for file-listings with older rsync versions (this is easier than
200 having to type "-r --exclude='/*/*'" manually).
201
202 - When getting an error while asking an older rsync daemon for a file
203 listing, rsync will try to notice if the error is a rejection of the
204 --dirs (-d) option and let the user know how to work around the issue.
205
206 - Added a few more --no-OPTION overrides.
207
208 - Improved the documentation of the --append option.
209
210 - Improved the documentation of the filter/exclude/include daemon
211 parameters.
212
213 INTERNAL:
214
215 - Fixed a couple minor bugs in the included popt library (ones which I
216 sent to the official popt project for inclusion in the 1.14 release).
217
218 - Fixed a stat() call that should have been do_stat() so that the proper
219 normal/64-bit stat() function gets called. (Was in an area that should
220 not have caused problems, though.)
221
222 - Changed the file-glob code to do a directory scan without using the
223 "glob" and "glob.h". This lets us do the globbing with less memory
224 churn, and also avoid adding daemon-excluded items to the returned
225 args.
226
227 DEVELOPER RELATED:
228
229 - The configure script tries to get the user's compiler to not warn about
230 unused function parameters if the build is not including one or more of
231 the ACL/xattrs/iconv features.
232
233 - The configure script now has better checks for figuring out if the
234 included popt code should be used or not.
235
236 - Fixed two testsuite glitches: avoid a failure if someone's "cd" command
237 outputs the current directory when cd-ing to a relative path, and made
238 the itemized test query how rsync was built to determine if it should
239 expect hard-linked symlinks or not.
240
241 - Updated the testsuite to verify that various bug fixes remain fixed.
242
243 - The RPM spec file was updated to have: (1) comments for how to use the
244 rsync-patch tar file, and (2) an /etc/xinetd.d/rsync file.
245
246 - Updated the build scripts to work with a revised FTP directory
247 structure.
248
249\f
3cbe640d
WD
250NEWS for rsync 3.0.0 (1 Mar 2008)
251Protocol: 30 (changed)
252Changes since 2.6.9:
253
254 NOTABLE CHANGES IN BEHAVIOR:
255
256 - The handling of implied directories when using --relative has changed to
257 send them as directories (e.g. no implied dir is ever sent as a symlink).
258 This avoids unexpected behavior and should not adversely affect most
259 people. If you're one of those rare individuals who relied upon having
260 an implied dir be duplicated as a symlink, you should specify the
261 transfer of the symlink and the transfer of the referent directory as
262 separate args. (See also --keep-dirlinks and --no-implied-dirs.)
263 Also, exclude rules no longer have a partial effect on implied dirs.
264
265 - Requesting a remote file-listing without specifying -r (--recursive) now
266 sends the -d (--dirs) option to the remote rsync rather than sending -r
267 along with an extra exclude of /*/*. If the remote rsync does not
268 understand the -d option (i.e. it is 2.6.3 or older), you will need to
269 either turn off -d (--no-d), or specify -r --exclude='/*/*' manually.
270
271 - In --dry-run mode, the last line of the verbose summary text is output
272 with a "(DRY RUN)" suffix to help remind you that no updates were made.
273 Similarly, --only-write-batch outputs "(BATCH ONLY)".
274
275 - A writable rsync daemon with "use chroot" disabled now defaults to a
276 symlink-munging behavior designed to make symlinks safer while also
277 allowing absolute symlinks to be stored and retrieved. This also has
278 the effect of making symlinks unusable while they're in the daemon's
279 hierarchy. See the daemon's "munge symlinks" parameter for details.
280
281 - Starting up an extra copy of an rsync daemon will not clobber the pidfile
282 for the running daemon -- if the pidfile exists, the new daemon will exit
283 with an error. This means that your wrapper script that starts the rsync
284 daemon should be made to handle lock-breaking (if you want any automatic
285 breaking of locks to be done).
286
287 BUG FIXES:
288
289 - A daemon with "use chroot = no" and excluded items listed in the daemon
290 config file now properly checks an absolute-path arg specified for these
291 options: --compare-dest, --link-dest, --copy-dest, --partial-dir,
292 --backup-dir, --temp-dir, and --files-from.
293
294 - A daemon can now be told to disable all user- and group-name translation
295 on a per-module basis. This avoids a potential problem with a writable
296 daemon module that has "use chroot" enabled -- if precautions weren't
297 taken, a user could try to add a missing library and get rsync to use
298 it. This makes rsync safer by default, and more configurable when id-
299 translation is not desired. See the daemon's "numeric ids" parameter
300 for full details.
301
302 - A chroot daemon can now indicate which part of its path should affect the
303 chroot call, and which part should become an inside-chroot path for the
304 module. This allows you to have outside-the-transfer paths (such as for
305 libraries) even when you enable chroot protection. The idiom used in the
306 rsyncd.conf file is: path = /chroot/dirs/./dirs/inside
307
308 - If a file's data arrived successfully on the receiving side but the
309 rename of the temporary file to the destination file failed AND the
310 --remove-source-files (or the deprecated --remove-sent-files) option
311 was specified, rsync no longer erroneously removes the associated
312 source file.
313
314 - Fixed the output of -ii when combined with one of the --*-dest options:
315 it now itemizes all the items, not just the changed ones.
316
317 - Made the output of all file types consistent when using a --*-dest
318 option. Prior versions would output too many creation events for
319 matching items.
320
321 - The code that waits for a child pid now handles being interrupted by a
322 signal. This fixes a problem with the pre-xfer exec function not being
323 able to get the exit status from the script.
324
325 - A negated filter rule (i.e. with a '!' modifier) no longer loses the
326 negation when sending the filter rules to the remote rsync.
327
328 - Fixed a problem with the --out-format (aka --log-format) option %f: it
329 no longer outputs superfluous directory info for a non-daemon rsync.
330
331 - Fixed a problem with -vv (double --verbose) and --stats when "pushing"
332 files (which includes local copies). Version 2.6.9 would complete the
333 copy, but exit with an error when the receiver output its memory stats.
334
335 - If --password-file is used on a non-daemon transfer, rsync now complains
336 and exits. This should help users figure out that they can't use this
337 option to control a remote shell's password prompt.
338
339 - Make sure that directory permissions of a newly-created destination
340 directory are handled right when --perms is left off.
341
342 - The itemized output of a newly-created destination directory is now
343 output as a creation event, not a change event.
344
345 - Improved --hard-link so that more corner cases are handled correctly
346 when combined with options such as --link-dest and/or --ignore-existing.
347
348 - The --append option no longer updates a file that has the same size.
349
350 - Fixed a bug when combining --backup and --backup-dir with --inplace:
351 any missing backup directories are now created.
352
353 - Fixed a bug when using --backup and --inplace with --whole-file or
354 --read-batch: backup files are actually created now.
355
356 - The daemon pidfile is checked and created sooner in the startup sequence.
357
358 - If a daemon module's "path" value is not an absolute pathname, the code
359 now makes it absolute internally (making it work properly).
360
361 - Ensure that a temporary file always has owner-write permission while we
362 are writing to it. This avoids problems with some network filesystems
363 when transfering read-only files.
364
365 - Any errors output about password-file reading no longer cause an error at
366 the end of the run about a partial transfer.
367
368 - The --read-batch option for protocol 30 now ensures that several more
369 options are set correctly for the current batch file: --iconv, --acls,
370 --xattrs, --inplace, --append, and --append-verify.
371
372 - Using --only-write-batch to a daemon receiver now works properly (older
373 versions would update some files while writing the batch).
374
375 - Avoid outputting a "file has vanished" message when the file is a broken
376 symlink and --copy-unsafe-links or --copy-dirlinks is used (the code
377 already handled this for --copy-links).
378
379 - Fixed the combination of --only-write-batch and --dry-run.
380
381 - Fixed rsync's ability to remove files that are not writable by the file's
382 owner when rsync is running as the same user.
383
1fe0d142
WD
384 - When transferring large files, the sender's hashtable of checksums is
385 kept at a more reasonable state of fullness (no more than 80% full) so
386 that the scanning of the hashtable will not bog down as the number of
387 blocks increases.
388
3cbe640d
WD
389 ENHANCEMENTS:
390
391 - A new incremental-recursion algorithm is now used when rsync is talking
392 to another 3.x version. This starts the transfer going more quickly
393 (before all the files have been found), and requires much less memory.
394 See the --recursive option in the manpage for some restrictions.
395
396 - Lowered memory use in the non-incremental-recursion algorithm for typical
397 option values (usually saving from 21-29 bytes per file).
398
399 - The default --delete algorithm is now --delete-during when talking to a
400 3.x rsync. This is a faster scan than using --delete-before (which is
401 the default when talking to older rsync versions), and is compatible with
402 the new incremental recursion mode.
403
404 - Rsync now allows multiple remote-source args to be specified rather than
405 having to rely on a special space-splitting side-effect of the remote-
406 shell. Additional remote args must specify the same host or an empty one
407 (e.g. empty: :file1 or ::module/file2). For example, this means that
408 local use of brace expansion now works: rsync -av host:dir/{f1,f2} .
409
410 - Added the --protect-args (-s) option, that tells rsync to send most of
411 the command-line args at the start of the transfer rather than as args
412 to the remote-shell command. This protects them from space-splitting,
413 and only interprets basic wildcard special shell characters (*?[).
414
415 - Added the --delete-delay option, which is a more efficient way to delete
416 files at the end of the transfer without needing a separate delete pass.
417
418 - Added the --acls (-A) option to preserve Access Control Lists. This is
419 an improved version of the prior patch that was available, and it even
420 supports OS X ACLs. If you need to have backward compatibility with old,
421 ACL-patched versions of rsync, apply the acls.diff file from the patches
422 dir.
423
424 - Added the --xattrs (-X) option to preserve extended attributes. This is
425 an improved version of the prior patch that was available, and it even
426 supports OS X xattrs (which includes their resource fork data). If you
427 need to have backward compatibility with old, xattr-patched versions of
428 rsync, apply the xattrs.diff file from the patches dir.
429
430 - Added the --fake-super option that allows a non-super user to preserve
431 all attributes of a file by using a special extended-attribute idiom.
432 It even supports the storing of foreign ACL data on your backup server.
433 There is also an analogous "fake super" parameter for an rsync daemon.
434
435 - Added the --iconv option, which allows rsync to convert filenames from
436 one character-set to another during the transfer. The default is to
437 make this feature available as long as your system has iconv_open().
438 If compilation fails, specify --disable-iconv to configure, and then
439 rebuild. If you want rsync to perform character-set conversions by
440 default, you can specify --enable-iconv=CONVERT_STRING with the default
441 value for the --iconv option that you wish to use. For example,
442 "--enable-iconv=." is a good choice. See the rsync manpage for an
443 explanation of the --iconv option's settings.
444
445 - A new daemon config parameter, "charset", lets you control the character-
446 set that is used during an --iconv transfer to/from a daemon module. You
447 can also set your daemon to refuse "no-iconv" if you want to force the
448 client to use an --iconv transfer (requiring an rsync 3.x client).
449
450 - Added the --skip-compress=LIST option to override the default list of
451 file suffixes that will not be compressed when using --compress (-z).
452
453 - The daemon's default for "dont compress" was extended to include:
454 *.7z *.mp[34] *.mov *.avi *.ogg *.jpg *.jpeg
455 The name-matching routine was also optimized to run more quickly.
456
457 - The --max-delete option now outputs a warning if it skipped any file
458 deletions, including a count of how many deletions were skipped. (Older
459 versions just silently stopped deleting things.)
460
461 - You may specify --max-delete=0 to a 3.0.0 client to request that it warn
462 about extraneous files without deleting anything. If you're not sure
463 what version the client is, you can use the less-obvious --max-delete=-1,
464 as both old and new versions will treat that as the same request (though
465 older versions don't warn).
466
467 - The --hard-link option now uses less memory on both the sending and
468 receiving side for all protocol versions. For protocol 30, the use of a
469 hashtable on the sending side allows us to more efficiently convey to the
470 receiver what files are linked together. This reduces the amount of data
471 sent over the socket by a considerable margin (rather than adding more
472 data), and limits the in-memory storage of the device+inode information
473 to just the sending side for the new protocol 30, or to the receiving
474 side when speaking an older protocol (note that older rsync versions kept
475 the device+inode information on both sides).
476
477 - The filter rules now support a perishable ("p") modifier that marks rules
478 that should not have an effect in a directory that is being deleted. e.g.
479 -f '-p .svn/' would only affect "live" .svn directories.
480
481 - Rsync checks all the alternate-destination args for validity (e.g.
482 --link-dest). This lets the user know when they specified a directory
483 that does not exist.
484
0f715920
WD
485 - If we get an ENOSYS error setting the time on a symlink, we don't
486 complain about it anymore (for those systems that even support the
487 setting of the modify-time on a symlink).
3cbe640d
WD
488
489 - Protocol 30 now uses MD5 checksums instead of MD4.
490
491 - Changed the --append option to not checksum the existing data in the
492 destination file, which speeds up file appending.
493
494 - Added the --append-verify option, which works like the older --append
495 option (verifying the existing data in the destination file). For
496 compatibility with older rsync versions, any use of --append that is
497 talking protocol 29 or older will revert to the --append-verify method.
498
499 - Added the --contimeout=SECONDS option that lets the user specify a
500 connection timeout for rsync daemon access.
501
502 - Documented and extended the support for the RSYNC_CONNECT_PROG variable
503 that can be used to enhance the client side of a daemon connection.
504
505 - Improved the dashes and double-quotes in the nroff manpage output.
506
507 - Rsync now supports a lot more --no-OPTION override options.
508
509 INTERNAL:
510
511 - The file-list sorting algorithm now uses a sort that keeps any same-
512 named items in the same order as they were specified. This allows
513 rsync to always ensure that the first of the duplicates is the one
514 that will be included in the copy. The new sort is also faster
515 than the glibc version of qsort() and mergesort().
516
517 - Rsync now supports the transfer of 64-bit timestamps (time_t values).
518
519 - Made the file-deletion code use a little less stack when recursing
520 through a directory hierarchy of extraneous files.
521
522 - Fixed a build problem with older (2.x) versions of gcc.
523
524 - Added some isType() functions that make dealing with signed characters
525 easier without forcing variables via casts.
526
527 - Changed strcat/strcpy/sprintf function calls to use safer versions.
528
529 - Upgraded the included popt version to 1.10.2 and improved its use of
530 string-handling functions.
531
532 - Added missing prototypes for compatibility functions from the lib dir.
533
534 - Configure determines if iconv() has a const arg, allowing us to avoid a
535 compiler warning.
536
537 - Made the sending of some numbers more efficient for protocol 30.
538
539 - Make sure that a daemon process doesn't mind if the client was weird and
540 omitted the --server option.
541
542 - There are more internal logging categories available in protocol 30 than
543 the age-old FINFO and FERROR, including FERROR_XFER and FWARN. These new
544 categories allow some errors and warnings to go to stderr without causing
545 an erroneous end-of-run warning about some files not being able to be
546 transferred.
547
548 - Improved the use of "const" on pointers.
549
550 - Improved J.W.'s pool_alloc routines to add a way of incrementally freeing
551 older sections of a pool's memory.
552
553 - The getaddrinfo.c compatibility code in the "lib" dir was replaced with
554 some new code (derived from samba, derived from PostgreSQL) that has a
555 better license than the old code.
556
557 DEVELOPER RELATED:
558
559 - Rsync is now licensed under the GPLv3 or later.
560
561 - Rsync is now being maintained in a "git" repository instead of CVS
562 (though the old CVS repository still exists for historical access).
563 Several maintenance scripts were updated to work with git.
564
565 - Generated files are no longer committed into the source repository. The
566 autoconf and autoheader commands are now automatically run during the
567 normal use of "configure" and "make". The latest dev versions of all
568 generated files can also be copied from the samba.org web site (see the
569 prepare-source script's fetch option).
570
571 - The "patches" directory of diff files is now built from branches in the
572 rsync git repository (branch patch/FOO creates file patches/FOO.diff).
573 This directory is now distributed in a separate separate tar file named
574 rsync-patches-VERSION.tar.gz instead of the main rsync-VERSION.tar.gz.
575
576 - The proto.h file is now built using a simple perl script rather than a
577 complex awk script, which proved to be more widely compatible.
578
579 - When running the tests, we now put our per-test temp dirs into a sub-
580 directory named testtmp (which is created, if missing). This allows
581 someone to symlink the testtmp directory to another filesystem (which is
582 useful if the build dir's filesystem does not support ACLs and xattrs,
583 but another filesystem does).
584
585 - Rsync now has a way of handling protocol-version changes during the
586 development of a new protocol version. This causes any out-of-sync
587 versions to speak an older protocol rather than fail in a cryptic manner.
588 This addition makes it safer to deploy a pre-release version that may
589 interact with the public. This new exchange of sub-version info does not
590 interfere with the {MIN,MAX}_PROTOCOL_VERSION checking algorithm (which
591 does not have enough range to allow the main protocol number to be
592 incremented for every minor tweak in that happens during development).
593
594 - The csprotocol.txt file was updated to mention the daemon protocol change
595 in the 3.0.0 release.
596
597\f
2955529b
WD
598NEWS for rsync 2.6.9 (6 Nov 2006)
599Protocol: 29 (unchanged)
600Changes since 2.6.8:
601
602 BUG FIXES:
603
604 - If rsync is interrupted via a handled signal (such as SIGINT), it will
605 once again clean-up its temp file from the destination dir.
606
607 - Fixed an overzealous sanitizing bug in the handling of the --link-dest,
608 --copy-dest, and --compare-dest options to a daemon without chroot: if
609 the copy's destination dir is deeper than the top of the module's path,
610 these options now accept a safe number of parent-dir (../) references
611 (since these options are relative to the destination dir). The old code
612 incorrectly chopped off all "../" prefixes for these options, no matter
613 how deep the destination directory was in the module's hierarchy.
614
615 - Fixed a bug where a deferred info/error/log message could get sent
616 directly to the sender instead of being handled by rwrite() in the
617 generator. This fixes an "unexpected tag 3" fatal error, and should
618 also fix a potential problem where a deferred info/error message from
619 the receiver might bypass the log file and get sent only to the client
620 process. (These problems could only affect an rsync daemon that was
621 receiving files.)
622
623 - Fixed a bug when --inplace was combined with a --*-dest option and we
624 update a file's data using an alternate basis file. The code now
625 notices that it needs to copy the matching data from the basis file
626 instead of (wrongly) assuming that it was already present in the file.
627
628 - Fixed a bug where using --dry-run with a --*-dest option with a path
629 relative to a directory that does not yet exist: the affected option
630 gets its proper path value so that the output of the dry-run is right.
631
632 - Fixed a bug in the %f logfile escape when receiving files: the
633 destination path is now included in the output (e.g. you can now tell
634 when a user specifies a subdir inside a module).
635
636 - If the receiving side fails to create a directory, it will now skip
637 trying to update everything that is inside that directory.
638
639 - If --link-dest is specified with --checksum but without --times, rsync
640 will now allow a hard-link to be created to a matching link-dest file
641 even when the file's modify-time doesn't match the server's file.
642
643 - The daemon now calls more timezone-using functions prior to doing a
644 chroot. This should help some C libraries to generate proper timestamps
645 from inside a chrooted daemon (and to not try to access /etc/timezone
646 over and over again).
647
648 - Fixed a bug in the handling of an absolute --partial-dir=ABS_PATH option:
649 it now deletes an alternate basis file from the partial-dir that was used
650 to successfully update a destination file.
651
652 - Fixed a bug in the handling of --delete-excluded when using a per-dir
653 merge file: the merge file is now honored on the receiving side, and
654 only its unqualified include/exclude commands are ignored (just as is
655 done for global include/excludes).
656
657 - Fixed a recent bug where --delete was not working when transferring from
658 the root (/) of the filesystem with --relative enabled.
659
660 - Fixed a recent bug where an --exclude='*' could affect the root (/) of
661 the filesystem with --relative enabled.
662
663 - When --inplace creates a file, it is now created with owner read/write
664 permissions (0600) instead of no permissions at all. This avoids a
665 problem continuing a transfer that was interrupted (since --inplace
666 will not update a file that has no write permissions).
667
668 - If either --remove-source-files or --remove-sent-files is enabled and we
669 are unable to remove the source file, rsync now outputs an error.
670
671 - Fixed a bug in the daemon's "incoming chmod" rule: newly-created
672 directories no longer get the 'F' (file) rules applied to them.
673
674 - Fixed an infinite loop bug when a filter rule was rejected due to being
675 overly long.
676
677 - When the server receives a --partial-dir option from the client, it no
678 longer runs the client-side code that adds an assumed filter rule (since
679 the client will be sending us the rules in the usual manner, and they
680 may have chosen to override the auto-added rule).
681
682 ENHANCEMENTS:
683
684 - Added the --log-file=FILE and --log-file-format=FORMAT options. These
685 can be used to tell any rsync to output what it is doing to a log file.
686 They work with a client rsync, a non-daemon server rsync (see the man
687 page for instructions), and also allows the overriding of rsyncd.conf
688 settings when starting a daemon.
689
690 - The --log-format option was renamed to be --out-format to avoid confusing
691 it with affecting the log-file output. (The old option remains as an
692 alias for the new to preserve backward compatibility.)
693
694 - Made "log file" and "syslog facility" settable on a per-module basis in
695 the daemon's config file.
696
697 - Added the --remove-source-files option as a replacement for the (now
698 deprecated) --remove-sent-files option. This new option removes all
699 non-dirs from the source directories, even if the file was already
700 up-to-date. This fixes a problem where interrupting an rsync that
701 was using --remove-sent-files and restarting it could leave behind
702 a file that the earlier rsync synchronized, but didn't get to remove.
703 (The deprecated --remove-sent-files is still understood for now, and
704 still behaves in the same way as before.)
705
706 - Added the option --no-motd to suppress the message-of-the-day output
707 from a daemon when doing a copy. (See the manpage for a caveat.)
708
709 - Added a new environment variable to the pre-/post-xfer exec commands (in
710 the daemon's config file): RSYNC_PID. This value will be the same in
4eeaa162
WD
711 both the pre- and post-xfer commands, so it can be used as a unique ID
712 if the pre-xfer command wants to cache some arg/request info for the
713 post-xfer command.
2955529b
WD
714
715 INTERNAL:
716
717 - Did a code audit using IBM's code-checker program and made several
718 changes, including: replacing most of the strcpy() and sprintf()
719 calls with strlcpy(), snprintf(), and memcpy(), adding a 0-value to
720 an enum that had been intermingling a literal 0 with the defined enum
721 values, silencing some uninitialized memory checks, marking some
722 functions with a "noreturn" attribute, and changing an "if" that
723 could never succeed on some platforms into a pre-processor directive
724 that conditionally compiles the code.
725
726 - Fixed a potential bug in f_name_cmp() when both the args are a
727 top-level "." dir (which doesn't happen in normal operations).
728
729 - Changed exit_cleanup() so that it can never return instead of exit.
730 The old code might return if it found the exit_cleanup() function
731 was being called recursively. The new code is segmented so that
732 any recursive calls move on to the next step of the exit-processing.
733
734 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
735 define it.
736
737 DEVELOPER RELATED:
738
739 - The acls.diff and xattrs.diff patches have received a bunch of work to
740 make them much closer to being acceptable in the main distribution.
741 The xattrs patch also has some preliminary Mac OS X and FreeBSD
742 compatibility code that various system types to exchange extended
743 file-attributes.
744
745 - A new diff in the patches dir, fake-root.diff, allows rsync to
746 maintain a backup hierarchy with full owner, group, and device info
747 without actually running as root. It does this using a special
748 extended attribute, so it depends on xattrs.diff (which depends on
749 acls.diff).
750
751 - The rsync.yo and rsyncd.conf.yo files have been updated to work
752 better with the latest yodl 2.x releases.
753
754 - Updated config.guess and config.sub to their 2006-07-02 versions.
755
756 - Updated various files to include the latest FSF address and to have
757 consistent opening comments.
758
759\f
60ef8ed1
WD
760NEWS for rsync 2.6.8 (22 Apr 2006)
761Protocol: 29 (unchanged)
762Changes since 2.6.7:
763
764 BUG FIXES:
765
766 - Fixed a bug in the exclude code where an anchored exclude without any
767 wildcards fails to match an absolute source arg, but only when --relative
768 is in effect.
769
770 - Improved the I/O code for the generator to fix a potential hang when the
771 receiver gets an EOF on the socket but the generator's select() call
772 never indicates that the socket is writable for it to be notified about
773 the EOF. (This can happen when using stunnel).
774
775 - Fixed a problem with the file-reading code where a failed read (such as
776 that caused by a bad sector) would not advance the file's read-position
777 beyond the failed read's data.
778
779 - Fixed a logging bug where the "log file" directive was not being honored
780 in a single-use daemon (one spawned by a remote-shell connection or by
781 init).
782
783 - If rsync cannot honor the --delete option, we output an error and exit
784 instead of silently ignoring the option.
785
786 - Fixed a bug in the --link-dest code that prevented special files (such as
787 fifos) from being linked.
788
789 - The ability to hard-link symlinks and special files is now determined at
790 configure time instead of at runtime. This fixes a bug with --link-dest
791 creating a hard-link to a symlink's referent on a BSD system.
792
793 ENHANCEMENTS:
794
795 - In daemon mode, if rsync fails to bind to the requested port, the
796 error(s) returned by socket() and/or bind() are now logged.
797
798 - When we output a fatal error, we now output the version of rsync in the
799 message.
800
801 - Improved the documentation for the --owner and --group options.
802
803 - The rsyncstats script in "support" has an improved line-parsing regex
804 that is easier to read and also makes it to parse syslog-generated lines.
805
806 - A new script in "support": file-attr-restore, can be used to restore the
807 attributes of a file-set (the permissions, ownership, and group info)
808 taken from the cached output of a "find ARG... -ls" command.
809
810 DEVELOPER RELATED:
811
812 - Removed the unused function write_int_named(), the unused variable
813 io_read_phase, and the rarely used variable io_write_phase. This also
814 elides the confusing 'phase "unknown"' part of one error message.
815
816 - Removed two unused configure checks and two related (also unused)
817 compatibility functions.
818
819 - The xattrs.diff patch received a security fix that prevents a potential
820 buffer overflow in the receive_xattr() code.
821
822 - The acls.diff patch has been improved quite a bit, with more to come.
823
824 - A new patch was added: log-file.diff. This contains an early version of
825 a future option, --log-file=FILE, that will allow any rsync to log its
826 actions to a file (something that only a daemon supports at present).
827
828\f
f171bf5b
WD
829NEWS for rsync 2.6.7 (11 Mar 2006)
830Protocol: 29 (unchanged)
831Changes since 2.6.6:
832
833 OUTPUT CHANGES:
834
835 - The letter 'D' in the itemized output was being used for both devices
836 (character or block) as well as other special files (such as fifos and
837 named sockets). This has changed to separate non-device special files
838 under the 'S' designation (e.g. "cS+++++++ path/fifo"). See also the
839 "--specials" option, below.
840
841 - The way rsync escapes unreadable characters has changed. First, rsync
842 now has support for recognizing valid multibyte character sequences in
843 your current locale, allowing it to escape fewer characters than before
844 for a locale such as UTF-8. Second, it now uses an escape idiom of
845 "\#123", which is the literal string "\#" followed by exactly 3 octal
846 digits. Rsync no longer doubles a backslash character in a filename
847 (e.g. it used to output "foo\\bar" when copying "foo\bar") -- now it only
848 escapes a backslash that is followed by a hash-sign and 3 digits (0-9)
849 (e.g. it will output "foo\#134#789" when copying "foo\#789"). See also
850 the --8-bit-output (-8) option, mentioned below.
851
852 Script writers: the local rsync is the one that outputs escaped names,
853 so if you need to support unescaping of filenames for older rsyncs, I'd
854 suggest that you parse the output of "rsync --version" and only use the
855 old unescaping rules for 2.6.5 and 2.6.6.
856
857 BUG FIXES:
858
859 - Fixed a really old bug that caused --checksum (-c) to checksum all the
860 files encountered during the delete scan (ouch).
861
862 - Fixed a potential hang in a remote generator: when the receiver gets a
863 read-error on the socket, it now signals the generator about this so that
864 the generator does not try to send any of the terminating error messages
865 to the client (avoiding a potential hang in some setups).
866
867 - Made hard-links work with symlinks and devices again.
868
869 - If the sender gets an early EOF reading a source file, we propagate this
870 error to the receiver so that it can discard the file and try requesting
871 it again (which is the existing behavior for other kinds of read errors).
872
873 - If a device-file/special-file changes permissions, rsync now updates the
874 permissions without recreating the file.
875
876 - If the user specifies a remote-host for both the source and destination,
877 we now output a syntax error rather than trying to open the destination
878 hostspec as a filename.
879
880 - When --inplace creates a new destination file, rsync now creates it with
881 permissions 0600 instead of 0000 -- this makes restarting possible when
882 the transfer gets interrupted in the middle of sending a new file.
883
884 - Reject the combination of --inplace and --sparse since the sparse-output
885 algorithm doesn't work when overwriting existing data.
886
887 - Fixed the directory name in the error that is output when pop_dir()
888 fails.
889
890 - Really fixed the parsing of a "!" entry in .cvsignore files this time.
891
892 - If the generator gets a stat() error on a file, output it (this used to
893 require at least -vv for the error to be seen).
894
895 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle
896 the exit status properly and generate a better error.
897
898 - Fixed some glitches in the double-verbose output when using --copy-dest,
899 --link-dest, or --compare-dest. Also improved how the verbose output
900 handles hard-links (within the transfer) that had an up-to-date alternate
901 "dest" file, and copied files (via --copy-dest).
902
903 - Fixed the matching of the dont-compress items (e.g. *.gz) against files
904 that have a path component containing a slash.
905
549a3efb
WD
906 - If the code reading a filter/exclude file gets an EINTR error, rsync now
907 clears the error flag on the file handle so it can keep on reading.
f171bf5b
WD
908
909 - If --relative is active, the sending side cleans up trailing "/" or "/."
910 suffixes to avoid triggering a bug in older rsync versions. Also, we now
911 reject a ".." dir if it would be sent as a relative dir.
912
913 - If a non-directory is in the way of a directory and rsync is run with
914 --dry-run and --delete, rsync no longer complains about not being able
915 to opendir() the not-yet present directory.
916
917 - When --list-only is used and a non-existent local destination dir was
918 also specified as a destination, rsync no longer generates a warning
919 about being unable to create the missing directory.
920
921 - Fixed some problems with --relative --no-implied-dirs when the
922 destination directory did not yet exist: we can now create a symlink or
923 device when it is the first thing in the missing dir, and --fuzzy no
924 longer complains about being unable to open the missing dir.
925
926 - Fixed a bug where the --copy-links option would not affect implied
927 directories without --copy-unsafe-links (see --relative).
928
929 - Got rid of the need for --force to be used in some circumstances with
930 --delete-after (making it consistent with --delete-before/-during).
931
932 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this
933 when a file is too large (rsync handles the write error).
934
935 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it
936 was not properly padded with trailing '=' chars. This only affects a
937 user that need to use a password-authenticated proxy for an outgoing
938 daemon-rsync connection.
939
940 - If we're transferring an empty directory to a new name, rsync no longer
941 forces S_IWUSR if it wasn't already set, nor does it accidentally leave
942 it set.
943
944 - Fixed a bug in the debug output (-vvvvv) that could mention the wrong
945 checksum for the current file offset.
946
947 - Rsync no longer allows a single directory to be copied over a non-
948 directory destination arg.
949
950 ENHANCEMENTS:
951
952 - Added the --append option that makes rsync append data onto files that
953 are longer on the source than the destination (this includes new files).
954
955 - Added the --min-size=SIZE option to exclude small files from the
956 transfer.
957
958 - Added the --compress-level option to allow you to set how aggressive
959 rsync's compression should be (this option implies --compress).
960
961 - Enhanced the parsing of the SIZE value for --min-size and --max-size to
962 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
963 and off-by-one values too (e.g. --max-size=8mb-1).
964
965 - Added the --8-bit-output (-8) option, which tells rsync to avoid escaping
966 high-bit characters that it thinks are unreadable in the current locale.
967
968 - The new option --human-readable (-h) changes the output of --progress,
969 --stats, and the end-of-run summary to be easier to read. If repeated,
970 the units become powers of 1024 instead of powers of 1000. (The old
971 meaning of -h, as a shorthand for --help, still works as long as you
972 just use it on its own, as in "rsync -h".)
973
974 - If lutimes() and/or lchmod() are around, use them to allow the
975 preservation of attributes on symlinks.
976
977 - The --link-dest option now affects symlinks and devices (when possible).
978
979 - Added two config items to the rsyncd.conf parsing: "pre-xfer exec" and
980 "post-xfer exec". These allow a command to be specified on a per-module
981 basis that will be run before and/or after a daemon-mode transfer. (See
982 the man page for a list of the environment variables that are set with
983 information about the transfer.)
984
985 - When using the --relative option, you can now insert a dot dir in
986 the source path to indicate where the replication of the source dirs
987 should start. For example, if you specify a source path of
988 rsync://host/module/foo/bar/./baz/dir with -R, rsync will now only
989 replicate the "baz/dir" part of the source path (note: a trailing
990 dot dir is unaffected unless it also has a trailing slash).
991
992 - Added some new --no-FOO options that make it easier to override unwanted
993 implied or default options. For example, "-a --no-o" (aka "--archive
994 --no-owner") can be used to turn off the preservation of file ownership
995 that is implied by -a.
996
997 - Added the --chmod=MODE option that allows the destination permissions to
998 be changed from the source permissions. E.g. --chmod=g+w,o-rwx
999
1000 - Added the "incoming chmod" and "outgoing chmod" daemon options that allow
1001 a module to specify what permissions changes should be applied to all
1002 files copied to and from the daemon.
1003
1004 - Allow the --temp-dir option to be specified when starting a daemon, which
1005 sets the default temporary directory for incoming files.
1006
1007 - If --delete is combined with --dirs without --recursive, rsync will now
1008 delete in any directory whose content is being synchronized.
1009
1010 - If --backup is combined with --delete without --backup-dir (and without
1011 --delete-excluded), we add a "protect" filter-rule to ensure that files
1012 with the backup suffix are not deleted.
1013
1014 - The file-count stats that are output by --progress were improved to
1015 better indicate what the numbers mean. For instance, the output:
1016 "(xfer#5, to-check=8383/9999)" indicates that this was the fifth file
1017 to be transferred, and we still need to check 8383 more files out of
1018 a total of 9999.
1019
1020 - The include/exclude code now allows a dir/*** directive (with 3 trailing
1021 stars) to match both the dir itself as well as all the content below the
1022 dir (dir/** would not match the dir).
1023
1024 - Added the --prune-empty-dirs (-m) option that makes the receiving rsync
1025 discard empty chains of directories from the file-list. This makes it
1026 easier to selectively copy files from a source hierarchy and end up with
1027 just the directories needed to hold the resulting files.
1028
1029 - If the --itemize-changes (-i) option is repeated, rsync now includes
1030 unchanged files in the itemized output (similar to -vv, but without all
1031 the other verbose messages that can get in the way). Of course, the
1032 client must be version 2.6.7 for this to work, but the remote rsync only
1033 needs to be 2.6.7 if you're pushing files.
1034
1035 - Added the --specials option to tell rsync to copy non-device special
1036 files (which rsync now attempts even as a normal user). The --devices
1037 option now requests the copying of just devices (character and block).
1038 The -D option still requests both (e.g. --devices and --specials), -a
1039 still implies -D, and non-root users still get a silent downgrade that
1040 omits device copying.
1041
1042 - Added the --super option to make the receiver always attempt super-user
1043 activities. This is useful for systems that allow things such as devices
1044 to be created or ownership to be set without being UID 0, and is also
1045 useful for someone who wants to ensure that errors will be output if the
1046 receiving rsync isn't being run as root.
1047
1048 - Added the --sockopts option for those few who want to customize the TCP
1049 options used to contact a daemon rsync.
1050
1051 - Added a way for the --temp-dir option to be combined with a partial-dir
1052 setting that lets rsync avoid non-atomic updates (for those times when
1053 --temp-dir is not being used because space is tight).
1054
1055 - A new support script, files-to-excludes, will transform a list of files
1056 into a set of include/exclude directives that will copy those files.
1057
1058 - A new option, --executability (-E) can be used to preserve just the
1059 execute bit on files, for those times when using the --perms option is
1060 not desired.
1061
1062 - The daemon now logs each connection and also each module-list request
1063 that it receives.
1064
1065 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B
1066 (permission bits, e.g. "rwxr-xrwt").
1067
1068 - The --dry-run option no longer forces the enabling of --verbose.
1069
1070 - The --remove-sent-files option now does a better job of incrementally
1071 removing the sent files on the sending side (older versions tended to
1072 clump up all the removals at the end).
1073
1074 - A daemon now supersedes its minimal SIGCHLD handler with the standard
1075 PID-remembering version after forking. This ensures that the generator
1076 can get the child-exit status from the receiver.
1077
1078 - Use of the --bwlimit option no longer interferes with the remote rsync
1079 sending error messages about invalid/refused options.
1080
1081 - Rsync no longer returns a usage error when used with one local source arg
1082 and no destination: this now implies the --list-only option, just like
1083 the comparable situation with a remote source arg.
1084
1085 - Added the --copy-dirlinks option, a more limited version of --copy-links.
1086
1087 - Various documentation improvements, including: a better synopsis, some
1088 improved examples, a better discussion of the presence and absence of
1089 --perms (including how it interacts with the new --executability and
1090 --chmod options), an extended discussion of --temp-dir, an improved
1091 discussion of --partial-dir, a better description of rsync's pattern
1092 matching characters, an improved --no-implied-dirs section, and the
1093 documenting of what the --stats option outputs.
1094
1095 - Various new and updated diffs in the patches dir, including: acls.diff,
1096 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
1097
1098 INTERNAL:
1099
1100 - We now use sigaction() and sigprocmask() if possible, and fall back on
1101 signal() if not. Using sigprocmask() ensures that rsync enables all the
1102 signals that it needs, just in case it was started in a masked state.
1103
1104 - Some buffer sizes were expanded a bit, particularly on systems where
1105 MAXPATHLEN is overly small (e.g. cygwin).
1106
1107 - If io_printf() tries to format more data than fits in the buffer, exit
1108 with an error instead of transmitting a truncated buffer.
1109
1110 - If a va_copy macro is defined, lib/snprintf.c will use it when defining
1111 the VA_COPY macro.
1112
1113 - Reduced the amount of stack memory needed for each level of directory
1114 recursion by nearly MAXPATHLEN bytes.
1115
1116 - The wildmatch function was extended to allow an array of strings to be
1117 supplied as the string to match. This allows the exclude code to do less
1118 string copying.
1119
1120 - Got rid of the safe_fname() function (and all the myriad calls) and
1121 replaced it with a new function in the log.c code that filters all the
1122 output going to the terminal.
1123
1124 - Unified the f_name() and the f_name_to() functions.
1125
1126 - Improved the hash-table code the sender uses to handle checksums to make
1127 it use slightly less memory and run just a little faster.
1128
1129 DEVELOPER RELATED:
1130
1131 - The diffs in the patches dir now require "patch -p1 <DIFF" instead of
1132 the previous -p0. Also, the version included in the release tar now
1133 affect generated files (e.g. configure, rsync.1, proto.h, etc.), so
1134 it is no longer necessary to run autoconf and/or yodl unless you're
1135 applying a patch that was checked out from CVS.
1136
1137 - Several diffs in the patches dir now use the proper --enable-FOO
1138 configure option instead of --with-FOO to turn on the inclusion of
1139 the newly patched feature.
1140
1141 - There is a new script, "prepare-source" than can be used to update the
1142 various generated files (proto.h, configure, etc.) even before configure
1143 has created the Makefile (this is mainly useful when patching the source
1144 with a patch that doesn't affect generated files).
1145
1146 - The testsuite now sets HOME so that it won't be affected by a file such
1147 as ~/.popt.
1148
1149\f
f90f7149
WD
1150NEWS for rsync 2.6.6 (28 Jul 2005)
1151Protocol: 29 (unchanged)
1152Changes since 2.6.5:
1153
1154 SECURITY FIXES:
1155
1156 - The zlib code was upgraded to version 1.2.3 in order to make it more
1157 secure. While the widely-publicized security problem in zlib 1.2.2 did
1158 not affect rsync, another security problem surfaced that affects rsync's
1159 zlib 1.1.4.
1160
1161 BUG FIXES:
1162
1163 - The setting of flist->high in clean_flist() was wrong for an empty list.
1164 This could cause flist_find() to crash in certain rare circumstances
1165 (e.g. if just the right directory setup was around when --fuzzy was
1166 combined with --link-dest).
1167
1168 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
1169 (1) Without -i it would output the name of each hard-linked file as
1170 though it had been changed; it now outputs a "is hard linked" message for
1171 the file. (2) With -i it would output all dots for the unchanged
1172 attributes of a hard-link; it now changes those dots to spaces, as is
1173 done for other totally unchanged items.
f90f7149
WD
1174
1175 - When backing up a changed symlink or device, get rid of any old backup
1176 item so that we don't get an "already exists" error.
1177
1178 - A couple places that were comparing a local and a remote modification-
1179 time were not honoring the --modify-window option.
1180
1181 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
1182 set too often (if some non-significant mode bits differed).
1183
1184 - Fixed a really old, minor bug that could cause rsync to warn about being
1185 unable to mkdir() a path that ends in "/." because it just created the
1186 directory (required --relative, --no-implied-dirs, a source path that
1187 ended in either a trailing slash or a trailing "/.", and a non-existing
1188 destination dir to tickle the bug in a recent version).
1189
1190 ENHANCEMENTS:
1191
1192 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
1193 per-module basis (which now matches the documentation).
1194
1195 - The support/rrsync script has been upgraded to verify the args of options
1196 that take args (instead of rejecting any such options). The script was
1197 also changed to try to be more secure and to fix a problem in the parsing
1198 of a pull operation that has multiple sources.
1199
1200 - Improved the documentation that explains the difference between a
1201 normal daemon transfer and a daemon-over remote-shell transfer.
1202
1203 - Some of the diffs supplied in the patches dir were fixed and/or
1204 improved.
1205
1206 BUILD CHANGES:
1207
1208 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
1209 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
1210 find in the /etc/group file).
1211
1212 - Added a test to the test suite, itemized.test, that tests the output of
1213 -i (log-format w/%i) and some double-verbose messages.
1214
1215\f
a1c75ed0
WD
1216NEWS for rsync 2.6.5 (1 Jun 2005)
1217Protocol: 29 (unchanged)
1218Changes since 2.6.4:
1219
1220 OUTPUT CHANGES:
1221
1222 - Non-printable chars in filenames are now output using backslash-
1223 escaped characters rather than '?'s. Any non-printable character is
1224 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
1225 is now output as "\\". Rsync also uses your locale setting, which
1226 can make it treat fewer high-bit characters as non-printable.
1227
1228 - If rsync received an empty file-list when pulling files, it would
1229 output a "nothing to do" message and exit with a 0 (success) exit
1230 status, even if the remote rsync returned an error (it did not do
1231 this under the same conditions when pushing files). This was changed
1232 to make the pulling behavior the same as the pushing behavior: we
1233 now do the normal end-of-run outputting (depending on options) and
1234 exit with the appropriate exit status.
1235
1236 BUG FIXES:
1237
1238 - A crash bug was fixed when a daemon had its "path" set to "/", did
1239 not have chroot enabled, and used some anchored excludes in the
1240 rsyncd.conf file.
1241
1242 - Fixed a bug in the transfer of a single file when -H is specified
1243 (rsync would either infinite loop or perhaps crash).
1244
1245 - Fixed a case where the generator might try (and fail) to tweak the
1246 write-permissions of a read-only directory in list-only mode (this
1247 only caused an annoying warning message).
1248
1249 - If --compare-dest or --link-dest uses a locally-copied file as the
1250 basis for an updated version, log this better when --verbose or -i
1251 is in effect.
1252
1253 - Fixed the accidental disabling of --backup during the --delete-after
1254 processing.
1255
1256 - Restored the ability to use the --address option in client mode (in
1257 addition to its use in daemon mode).
1258
1259 - Make sure that some temporary progress information from the delete
1260 processing does not get left on the screen when it is followed by a
1261 newline.
1262
1263 - When --existing skips a directory with extra verbosity, refer to it
1264 as a "directory", not a "file".
1265
1266 - When transferring a single file to a different-named file, any
1267 generator messages that are source-file related no longer refer to
1268 the file by the destination filename.
1269
1270 - Fixed a bug where hard-linking a group of files might fail if the
1271 generator hasn't created a needed destination directory yet.
1272
1273 - Fixed a bug where a hard-linked group of files that is newly-linked
1274 to a file in a --link-dest dir doesn't link the files from the rest
1275 of the cluster.
1276
1277 - When deleting files with the --one-file-system (-x) option set, rsync
1278 no longer tries to remove files from inside a mount-point on the
1279 receiving side. Also, we don't complain about being unable to remove
1280 the mount-point dir.
1281
1282 - Fixed a compatibility problem when using --cvs-ignore (-C) and
1283 sending files to an older rsync without using --delete.
1284
1285 - Make sure that a "- !" or "+ !" include/exclude pattern does not
1286 trigger the list-clearing action that is reserved for "!".
1287
1288 - Avoid a timeout in the generator when the sender/receiver aren't
1289 handling the generator's checksum output quickly enough.
1290
1291 - Fixed the omission of some directories in the delete processing when
1292 --relative (-R) was combined with a source path that had a trailing
1293 slash.
1294
1295 - Fixed a case where rsync would erroneously delete some files and then
1296 re-transfer them when the options --relative (-R) and --recursive
1297 (-r) were both enabled (along with --delete) and a source path had a
1298 trailing slash.
1299
1300 - Make sure that --max-size doesn't affect a device or a symlink.
1301
1302 - Make sure that a system with a really small MAXPATHLEN does not cause
1303 the buffers in readfd_unbuffered() to be too small to receive normal
1304 messages. (This mainly affected Cygwin.)
1305
1306 - If a source pathname ends with a filename of "..", treat it as if
1307 "../" had been specified (so that we don't copy files to the parent
1308 dir of the destination).
1309
1310 - If --delete is combined with a file-listing rsync command (i.e. no
1311 transfer is happening), avoid outputting a warning that we couldn't
1312 delete anything.
1313
1314 - If --stats is specified with --delete-after, ensure that all the
1315 "deleting" messages are output before the statistics.
1316
1317 - Improved one "if" in the deletion code that was only checking errno
1318 for ENOTEMPTY when it should have also been checking for EEXIST (for
1319 compatibility with OS variations).
1320
1321 ENHANCEMENTS:
1322
1323 - Added the --only-write-batch=FILE option that may be used (instead
1324 of --write-batch=FILE) to create a batch file without doing any
1325 actual updating of the destination. This allows you to divert all
1326 the file-updating data away from a slow data link (as long as you
1327 are pushing the data to the remote server when creating the batch).
1328
1329 - When the generator is taking a long time to fill up its output buffer
1330 (e.g. if the transferred files are few, small, or missing), it now
1331 periodically flushes the output buffer so that the sender/receiver
1332 can get started on the files sooner rather than later.
1333
1334 - Improved the keep-alive code to handle a long silence between the
1335 sender and the receiver that can occur when the sender is receiving
1336 the checksum data for a large file.
1337
1338 - Improved the auth-errors that are logged by the daemon to include
1339 some information on why the authorization failed: wrong user,
1340 password mismatch, etc. (The client-visible message is unchanged!)
1341
1342 - Improved the client's handling of an "@ERROR" from a daemon so that
1343 it does not complain about an unexpectedly closed socket (since we
1344 really did expect the socket to close).
1345
1346 - If the daemon can't open the log-file specified in rsyncd.conf, fall
1347 back to using syslog and log an appropriate warning. This is better
1348 than what was typically a totally silent (and fatal) failure (since a
1349 daemon is not usually run with the --no-detach option that was
1350 necessary to see the error on stderr).
1351
1352 - The man pages now consistently refer to an rsync daemon as a "daemon"
1353 instead of a "server" (to distinguish it from the server process in a
1354 non-daemon transfer).
1355
1356 - Made a small change to the rrsync script (restricted rsync -- in the
1357 support dir) to make a read-only server reject all --remove-* options
1358 when sending files (to future-proof it against the possibility of
1359 other similar options being added at some point).
1360
1361 INTERNAL:
1362
1363 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
1364 better discern which filename characters need to be escaped in
1365 messages (which should result in fewer escaped characters in some
1366 locales).
1367
1368 - Improved the naming of the log-file open/reopen/close functions.
1369
1370 - Removed some protocol-compatibility code that was only needed to help
1371 someone running a pre-release of 2.6.4.
1372
1373 BUILD CHANGES:
1374
1375 - Added configure option "--disable-locale" to disable any use of
1376 setlocale() in the binary.
1377
1378 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
1379 rsync from being built without symlink or hard-link support.
1380
1381 - Only #define HAVE_REMSH if it is going to be set to 1.
1382
1383 - Configure now disables the use of mkstemp() under HP-UX (since they
1384 refuse to fix its broken handling of large files).
1385
1386 - Configure now explicitly checks for the lseek64() function so that
1387 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
1388 presence based on the presence of the off64_t type.
1389
1390 - Configure no longer mentions the change in the default remote-shell
1391 (from rsh to ssh) that occurred for the 2.6.0 release.
1392
1393 - Some minor enhancements to the test scripts.
1394
1395 - Added a few new *.diff files to the patches dir, including a patch
1396 that enables the optional copying of extended attributes.
1397
1398\f
1ad6a7f6
WD
1399NEWS for rsync 2.6.4 (30 March 2005)
1400Protocol: 29 (changed)
1401Changes since 2.6.3:
1402
1403 OUTPUT CHANGES:
1404
1405 - When rsync deletes a directory and outputs a verbose message about
1406 it, it now appends a trailing slash to the name instead of (only
1407 sometimes) outputting a preceding "directory " string.
1408
1409 - The --stats output will contain file-list time-statistics if both
1410 sides are 2.6.4, or if the local side is 2.6.4 and the files are
1411 being pushed (since the stats come from the sending side).
1412 (Requires protocol 29 for a pull.)
1413
1414 - The "%o" (operation) log-format escape now has a third value (besides
1415 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
1416 This changes the way deletions are logged in the daemon's log file.
1417
1418 - When the --log-format option is combined with --verbose, rsync now
1419 avoids outputting the name of the file twice in most circumstances.
1420 As long as the --log-format item does not refer to any post-transfer
1421 items (such as %b or %c), the --log-format message is output prior to
1422 the transfer, so --verbose is now the equivalent of a --log-format of
1423 '%n%L' (which outputs the name and any link info). If the log output
1424 must occur after the transfer to be complete, the only time the name
1425 is also output prior to the transfer is when --progress was specified
1426 (so that the name will precede the progress stats, and the full
1427 --log-format output will come after).
97e3c50c 1428
7c2a83c6
WD
1429 - Non-printable characters in filenames are replaced with a '?' to
1430 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
1431
1432 BUG FIXES:
1433
1434 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
1435 was only treating it as a special token in an rsync include/exclude
1436 file).
1437
1438 - The combination of --verbose and --dry-run now mentions the full list
1439 of changes that would be output without --dry-run.
1440
1441 - Avoid a mkdir warning when removing a directory in the destination
1442 that already exists in the --backup-dir.
1443
1444 - An OS that has a binary mode for its files (such as cygwin) needed
1445 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 1446 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
1447
1448 - Fixed a potential hang when verbosity is high, the client side is
1449 the sender, and the file-list is large.
1450
1451 - Fixed a potential protocol-corrupting bug where the generator could
1452 merge a message from the receiver into the middle of a multiplexed
1453 packet of data if only part of that data had been written out to the
1454 socket when the message from the generator arrived.
1455
1456 - We now check if the OS doesn't support using mknod() for creating
1457 FIFOs and sockets, and compile-in some compatibility code using
1458 mkfifo() and socket() when necessary.
1459
1460 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
1461 if the --max-delete limit is exceeded during a run, we now output a
1462 warning about this at the end of the run and exit with a new error
1463 code (25).
1464
1465 - One place in the code wasn't checking if fork() failed.
1466
1467 - The "ignore nonreadable" daemon parameter used to erroneously affect
1468 readable symlinks that pointed to a non-existent file.
1469
1470 - If the OS does not have lchown() and a chown() of a symlink will
1471 affect the referent of a symlink (as it should), we no longer try
1472 to set the user and group of a symlink.
1473
1474 - The generator now properly runs the hard-link loop and the dir-time
1475 rewriting loop after we're sure that the redo phase is complete.
1476
1477 - When --backup was specified with --partial-dir=DIR, where DIR is a
1478 relative path, the backup code was erroneously trying to backup a
1479 file that was put into the partial-dir.
1480
1481 - If a file gets resent in a single transfer and the --backup option is
1482 enabled along with --inplace, rsync no longer performs a duplicate
1483 backup (it used to overwrite the first backup with the failed file).
1484
1485 - One call to flush_write_file() was not being checked for an error.
1486
1487 - The --no-relative option was not being sent from the client to a
1488 server sender.
1489
1490 - If an rsync daemon specified "dont compress = ..." for a file and the
1491 client tried to specify --compress, the libz code was not handling a
1492 compression level of 0 properly. This could cause a transfer failure
1493 if the block-size for a file was large enough (e.g. rsync might have
1494 exited with an error for large files).
1495
1496 - Fixed a bug that would sometimes surface when using --compress and
1497 sending a file with a block-size larger than 64K (either manually
1498 specified, or computed due to the file being really large). Prior
1499 versions of rsync would sometimes fail to decompress the data
1500 properly, and thus the transferred file would fail its verification.
1501
1502 - If a daemon can't open the specified log file (i.e. syslog is not
1503 being used), die without crashing. We also output an error about
1504 the failure on stderr (which will only be seen if --no-detach was
1505 specified) and exit with a new error code (6).
1506
1507 - A local transfer no longer duplicates all its include/exclude options
1508 (since the forked process already has a copy of the exclude list,
1509 there's no need to send them a set of duplicates).
1510
7eb2ecda
WD
1511 - The output of the items that are being updated by the generator (dirs,
1512 symlinks, devices) is now intermingled in the proper order with the
1513 output from the items that the receiver is updating (regular files)
1514 when pulling. This misordering was particularly bad when --progress
1515 was specified. (Requires protocol 29.)
1ad6a7f6
WD
1516
1517 - When --timeout is specified, lulls that occur in the transfer while
1518 the generator is doing work that does not generate socket traffic
1519 (looking for changed files, deleting files, doing directory-time
1520 touch-ups, etc.) will cause a new keep-alive packet to be sent that
1521 should keep the transfer going as long as the generator continues to
1522 make progress. (Requires protocol 29.)
1523
1524 - The stat size of a device is not added to the total file size of the
1525 items in the transfer (the size might be undefined on some OSes).
1526
1527 - Fixed a problem with refused-option messages sometimes not making it
1528 back to the client side when a remote --files-from was in effect and
1529 the daemon was the receiver.
1530
0f9941dc 1531 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
1532 (the preserved) attributes from the version in the compare-dest DIR.
1533
1534 - When rsync is copying files into a write-protected directory, fixed
1535 the change-report output for the directory so that we don't report
1536 an identical directory as changed.
1537
1538 ENHANCEMENTS:
1539
1540 - Rsync now supports popt's option aliases, which means that you can
1541 use /etc/popt and/or ~/.popt to create your own option aliases.
1542
1543 - Added the --delete-during (--del) option which will delete files
1544 from the receiving side incrementally as each directory in the
1545 transfer is being processed. This makes it more efficient than the
1546 default, before-the-transfer behavior, which is now also available as
1547 --delete-before (and is still the default --delete-WHEN option that
1548 will be chosen if --delete or --delete-excluded is specified without
1549 a --delete-WHEN choice). All the --del* options infer --delete, so
1550 an rsync daemon that refuses "delete" will still refuse to allow any
1551 file-deleting options (including the new --remove-sent-files option).
1552
1553 - All the --delete-WHEN options are now more memory efficient:
1554 Previously an duplicate set of file-list objects was created on the
1555 receiving side for the entire destination hierarchy. The new
1556 algorithm only creates one directory of objects at a time (for files
1557 inside the transfer).
1558
1559 - Added the --copy-dest option, which works like --link-dest except
1560 that it locally copies identical files instead of hard-linking them.
1561
1562 - Added support for specifying multiple --compare-dest, --copy-dest, or
1563 --link-dest options, but only of a single type. (Promoted from the
1564 patches dir and enhanced.) (Requires protocol 29.)
1565
1566 - Added the --max-size option. (Promoted from the patches dir.)
1567
1568 - The daemon-mode options are now separated from the normal rsync
1569 options so that they can't be mixed together. This makes it
1570 impossible to start a daemon that has improper default option values
1571 (which could cause problems when a client connects, such as hanging
1572 or crashing).
1573
1574 - The --bwlimit option may now be used in combination with --daemon
1575 to specify both a default value for the daemon side and a value
1576 that cannot be exceeded by a user-specified --bwlimit option.
1577
1578 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
1579 the patches dir.) Also added "address". The command-line options
1580 take precedence over a config-file option, as expected.
1581
1582 - In _exit_cleanup(): when we are exiting with a partially-received
1583 file, we now flush any data in the write-cache before closing the
1584 partial file.
1585
1586 - The --inplace support was enhanced to work with --compare-dest,
1587 --link-dest, and (the new) --copy-dest options. (Requires protocol
1588 29.)
1589
1590 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
1591 without recursion. Any directories that are encountered are created
1592 on the destination. Specifying a directory with a trailing slash
1593 copies its immediate contents to the destination.
1594
1595 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
1596
1597 - Added the --list-only option, which is mainly a way for the client to
1598 put the server into listing mode without needing to resort to any
1599 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
1600 for a non-recursive listing). This option is used automatically
1601 (behind the scenes) when a modern rsync speaks to a modern daemon,
1602 but may also be specified manually if you want to force the use of
1603 the --list-only option over a remote-shell connection.
1604
1605 - Added the --omit-dir-times (-O) option, which will avoid updating
1606 the modified time for directories when --times was specified. This
1607 option will avoid an extra pass through the file-list at the end of
1608 the transfer (to tweak all the directory times), which may provide
1609 an appreciable speedup for a really large transfer. (Promoted from
1610 the patches dir.)
1611
1612 - Added the --filter (-f) option and its helper option, -F. Filter
1613 rules are an extension to the existing include/exclude handling
1614 that also supports nested filter files as well as per-directory
1615 filter files (like .cvsignore, but with full filter-rule parsing).
1616 This new option was chosen in order to ensure that all existing
1617 include/exclude processing remained 100% compatible with older
1618 versions. Protocol 29 is needed for full filter-rule support, but
1619 backward-compatible rules work with earlier protocol versions.
1620 (Promoted from the patches dir and enhanced.)
1621
1622 - Added the --delay-updates option that puts all updated files into
1623 a temporary directory (by default ".~tmp~", but settable via the
1624 --partial-dir=DIR option) until the end of the transfer. This
1625 makes the updates a little more atomic for a large transfer.
1626
1627 - If rsync is put into the background, any output from --progress is
1628 reduced.
1629
1630 - Documented the "max verbosity" setting for rsyncd.conf. (This
1631 setting was added a couple releases ago, but left undocumented.)
1632
1633 - The sender and the generator now double-check the file-list index
1634 they are given, and refuse to try to do a file transfer on a
1635 non-file index (since that would indicate that something had gone
1636 very wrong).
1637
1638 - Added the --itemize-changes (-i) option, which is a way to output a
1639 more detailed list of what files changed and in what way. The effect
1640 is the same as specifying a --log-format of "%i %n%L" (see both the
1641 rsync and rsyncd.conf manpages). Works with --dry-run too.
1642
1643 - Added the --fuzzy (-y) option, which attempts to find a basis file
1644 for a file that is being created from scratch. The current algorithm
1645 only looks in the destination directory for the created file, but it
1646 does attempt to find a match based on size/mod-time (in case the file
1647 was renamed with no other changes) as well as based on a fuzzy
1648 name-matching algorithm. This option requires protocol 29 because it
1649 needs the new file-sorting order. (Promoted from patches dir and
1650 enhanced.) (Requires protocol 29.)
1651
1652 - Added the --remove-sent-files option, which lets you move files
1653 between systems.
1654
1655 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
1656 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
1657 literals in the rsync://HOST:PORT/PATH format.)
1658
1659 - When rsync recurses to build the file list, it no longer keeps open
1660 one or more directory handles from the dir's parent dirs.
1661
1662 - When building under windows, the default for --daemon is now to
1663 avoid detaching, requiring the new --detach option to force rsync
1664 to detach.
1665
1666 - The --dry-run option can now be combined with either --write-batch or
1667 --read-batch, allowing you to run a do-nothing test command to see
1668 what would happen without --dry-run.
1669
1670 - The daemon's "read only" config item now sets an internal read_only
1671 variable that makes extra sure that no write/delete calls on the
1672 read-only side can succeed.
1673
1674 - The log-format % escapes can now have a numeric field width in
1675 between the % and the escape letter (e.g. "%-40n %08p").
1676
1677 - Improved the option descriptions in the --help text.
1678
1679 SUPPORT FILES:
1680
1681 - Added atomic-rsync to the support dir: a perl script that will
1682 transfer some files using rsync, and then move the updated files into
1683 place all at once at the end of the transfer. Only works when
1684 pulling, and uses --link-dest and a parallel hierarchy of files to
1685 effect its update.
1686
1687 - Added mnt-excl to the support dir: a perl script that takes the
1688 /proc/mounts file and translates it into a set of excludes that will
1689 exclude all mount points (even mapped mounts to the same disk). The
1690 excludes are made relative to the specified source dir and properly
1691 anchored.
1692
1693 - Added savetransfer.c to the support dir: a C program that can make
1694 a copy of all the data that flows over the wire. This lets you test
1695 for data corruption (by saving the data on both the sending side and
1696 the receiving side) and provides one way to debug a protocol error.
1697
1698 - Added rrsync to the support dir: this is an updated version of Joe
1699 Smith's restricted rsync perl script. This helps to ensure that only
1700 certain rsync commands can be run by an ssh invocation.
1701
1702 INTERNAL:
1703
1704 - Added better checking of the checksum-header values that come over
1705 the socket.
1706
1707 - Merged a variety of file-deleting functions into a single function so
1708 that it is easier to maintain.
1709
1710 - Improved the type of some variables (particularly blocksize vars) for
1711 consistency and proper size.
1712
1713 - Got rid of the uint64 type (which we didn't need).
1714
1715 - Use a slightly more compatible set of core #include directives.
1716
1717 - Defined int32 in a way that ensures that the build dies if we can't
1718 find a variable with at least 32 bits.
1719
1720 PROTOCOL DIFFERENCES FOR VERSION 29:
1721
1722 - A 16-bit flag-word is transmitted after every file-list index. This
1723 indicates what is changing between the sender and the receiver. The
1724 generator now transmits an index and a flag-word to indicate when
1725 dirs and symlinks have changed (instead of producing a message),
1726 which makes the outputting of the information more consistent and
1727 less prone to screen corruption (because the local receiver/sender is
1728 now outputting all the file-change info messages).
1729
1730 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
1731 in the flag-word and the name of the file that was linked immediately
1732 follows in vstring format (see below).
1733
1734 - If a file is being transferred with an alternate-basis file, the
1735 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
1736 byte follows, indicating what type of basis file was chosen. If that
1737 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
1738 is set in the flag-word and the name of the match in vstring format
1739 follows the basis byte. A vstring is a variable length string that
1740 has its size written prior to the string, and no terminating null.
1741 If the string is from 1-127 bytes, the length is a single byte. If
1742 it is from 128-32767 bytes, the length is written as ((len >> 8) |
1743 0x80) followed by (len % 0x100).
1744
1745 - The sending of exclude names is done using filter-rule syntax. This
1746 means that all names have a prefixed rule indicator, even excludes
1747 (which used to be sent as a bare pattern, when possible). The -C
1748 option will include the per-dir .cvsignore merge file in the list of
1749 filter rules so it is positioned correctly (unlike in some older
1750 transfer scenarios).
1751
1752 - Rsync sorts the filename list in a different way: it sorts the subdir
1753 names after the non-subdir names for each dir's contents, and it
1754 always puts a dir's contents immediately after the dir's name in the
1755 list. (Previously an item named "foo.txt" would sort in between
1756 directory "foo/" and "foo/bar".)
1757
1758 - When talking to a protocol 29 rsync daemon, a list-only request
1759 is able to note this before the options are sent over the wire and
1760 the new --list-only option is included in the options.
1761
1762 - When the --stats bytes are sent over the wire (or stored in a batch),
1763 they now include two elapsed-time values: one for how long it took to
1764 build the file-list, and one for how long it took to send it over the
1765 wire (each expressed in thousandths of a second).
1766
1767 - When --delete-excluded is specified with some filter rules (AKA
1768 excludes), a client sender will now initiate a send of the rules to
1769 the receiver (older protocols used to omit the sending of excludes in
1770 this situation since there were no receiver-specific rules that
1771 survived --delete-excluded back then). Note that, as with all the
1772 filter-list sending, only items that are significant to the other
1773 side will actually be sent over the wire, so the filter-rule list
1774 that is sent in this scenario is often empty.
1775
1776 - An index equal to the file-list count is sent as a keep-alive packet
1777 from the generator to the sender, which then forwards it on to the
1778 receiver. This normally invalid index is only a valid keep-alive
1779 packet if the 16-bit flag-word that follows it contains a single bit
1780 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
1781
1782 - A protocol-29 batch file includes a bit for the setting of the --dirs
1783 option and for the setting of the --compress option. Also, the shell
1784 script created by --write-batch will use the --filter option instead
1785 of --exclude-from to capture any filter rules.
1786
1787 BUILD CHANGES:
1788
1789 - Handle an operating system that use mkdev() in place of makedev().
1790
1791 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
1792
1793\f
ca39ebf9
WD
1794NEWS for rsync 2.6.3 (30 Sep 2004)
1795Protocol: 28 (unchanged)
1796Changes since 2.6.2:
1797
1798 SECURITY FIXES:
1799
1800 - A bug in the sanitize_path routine (which affects a non-chrooted
1801 rsync daemon) could allow a user to craft a pathname that would get
1802 transformed into an absolute path for certain options (but not for
1803 file-transfer names). If you're running an rsync daemon with chroot
1804 disabled, *please upgrade*, ESPECIALLY if the user privs you run
1805 rsync under is anything above "nobody".
1806
1807 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
1808
1809 - Please note that the 2-line footer (output when verbose) now uses the
1810 term "sent" instead of "wrote" and "received" instead of "read". If
1811 you are not parsing the numeric values out of this footer, a script
1812 would be better off using the empty line prior to the footer as the
1813 indicator that the verbose output is over.
1814
1815 - The output from the --stats option was similarly affected to change
1816 "written" to "sent" and "read" to "received".
1817
1818 - Rsync ensures that a filename that contains a newline gets mentioned
1819 with each newline transformed into a question mark (which prevents a
1820 filename from causing an empty line to be output).
1821
1822 - The "backed up ..." message that is output when at least 2 --verbose
1823 options are specified is now the same both with and without the
1824 --backup-dir option.
1825
1826 BUG FIXES:
1827
1828 - Fixed a crash bug that might appear when --delete was used and
1829 multiple source directories were specified.
1830
1831 - Fixed a 32-bit truncation of the file length when generating the
1832 checksums.
1833
1834 - The --backup code no longer attempts to create some directories
1835 over and over again (generating warnings along the way).
1836
1837 - Fixed a bug in the reading of the secrets file (by the daemon) and
1838 the password file (by the client): the files no longer need to be
1839 terminated by a newline for their content to be read in.
1840
1841 - If a file has a read error on the sending side or the reconstructed
1842 data doesn't match the expected checksum (perhaps due to the basis
1843 file changing during the transfer), the receiver will no longer
1844 retain the resulting file unless the --partial option was specified.
1845 (Note: for the read-error detection to work, neither side can be
1846 older than 2.6.3 -- older receivers will always retain the file, and
1847 older senders don't tell the receiver that the file had a read
1848 error.)
1849
1850 - If a file gets resent in a single transfer and the --backup option
1851 is enabled, rsync no longer performs a duplicate backup (it used to
1852 overwrite the original file in the backup area).
1853
1854 - Files specified in the daemon's "exclude" or "exclude from" config
1855 items are now excluded from being uploaded (assuming that the module
1856 allows uploading at all) in addition to the old download exclusion.
1857
1858 - Got rid of a potential hang in the receiver when near the end of a
1859 phase.
1860
1861 - When using --backup without a --backup-dir, rsync no longer preserves
1862 the modify time on directories. This avoids confusing NFS.
1863
1864 - When --copy-links (-L) is specified, we now output a separate error
1865 for a symlink that has no referent instead of claiming that a file
1866 "vanished".
1867
1868 - The --copy-links (-L) option no longer has the side-effect of telling
1869 the receiving side to follow symlinks. See the --keep-dirlinks
1870 option (mentioned below) for a way to specify that behavior.
1871
1872 - Error messages from the daemon server's option-parsing (such as
1873 refused options) are now successfully transferred back to the client
1874 (the server used to fail to send the message because the socket
1875 wasn't in the right state for the message to get through).
1876
1877 - Most transfer errors that occur during a daemon transfer are now
1878 returned to the user in addition to being logged (some messages are
1879 intended to be daemon-only and are not affected by this).
1880
1881 - Fixed a bug in the daemon authentication code when using one of the
1882 batch-processing options.
1883
1884 - We try to work around some buggy IPv6 implementations that fail to
1885 implement IPV6_V6ONLY. This should fix the "address in use" error
1886 that some daemons get when running on an OS with a buggy IPv6
1887 implementation. Also, if the new code gets this error, we might
1888 suggest that the user specify --ipv4 or --ipv6 (if we think it will
1889 help).
1890
1891 - When the remote rsync dies, make a better effort to recover any error
1892 messages it may have sent before dying (the local rsync used to just
1893 die with a socket-write error).
1894
1895 - When using --delete and a --backup-dir that contains files that are
1896 hard-linked to their destination equivalents, rsync now makes sure
1897 that removed files really get removed (avoids a really weird rename()
1898 behavior).
1899
1900 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
1901 the int64 type is defined as an off_t and it actually has 64-bits.
1902
1903 - Added a configure check for open64() without mkstemp64() so that we
1904 can avoid using mkstemp() when such a combination is encountered.
1905 This bypasses a problem writing out large temp files on OSes such as
1906 AIX and HP-UX.
1907
1908 - Fixed an age-old crash problem with --read-batch on a local copy
1909 (rsync was improperly assuming --whole-file for the local copy).
1910
1911 - When --dry-run (-n) is used and the destination directory does not
1912 exist, rsync now produces a correct report of files that would be
1913 sent instead of dying with a chdir() error.
1914
1915 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
1916 with an error instead of waiting for the connection to finish.
1917
1918 - Fixed an ssh interaction that could cause output to be lost when the
1919 user chose to combine the output of rsync's stdout and stderr (e.g.
1920 using the "2>&1").
1921
920240a6
WD
1922 - Fixed an option-parsing bug when --files-from got passed to a daemon.
1923
ca39ebf9
WD
1924 ENHANCEMENTS:
1925
1926 - Added the --partial-dir=DIR option that lets you specify where to
1927 (temporarily) put a partially transferred file (instead of over-
1928 writing the destination file). E.g. --partial-dir=.rsync-partial
1929 Also added support for the RSYNC_PARTIAL_DIR environment variable
1930 that, when found, transforms a regular --partial option (such as
1931 the convenient -P option) into one that also specifies a directory.
1932
1933 - Added --keep-dirlinks (-K), which allows you to symlink a directory
1934 onto another partition on the receiving side and have rsync treat it
1935 as matching a normal directory from the sender.
1936
1937 - Added the --inplace option that tells rsync to write each destination
1938 file without using a temporary file. The matching of existing data
1939 in the destination file can be severely limited by this, but there
1940 are also cases where this is more efficient (such as appending data).
1941 Use only when needed (see the man page for more details).
1942
1943 - Added the "write only" option for the daemon's config file.
1944
1945 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
1946 and documented all these options in the man page.
1947
1948 - Improved the handling of the --bwlimit option so that it's less
1949 bursty, more accurate, and works properly over a larger range of
1950 values.
1951
1952 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
1953 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
1954
1955 - Added the --checksum-seed=N option for advanced users.
1956
1957 - Batch writing/reading has a brand-new implementation that is simpler,
1958 fixes a few weird problems with the old code (such as no longer
1959 sprinkling the batch files into different dirs or even onto different
1960 systems), and is much less intrusive into the code (making it easier
1961 to maintain for the future). The new code generates just one data
1962 file instead of three, which makes it possible to read the batch on
1963 stdin via a remote shell. Also, the old requirement of forcing the
1964 same fixed checksum-seed for all batch processing has been removed.
1965
1966 - If an rsync daemon has a module set with "list = no" (which hides its
1967 presence in the list of available modules), a user that fails to
1968 authenticate gets the same "unknown module" error that they would get
1969 if the module were actually unknown (while still logging the real
1970 error to the daemon's log file). This prevents fishing for module
1971 names.
1972
1973 - The daemon's "refuse options" config item now allows you to match
1974 option names using wildcards and/or the single-letter option names.
1975
1976 - Each transferred file now gets its permissions and modified-time
1977 updated before the temp-file gets moved into place. Previously, the
1978 finished file would have a very brief window where its permissions
1979 disallowed all group and world access.
1980
1981 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
1982 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
1983
1984 - The daemon's wildcard expanding code can now handle more than 1000
1985 filenames (it's now limited by memory instead of having a hard-wired
1986 limit).
1987
1988 INTERNAL:
1989
1990 - Some cleanup in the exclude code has saved some per-exclude memory
1991 and made the code easier to maintain.
1992
1993 - Improved the argv-overflow checking for a remote command that has a
1994 lot of args.
1995
1996 - Use rsyserr() in the various places that were still calling rprintf()
1997 with strerror() as an arg.
1998
1999 - If an rsync daemon is listening on multiple sockets (to handle both
2000 IPv4 and IPv6 to a single port), we now close all the unneeded file
2001 handles after we accept a connection (we used to close just one of
2002 them).
2003
2004 - Optimized the handling of larger block sizes (rsync used to slow to a
2005 crawl if the block size got too large).
2006
2007 - Optimized away a loop in hash_search().
2008
2009 - Some improvements to the sanitize_path() and clean_fname() functions
2010 makes them more efficient and produce better results (while still
2011 being compatible with the file-name cleaning that gets done on both
2012 sides when sending the file-list).
2013
2014 - Got rid of alloc_sanitize_path() after adding a destination-buffer
2015 arg to sanitize_path() made it possible to put all the former's
2016 functionality into the latter.
2017
2018 - The file-list that is output when at least 4 verbose options are
2019 specified reports the uid value on the sender even when rsync is
2020 not running as root (since we might be sending to a root receiver).
2021
2022 BUILD CHANGES:
2023
2024 - Added a "gen" target to rebuild most of the generated files,
2025 including configure, config.h.in, the man pages, and proto.h.
2026
2027 - If "make proto" doesn't find some changes in the prototypes, the
2028 proto.h file is left untouched (its time-stamp used to always be
2029 updated).
2030
2031 - The variable $STRIP (that is optionally set by the install-strip
2032 target's rule) was changed to $INSTALL_STRIP because some systems
2033 have $STRIP already set in the environment.
2034
2035 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
2036
2037 - When cross-compiling, the gettimeofday() function is now assumed to
2038 be a modern version that takes two-args (since we can't test it).
2039
2040 DEVELOPER RELATED:
2041
2042 - The scripts in the testsuite dir were cleaned up a bit and a few
2043 new tests added.
2044
2045 - Some new diffs were added to the patches dir, and some accepted
2046 ones were removed.
2047
2048\f
c7be6dec
WD
2049NEWS for rsync 2.6.2 (30 Apr 2004)
2050Protocol: 28 (unchanged)
2051Changes since 2.6.1:
2052
2053 BUG FIXES:
2054
2055 - Fixed a major bug in the sorting of the filenames when --relative
2056 is used for some sources (just sources such as "/" and "/*" were
2057 affected). This fix ensures that we ask for the right file-list
2058 item when requesting changes from the sender.
2059
2060 - Rsync now checks the return value of the close() function to
2061 better report disk-full problems on an NFS file system.
2062
2063 - Restored the old daemon-server behavior of logging error messages
2064 rather than returning them to the user. (A better long-term fix
2065 will be sought in the future.)
2066
2067 - An obscure uninitialized-variable bug was fixed in the uid/gid
2068 code. (This bug probably had no ill effects.)
2069
2070 BUILD CHANGES:
2071
2072 - Got rid of the configure check for sys/sysctl.h (it wasn't used
2073 and was causing a problem on some systems). Also improved the
2074 broken-largefile-locking test to try to avoid failure due to an
2075 NFS build-dir.
2076
2077 - Fixed a compile problem on systems that don't define
2078 AI_NUMERICHOST.
2079
2080 - Fixed a compile problem in the popt source for compilers that
2081 don't support __attribute__.
2082
2083 DEVELOPER RELATED:
2084
2085 - Improved the testsuite's "merge" test to work on OSF1.
2086
2087 - Two new diffs were added to the patches dir.
2088
2089\f
2090NEWS for rsync 2.6.1 (26 Apr 2004)
2091Protocol: 28 (changed)
2092Changes since 2.6.0:
2093
2094 SECURITY FIXES:
2095
2096 - Paths sent to an rsync daemon are more thoroughly sanitized when
2097 chroot is not used. If you're running a non-read-only rsync
2098 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
2099 user privs you run rsync under is anything above "nobody".
2100
2101 ENHANCEMENTS:
2102
2103 - Lower memory use, more optimal transfer of data over the socket,
2104 and lower CPU usage (see the INTERNAL section for details).
2105
2106 - The RSYNC_PROXY environment variable can now contain a
2107 "USER:PASS@" prefix before the "HOST:PORT" information.
2108 (Bardur Arantsson)
2109
2110 - The --progress output now mentions how far along in the transfer
2111 we are, including both a count of files transferred and a
2112 percentage of the total file-count that we've processed. It also
2113 shows better current-rate-of-transfer and remaining-transfer-time
2114 values.
2115
2116 - Documentation changes now attempt to describe some often mis-
2117 understood features more clearly.
2118
2119 BUG FIXES:
2120
2121 - When -x (--one-file-system) is combined with -L (--copy-links) or
2122 --copy-unsafe-links, no symlinked files are skipped, even if the
2123 referent file is on a different filesystem.
2124
2125 - The --link-dest code now works properly for a non-root user when
2126 (1) the UIDs of the source and destination differ and -o was
2127 specified, or (2) when the group of the source can't be used on
2128 the destination and -g was specified.
2129
2130 - Fixed a bug in the handling of -H (hard-links) that might cause
2131 the expanded PATH/NAME value of the current item to get
2132 overwritten (due to an expanded-name caching bug).
2133
2134 - We now reset the "new data has been sent" flag at the start of
2135 each file we send. This makes sure that an interrupted transfer
2136 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 2137 than the current basis file when no new data has been transferred
c7be6dec
WD
2138 over the wire for that file.
2139
2140 - Fixed a byte-order problem in --batch-mode on big-endian machines.
2141 (Jay Fenlason)
2142
2143 - When using --cvs-exclude, the exclude items we get from a
2144 per-directory's .cvsignore file once again only affect that one
2145 directory (not all following directories too). The items are also
2146 now properly word-split and parsed without any +/- prefix parsing.
2147
2148 - When specifying the USER@HOST: prefix for a file, the USER part
2149 can now contain an '@', if needed (i.e. the last '@' is used to
2150 find the HOST, not the first).
2151
2152 - Fixed some bugs in the handling of group IDs for non-root users:
2153 (1) It properly handles a group that the sender didn't have a name
2154 for (it would previously skip changing the group on any files in
2155 that group). (2) If --numeric-ids is used, rsync no longer
2156 attempts to set groups that the user doesn't have the permission
2157 to set.
2158
2159 - Fixed the "refuse options" setting in the rsyncd.conf file.
2160
2161 - Improved the -x (--one-file-system) flag's handling of any mount-
2162 point directories we encounter. It is both more optimal (in that
2163 it no longer does a useless scan of the contents of the mount-
2164 point dirs) and also fixes a bug where a remapped mount of the
2165 original filesystem could get discovered in a subdir we should be
2166 ignoring.
2167
2168 - Rsync no longer discards a double-slash at the start of a filename
2169 when trying to open the file. It also no longer constructs names
2170 that start with a double slash (unless the user supplied them).
2171
2172 - Path-specifying options to a daemon should now work the same with
2173 or without chroot turned on. Previously, such a option (such as
2174 --link-dest) would get its absolute path munged into a relative
2175 one if chroot was not on, making that setting fairly useless.
2176 Rsync now transforms the path into one that is based on the
2177 module's base dir when chroot is not enabled.
2178
2179 - Fixed a compatibility problem interacting with older rsync
2180 versions that might send us an empty --suffix value without
2181 telling us that --backup-dir was specified.
2182
2183 - The "hosts allow" option for a daemon-over-remote-shell process
2184 now has improved support for IPv6 addresses and a fix for systems
2185 that have a length field in their socket structs.
2186
2187 - Fixed the ability to request an empty backup --suffix when sending
2188 files to an rsync daemon.
2189
920240a6
WD
2190 - Fixed an option-parsing bug when --files-from was sent to a server
2191 sender.
2192
c7be6dec
WD
2193 INTERNAL:
2194
2195 - Most of the I/O is now buffered, which results in a pretty large
2196 speedup when running under MS Windows. (Craig Barratt)
2197
2198 - Optimizations to the name-handling/comparing code have made some
2199 significant reductions in user-CPU time for large file sets.
2200
2201 - Some cleanup of the variable types make the code more consistent.
2202
2203 - Reduced memory requirements of hard link preservation.
2204 (J.W. Schultz)
2205
2206 - Implemented a new algorithm for hard-link handling that speeds up
2207 the code significantly. (J.W. Schultz and Wayne Davison)
2208
2209 - The --hard-link option now uses the first existing file in the
2210 group of linked files as the basis for the transfer. This
2211 prevents the sub-optimal transfer of a file's data when a new
2212 hardlink is added on the sending side and it sorts alphabetically
2213 earlier in the list than the files that are already present on the
2214 receiving side.
2215
2216 - Dropped support for protocol versions less than 20 (2.3.0 released
2217 15 Mar 1999) and activated warnings for protocols less than 25
2218 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
2219 severally)
2220
2221 - More optimal data transmission for --hard-links (protocol 28).
2222
2223 - More optimal data transmission for --checksum (protocol 28).
2224
2225 - Less memory is used when --checksum is specified.
2226
2227 - Less memory is used in the file list (a per-file savings).
2228
2229 - The generator is now better about not modifying the file list
2230 during the transfer in order to avoid a copy-on-write memory
2231 bifurcation (on systems where fork() uses shared memory).
2232 Previously, rsync's shared memory would slowly become unshared,
2233 resulting in real memory usage nearly doubling on the receiving
2234 side by the end of the transfer. Now, as long as permissions
2235 are being preserved, the shared memory should remain that way
2236 for the entire transfer.
2237
2238 - Changed hardlink info and file_struct + strings to use allocation
2239 pools. This reduces memory use for large file-sets and permits
2240 freeing memory to the OS. (J.W. Schultz)
2241
2242 - The 2 pipes used between the receiver and generator processes
2243 (which are forked on the same machine) were reduced to 1 pipe and
2244 the protocol improved so that (1) it is now impossible to have the
2245 "redo" pipe fill up and hang rsync, and (2) trailing messages from
2246 the receiver don't get lost on their way through the generator
2247 over to the sender (which mainly affected hard-link messages and
2248 verbose --stats output).
2249
2250 - Improved the internal uid/gid code to be more portable and a
2251 little more optimized.
2252
2253 - The device numbers sent when using --devices are now sent as
2254 separate major/minor values with 32-bit accuracy (protocol 28).
2255 Previously, the copied devices were sent as a single 32-bit
2256 number. This will make inter-operation of 64-bit binaries more
2257 compatible with their 32-bit brethren (with both ends of the
2258 connection are using protocol 28). Note that optimizations in the
2259 binary protocol for sending the device numbers often results in
2260 fewer bytes being used than before, even though more precision is
2261 now available.
2262
2263 - Some cleanup of the exclude/include structures and its code made
2264 things clearer (internally), simpler, and more efficient.
2265
2266 - The reading & writing of the file-list in batch-mode is now
2267 handled by the same code that sends & receives the list over the
2268 wire. This makes it much easier to maintain. (Note that the
2269 batch code is still considered to be experimental.)
2270
2271 BUILD CHANGES:
2272
2273 - The configure script now accepts --with-rsyncd-conf=PATH to
2274 override the default value of the /etc/rsyncd.conf file.
2275
2276 - Fixed configure bug when running "./configure --disable-ipv6".
2277
2278 - Fixed compilation problem on Tru64 Unix (having to do with
2279 sockaddr.sa_len and sockaddr.sin_len).
2280
2281 DEVELOPER RELATED:
2282
2283 - Fixed "make test" bug when build dir is not the source dir.
2284
2285 - Added a couple extra diffs in the "patches" dir, removed the ones
2286 that got applied, and rebuilt the rest.
2287
2288\f
0f1aa0d3
WD
2289NEWS for rsync 2.6.0 (1 Jan 2004)
2290Protocol: 27 (changed)
2291Changes since 2.5.7:
2292
2293 ENHANCEMENTS:
2294
2295 * "ssh" is now the default remote shell for rsync. If you want to
2296 change this, configure like this: "./configure --with-rsh=rsh".
2297
2298 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
2299 Note that --from0 affects the line-ending character for all the
2300 files read by the --*-from options. (Wayne Davison)
2301
2302 * Length of csum2 is now per-file starting with protocol version
2303 27. (J.W. Schultz)
2304
2305 * Per-file dynamic block size is now sqrt(file length). The
2306 per-file checksum size is determined according to an algorithm
2307 provided by Donovan Baarda which reduces the probability of rsync
2308 algorithm corrupting data and falling back using the whole md4
2309 checksums. (J.W. Schultz, Donovan Baarda)
2310
2311 * The --stats option no longer includes the (debug) malloc summary
2312 unless the verbose option was specified at least twice.
2313
2314 * Added a new error/warning code for when files vanish from the
2315 sending side. Made vanished source files not interfere with the
2316 file-deletion pass when --delete-after was specified.
2317
2318 * Various trailing-info sections are now preceded by a newline.
2319
2320 BUG FIXES:
2321
2322 * Fixed several exclude/include matching bugs when using wild-cards.
2323 This has a several user-visible effects, all of which make the
2324 matching more consistent and intuitive. This should hopefully not
2325 cause anyone problems since it makes the matching work more like
2326 what people are expecting. (Wayne Davison)
2327
2328 - A pattern with a "**" no longer causes a "*" to match slashes.
2329 For example, with "/*/foo/**", "foo" must be 2 levels deep.
2330 [If your string has BOTH "*" and "**" wildcards, changing the
2331 "*" wildcards to "**" will provide the old behavior in all
2332 versions.]
2333
2334 - "**/foo" now matches at the base of the transfer (like /foo
2335 does). [Use "/**/foo" to get the old behavior in all versions.]
2336
2337 - A non-anchored wildcard term floats to match beyond the base of
2338 the transfer. E.g. "CVS/R*" matches at the end of the path,
2339 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
2340 to get the old behavior in all versions.]
2341
2342 - Including a "**" in the match term causes it to be matched
2343 against the entire path, not just the name portion, even if
2344 there aren't any interior slashes in the term. E.g. "foo**bar"
2345 would exclude "/path/foo-bar" (just like before) as well as
2346 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
2347 old behavior in all versions.]
2348
2349 * The exclude list specified in the daemon's config file is now
2350 properly applied to the pulled items no matter how deep the
2351 user's file-args are in the source tree. (Wayne Davison)
2352
2353 * For protocol version >= 27, mdfour_tail() is called when the
2354 block size (including checksum_seed) is a multiple of 64.
2355 Previously it was not called, giving the wrong MD4 checksum.
2356 (Craig Barratt)
2357
2358 * For protocol version >= 27, a 64 bit bit counter is used in
2359 mdfour.c as required by the RFC. Previously only a 32 bit bit
2360 counter was used, causing incorrect MD4 file checksums for
2361 file sizes >= 512MB - 4. (Craig Barratt)
2362
2363 * Fixed a crash bug when interacting with older rsync versions and
2364 multiple files of the same name are destined for the same dir.
2365 (Wayne Davison)
2366
2367 * Keep tmp names from overflowing MAXPATHLEN.
2368
2369 * Make --link-dest honor the absence of -p, -o, and -g.
2370
2371 * Made rsync treat a trailing slash in the destination in a more
2372 consistent manner.
2373
2374 * Fixed file I/O error detection. (John Van Essen)
2375
2376 * Fixed bogus "malformed address {hostname}" message in rsyncd log
2377 when checking IP address against hostnames from "hosts allow"
2378 and "hosts deny" parameters in config file.
2379
2380 * Print heap statistics when verbose >= 2 instead of when >= 1.
2381
2382 * Fixed a compression (-z) bug when syncing a mostly-matching file
2383 that contains already-compressed data. (Yasuoka Masahiko and
2384 Wayne Davison)
2385
2386 * Fixed a bug in the --backup code that could cause deleted files
2387 to not get backed up.
2388
2389 * When the backup code makes new directories, create them with mode
2390 0700 instead of 0755 (since the directory permissions in the
2391 backup tree are not yet copied from the main tree).
2392
2393 * Call setgroups() in a more portable manner.
2394
2395 * Improved file-related error messages to better indicate exactly
2396 what pathname failed. (Wayne Davison)
2397
2398 * Fixed some bugs in the handling of --delete and --exclude when
2399 using the --relative (-R) option. (Wayne Davison)
2400
2401 * Fixed bug that prevented regular files from replacing
2402 special files and caused a directory in --link-dest or
2403 --compare-dest to block the creation of a file with the
2404 same path. A directory still cannot be replaced by a
2405 regular file unless --delete specified. (J.W. Schultz)
2406
2407 * Detect and report when open or opendir succeed but read and
2408 readdir fail caused by network filesystem issues and truncated
2409 files. (David Norwood, Michael Brown, J.W. Schultz)
2410
2411 * Added a fix that should give ssh time to restore the tty settings
2412 if the user presses Ctrl-C at an ssh password prompt.
2413
2414 INTERNAL:
2415
2416 * Eliminated vestigial support for old versions that we stopped
2417 supporting. (J.W. Schultz)
2418
2419 * Simplified some of the option-parsing code. (Wayne Davison)
2420
2421 * Some cleanup made to the exclude code, as well as some new
2422 defines added to enhance readability. (Wayne Davison)
2423
2424 * Changed the protocol-version code so that it can interact at a
2425 lower protocol level than the maximum supported by both sides.
2426 Added an undocumented option, --protocol=N, to force the value
2427 we advertise to the other side (primarily for testing purposes).
2428 (Wayne Davison)
2429
2430\f
276877cf
WD
2431NEWS for rsync 2.5.7 (4 Dec 2003)
2432Protocol: 26 (unchanged)
2433Changes since 2.5.6:
2434
2435 SECURITY FIXES:
2436
2437 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
2438 Russell, Andrea Barisani)
2439
2440\f
2441NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
2442Protocol: 26 (unchanged)
2443Changes since 2.5.5:
2444
2445 ENHANCEMENTS:
2446
2447 * The --delete-after option now implies --delete. (Wayne Davison)
2448
2449 * The --suffix option can now be used with --backup-dir. (Michael
2450 Zimmerman)
2451
a923437b 2452 * Combining "::" syntax with the --rsh/-e option now uses the
276877cf
WD
2453 specified remote-shell as a transport to talk to a (newly-spawned)
2454 server-daemon. This allows someone to use daemon features, such
2455 as modules, over a secure protocol, such as ssh. (JD Paul)
2456
2457 * The rsync:// syntax for daemon connections is now accepted in the
2458 destination field.
2459
2460 * If the file name given to --include-from or --exclude-from is "-",
2461 rsync will read from standard input. (J.W. Schultz)
2462
2463 * New option --link-dest which is like --compare-dest except that
2464 unchanged files are hard-linked in to the destination directory.
2465 (J.W. Schultz)
2466
2467 * Don't report an error if an excluded file disappears during an
2468 rsync run. (Eugene Chupriyanov and Bo Kersey)
2469
2470 * Added .svn to --cvs-exclude list to support subversion. (Jon
2471 Middleton)
2472
2473 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
2474 and "hosts deny" fields. (Hideaki Yoshifuji)
2475
2476 * Changed exclude file handling to permit DOS or MAC style line
2477 terminations. (J.W. Schultz)
2478
2479 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
2480 (Dave Dykstra)
2481
2482 BUG FIXES:
2483
2484 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
2485 L. Allen, Martin Pool)
2486
2487 * Generate each file's rolling-checksum data as we send it, not
2488 in a separate (memory-eating) pass before hand. This prevents
2489 timeout errors on really large files. (Stefan Nehlsen)
2490
2491 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
2492
2493 * Better handling of some client-server errors. (Martin Pool)
2494
2495 * Fixed a crash that would occur when sending a list of files that
2496 contains a duplicate name (if it sorts to the end of the file
2497 list) and using --delete. (Wayne Davison)
2498
2499 * Fixed the file-name duplicate-removal code when dealing with multiple
2500 dups in a row. (Wayne Davison)
2501
2502 * Fixed a bug that caused rsync to lose the exit status of its child
2503 processes and sometimes return an exit code of 0 instead of showing
2504 an error. (David R. Staples, Dave Dykstra)
2505
2506 * Fixed bug in --copy-unsafe-links that caused it to be completely
2507 broken. (Dave Dykstra)
2508
2509 * Prevent infinite recursion in cleanup code under certain circumstances.
2510 (Sviatoslav Sviridov and Marc Espie)
2511
2512 * Fixed a bug that prevented rsync from creating intervening directories
2513 when --relative-paths/-R is set. (Craig Barratt)
2514
2515 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
2516
2517 INTERNAL:
2518
2519 * Many code cleanups and improved internal documentation. (Martin
2520 Pool, Nelson Beebe)
2521
2522 * Portability fixes. (Dave Dykstra and Wayne Davison)
2523
2524 * More test cases. (Martin Pool)
2525
2526 * Some test-case fixes. (Brian Poole, Wayne Davison)
2527
2528 * Updated included popt to the latest vendor drop, version 1.6.4.
2529 (Jos Backus)
2530
2531 * Updated config.guess and config.sub to latest versions; this
2532 means rsync should build on more platforms. (Paul Green)
2533
2534\f
2535NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
2536Protocol: 26 (unchanged)
2537Changes since 2.5.4:
54c7298c
MP
2538
2539 ENHANCEMENTS:
2540
2541 * With --progress, when a transfer is complete show the time taken;
2542 otherwise show expected time to complete. (Cameron Simpson)
2543
2544 * Make "make install-strip" works properly, and "make install"
2545 accepts a DESTDIR variable for help in building binary packages.
2546 (Peter Breitenlohner, Greg Louis)
2547
2548 * If configured with --enable-maintainer-mode, then on receipt of
2549 a fatal signal rsync will try to open an xterm running gdb,
2550 similarly to Samba's "panic action" or GNOME's bug-buddy.
2551 (Martin Pool)
2552
2553
2554 BUG FIXES:
2555
2556 * Fix situation where failure to fork (e.g. because out of process
2557 slots) would cause rsync to kill all processes owned by the
2558 current user. Yes, really! (Paul Haas, Martin Pool)
2559
2560 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
2561
2562 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
2563 Pool.)
2564
2565 * Fix --whole-file problem that caused it to be the default even
2566 for remote connections. (Martin Pool, Frank Schulz)
2567
2568 * Work around bug in Mac OS X mkdir(2), which cannot handle
2569 trailing slashes.
2570 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
2571 (Martin Pool)
2572
2573 * Improved network error handling. (Greg A. Woods)
2574
2575\f
276877cf
WD
2576NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
2577Protocol: 26 (unchanged)
2578Changes since 2.5.3:
c9a66d41
MP
2579
2580 BUG FIXES:
2581
2582 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
2583 Tridgell) (CVE CAN-2002-0059)
276877cf 2584
c9a66d41
MP
2585 ENHANCEMENTS:
2586
2587 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
2588 (Note that rsync still uses a custom version of zlib; you can
2589 not just link against a system library. See zlib/README.rsync)
2590
2591 * Additional test cases for --compress. (Martin Pool)
2592
2593\f
276877cf
WD
2594NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
2595Protocol: 26 (unchanged)
2596Changes since 2.5.2:
d40fb723
MP
2597
2598 SECURITY FIXES:
2599
2600 * Make sure that supplementary groups are removed from a server
2601 process after changing uid and gid. (Ethan Benson) (Debian bug
2602 #132272, CVE CAN-2002-0080)
2603
2604 BUG FIXES:
2605
2606 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
2607 CAN-2002-0059)
2608
276877cf 2609 * Fixed problem that in many cases caused the error message
d40fb723
MP
2610 unexpected read size of 0 in map_ptr
2611 and resulted in the wrong data being copied.
2612
2613 * Fixed compilation errors on some systems caused by the use of
2614 "unsigned int64" in rsync.h.
2615
2616 * Fixed problem on systems such as Sunos4 that do not support realloc
2617 on a NULL pointer; error was "out of memory in flist_expand".
2618
2619 * Fix for rsync server processes hanging around after the client
2620 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
2621
2622 * Cope with BSD systems on which mkdir() will not accept a trailing
2623 slash.
2624
2625 ENHANCEMENTS:
2626
2627 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
2628 rsync still uses a custom version of zlib; you can not just link
2629 against a system library. See zlib/README.rsync)
276877cf 2630
d40fb723
MP
2631 * Command to initiate connections is only shown with -vv, rather
2632 than -v as in 2.5.2. Output from plain -v is more similar to
2633 what was historically used so as not to break scripts that try
2634 to parse the output.
2635
2636 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
2637
2638 * Made the --write-batch and --read-batch options actually work
2639 and added documentation in the man page (Jos Backus)
2640
2641 * If the daemon is unable to fork a child to accept a connection,
2642 print an error message. (Colin Walters)
2643
276877cf
WD
2644\f
2645NEWS for rsync 2.5.2 (26 Jan 2002)
2646Protocol: 26 (changed)
2647Changes since 2.5.1:
97efa5c3
MP
2648
2649 SECURITY FIXES:
2650
2651 * Signedness security patch from Sebastian Krahmer
2652 <krahmer@suse.de> -- in some cases we were not sufficiently
2653 careful about reading integers from the network.
2654
2655 BUG FIXES:
2656
2657 * Fix possible string mangling in log files.
2658
2659 * Fix for setting local address of outgoing sockets.
2660
2661 * Better handling of hardlinks and devices on platforms with
2662 64-bit dev_t or ino_t.
2663
2664 * Name resolution on machines supporting IPv6 is improved.
2665
2666 * Fix for device nodes. (dann frazier) (Debian #129135)
2667
2668 ENHANCEMENTS:
2669
2670 * With -v, rsync now shows the command used to initiate an ssh/rsh
2671 connection.
2672
2673 * --statistics now shows memory heap usage on platforms that
276877cf 2674 support mallinfo().
97efa5c3
MP
2675
2676 * "The Ted T'so school of program optimization": make progress
2677 visible and people will think it's faster. (With --progress,
2678 rsync will show you how many files it has seen as it builds the
2679 file_list, giving some indication that it has not hung.)
2680
2681 * Improvements to batch mode support. This is still experimental
2682 but testing would be welcome. (Jos Backus)
276877cf 2683
97efa5c3
MP
2684 * New --ignore-existing option, patch previously distributed with
2685 Vipul's Razor. (Debian #124286)
2686
276877cf
WD
2687\f
2688NEWS for rsync 2.5.1 (3 Jan 2002)
2689Protocol: 25 (unchanged)
2690Changes since 2.5.0:
2691
2692 BUG FIXES:
499957d9 2693
499957d9
MP
2694 * Fix for segfault in --daemon mode configuration parser. (Paul
2695 Mackerras)
2696
2697 * Correct string<->address parsing for both IPv4 and 6.
2698 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
2699 Hagino)
2700
2701 * Various fixes for IPv6 support. (Dave Dykstra)
2702
2703 * rsync.1 typo fix. (Matt Kraai)
2704
2705 * Test suite typo fixes. (Tom Schmidt)
2706
2707 * rsync.1 grammar and clarity improvements. (Edward
2708 Welbourne)
2709
2710 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
2711
2712 ENHANCEMENTS:
2713
2714 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
2715 multiple of bytes/s) and estimated time to completion. (Rik
2716 Faith)
2717
499957d9 2718 * --no-detach option, required to run as a W32 service and also
276877cf
WD
2719 useful when running on Unix under daemontools, AIX's SRC, or a
2720 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
2721
2722 * Clearer error messages for some conditions.
2723
c9a66d41 2724\f
276877cf
WD
2725NEWS for rsync 2.5.0 (30 Nov 2001)
2726Protocol: 25 (changed)
2727Changes since 2.4.6:
d313ae7d
MP
2728
2729 ANNOUNCEMENTS
2730
2731 * Martin Pool <mbp@samba.org> is now a co-maintainer.
2732
2733 NEW FEATURES
2734
2735 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
2736
2737 * Shell wildcards are allowed in "auth users" lines.
2738
2739 * Merged UNC rsync+ patch to support creation of standalone patch
2740 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
2741 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
2742
2743 * IPv6 support based on a patch from KAME.net, on systems
2744 including modern versions of Linux, Solaris, and HP-UX. Also
2745 includes IPv6 compatibility functions for old OSs by the
2746 Internet Software Consortium, Paul Vixie, the OpenSSH
2747 portability project, and OpenBSD.
2748
2749 ENHANCEMENTS
2750
2751 * Include/exclude cluestick: with -vv, print out whether files are
2752 included or excluded and why.
2753
2754 * Many error messages have more friendly explanations and more
2755 details.
2756
2757 * Manual page improvements plus scanty protocol documentation.
2758
2759 * When running as --daemon in the background and using a "log
2760 file" rsyncd.conf directive, close the log file every time it is
2761 open when going to sleep on the socket. This allows the log
2762 file to get cleaned out by another process.
2763
2764 * Change to using libpopt rather than getopt for processing
2765 options. This makes the code cleaner and the behaviour more
2766 consistent across platforms. popt is included and built if not
2767 installed on the platform.
2768
2769 * More details in --version, including note about whether 64-bit
2770 files, symlinks and hardlinks are supported.
2771
2772 * MD4 code may use less CPU cycles.
2773
2774 * Use mkstemp on systems where it is secure. If we use mktemp,
2775 explain that we do it in a secure way.
2776
2777 * --whole-file is the default when source and target are on the
2778 local machine.
2779
2780 BUG FIXES:
2781
2782 * Fix for various bugs causing rsync to hang.
2783
2784 * Attempt to fix Large File Summit support on AIX.
2785
2786 * Attempt to fix error handling lockup bug.
2787
2788 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 2789 to transfer fail to transfer.
d313ae7d
MP
2790
2791 * For log messages containing ridiculously long strings that might
2792 overflow a buffer rsync no longer aborts, but rather prints an
2793 ellipsis at the end of the string. (Patch from Ed Santiago.)
2794
2795 PLATFORMS:
2796
2797 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
2798
2799 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 2800 scripts. It is not required to simply build rsync.
d313ae7d
MP
2801
2802 * Platforms thought to work in this release:
2803
2804 Cray SV1 UNICOS 10.0.0.8 cc
2805 Debian Linux 2.2 UltraSparc gcc
2806 Debian Linux testing/unstable ARM gcc
2807 FreeBSD 3.3-RELEASE i386 cc
2808 FreeBSD 4.1.1-RELEASE i386 cc
2809 FreeBSD 4.3-STABLE i386 cc
2810 HP PA-RISC HP-UX 10.20 gcc
2811 HP PA-RISC HP-UX 11.11 cc
2812 IRIX 6.5 MIPS cc
2813 IRIX 6.5 MIPS gcc
2814 Mac OS X PPC (--disable-ipv6) cc
2815 NetBSD 1.5 i386 gcc
2816 NetBSD Current i386 cc
2817 OpenBSD 2.5 Sparc gcc
2818 OpenBSD 2.9 i386 cc
2819 OpenBSD Current i386 cc
2820 RedHat 6.2 i386 gcc
2821 RedHat 6.2 i386 insure++
2822 RedHat 7.0 i386 gcc
2823 RedHat 7.1 i386 (Kernel 2.4.10) gcc
2824 Slackware 8.0 i686 (Kernel 2.4.10)
2825 Solaris 8 UltraSparc cc
2826 Solaris 8 UltraSparc gcc
2827 Solaris 8 i386 gcc
2828 SuSE 7.1 i386 gcc2.95.2
2829 SuSE 7.1 ppc gcc2.95.2
2830 i386-pc-sco3.2v5.0.5 cc
2831 i386-pc-sco3.2v5.0.5 gcc
2832 powerpc-ibm-aix4.3.3.0 cc
2833 i686-unknown-sysv5UnixWare7.1.0 gcc
2834 i686-unknown-sysv5UnixWare7.1.0 cc
2835
2836 TESTING:
2837
2838 * The existing test.sh script by Phil Hands has been merged into a
2839 test framework that works from both "make check" and the Samba
2840 build farm.
3742bf3a
S
2841\f
2842Partial Protocol History
f7e48a5c 2843 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
8b3e6052 2844 ?? ??? 2008 3.1.0 31 Aug 2008 31
46b1361b 2845 06 Sep 2008 3.0.4 30
db8f3f73 2846 29 Jun 2008 3.0.3 30
8ba802f3 2847 08 Apr 2008 3.0.2 30
325c2432 2848 03 Apr 2008 3.0.1 30
4cb6197b 2849 01 Mar 2008 3.0.0 11 Nov 2006 30
0c6d7952 2850 06 Nov 2006 2.6.9 29
4177f09b 2851 22 Apr 2006 2.6.8 29
a058cbc4 2852 11 Mar 2006 2.6.7 29
cbc63b9b 2853 28 Jul 2005 2.6.6 29
2dfe1c37 2854 01 Jun 2005 2.6.5 29
f7e48a5c 2855 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 2856 30 Sep 2004 2.6.3 28
c7be6dec
WD
2857 30 Apr 2004 2.6.2 28
2858 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
2859 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
2860 04 Dec 2003 2.5.7 26
2861 26 Jan 2003 2.5.6 26
2862 02 Apr 2002 2.5.5 26
2863 13 Mar 2002 2.5.4 26
2864 11 Mar 2002 2.5.3 26
2865 26 Jan 2002 2.5.2 11 Jan 2002 26
2866 03 Jan 2002 2.5.1 25
2867 30 Nov 2001 2.5.0 23 Aug 2001 25
2868 06 Sep 2000 2.4.6 24
2869 19 Aug 2000 2.4.5 24
2870 29 Jul 2000 2.4.4 24
2871 09 Apr 2000 2.4.3 24
2872 30 Mar 2000 2.4.2 24
2873 30 Jan 2000 2.4.1 29 Jan 2000 24
2874 29 Jan 2000 2.4.0 28 Jan 2000 23
2875 25 Jan 2000 2.3.3 23 Jan 2000 22
2876 08 Nov 1999 2.3.2 26 Jun 1999 21
2877 06 Apr 1999 2.3.1 20
2878 15 Mar 1999 2.3.0 15 Mar 1999 20
2879 25 Nov 1998 2.2.1 19
2880 03 Nov 1998 2.2.0 19
2881 09 Sep 1998 2.1.1 19
2882 20 Jul 1998 2.1.0 19
2883 17 Jul 1998 2.0.19 19
2884 18 Jun 1998 2.0.17 19
2885 01 Jun 1998 2.0.16 19
2886 27 May 1998 2.0.13 27 May 1998 19
2887 26 May 1998 2.0.12 18
2888 22 May 1998 2.0.11 18
2889 18 May 1998 2.0.9 18 May 1998 18
2890 17 May 1998 2.0.8 17
2891 15 May 1998 2.0.1 17
2892 14 May 1998 2.0.0 17
2893 17 Apr 1998 1.7.4 17
2894 13 Apr 1998 1.7.3 17
2895 05 Apr 1998 1.7.2 17
2896 26 Mar 1998 1.7.1 17
2897 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
2898 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
2899
2900* DATE OF COMMIT is the date the protocol change was committed to CVS.