Make hard-linking work when a device has an st_dev of 0.
[rsync/rsync.git] / OLDNEWS
CommitLineData
93f3fbf7
WD
1NEWS for rsync 3.0.3 (29 Jun 2008)
2Protocol: 30 (unchanged)
3Changes since 3.0.2:
4
5 BUG FIXES:
6
7 - Fixed a wildcard matching problem in the daemon when a module has
8 "use chroot" enabled.
9
10 - Fixed a crash bug in the hard-link code.
11
12 - Fixed the sending of xattr directory information when the code finds a
13 --link-dest or --copy-dest directory with unchanged xattrs -- the
14 destination directory now gets these unchanged xattrs properly applied.
15
16 - Fixed an xattr-sending glitch that could cause an "Internal abbrev"
17 error.
18
19 - Fixed the combination of --xattrs and --backup.
20
21 - The generator no longer allows a '.' dir to be excluded by a daemon-
22 exclude rule.
23
24 - Fixed deletion handling when copying a single, empty directory (with no
25 files) to a differently named, non-existent directory.
26
27 - Fixed the conversion of spaces into dashes in the %M log escape.
28
29 - Fixed several places in the code that were not returning the right
30 errno when a function failed.
31
32 - Fixed the backing up of a device or special file into a backup dir.
33
34 - Moved the setting of the socket options prior to the connect().
35
36 - If rsync exits in the middle of a --progress output, it now outputs a
37 newline to help prevent the progress line from being overwritten.
38
39 - Fixed a problem with how a destination path with a trailing slash or
40 a trailing dot-dir was compared against the daemon excludes.
41
42 - Fixed the sending of large (size > 16GB) files when talking to an older
43 rsync (protocols < 30): we now use a compatible block size limit.
44
45 - If a file's length is so huge that we overflow a checksum buffer count
46 (i.e. several hundred TB), warn the user and avoid sending an invalid
47 checksum struct over the wire.
48
49 - If a source arg is excluded, --relative no longer adds the excluded
50 arg's implied dirs to the transfer. This fix also made the exclude
51 check happen in the better place in the sending code.
52
53 - Use the overflow_exit() function for overflows, not out_of_memory().
54
55 - Improved the code to better handle a system that has only 32-bit file
56 offsets.
57
58 ENHANCEMENTS:
59
60 - The rsyncd.conf manpage now consistently refers to the parameters in
61 the daemon config file as "parameters".
62
63 - The description of the --inplace option was improved.
64
65 EXTRAS:
66
67 - Added a new script in the support directory, deny-rsync, which allows
68 an admin to (temporarily) replace the rsync command with a script that
69 sends an error message to the remote client via the rsync protocol.
70
71 DEVELOPER RELATED:
72
73 - Fixed a testcase failure if the tests are run as root and made some
74 compatibility improvements.
75
76 - Improved the daemon tests, including checking module comments, the
77 listing of files, and the ensuring that daemon excludes can't affect
78 a dot-dir arg.
79
80 - Improved some build rules for those that build in a separate directory
81 from the source, including better install rules for the man pages, and
82 the fixing of a proto.h-tstamp rule that could make the binaries get
83 rebuild without cause.
84
85 - Improved the testsuite to work around a problem with some utilities
86 (e.g. cp -p & touch -r) rounding sub-second timestamps.
87
88 - Ensure that the early patches don't cause any generated-file hunks to
89 bleed-over into patches that follow.
90
91\f
da9aefa6
WD
92NEWS for rsync 3.0.2 (8 Apr 2008)
93Protocol: 30 (unchanged)
94Changes since 3.0.1:
95
96 BUG FIXES:
97
98 - Fixed a potential buffer overflow in the xattr code.
99
100 ENHANCEMENTS:
101
102 - None.
103
104 DEVELOPER RELATED:
105
106 - The RPM spec file was improved to install more useful files.
107
108 - A few developer-oriented scripts were moved from the support dir
109 to the packaging dir.
110
111\f
0917f581
WD
112NEWS for rsync 3.0.1 (3 Apr 2008)
113Protocol: 30 (unchanged)
114Changes since 3.0.0:
115
116 NOTABLE CHANGES IN BEHAVIOR:
117
118 - Added the 'c'-flag to the itemizing of non-regular files so that the
119 itemized output doesn't get hidden if there were no attribute changes,
120 and also so that the itemizing of a --copy-links run will distinguish
121 between copying an identical non-regular file and the creation of a
122 revised version with a new value (e.g. a changed symlink referent, a
123 new device number, etc.).
124
125 BUG FIXES:
126
127 - Fixed a crash bug when a single-use rsync daemon (via remote shell) was
128 run without specifying a --config=FILE option.
129
130 - Fixed a crash when backing up a directory that has a default ACL.
131
132 - Fixed a bug in the handling of xattr values that could cause rsync to
133 not think that a file's extended attributes are up-to-date.
134
135 - Fixed the working of --fake-super with --link-dest and --xattrs.
136
137 - Fixed a hang when combining --dry-run with --remove-source-files.
138
139 - Fixed a bug with --iconv's handling of files that cannot be converted:
140 a failed name can no longer cause a transfer failure.
141
142 - Fixed the building of the rounding.h file on systems that need custom
143 CPPFLAGS to be used. Also improved the error reporting if the building
144 of rounding.h fails.
145
146 - Fixed the use of the --protect-args (-s) option when talking to a daemon.
147
148 - Fixed the --ignore-existing option's protection of files on the receiver
149 that are non-regular files on the sender (e.g. if a symlink or a dir on
150 the sender is trying to replace a file on the receiver). The reverse
151 protection (protecting a dir/symlink/device from being replaced by a
152 file) was already working.
153
154 - Fixed an assert failure if --hard-links is combined with an option that
155 can skip a file in a set of hard-linked files (i.e. --ignore-existing,
156 --append, etc.), without skipping all the files in the set.
157
158 - Avoid setting the modify time on a directory that already has the right
159 modify time set. This avoids tweaking the dir's ctime.
160
161 - Improved the daemon-exclude handling to do a better job of applying the
162 exclude rules to path entries. It also sends the user an error just as
163 if the files were actually missing (instead of silently ignoring the
164 user's args), and avoids sending the user the filter-action messages
165 for these non-user-initiated rules.
166
167 - Fixed some glitches with the dry-run code's missing-directory
168 handling, including a problem when combined with --fuzzy.
169
170 - Fixed some glitches with the skipped-directory handling.
171
172 - Fixed the 'T'-flag itemizing of symlinks when --time isn't preserved.
173
174 - Fixed a glitch in the itemizing of permissions with the -E option.
175
176 - The --append option's restricting of transfers to those that add data no
177 longer prevents the updating of non-content changes to otherwise up-to-
178 date files (i.e. those with the same content but differing permissions,
179 ownership, xattrs, etc.).
180
181 - Don't allow --fake-super to be specified with -XX (double --xattrs)
182 because the options conflict. If a daemon has "fake super" enabled,
183 it automatically downgrades a -XX request to -X.
184
185 - Fixed a couple bugs in the parsing of daemon-config excludes that could
186 make a floating exclude rule get treated as matching an absolute path.
187
188 - A daemon doesn't try to auto-refuse the "iconv" option if iconv-support
189 wasn't compiled in to the daemon (avoiding a warning in the logs).
190
191 - Fixed the inclusion of per-dir merge files from implied dirs.
192
193 - Fixed the support/rrsync script to work with the latest options that
194 rsync sends (including its flag-specifying use of -e to the server).
195
196 ENHANCEMENTS:
197
198 - Added the --old-dirs (--old-d) option to make it easier for a user to
199 ask for file-listings with older rsync versions (this is easier than
200 having to type "-r --exclude='/*/*'" manually).
201
202 - When getting an error while asking an older rsync daemon for a file
203 listing, rsync will try to notice if the error is a rejection of the
204 --dirs (-d) option and let the user know how to work around the issue.
205
206 - Added a few more --no-OPTION overrides.
207
208 - Improved the documentation of the --append option.
209
210 - Improved the documentation of the filter/exclude/include daemon
211 parameters.
212
213 INTERNAL:
214
215 - Fixed a couple minor bugs in the included popt library (ones which I
216 sent to the official popt project for inclusion in the 1.14 release).
217
218 - Fixed a stat() call that should have been do_stat() so that the proper
219 normal/64-bit stat() function gets called. (Was in an area that should
220 not have caused problems, though.)
221
222 - Changed the file-glob code to do a directory scan without using the
223 "glob" and "glob.h". This lets us do the globbing with less memory
224 churn, and also avoid adding daemon-excluded items to the returned
225 args.
226
227 DEVELOPER RELATED:
228
229 - The configure script tries to get the user's compiler to not warn about
230 unused function parameters if the build is not including one or more of
231 the ACL/xattrs/iconv features.
232
233 - The configure script now has better checks for figuring out if the
234 included popt code should be used or not.
235
236 - Fixed two testsuite glitches: avoid a failure if someone's "cd" command
237 outputs the current directory when cd-ing to a relative path, and made
238 the itemized test query how rsync was built to determine if it should
239 expect hard-linked symlinks or not.
240
241 - Updated the testsuite to verify that various bug fixes remain fixed.
242
243 - The RPM spec file was updated to have: (1) comments for how to use the
244 rsync-patch tar file, and (2) an /etc/xinetd.d/rsync file.
245
246 - Updated the build scripts to work with a revised FTP directory
247 structure.
248
249\f
3cbe640d
WD
250NEWS for rsync 3.0.0 (1 Mar 2008)
251Protocol: 30 (changed)
252Changes since 2.6.9:
253
254 NOTABLE CHANGES IN BEHAVIOR:
255
256 - The handling of implied directories when using --relative has changed to
257 send them as directories (e.g. no implied dir is ever sent as a symlink).
258 This avoids unexpected behavior and should not adversely affect most
259 people. If you're one of those rare individuals who relied upon having
260 an implied dir be duplicated as a symlink, you should specify the
261 transfer of the symlink and the transfer of the referent directory as
262 separate args. (See also --keep-dirlinks and --no-implied-dirs.)
263 Also, exclude rules no longer have a partial effect on implied dirs.
264
265 - Requesting a remote file-listing without specifying -r (--recursive) now
266 sends the -d (--dirs) option to the remote rsync rather than sending -r
267 along with an extra exclude of /*/*. If the remote rsync does not
268 understand the -d option (i.e. it is 2.6.3 or older), you will need to
269 either turn off -d (--no-d), or specify -r --exclude='/*/*' manually.
270
271 - In --dry-run mode, the last line of the verbose summary text is output
272 with a "(DRY RUN)" suffix to help remind you that no updates were made.
273 Similarly, --only-write-batch outputs "(BATCH ONLY)".
274
275 - A writable rsync daemon with "use chroot" disabled now defaults to a
276 symlink-munging behavior designed to make symlinks safer while also
277 allowing absolute symlinks to be stored and retrieved. This also has
278 the effect of making symlinks unusable while they're in the daemon's
279 hierarchy. See the daemon's "munge symlinks" parameter for details.
280
281 - Starting up an extra copy of an rsync daemon will not clobber the pidfile
282 for the running daemon -- if the pidfile exists, the new daemon will exit
283 with an error. This means that your wrapper script that starts the rsync
284 daemon should be made to handle lock-breaking (if you want any automatic
285 breaking of locks to be done).
286
287 BUG FIXES:
288
289 - A daemon with "use chroot = no" and excluded items listed in the daemon
290 config file now properly checks an absolute-path arg specified for these
291 options: --compare-dest, --link-dest, --copy-dest, --partial-dir,
292 --backup-dir, --temp-dir, and --files-from.
293
294 - A daemon can now be told to disable all user- and group-name translation
295 on a per-module basis. This avoids a potential problem with a writable
296 daemon module that has "use chroot" enabled -- if precautions weren't
297 taken, a user could try to add a missing library and get rsync to use
298 it. This makes rsync safer by default, and more configurable when id-
299 translation is not desired. See the daemon's "numeric ids" parameter
300 for full details.
301
302 - A chroot daemon can now indicate which part of its path should affect the
303 chroot call, and which part should become an inside-chroot path for the
304 module. This allows you to have outside-the-transfer paths (such as for
305 libraries) even when you enable chroot protection. The idiom used in the
306 rsyncd.conf file is: path = /chroot/dirs/./dirs/inside
307
308 - If a file's data arrived successfully on the receiving side but the
309 rename of the temporary file to the destination file failed AND the
310 --remove-source-files (or the deprecated --remove-sent-files) option
311 was specified, rsync no longer erroneously removes the associated
312 source file.
313
314 - Fixed the output of -ii when combined with one of the --*-dest options:
315 it now itemizes all the items, not just the changed ones.
316
317 - Made the output of all file types consistent when using a --*-dest
318 option. Prior versions would output too many creation events for
319 matching items.
320
321 - The code that waits for a child pid now handles being interrupted by a
322 signal. This fixes a problem with the pre-xfer exec function not being
323 able to get the exit status from the script.
324
325 - A negated filter rule (i.e. with a '!' modifier) no longer loses the
326 negation when sending the filter rules to the remote rsync.
327
328 - Fixed a problem with the --out-format (aka --log-format) option %f: it
329 no longer outputs superfluous directory info for a non-daemon rsync.
330
331 - Fixed a problem with -vv (double --verbose) and --stats when "pushing"
332 files (which includes local copies). Version 2.6.9 would complete the
333 copy, but exit with an error when the receiver output its memory stats.
334
335 - If --password-file is used on a non-daemon transfer, rsync now complains
336 and exits. This should help users figure out that they can't use this
337 option to control a remote shell's password prompt.
338
339 - Make sure that directory permissions of a newly-created destination
340 directory are handled right when --perms is left off.
341
342 - The itemized output of a newly-created destination directory is now
343 output as a creation event, not a change event.
344
345 - Improved --hard-link so that more corner cases are handled correctly
346 when combined with options such as --link-dest and/or --ignore-existing.
347
348 - The --append option no longer updates a file that has the same size.
349
350 - Fixed a bug when combining --backup and --backup-dir with --inplace:
351 any missing backup directories are now created.
352
353 - Fixed a bug when using --backup and --inplace with --whole-file or
354 --read-batch: backup files are actually created now.
355
356 - The daemon pidfile is checked and created sooner in the startup sequence.
357
358 - If a daemon module's "path" value is not an absolute pathname, the code
359 now makes it absolute internally (making it work properly).
360
361 - Ensure that a temporary file always has owner-write permission while we
362 are writing to it. This avoids problems with some network filesystems
363 when transfering read-only files.
364
365 - Any errors output about password-file reading no longer cause an error at
366 the end of the run about a partial transfer.
367
368 - The --read-batch option for protocol 30 now ensures that several more
369 options are set correctly for the current batch file: --iconv, --acls,
370 --xattrs, --inplace, --append, and --append-verify.
371
372 - Using --only-write-batch to a daemon receiver now works properly (older
373 versions would update some files while writing the batch).
374
375 - Avoid outputting a "file has vanished" message when the file is a broken
376 symlink and --copy-unsafe-links or --copy-dirlinks is used (the code
377 already handled this for --copy-links).
378
379 - Fixed the combination of --only-write-batch and --dry-run.
380
381 - Fixed rsync's ability to remove files that are not writable by the file's
382 owner when rsync is running as the same user.
383
384 ENHANCEMENTS:
385
386 - A new incremental-recursion algorithm is now used when rsync is talking
387 to another 3.x version. This starts the transfer going more quickly
388 (before all the files have been found), and requires much less memory.
389 See the --recursive option in the manpage for some restrictions.
390
391 - Lowered memory use in the non-incremental-recursion algorithm for typical
392 option values (usually saving from 21-29 bytes per file).
393
394 - The default --delete algorithm is now --delete-during when talking to a
395 3.x rsync. This is a faster scan than using --delete-before (which is
396 the default when talking to older rsync versions), and is compatible with
397 the new incremental recursion mode.
398
399 - Rsync now allows multiple remote-source args to be specified rather than
400 having to rely on a special space-splitting side-effect of the remote-
401 shell. Additional remote args must specify the same host or an empty one
402 (e.g. empty: :file1 or ::module/file2). For example, this means that
403 local use of brace expansion now works: rsync -av host:dir/{f1,f2} .
404
405 - Added the --protect-args (-s) option, that tells rsync to send most of
406 the command-line args at the start of the transfer rather than as args
407 to the remote-shell command. This protects them from space-splitting,
408 and only interprets basic wildcard special shell characters (*?[).
409
410 - Added the --delete-delay option, which is a more efficient way to delete
411 files at the end of the transfer without needing a separate delete pass.
412
413 - Added the --acls (-A) option to preserve Access Control Lists. This is
414 an improved version of the prior patch that was available, and it even
415 supports OS X ACLs. If you need to have backward compatibility with old,
416 ACL-patched versions of rsync, apply the acls.diff file from the patches
417 dir.
418
419 - Added the --xattrs (-X) option to preserve extended attributes. This is
420 an improved version of the prior patch that was available, and it even
421 supports OS X xattrs (which includes their resource fork data). If you
422 need to have backward compatibility with old, xattr-patched versions of
423 rsync, apply the xattrs.diff file from the patches dir.
424
425 - Added the --fake-super option that allows a non-super user to preserve
426 all attributes of a file by using a special extended-attribute idiom.
427 It even supports the storing of foreign ACL data on your backup server.
428 There is also an analogous "fake super" parameter for an rsync daemon.
429
430 - Added the --iconv option, which allows rsync to convert filenames from
431 one character-set to another during the transfer. The default is to
432 make this feature available as long as your system has iconv_open().
433 If compilation fails, specify --disable-iconv to configure, and then
434 rebuild. If you want rsync to perform character-set conversions by
435 default, you can specify --enable-iconv=CONVERT_STRING with the default
436 value for the --iconv option that you wish to use. For example,
437 "--enable-iconv=." is a good choice. See the rsync manpage for an
438 explanation of the --iconv option's settings.
439
440 - A new daemon config parameter, "charset", lets you control the character-
441 set that is used during an --iconv transfer to/from a daemon module. You
442 can also set your daemon to refuse "no-iconv" if you want to force the
443 client to use an --iconv transfer (requiring an rsync 3.x client).
444
445 - Added the --skip-compress=LIST option to override the default list of
446 file suffixes that will not be compressed when using --compress (-z).
447
448 - The daemon's default for "dont compress" was extended to include:
449 *.7z *.mp[34] *.mov *.avi *.ogg *.jpg *.jpeg
450 The name-matching routine was also optimized to run more quickly.
451
452 - The --max-delete option now outputs a warning if it skipped any file
453 deletions, including a count of how many deletions were skipped. (Older
454 versions just silently stopped deleting things.)
455
456 - You may specify --max-delete=0 to a 3.0.0 client to request that it warn
457 about extraneous files without deleting anything. If you're not sure
458 what version the client is, you can use the less-obvious --max-delete=-1,
459 as both old and new versions will treat that as the same request (though
460 older versions don't warn).
461
462 - The --hard-link option now uses less memory on both the sending and
463 receiving side for all protocol versions. For protocol 30, the use of a
464 hashtable on the sending side allows us to more efficiently convey to the
465 receiver what files are linked together. This reduces the amount of data
466 sent over the socket by a considerable margin (rather than adding more
467 data), and limits the in-memory storage of the device+inode information
468 to just the sending side for the new protocol 30, or to the receiving
469 side when speaking an older protocol (note that older rsync versions kept
470 the device+inode information on both sides).
471
472 - The filter rules now support a perishable ("p") modifier that marks rules
473 that should not have an effect in a directory that is being deleted. e.g.
474 -f '-p .svn/' would only affect "live" .svn directories.
475
476 - Rsync checks all the alternate-destination args for validity (e.g.
477 --link-dest). This lets the user know when they specified a directory
478 that does not exist.
479
0f715920
WD
480 - If we get an ENOSYS error setting the time on a symlink, we don't
481 complain about it anymore (for those systems that even support the
482 setting of the modify-time on a symlink).
3cbe640d
WD
483
484 - Protocol 30 now uses MD5 checksums instead of MD4.
485
486 - Changed the --append option to not checksum the existing data in the
487 destination file, which speeds up file appending.
488
489 - Added the --append-verify option, which works like the older --append
490 option (verifying the existing data in the destination file). For
491 compatibility with older rsync versions, any use of --append that is
492 talking protocol 29 or older will revert to the --append-verify method.
493
494 - Added the --contimeout=SECONDS option that lets the user specify a
495 connection timeout for rsync daemon access.
496
497 - Documented and extended the support for the RSYNC_CONNECT_PROG variable
498 that can be used to enhance the client side of a daemon connection.
499
500 - Improved the dashes and double-quotes in the nroff manpage output.
501
502 - Rsync now supports a lot more --no-OPTION override options.
503
504 INTERNAL:
505
506 - The file-list sorting algorithm now uses a sort that keeps any same-
507 named items in the same order as they were specified. This allows
508 rsync to always ensure that the first of the duplicates is the one
509 that will be included in the copy. The new sort is also faster
510 than the glibc version of qsort() and mergesort().
511
512 - Rsync now supports the transfer of 64-bit timestamps (time_t values).
513
514 - Made the file-deletion code use a little less stack when recursing
515 through a directory hierarchy of extraneous files.
516
517 - Fixed a build problem with older (2.x) versions of gcc.
518
519 - Added some isType() functions that make dealing with signed characters
520 easier without forcing variables via casts.
521
522 - Changed strcat/strcpy/sprintf function calls to use safer versions.
523
524 - Upgraded the included popt version to 1.10.2 and improved its use of
525 string-handling functions.
526
527 - Added missing prototypes for compatibility functions from the lib dir.
528
529 - Configure determines if iconv() has a const arg, allowing us to avoid a
530 compiler warning.
531
532 - Made the sending of some numbers more efficient for protocol 30.
533
534 - Make sure that a daemon process doesn't mind if the client was weird and
535 omitted the --server option.
536
537 - There are more internal logging categories available in protocol 30 than
538 the age-old FINFO and FERROR, including FERROR_XFER and FWARN. These new
539 categories allow some errors and warnings to go to stderr without causing
540 an erroneous end-of-run warning about some files not being able to be
541 transferred.
542
543 - Improved the use of "const" on pointers.
544
545 - Improved J.W.'s pool_alloc routines to add a way of incrementally freeing
546 older sections of a pool's memory.
547
548 - The getaddrinfo.c compatibility code in the "lib" dir was replaced with
549 some new code (derived from samba, derived from PostgreSQL) that has a
550 better license than the old code.
551
552 DEVELOPER RELATED:
553
554 - Rsync is now licensed under the GPLv3 or later.
555
556 - Rsync is now being maintained in a "git" repository instead of CVS
557 (though the old CVS repository still exists for historical access).
558 Several maintenance scripts were updated to work with git.
559
560 - Generated files are no longer committed into the source repository. The
561 autoconf and autoheader commands are now automatically run during the
562 normal use of "configure" and "make". The latest dev versions of all
563 generated files can also be copied from the samba.org web site (see the
564 prepare-source script's fetch option).
565
566 - The "patches" directory of diff files is now built from branches in the
567 rsync git repository (branch patch/FOO creates file patches/FOO.diff).
568 This directory is now distributed in a separate separate tar file named
569 rsync-patches-VERSION.tar.gz instead of the main rsync-VERSION.tar.gz.
570
571 - The proto.h file is now built using a simple perl script rather than a
572 complex awk script, which proved to be more widely compatible.
573
574 - When running the tests, we now put our per-test temp dirs into a sub-
575 directory named testtmp (which is created, if missing). This allows
576 someone to symlink the testtmp directory to another filesystem (which is
577 useful if the build dir's filesystem does not support ACLs and xattrs,
578 but another filesystem does).
579
580 - Rsync now has a way of handling protocol-version changes during the
581 development of a new protocol version. This causes any out-of-sync
582 versions to speak an older protocol rather than fail in a cryptic manner.
583 This addition makes it safer to deploy a pre-release version that may
584 interact with the public. This new exchange of sub-version info does not
585 interfere with the {MIN,MAX}_PROTOCOL_VERSION checking algorithm (which
586 does not have enough range to allow the main protocol number to be
587 incremented for every minor tweak in that happens during development).
588
589 - The csprotocol.txt file was updated to mention the daemon protocol change
590 in the 3.0.0 release.
591
592\f
2955529b
WD
593NEWS for rsync 2.6.9 (6 Nov 2006)
594Protocol: 29 (unchanged)
595Changes since 2.6.8:
596
597 BUG FIXES:
598
599 - If rsync is interrupted via a handled signal (such as SIGINT), it will
600 once again clean-up its temp file from the destination dir.
601
602 - Fixed an overzealous sanitizing bug in the handling of the --link-dest,
603 --copy-dest, and --compare-dest options to a daemon without chroot: if
604 the copy's destination dir is deeper than the top of the module's path,
605 these options now accept a safe number of parent-dir (../) references
606 (since these options are relative to the destination dir). The old code
607 incorrectly chopped off all "../" prefixes for these options, no matter
608 how deep the destination directory was in the module's hierarchy.
609
610 - Fixed a bug where a deferred info/error/log message could get sent
611 directly to the sender instead of being handled by rwrite() in the
612 generator. This fixes an "unexpected tag 3" fatal error, and should
613 also fix a potential problem where a deferred info/error message from
614 the receiver might bypass the log file and get sent only to the client
615 process. (These problems could only affect an rsync daemon that was
616 receiving files.)
617
618 - Fixed a bug when --inplace was combined with a --*-dest option and we
619 update a file's data using an alternate basis file. The code now
620 notices that it needs to copy the matching data from the basis file
621 instead of (wrongly) assuming that it was already present in the file.
622
623 - Fixed a bug where using --dry-run with a --*-dest option with a path
624 relative to a directory that does not yet exist: the affected option
625 gets its proper path value so that the output of the dry-run is right.
626
627 - Fixed a bug in the %f logfile escape when receiving files: the
628 destination path is now included in the output (e.g. you can now tell
629 when a user specifies a subdir inside a module).
630
631 - If the receiving side fails to create a directory, it will now skip
632 trying to update everything that is inside that directory.
633
634 - If --link-dest is specified with --checksum but without --times, rsync
635 will now allow a hard-link to be created to a matching link-dest file
636 even when the file's modify-time doesn't match the server's file.
637
638 - The daemon now calls more timezone-using functions prior to doing a
639 chroot. This should help some C libraries to generate proper timestamps
640 from inside a chrooted daemon (and to not try to access /etc/timezone
641 over and over again).
642
643 - Fixed a bug in the handling of an absolute --partial-dir=ABS_PATH option:
644 it now deletes an alternate basis file from the partial-dir that was used
645 to successfully update a destination file.
646
647 - Fixed a bug in the handling of --delete-excluded when using a per-dir
648 merge file: the merge file is now honored on the receiving side, and
649 only its unqualified include/exclude commands are ignored (just as is
650 done for global include/excludes).
651
652 - Fixed a recent bug where --delete was not working when transferring from
653 the root (/) of the filesystem with --relative enabled.
654
655 - Fixed a recent bug where an --exclude='*' could affect the root (/) of
656 the filesystem with --relative enabled.
657
658 - When --inplace creates a file, it is now created with owner read/write
659 permissions (0600) instead of no permissions at all. This avoids a
660 problem continuing a transfer that was interrupted (since --inplace
661 will not update a file that has no write permissions).
662
663 - If either --remove-source-files or --remove-sent-files is enabled and we
664 are unable to remove the source file, rsync now outputs an error.
665
666 - Fixed a bug in the daemon's "incoming chmod" rule: newly-created
667 directories no longer get the 'F' (file) rules applied to them.
668
669 - Fixed an infinite loop bug when a filter rule was rejected due to being
670 overly long.
671
672 - When the server receives a --partial-dir option from the client, it no
673 longer runs the client-side code that adds an assumed filter rule (since
674 the client will be sending us the rules in the usual manner, and they
675 may have chosen to override the auto-added rule).
676
677 ENHANCEMENTS:
678
679 - Added the --log-file=FILE and --log-file-format=FORMAT options. These
680 can be used to tell any rsync to output what it is doing to a log file.
681 They work with a client rsync, a non-daemon server rsync (see the man
682 page for instructions), and also allows the overriding of rsyncd.conf
683 settings when starting a daemon.
684
685 - The --log-format option was renamed to be --out-format to avoid confusing
686 it with affecting the log-file output. (The old option remains as an
687 alias for the new to preserve backward compatibility.)
688
689 - Made "log file" and "syslog facility" settable on a per-module basis in
690 the daemon's config file.
691
692 - Added the --remove-source-files option as a replacement for the (now
693 deprecated) --remove-sent-files option. This new option removes all
694 non-dirs from the source directories, even if the file was already
695 up-to-date. This fixes a problem where interrupting an rsync that
696 was using --remove-sent-files and restarting it could leave behind
697 a file that the earlier rsync synchronized, but didn't get to remove.
698 (The deprecated --remove-sent-files is still understood for now, and
699 still behaves in the same way as before.)
700
701 - Added the option --no-motd to suppress the message-of-the-day output
702 from a daemon when doing a copy. (See the manpage for a caveat.)
703
704 - Added a new environment variable to the pre-/post-xfer exec commands (in
705 the daemon's config file): RSYNC_PID. This value will be the same in
4eeaa162
WD
706 both the pre- and post-xfer commands, so it can be used as a unique ID
707 if the pre-xfer command wants to cache some arg/request info for the
708 post-xfer command.
2955529b
WD
709
710 INTERNAL:
711
712 - Did a code audit using IBM's code-checker program and made several
713 changes, including: replacing most of the strcpy() and sprintf()
714 calls with strlcpy(), snprintf(), and memcpy(), adding a 0-value to
715 an enum that had been intermingling a literal 0 with the defined enum
716 values, silencing some uninitialized memory checks, marking some
717 functions with a "noreturn" attribute, and changing an "if" that
718 could never succeed on some platforms into a pre-processor directive
719 that conditionally compiles the code.
720
721 - Fixed a potential bug in f_name_cmp() when both the args are a
722 top-level "." dir (which doesn't happen in normal operations).
723
724 - Changed exit_cleanup() so that it can never return instead of exit.
725 The old code might return if it found the exit_cleanup() function
726 was being called recursively. The new code is segmented so that
727 any recursive calls move on to the next step of the exit-processing.
728
729 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
730 define it.
731
732 DEVELOPER RELATED:
733
734 - The acls.diff and xattrs.diff patches have received a bunch of work to
735 make them much closer to being acceptable in the main distribution.
736 The xattrs patch also has some preliminary Mac OS X and FreeBSD
737 compatibility code that various system types to exchange extended
738 file-attributes.
739
740 - A new diff in the patches dir, fake-root.diff, allows rsync to
741 maintain a backup hierarchy with full owner, group, and device info
742 without actually running as root. It does this using a special
743 extended attribute, so it depends on xattrs.diff (which depends on
744 acls.diff).
745
746 - The rsync.yo and rsyncd.conf.yo files have been updated to work
747 better with the latest yodl 2.x releases.
748
749 - Updated config.guess and config.sub to their 2006-07-02 versions.
750
751 - Updated various files to include the latest FSF address and to have
752 consistent opening comments.
753
754\f
60ef8ed1
WD
755NEWS for rsync 2.6.8 (22 Apr 2006)
756Protocol: 29 (unchanged)
757Changes since 2.6.7:
758
759 BUG FIXES:
760
761 - Fixed a bug in the exclude code where an anchored exclude without any
762 wildcards fails to match an absolute source arg, but only when --relative
763 is in effect.
764
765 - Improved the I/O code for the generator to fix a potential hang when the
766 receiver gets an EOF on the socket but the generator's select() call
767 never indicates that the socket is writable for it to be notified about
768 the EOF. (This can happen when using stunnel).
769
770 - Fixed a problem with the file-reading code where a failed read (such as
771 that caused by a bad sector) would not advance the file's read-position
772 beyond the failed read's data.
773
774 - Fixed a logging bug where the "log file" directive was not being honored
775 in a single-use daemon (one spawned by a remote-shell connection or by
776 init).
777
778 - If rsync cannot honor the --delete option, we output an error and exit
779 instead of silently ignoring the option.
780
781 - Fixed a bug in the --link-dest code that prevented special files (such as
782 fifos) from being linked.
783
784 - The ability to hard-link symlinks and special files is now determined at
785 configure time instead of at runtime. This fixes a bug with --link-dest
786 creating a hard-link to a symlink's referent on a BSD system.
787
788 ENHANCEMENTS:
789
790 - In daemon mode, if rsync fails to bind to the requested port, the
791 error(s) returned by socket() and/or bind() are now logged.
792
793 - When we output a fatal error, we now output the version of rsync in the
794 message.
795
796 - Improved the documentation for the --owner and --group options.
797
798 - The rsyncstats script in "support" has an improved line-parsing regex
799 that is easier to read and also makes it to parse syslog-generated lines.
800
801 - A new script in "support": file-attr-restore, can be used to restore the
802 attributes of a file-set (the permissions, ownership, and group info)
803 taken from the cached output of a "find ARG... -ls" command.
804
805 DEVELOPER RELATED:
806
807 - Removed the unused function write_int_named(), the unused variable
808 io_read_phase, and the rarely used variable io_write_phase. This also
809 elides the confusing 'phase "unknown"' part of one error message.
810
811 - Removed two unused configure checks and two related (also unused)
812 compatibility functions.
813
814 - The xattrs.diff patch received a security fix that prevents a potential
815 buffer overflow in the receive_xattr() code.
816
817 - The acls.diff patch has been improved quite a bit, with more to come.
818
819 - A new patch was added: log-file.diff. This contains an early version of
820 a future option, --log-file=FILE, that will allow any rsync to log its
821 actions to a file (something that only a daemon supports at present).
822
823\f
f171bf5b
WD
824NEWS for rsync 2.6.7 (11 Mar 2006)
825Protocol: 29 (unchanged)
826Changes since 2.6.6:
827
828 OUTPUT CHANGES:
829
830 - The letter 'D' in the itemized output was being used for both devices
831 (character or block) as well as other special files (such as fifos and
832 named sockets). This has changed to separate non-device special files
833 under the 'S' designation (e.g. "cS+++++++ path/fifo"). See also the
834 "--specials" option, below.
835
836 - The way rsync escapes unreadable characters has changed. First, rsync
837 now has support for recognizing valid multibyte character sequences in
838 your current locale, allowing it to escape fewer characters than before
839 for a locale such as UTF-8. Second, it now uses an escape idiom of
840 "\#123", which is the literal string "\#" followed by exactly 3 octal
841 digits. Rsync no longer doubles a backslash character in a filename
842 (e.g. it used to output "foo\\bar" when copying "foo\bar") -- now it only
843 escapes a backslash that is followed by a hash-sign and 3 digits (0-9)
844 (e.g. it will output "foo\#134#789" when copying "foo\#789"). See also
845 the --8-bit-output (-8) option, mentioned below.
846
847 Script writers: the local rsync is the one that outputs escaped names,
848 so if you need to support unescaping of filenames for older rsyncs, I'd
849 suggest that you parse the output of "rsync --version" and only use the
850 old unescaping rules for 2.6.5 and 2.6.6.
851
852 BUG FIXES:
853
854 - Fixed a really old bug that caused --checksum (-c) to checksum all the
855 files encountered during the delete scan (ouch).
856
857 - Fixed a potential hang in a remote generator: when the receiver gets a
858 read-error on the socket, it now signals the generator about this so that
859 the generator does not try to send any of the terminating error messages
860 to the client (avoiding a potential hang in some setups).
861
862 - Made hard-links work with symlinks and devices again.
863
864 - If the sender gets an early EOF reading a source file, we propagate this
865 error to the receiver so that it can discard the file and try requesting
866 it again (which is the existing behavior for other kinds of read errors).
867
868 - If a device-file/special-file changes permissions, rsync now updates the
869 permissions without recreating the file.
870
871 - If the user specifies a remote-host for both the source and destination,
872 we now output a syntax error rather than trying to open the destination
873 hostspec as a filename.
874
875 - When --inplace creates a new destination file, rsync now creates it with
876 permissions 0600 instead of 0000 -- this makes restarting possible when
877 the transfer gets interrupted in the middle of sending a new file.
878
879 - Reject the combination of --inplace and --sparse since the sparse-output
880 algorithm doesn't work when overwriting existing data.
881
882 - Fixed the directory name in the error that is output when pop_dir()
883 fails.
884
885 - Really fixed the parsing of a "!" entry in .cvsignore files this time.
886
887 - If the generator gets a stat() error on a file, output it (this used to
888 require at least -vv for the error to be seen).
889
890 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle
891 the exit status properly and generate a better error.
892
893 - Fixed some glitches in the double-verbose output when using --copy-dest,
894 --link-dest, or --compare-dest. Also improved how the verbose output
895 handles hard-links (within the transfer) that had an up-to-date alternate
896 "dest" file, and copied files (via --copy-dest).
897
898 - Fixed the matching of the dont-compress items (e.g. *.gz) against files
899 that have a path component containing a slash.
900
549a3efb
WD
901 - If the code reading a filter/exclude file gets an EINTR error, rsync now
902 clears the error flag on the file handle so it can keep on reading.
f171bf5b
WD
903
904 - If --relative is active, the sending side cleans up trailing "/" or "/."
905 suffixes to avoid triggering a bug in older rsync versions. Also, we now
906 reject a ".." dir if it would be sent as a relative dir.
907
908 - If a non-directory is in the way of a directory and rsync is run with
909 --dry-run and --delete, rsync no longer complains about not being able
910 to opendir() the not-yet present directory.
911
912 - When --list-only is used and a non-existent local destination dir was
913 also specified as a destination, rsync no longer generates a warning
914 about being unable to create the missing directory.
915
916 - Fixed some problems with --relative --no-implied-dirs when the
917 destination directory did not yet exist: we can now create a symlink or
918 device when it is the first thing in the missing dir, and --fuzzy no
919 longer complains about being unable to open the missing dir.
920
921 - Fixed a bug where the --copy-links option would not affect implied
922 directories without --copy-unsafe-links (see --relative).
923
924 - Got rid of the need for --force to be used in some circumstances with
925 --delete-after (making it consistent with --delete-before/-during).
926
927 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this
928 when a file is too large (rsync handles the write error).
929
930 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it
931 was not properly padded with trailing '=' chars. This only affects a
932 user that need to use a password-authenticated proxy for an outgoing
933 daemon-rsync connection.
934
935 - If we're transferring an empty directory to a new name, rsync no longer
936 forces S_IWUSR if it wasn't already set, nor does it accidentally leave
937 it set.
938
939 - Fixed a bug in the debug output (-vvvvv) that could mention the wrong
940 checksum for the current file offset.
941
942 - Rsync no longer allows a single directory to be copied over a non-
943 directory destination arg.
944
945 ENHANCEMENTS:
946
947 - Added the --append option that makes rsync append data onto files that
948 are longer on the source than the destination (this includes new files).
949
950 - Added the --min-size=SIZE option to exclude small files from the
951 transfer.
952
953 - Added the --compress-level option to allow you to set how aggressive
954 rsync's compression should be (this option implies --compress).
955
956 - Enhanced the parsing of the SIZE value for --min-size and --max-size to
957 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
958 and off-by-one values too (e.g. --max-size=8mb-1).
959
960 - Added the --8-bit-output (-8) option, which tells rsync to avoid escaping
961 high-bit characters that it thinks are unreadable in the current locale.
962
963 - The new option --human-readable (-h) changes the output of --progress,
964 --stats, and the end-of-run summary to be easier to read. If repeated,
965 the units become powers of 1024 instead of powers of 1000. (The old
966 meaning of -h, as a shorthand for --help, still works as long as you
967 just use it on its own, as in "rsync -h".)
968
969 - If lutimes() and/or lchmod() are around, use them to allow the
970 preservation of attributes on symlinks.
971
972 - The --link-dest option now affects symlinks and devices (when possible).
973
974 - Added two config items to the rsyncd.conf parsing: "pre-xfer exec" and
975 "post-xfer exec". These allow a command to be specified on a per-module
976 basis that will be run before and/or after a daemon-mode transfer. (See
977 the man page for a list of the environment variables that are set with
978 information about the transfer.)
979
980 - When using the --relative option, you can now insert a dot dir in
981 the source path to indicate where the replication of the source dirs
982 should start. For example, if you specify a source path of
983 rsync://host/module/foo/bar/./baz/dir with -R, rsync will now only
984 replicate the "baz/dir" part of the source path (note: a trailing
985 dot dir is unaffected unless it also has a trailing slash).
986
987 - Added some new --no-FOO options that make it easier to override unwanted
988 implied or default options. For example, "-a --no-o" (aka "--archive
989 --no-owner") can be used to turn off the preservation of file ownership
990 that is implied by -a.
991
992 - Added the --chmod=MODE option that allows the destination permissions to
993 be changed from the source permissions. E.g. --chmod=g+w,o-rwx
994
995 - Added the "incoming chmod" and "outgoing chmod" daemon options that allow
996 a module to specify what permissions changes should be applied to all
997 files copied to and from the daemon.
998
999 - Allow the --temp-dir option to be specified when starting a daemon, which
1000 sets the default temporary directory for incoming files.
1001
1002 - If --delete is combined with --dirs without --recursive, rsync will now
1003 delete in any directory whose content is being synchronized.
1004
1005 - If --backup is combined with --delete without --backup-dir (and without
1006 --delete-excluded), we add a "protect" filter-rule to ensure that files
1007 with the backup suffix are not deleted.
1008
1009 - The file-count stats that are output by --progress were improved to
1010 better indicate what the numbers mean. For instance, the output:
1011 "(xfer#5, to-check=8383/9999)" indicates that this was the fifth file
1012 to be transferred, and we still need to check 8383 more files out of
1013 a total of 9999.
1014
1015 - The include/exclude code now allows a dir/*** directive (with 3 trailing
1016 stars) to match both the dir itself as well as all the content below the
1017 dir (dir/** would not match the dir).
1018
1019 - Added the --prune-empty-dirs (-m) option that makes the receiving rsync
1020 discard empty chains of directories from the file-list. This makes it
1021 easier to selectively copy files from a source hierarchy and end up with
1022 just the directories needed to hold the resulting files.
1023
1024 - If the --itemize-changes (-i) option is repeated, rsync now includes
1025 unchanged files in the itemized output (similar to -vv, but without all
1026 the other verbose messages that can get in the way). Of course, the
1027 client must be version 2.6.7 for this to work, but the remote rsync only
1028 needs to be 2.6.7 if you're pushing files.
1029
1030 - Added the --specials option to tell rsync to copy non-device special
1031 files (which rsync now attempts even as a normal user). The --devices
1032 option now requests the copying of just devices (character and block).
1033 The -D option still requests both (e.g. --devices and --specials), -a
1034 still implies -D, and non-root users still get a silent downgrade that
1035 omits device copying.
1036
1037 - Added the --super option to make the receiver always attempt super-user
1038 activities. This is useful for systems that allow things such as devices
1039 to be created or ownership to be set without being UID 0, and is also
1040 useful for someone who wants to ensure that errors will be output if the
1041 receiving rsync isn't being run as root.
1042
1043 - Added the --sockopts option for those few who want to customize the TCP
1044 options used to contact a daemon rsync.
1045
1046 - Added a way for the --temp-dir option to be combined with a partial-dir
1047 setting that lets rsync avoid non-atomic updates (for those times when
1048 --temp-dir is not being used because space is tight).
1049
1050 - A new support script, files-to-excludes, will transform a list of files
1051 into a set of include/exclude directives that will copy those files.
1052
1053 - A new option, --executability (-E) can be used to preserve just the
1054 execute bit on files, for those times when using the --perms option is
1055 not desired.
1056
1057 - The daemon now logs each connection and also each module-list request
1058 that it receives.
1059
1060 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B
1061 (permission bits, e.g. "rwxr-xrwt").
1062
1063 - The --dry-run option no longer forces the enabling of --verbose.
1064
1065 - The --remove-sent-files option now does a better job of incrementally
1066 removing the sent files on the sending side (older versions tended to
1067 clump up all the removals at the end).
1068
1069 - A daemon now supersedes its minimal SIGCHLD handler with the standard
1070 PID-remembering version after forking. This ensures that the generator
1071 can get the child-exit status from the receiver.
1072
1073 - Use of the --bwlimit option no longer interferes with the remote rsync
1074 sending error messages about invalid/refused options.
1075
1076 - Rsync no longer returns a usage error when used with one local source arg
1077 and no destination: this now implies the --list-only option, just like
1078 the comparable situation with a remote source arg.
1079
1080 - Added the --copy-dirlinks option, a more limited version of --copy-links.
1081
1082 - Various documentation improvements, including: a better synopsis, some
1083 improved examples, a better discussion of the presence and absence of
1084 --perms (including how it interacts with the new --executability and
1085 --chmod options), an extended discussion of --temp-dir, an improved
1086 discussion of --partial-dir, a better description of rsync's pattern
1087 matching characters, an improved --no-implied-dirs section, and the
1088 documenting of what the --stats option outputs.
1089
1090 - Various new and updated diffs in the patches dir, including: acls.diff,
1091 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
1092
1093 INTERNAL:
1094
1095 - We now use sigaction() and sigprocmask() if possible, and fall back on
1096 signal() if not. Using sigprocmask() ensures that rsync enables all the
1097 signals that it needs, just in case it was started in a masked state.
1098
1099 - Some buffer sizes were expanded a bit, particularly on systems where
1100 MAXPATHLEN is overly small (e.g. cygwin).
1101
1102 - If io_printf() tries to format more data than fits in the buffer, exit
1103 with an error instead of transmitting a truncated buffer.
1104
1105 - If a va_copy macro is defined, lib/snprintf.c will use it when defining
1106 the VA_COPY macro.
1107
1108 - Reduced the amount of stack memory needed for each level of directory
1109 recursion by nearly MAXPATHLEN bytes.
1110
1111 - The wildmatch function was extended to allow an array of strings to be
1112 supplied as the string to match. This allows the exclude code to do less
1113 string copying.
1114
1115 - Got rid of the safe_fname() function (and all the myriad calls) and
1116 replaced it with a new function in the log.c code that filters all the
1117 output going to the terminal.
1118
1119 - Unified the f_name() and the f_name_to() functions.
1120
1121 - Improved the hash-table code the sender uses to handle checksums to make
1122 it use slightly less memory and run just a little faster.
1123
1124 DEVELOPER RELATED:
1125
1126 - The diffs in the patches dir now require "patch -p1 <DIFF" instead of
1127 the previous -p0. Also, the version included in the release tar now
1128 affect generated files (e.g. configure, rsync.1, proto.h, etc.), so
1129 it is no longer necessary to run autoconf and/or yodl unless you're
1130 applying a patch that was checked out from CVS.
1131
1132 - Several diffs in the patches dir now use the proper --enable-FOO
1133 configure option instead of --with-FOO to turn on the inclusion of
1134 the newly patched feature.
1135
1136 - There is a new script, "prepare-source" than can be used to update the
1137 various generated files (proto.h, configure, etc.) even before configure
1138 has created the Makefile (this is mainly useful when patching the source
1139 with a patch that doesn't affect generated files).
1140
1141 - The testsuite now sets HOME so that it won't be affected by a file such
1142 as ~/.popt.
1143
1144\f
f90f7149
WD
1145NEWS for rsync 2.6.6 (28 Jul 2005)
1146Protocol: 29 (unchanged)
1147Changes since 2.6.5:
1148
1149 SECURITY FIXES:
1150
1151 - The zlib code was upgraded to version 1.2.3 in order to make it more
1152 secure. While the widely-publicized security problem in zlib 1.2.2 did
1153 not affect rsync, another security problem surfaced that affects rsync's
1154 zlib 1.1.4.
1155
1156 BUG FIXES:
1157
1158 - The setting of flist->high in clean_flist() was wrong for an empty list.
1159 This could cause flist_find() to crash in certain rare circumstances
1160 (e.g. if just the right directory setup was around when --fuzzy was
1161 combined with --link-dest).
1162
1163 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
1164 (1) Without -i it would output the name of each hard-linked file as
1165 though it had been changed; it now outputs a "is hard linked" message for
1166 the file. (2) With -i it would output all dots for the unchanged
1167 attributes of a hard-link; it now changes those dots to spaces, as is
1168 done for other totally unchanged items.
f90f7149
WD
1169
1170 - When backing up a changed symlink or device, get rid of any old backup
1171 item so that we don't get an "already exists" error.
1172
1173 - A couple places that were comparing a local and a remote modification-
1174 time were not honoring the --modify-window option.
1175
1176 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
1177 set too often (if some non-significant mode bits differed).
1178
1179 - Fixed a really old, minor bug that could cause rsync to warn about being
1180 unable to mkdir() a path that ends in "/." because it just created the
1181 directory (required --relative, --no-implied-dirs, a source path that
1182 ended in either a trailing slash or a trailing "/.", and a non-existing
1183 destination dir to tickle the bug in a recent version).
1184
1185 ENHANCEMENTS:
1186
1187 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
1188 per-module basis (which now matches the documentation).
1189
1190 - The support/rrsync script has been upgraded to verify the args of options
1191 that take args (instead of rejecting any such options). The script was
1192 also changed to try to be more secure and to fix a problem in the parsing
1193 of a pull operation that has multiple sources.
1194
1195 - Improved the documentation that explains the difference between a
1196 normal daemon transfer and a daemon-over remote-shell transfer.
1197
1198 - Some of the diffs supplied in the patches dir were fixed and/or
1199 improved.
1200
1201 BUILD CHANGES:
1202
1203 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
1204 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
1205 find in the /etc/group file).
1206
1207 - Added a test to the test suite, itemized.test, that tests the output of
1208 -i (log-format w/%i) and some double-verbose messages.
1209
1210\f
a1c75ed0
WD
1211NEWS for rsync 2.6.5 (1 Jun 2005)
1212Protocol: 29 (unchanged)
1213Changes since 2.6.4:
1214
1215 OUTPUT CHANGES:
1216
1217 - Non-printable chars in filenames are now output using backslash-
1218 escaped characters rather than '?'s. Any non-printable character is
1219 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
1220 is now output as "\\". Rsync also uses your locale setting, which
1221 can make it treat fewer high-bit characters as non-printable.
1222
1223 - If rsync received an empty file-list when pulling files, it would
1224 output a "nothing to do" message and exit with a 0 (success) exit
1225 status, even if the remote rsync returned an error (it did not do
1226 this under the same conditions when pushing files). This was changed
1227 to make the pulling behavior the same as the pushing behavior: we
1228 now do the normal end-of-run outputting (depending on options) and
1229 exit with the appropriate exit status.
1230
1231 BUG FIXES:
1232
1233 - A crash bug was fixed when a daemon had its "path" set to "/", did
1234 not have chroot enabled, and used some anchored excludes in the
1235 rsyncd.conf file.
1236
1237 - Fixed a bug in the transfer of a single file when -H is specified
1238 (rsync would either infinite loop or perhaps crash).
1239
1240 - Fixed a case where the generator might try (and fail) to tweak the
1241 write-permissions of a read-only directory in list-only mode (this
1242 only caused an annoying warning message).
1243
1244 - If --compare-dest or --link-dest uses a locally-copied file as the
1245 basis for an updated version, log this better when --verbose or -i
1246 is in effect.
1247
1248 - Fixed the accidental disabling of --backup during the --delete-after
1249 processing.
1250
1251 - Restored the ability to use the --address option in client mode (in
1252 addition to its use in daemon mode).
1253
1254 - Make sure that some temporary progress information from the delete
1255 processing does not get left on the screen when it is followed by a
1256 newline.
1257
1258 - When --existing skips a directory with extra verbosity, refer to it
1259 as a "directory", not a "file".
1260
1261 - When transferring a single file to a different-named file, any
1262 generator messages that are source-file related no longer refer to
1263 the file by the destination filename.
1264
1265 - Fixed a bug where hard-linking a group of files might fail if the
1266 generator hasn't created a needed destination directory yet.
1267
1268 - Fixed a bug where a hard-linked group of files that is newly-linked
1269 to a file in a --link-dest dir doesn't link the files from the rest
1270 of the cluster.
1271
1272 - When deleting files with the --one-file-system (-x) option set, rsync
1273 no longer tries to remove files from inside a mount-point on the
1274 receiving side. Also, we don't complain about being unable to remove
1275 the mount-point dir.
1276
1277 - Fixed a compatibility problem when using --cvs-ignore (-C) and
1278 sending files to an older rsync without using --delete.
1279
1280 - Make sure that a "- !" or "+ !" include/exclude pattern does not
1281 trigger the list-clearing action that is reserved for "!".
1282
1283 - Avoid a timeout in the generator when the sender/receiver aren't
1284 handling the generator's checksum output quickly enough.
1285
1286 - Fixed the omission of some directories in the delete processing when
1287 --relative (-R) was combined with a source path that had a trailing
1288 slash.
1289
1290 - Fixed a case where rsync would erroneously delete some files and then
1291 re-transfer them when the options --relative (-R) and --recursive
1292 (-r) were both enabled (along with --delete) and a source path had a
1293 trailing slash.
1294
1295 - Make sure that --max-size doesn't affect a device or a symlink.
1296
1297 - Make sure that a system with a really small MAXPATHLEN does not cause
1298 the buffers in readfd_unbuffered() to be too small to receive normal
1299 messages. (This mainly affected Cygwin.)
1300
1301 - If a source pathname ends with a filename of "..", treat it as if
1302 "../" had been specified (so that we don't copy files to the parent
1303 dir of the destination).
1304
1305 - If --delete is combined with a file-listing rsync command (i.e. no
1306 transfer is happening), avoid outputting a warning that we couldn't
1307 delete anything.
1308
1309 - If --stats is specified with --delete-after, ensure that all the
1310 "deleting" messages are output before the statistics.
1311
1312 - Improved one "if" in the deletion code that was only checking errno
1313 for ENOTEMPTY when it should have also been checking for EEXIST (for
1314 compatibility with OS variations).
1315
1316 ENHANCEMENTS:
1317
1318 - Added the --only-write-batch=FILE option that may be used (instead
1319 of --write-batch=FILE) to create a batch file without doing any
1320 actual updating of the destination. This allows you to divert all
1321 the file-updating data away from a slow data link (as long as you
1322 are pushing the data to the remote server when creating the batch).
1323
1324 - When the generator is taking a long time to fill up its output buffer
1325 (e.g. if the transferred files are few, small, or missing), it now
1326 periodically flushes the output buffer so that the sender/receiver
1327 can get started on the files sooner rather than later.
1328
1329 - Improved the keep-alive code to handle a long silence between the
1330 sender and the receiver that can occur when the sender is receiving
1331 the checksum data for a large file.
1332
1333 - Improved the auth-errors that are logged by the daemon to include
1334 some information on why the authorization failed: wrong user,
1335 password mismatch, etc. (The client-visible message is unchanged!)
1336
1337 - Improved the client's handling of an "@ERROR" from a daemon so that
1338 it does not complain about an unexpectedly closed socket (since we
1339 really did expect the socket to close).
1340
1341 - If the daemon can't open the log-file specified in rsyncd.conf, fall
1342 back to using syslog and log an appropriate warning. This is better
1343 than what was typically a totally silent (and fatal) failure (since a
1344 daemon is not usually run with the --no-detach option that was
1345 necessary to see the error on stderr).
1346
1347 - The man pages now consistently refer to an rsync daemon as a "daemon"
1348 instead of a "server" (to distinguish it from the server process in a
1349 non-daemon transfer).
1350
1351 - Made a small change to the rrsync script (restricted rsync -- in the
1352 support dir) to make a read-only server reject all --remove-* options
1353 when sending files (to future-proof it against the possibility of
1354 other similar options being added at some point).
1355
1356 INTERNAL:
1357
1358 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
1359 better discern which filename characters need to be escaped in
1360 messages (which should result in fewer escaped characters in some
1361 locales).
1362
1363 - Improved the naming of the log-file open/reopen/close functions.
1364
1365 - Removed some protocol-compatibility code that was only needed to help
1366 someone running a pre-release of 2.6.4.
1367
1368 BUILD CHANGES:
1369
1370 - Added configure option "--disable-locale" to disable any use of
1371 setlocale() in the binary.
1372
1373 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
1374 rsync from being built without symlink or hard-link support.
1375
1376 - Only #define HAVE_REMSH if it is going to be set to 1.
1377
1378 - Configure now disables the use of mkstemp() under HP-UX (since they
1379 refuse to fix its broken handling of large files).
1380
1381 - Configure now explicitly checks for the lseek64() function so that
1382 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
1383 presence based on the presence of the off64_t type.
1384
1385 - Configure no longer mentions the change in the default remote-shell
1386 (from rsh to ssh) that occurred for the 2.6.0 release.
1387
1388 - Some minor enhancements to the test scripts.
1389
1390 - Added a few new *.diff files to the patches dir, including a patch
1391 that enables the optional copying of extended attributes.
1392
1393\f
1ad6a7f6
WD
1394NEWS for rsync 2.6.4 (30 March 2005)
1395Protocol: 29 (changed)
1396Changes since 2.6.3:
1397
1398 OUTPUT CHANGES:
1399
1400 - When rsync deletes a directory and outputs a verbose message about
1401 it, it now appends a trailing slash to the name instead of (only
1402 sometimes) outputting a preceding "directory " string.
1403
1404 - The --stats output will contain file-list time-statistics if both
1405 sides are 2.6.4, or if the local side is 2.6.4 and the files are
1406 being pushed (since the stats come from the sending side).
1407 (Requires protocol 29 for a pull.)
1408
1409 - The "%o" (operation) log-format escape now has a third value (besides
1410 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
1411 This changes the way deletions are logged in the daemon's log file.
1412
1413 - When the --log-format option is combined with --verbose, rsync now
1414 avoids outputting the name of the file twice in most circumstances.
1415 As long as the --log-format item does not refer to any post-transfer
1416 items (such as %b or %c), the --log-format message is output prior to
1417 the transfer, so --verbose is now the equivalent of a --log-format of
1418 '%n%L' (which outputs the name and any link info). If the log output
1419 must occur after the transfer to be complete, the only time the name
1420 is also output prior to the transfer is when --progress was specified
1421 (so that the name will precede the progress stats, and the full
1422 --log-format output will come after).
97e3c50c 1423
7c2a83c6
WD
1424 - Non-printable characters in filenames are replaced with a '?' to
1425 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
1426
1427 BUG FIXES:
1428
1429 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
1430 was only treating it as a special token in an rsync include/exclude
1431 file).
1432
1433 - The combination of --verbose and --dry-run now mentions the full list
1434 of changes that would be output without --dry-run.
1435
1436 - Avoid a mkdir warning when removing a directory in the destination
1437 that already exists in the --backup-dir.
1438
1439 - An OS that has a binary mode for its files (such as cygwin) needed
1440 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 1441 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
1442
1443 - Fixed a potential hang when verbosity is high, the client side is
1444 the sender, and the file-list is large.
1445
1446 - Fixed a potential protocol-corrupting bug where the generator could
1447 merge a message from the receiver into the middle of a multiplexed
1448 packet of data if only part of that data had been written out to the
1449 socket when the message from the generator arrived.
1450
1451 - We now check if the OS doesn't support using mknod() for creating
1452 FIFOs and sockets, and compile-in some compatibility code using
1453 mkfifo() and socket() when necessary.
1454
1455 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
1456 if the --max-delete limit is exceeded during a run, we now output a
1457 warning about this at the end of the run and exit with a new error
1458 code (25).
1459
1460 - One place in the code wasn't checking if fork() failed.
1461
1462 - The "ignore nonreadable" daemon parameter used to erroneously affect
1463 readable symlinks that pointed to a non-existent file.
1464
1465 - If the OS does not have lchown() and a chown() of a symlink will
1466 affect the referent of a symlink (as it should), we no longer try
1467 to set the user and group of a symlink.
1468
1469 - The generator now properly runs the hard-link loop and the dir-time
1470 rewriting loop after we're sure that the redo phase is complete.
1471
1472 - When --backup was specified with --partial-dir=DIR, where DIR is a
1473 relative path, the backup code was erroneously trying to backup a
1474 file that was put into the partial-dir.
1475
1476 - If a file gets resent in a single transfer and the --backup option is
1477 enabled along with --inplace, rsync no longer performs a duplicate
1478 backup (it used to overwrite the first backup with the failed file).
1479
1480 - One call to flush_write_file() was not being checked for an error.
1481
1482 - The --no-relative option was not being sent from the client to a
1483 server sender.
1484
1485 - If an rsync daemon specified "dont compress = ..." for a file and the
1486 client tried to specify --compress, the libz code was not handling a
1487 compression level of 0 properly. This could cause a transfer failure
1488 if the block-size for a file was large enough (e.g. rsync might have
1489 exited with an error for large files).
1490
1491 - Fixed a bug that would sometimes surface when using --compress and
1492 sending a file with a block-size larger than 64K (either manually
1493 specified, or computed due to the file being really large). Prior
1494 versions of rsync would sometimes fail to decompress the data
1495 properly, and thus the transferred file would fail its verification.
1496
1497 - If a daemon can't open the specified log file (i.e. syslog is not
1498 being used), die without crashing. We also output an error about
1499 the failure on stderr (which will only be seen if --no-detach was
1500 specified) and exit with a new error code (6).
1501
1502 - A local transfer no longer duplicates all its include/exclude options
1503 (since the forked process already has a copy of the exclude list,
1504 there's no need to send them a set of duplicates).
1505
7eb2ecda
WD
1506 - The output of the items that are being updated by the generator (dirs,
1507 symlinks, devices) is now intermingled in the proper order with the
1508 output from the items that the receiver is updating (regular files)
1509 when pulling. This misordering was particularly bad when --progress
1510 was specified. (Requires protocol 29.)
1ad6a7f6
WD
1511
1512 - When --timeout is specified, lulls that occur in the transfer while
1513 the generator is doing work that does not generate socket traffic
1514 (looking for changed files, deleting files, doing directory-time
1515 touch-ups, etc.) will cause a new keep-alive packet to be sent that
1516 should keep the transfer going as long as the generator continues to
1517 make progress. (Requires protocol 29.)
1518
1519 - The stat size of a device is not added to the total file size of the
1520 items in the transfer (the size might be undefined on some OSes).
1521
1522 - Fixed a problem with refused-option messages sometimes not making it
1523 back to the client side when a remote --files-from was in effect and
1524 the daemon was the receiver.
1525
0f9941dc 1526 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
1527 (the preserved) attributes from the version in the compare-dest DIR.
1528
1529 - When rsync is copying files into a write-protected directory, fixed
1530 the change-report output for the directory so that we don't report
1531 an identical directory as changed.
1532
1533 ENHANCEMENTS:
1534
1535 - Rsync now supports popt's option aliases, which means that you can
1536 use /etc/popt and/or ~/.popt to create your own option aliases.
1537
1538 - Added the --delete-during (--del) option which will delete files
1539 from the receiving side incrementally as each directory in the
1540 transfer is being processed. This makes it more efficient than the
1541 default, before-the-transfer behavior, which is now also available as
1542 --delete-before (and is still the default --delete-WHEN option that
1543 will be chosen if --delete or --delete-excluded is specified without
1544 a --delete-WHEN choice). All the --del* options infer --delete, so
1545 an rsync daemon that refuses "delete" will still refuse to allow any
1546 file-deleting options (including the new --remove-sent-files option).
1547
1548 - All the --delete-WHEN options are now more memory efficient:
1549 Previously an duplicate set of file-list objects was created on the
1550 receiving side for the entire destination hierarchy. The new
1551 algorithm only creates one directory of objects at a time (for files
1552 inside the transfer).
1553
1554 - Added the --copy-dest option, which works like --link-dest except
1555 that it locally copies identical files instead of hard-linking them.
1556
1557 - Added support for specifying multiple --compare-dest, --copy-dest, or
1558 --link-dest options, but only of a single type. (Promoted from the
1559 patches dir and enhanced.) (Requires protocol 29.)
1560
1561 - Added the --max-size option. (Promoted from the patches dir.)
1562
1563 - The daemon-mode options are now separated from the normal rsync
1564 options so that they can't be mixed together. This makes it
1565 impossible to start a daemon that has improper default option values
1566 (which could cause problems when a client connects, such as hanging
1567 or crashing).
1568
1569 - The --bwlimit option may now be used in combination with --daemon
1570 to specify both a default value for the daemon side and a value
1571 that cannot be exceeded by a user-specified --bwlimit option.
1572
1573 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
1574 the patches dir.) Also added "address". The command-line options
1575 take precedence over a config-file option, as expected.
1576
1577 - In _exit_cleanup(): when we are exiting with a partially-received
1578 file, we now flush any data in the write-cache before closing the
1579 partial file.
1580
1581 - The --inplace support was enhanced to work with --compare-dest,
1582 --link-dest, and (the new) --copy-dest options. (Requires protocol
1583 29.)
1584
1585 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
1586 without recursion. Any directories that are encountered are created
1587 on the destination. Specifying a directory with a trailing slash
1588 copies its immediate contents to the destination.
1589
1590 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
1591
1592 - Added the --list-only option, which is mainly a way for the client to
1593 put the server into listing mode without needing to resort to any
1594 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
1595 for a non-recursive listing). This option is used automatically
1596 (behind the scenes) when a modern rsync speaks to a modern daemon,
1597 but may also be specified manually if you want to force the use of
1598 the --list-only option over a remote-shell connection.
1599
1600 - Added the --omit-dir-times (-O) option, which will avoid updating
1601 the modified time for directories when --times was specified. This
1602 option will avoid an extra pass through the file-list at the end of
1603 the transfer (to tweak all the directory times), which may provide
1604 an appreciable speedup for a really large transfer. (Promoted from
1605 the patches dir.)
1606
1607 - Added the --filter (-f) option and its helper option, -F. Filter
1608 rules are an extension to the existing include/exclude handling
1609 that also supports nested filter files as well as per-directory
1610 filter files (like .cvsignore, but with full filter-rule parsing).
1611 This new option was chosen in order to ensure that all existing
1612 include/exclude processing remained 100% compatible with older
1613 versions. Protocol 29 is needed for full filter-rule support, but
1614 backward-compatible rules work with earlier protocol versions.
1615 (Promoted from the patches dir and enhanced.)
1616
1617 - Added the --delay-updates option that puts all updated files into
1618 a temporary directory (by default ".~tmp~", but settable via the
1619 --partial-dir=DIR option) until the end of the transfer. This
1620 makes the updates a little more atomic for a large transfer.
1621
1622 - If rsync is put into the background, any output from --progress is
1623 reduced.
1624
1625 - Documented the "max verbosity" setting for rsyncd.conf. (This
1626 setting was added a couple releases ago, but left undocumented.)
1627
1628 - The sender and the generator now double-check the file-list index
1629 they are given, and refuse to try to do a file transfer on a
1630 non-file index (since that would indicate that something had gone
1631 very wrong).
1632
1633 - Added the --itemize-changes (-i) option, which is a way to output a
1634 more detailed list of what files changed and in what way. The effect
1635 is the same as specifying a --log-format of "%i %n%L" (see both the
1636 rsync and rsyncd.conf manpages). Works with --dry-run too.
1637
1638 - Added the --fuzzy (-y) option, which attempts to find a basis file
1639 for a file that is being created from scratch. The current algorithm
1640 only looks in the destination directory for the created file, but it
1641 does attempt to find a match based on size/mod-time (in case the file
1642 was renamed with no other changes) as well as based on a fuzzy
1643 name-matching algorithm. This option requires protocol 29 because it
1644 needs the new file-sorting order. (Promoted from patches dir and
1645 enhanced.) (Requires protocol 29.)
1646
1647 - Added the --remove-sent-files option, which lets you move files
1648 between systems.
1649
1650 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
1651 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
1652 literals in the rsync://HOST:PORT/PATH format.)
1653
1654 - When rsync recurses to build the file list, it no longer keeps open
1655 one or more directory handles from the dir's parent dirs.
1656
1657 - When building under windows, the default for --daemon is now to
1658 avoid detaching, requiring the new --detach option to force rsync
1659 to detach.
1660
1661 - The --dry-run option can now be combined with either --write-batch or
1662 --read-batch, allowing you to run a do-nothing test command to see
1663 what would happen without --dry-run.
1664
1665 - The daemon's "read only" config item now sets an internal read_only
1666 variable that makes extra sure that no write/delete calls on the
1667 read-only side can succeed.
1668
1669 - The log-format % escapes can now have a numeric field width in
1670 between the % and the escape letter (e.g. "%-40n %08p").
1671
1672 - Improved the option descriptions in the --help text.
1673
1674 SUPPORT FILES:
1675
1676 - Added atomic-rsync to the support dir: a perl script that will
1677 transfer some files using rsync, and then move the updated files into
1678 place all at once at the end of the transfer. Only works when
1679 pulling, and uses --link-dest and a parallel hierarchy of files to
1680 effect its update.
1681
1682 - Added mnt-excl to the support dir: a perl script that takes the
1683 /proc/mounts file and translates it into a set of excludes that will
1684 exclude all mount points (even mapped mounts to the same disk). The
1685 excludes are made relative to the specified source dir and properly
1686 anchored.
1687
1688 - Added savetransfer.c to the support dir: a C program that can make
1689 a copy of all the data that flows over the wire. This lets you test
1690 for data corruption (by saving the data on both the sending side and
1691 the receiving side) and provides one way to debug a protocol error.
1692
1693 - Added rrsync to the support dir: this is an updated version of Joe
1694 Smith's restricted rsync perl script. This helps to ensure that only
1695 certain rsync commands can be run by an ssh invocation.
1696
1697 INTERNAL:
1698
1699 - Added better checking of the checksum-header values that come over
1700 the socket.
1701
1702 - Merged a variety of file-deleting functions into a single function so
1703 that it is easier to maintain.
1704
1705 - Improved the type of some variables (particularly blocksize vars) for
1706 consistency and proper size.
1707
1708 - Got rid of the uint64 type (which we didn't need).
1709
1710 - Use a slightly more compatible set of core #include directives.
1711
1712 - Defined int32 in a way that ensures that the build dies if we can't
1713 find a variable with at least 32 bits.
1714
1715 PROTOCOL DIFFERENCES FOR VERSION 29:
1716
1717 - A 16-bit flag-word is transmitted after every file-list index. This
1718 indicates what is changing between the sender and the receiver. The
1719 generator now transmits an index and a flag-word to indicate when
1720 dirs and symlinks have changed (instead of producing a message),
1721 which makes the outputting of the information more consistent and
1722 less prone to screen corruption (because the local receiver/sender is
1723 now outputting all the file-change info messages).
1724
1725 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
1726 in the flag-word and the name of the file that was linked immediately
1727 follows in vstring format (see below).
1728
1729 - If a file is being transferred with an alternate-basis file, the
1730 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
1731 byte follows, indicating what type of basis file was chosen. If that
1732 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
1733 is set in the flag-word and the name of the match in vstring format
1734 follows the basis byte. A vstring is a variable length string that
1735 has its size written prior to the string, and no terminating null.
1736 If the string is from 1-127 bytes, the length is a single byte. If
1737 it is from 128-32767 bytes, the length is written as ((len >> 8) |
1738 0x80) followed by (len % 0x100).
1739
1740 - The sending of exclude names is done using filter-rule syntax. This
1741 means that all names have a prefixed rule indicator, even excludes
1742 (which used to be sent as a bare pattern, when possible). The -C
1743 option will include the per-dir .cvsignore merge file in the list of
1744 filter rules so it is positioned correctly (unlike in some older
1745 transfer scenarios).
1746
1747 - Rsync sorts the filename list in a different way: it sorts the subdir
1748 names after the non-subdir names for each dir's contents, and it
1749 always puts a dir's contents immediately after the dir's name in the
1750 list. (Previously an item named "foo.txt" would sort in between
1751 directory "foo/" and "foo/bar".)
1752
1753 - When talking to a protocol 29 rsync daemon, a list-only request
1754 is able to note this before the options are sent over the wire and
1755 the new --list-only option is included in the options.
1756
1757 - When the --stats bytes are sent over the wire (or stored in a batch),
1758 they now include two elapsed-time values: one for how long it took to
1759 build the file-list, and one for how long it took to send it over the
1760 wire (each expressed in thousandths of a second).
1761
1762 - When --delete-excluded is specified with some filter rules (AKA
1763 excludes), a client sender will now initiate a send of the rules to
1764 the receiver (older protocols used to omit the sending of excludes in
1765 this situation since there were no receiver-specific rules that
1766 survived --delete-excluded back then). Note that, as with all the
1767 filter-list sending, only items that are significant to the other
1768 side will actually be sent over the wire, so the filter-rule list
1769 that is sent in this scenario is often empty.
1770
1771 - An index equal to the file-list count is sent as a keep-alive packet
1772 from the generator to the sender, which then forwards it on to the
1773 receiver. This normally invalid index is only a valid keep-alive
1774 packet if the 16-bit flag-word that follows it contains a single bit
1775 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
1776
1777 - A protocol-29 batch file includes a bit for the setting of the --dirs
1778 option and for the setting of the --compress option. Also, the shell
1779 script created by --write-batch will use the --filter option instead
1780 of --exclude-from to capture any filter rules.
1781
1782 BUILD CHANGES:
1783
1784 - Handle an operating system that use mkdev() in place of makedev().
1785
1786 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
1787
1788\f
ca39ebf9
WD
1789NEWS for rsync 2.6.3 (30 Sep 2004)
1790Protocol: 28 (unchanged)
1791Changes since 2.6.2:
1792
1793 SECURITY FIXES:
1794
1795 - A bug in the sanitize_path routine (which affects a non-chrooted
1796 rsync daemon) could allow a user to craft a pathname that would get
1797 transformed into an absolute path for certain options (but not for
1798 file-transfer names). If you're running an rsync daemon with chroot
1799 disabled, *please upgrade*, ESPECIALLY if the user privs you run
1800 rsync under is anything above "nobody".
1801
1802 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
1803
1804 - Please note that the 2-line footer (output when verbose) now uses the
1805 term "sent" instead of "wrote" and "received" instead of "read". If
1806 you are not parsing the numeric values out of this footer, a script
1807 would be better off using the empty line prior to the footer as the
1808 indicator that the verbose output is over.
1809
1810 - The output from the --stats option was similarly affected to change
1811 "written" to "sent" and "read" to "received".
1812
1813 - Rsync ensures that a filename that contains a newline gets mentioned
1814 with each newline transformed into a question mark (which prevents a
1815 filename from causing an empty line to be output).
1816
1817 - The "backed up ..." message that is output when at least 2 --verbose
1818 options are specified is now the same both with and without the
1819 --backup-dir option.
1820
1821 BUG FIXES:
1822
1823 - Fixed a crash bug that might appear when --delete was used and
1824 multiple source directories were specified.
1825
1826 - Fixed a 32-bit truncation of the file length when generating the
1827 checksums.
1828
1829 - The --backup code no longer attempts to create some directories
1830 over and over again (generating warnings along the way).
1831
1832 - Fixed a bug in the reading of the secrets file (by the daemon) and
1833 the password file (by the client): the files no longer need to be
1834 terminated by a newline for their content to be read in.
1835
1836 - If a file has a read error on the sending side or the reconstructed
1837 data doesn't match the expected checksum (perhaps due to the basis
1838 file changing during the transfer), the receiver will no longer
1839 retain the resulting file unless the --partial option was specified.
1840 (Note: for the read-error detection to work, neither side can be
1841 older than 2.6.3 -- older receivers will always retain the file, and
1842 older senders don't tell the receiver that the file had a read
1843 error.)
1844
1845 - If a file gets resent in a single transfer and the --backup option
1846 is enabled, rsync no longer performs a duplicate backup (it used to
1847 overwrite the original file in the backup area).
1848
1849 - Files specified in the daemon's "exclude" or "exclude from" config
1850 items are now excluded from being uploaded (assuming that the module
1851 allows uploading at all) in addition to the old download exclusion.
1852
1853 - Got rid of a potential hang in the receiver when near the end of a
1854 phase.
1855
1856 - When using --backup without a --backup-dir, rsync no longer preserves
1857 the modify time on directories. This avoids confusing NFS.
1858
1859 - When --copy-links (-L) is specified, we now output a separate error
1860 for a symlink that has no referent instead of claiming that a file
1861 "vanished".
1862
1863 - The --copy-links (-L) option no longer has the side-effect of telling
1864 the receiving side to follow symlinks. See the --keep-dirlinks
1865 option (mentioned below) for a way to specify that behavior.
1866
1867 - Error messages from the daemon server's option-parsing (such as
1868 refused options) are now successfully transferred back to the client
1869 (the server used to fail to send the message because the socket
1870 wasn't in the right state for the message to get through).
1871
1872 - Most transfer errors that occur during a daemon transfer are now
1873 returned to the user in addition to being logged (some messages are
1874 intended to be daemon-only and are not affected by this).
1875
1876 - Fixed a bug in the daemon authentication code when using one of the
1877 batch-processing options.
1878
1879 - We try to work around some buggy IPv6 implementations that fail to
1880 implement IPV6_V6ONLY. This should fix the "address in use" error
1881 that some daemons get when running on an OS with a buggy IPv6
1882 implementation. Also, if the new code gets this error, we might
1883 suggest that the user specify --ipv4 or --ipv6 (if we think it will
1884 help).
1885
1886 - When the remote rsync dies, make a better effort to recover any error
1887 messages it may have sent before dying (the local rsync used to just
1888 die with a socket-write error).
1889
1890 - When using --delete and a --backup-dir that contains files that are
1891 hard-linked to their destination equivalents, rsync now makes sure
1892 that removed files really get removed (avoids a really weird rename()
1893 behavior).
1894
1895 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
1896 the int64 type is defined as an off_t and it actually has 64-bits.
1897
1898 - Added a configure check for open64() without mkstemp64() so that we
1899 can avoid using mkstemp() when such a combination is encountered.
1900 This bypasses a problem writing out large temp files on OSes such as
1901 AIX and HP-UX.
1902
1903 - Fixed an age-old crash problem with --read-batch on a local copy
1904 (rsync was improperly assuming --whole-file for the local copy).
1905
1906 - When --dry-run (-n) is used and the destination directory does not
1907 exist, rsync now produces a correct report of files that would be
1908 sent instead of dying with a chdir() error.
1909
1910 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
1911 with an error instead of waiting for the connection to finish.
1912
1913 - Fixed an ssh interaction that could cause output to be lost when the
1914 user chose to combine the output of rsync's stdout and stderr (e.g.
1915 using the "2>&1").
1916
920240a6
WD
1917 - Fixed an option-parsing bug when --files-from got passed to a daemon.
1918
ca39ebf9
WD
1919 ENHANCEMENTS:
1920
1921 - Added the --partial-dir=DIR option that lets you specify where to
1922 (temporarily) put a partially transferred file (instead of over-
1923 writing the destination file). E.g. --partial-dir=.rsync-partial
1924 Also added support for the RSYNC_PARTIAL_DIR environment variable
1925 that, when found, transforms a regular --partial option (such as
1926 the convenient -P option) into one that also specifies a directory.
1927
1928 - Added --keep-dirlinks (-K), which allows you to symlink a directory
1929 onto another partition on the receiving side and have rsync treat it
1930 as matching a normal directory from the sender.
1931
1932 - Added the --inplace option that tells rsync to write each destination
1933 file without using a temporary file. The matching of existing data
1934 in the destination file can be severely limited by this, but there
1935 are also cases where this is more efficient (such as appending data).
1936 Use only when needed (see the man page for more details).
1937
1938 - Added the "write only" option for the daemon's config file.
1939
1940 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
1941 and documented all these options in the man page.
1942
1943 - Improved the handling of the --bwlimit option so that it's less
1944 bursty, more accurate, and works properly over a larger range of
1945 values.
1946
1947 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
1948 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
1949
1950 - Added the --checksum-seed=N option for advanced users.
1951
1952 - Batch writing/reading has a brand-new implementation that is simpler,
1953 fixes a few weird problems with the old code (such as no longer
1954 sprinkling the batch files into different dirs or even onto different
1955 systems), and is much less intrusive into the code (making it easier
1956 to maintain for the future). The new code generates just one data
1957 file instead of three, which makes it possible to read the batch on
1958 stdin via a remote shell. Also, the old requirement of forcing the
1959 same fixed checksum-seed for all batch processing has been removed.
1960
1961 - If an rsync daemon has a module set with "list = no" (which hides its
1962 presence in the list of available modules), a user that fails to
1963 authenticate gets the same "unknown module" error that they would get
1964 if the module were actually unknown (while still logging the real
1965 error to the daemon's log file). This prevents fishing for module
1966 names.
1967
1968 - The daemon's "refuse options" config item now allows you to match
1969 option names using wildcards and/or the single-letter option names.
1970
1971 - Each transferred file now gets its permissions and modified-time
1972 updated before the temp-file gets moved into place. Previously, the
1973 finished file would have a very brief window where its permissions
1974 disallowed all group and world access.
1975
1976 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
1977 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
1978
1979 - The daemon's wildcard expanding code can now handle more than 1000
1980 filenames (it's now limited by memory instead of having a hard-wired
1981 limit).
1982
1983 INTERNAL:
1984
1985 - Some cleanup in the exclude code has saved some per-exclude memory
1986 and made the code easier to maintain.
1987
1988 - Improved the argv-overflow checking for a remote command that has a
1989 lot of args.
1990
1991 - Use rsyserr() in the various places that were still calling rprintf()
1992 with strerror() as an arg.
1993
1994 - If an rsync daemon is listening on multiple sockets (to handle both
1995 IPv4 and IPv6 to a single port), we now close all the unneeded file
1996 handles after we accept a connection (we used to close just one of
1997 them).
1998
1999 - Optimized the handling of larger block sizes (rsync used to slow to a
2000 crawl if the block size got too large).
2001
2002 - Optimized away a loop in hash_search().
2003
2004 - Some improvements to the sanitize_path() and clean_fname() functions
2005 makes them more efficient and produce better results (while still
2006 being compatible with the file-name cleaning that gets done on both
2007 sides when sending the file-list).
2008
2009 - Got rid of alloc_sanitize_path() after adding a destination-buffer
2010 arg to sanitize_path() made it possible to put all the former's
2011 functionality into the latter.
2012
2013 - The file-list that is output when at least 4 verbose options are
2014 specified reports the uid value on the sender even when rsync is
2015 not running as root (since we might be sending to a root receiver).
2016
2017 BUILD CHANGES:
2018
2019 - Added a "gen" target to rebuild most of the generated files,
2020 including configure, config.h.in, the man pages, and proto.h.
2021
2022 - If "make proto" doesn't find some changes in the prototypes, the
2023 proto.h file is left untouched (its time-stamp used to always be
2024 updated).
2025
2026 - The variable $STRIP (that is optionally set by the install-strip
2027 target's rule) was changed to $INSTALL_STRIP because some systems
2028 have $STRIP already set in the environment.
2029
2030 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
2031
2032 - When cross-compiling, the gettimeofday() function is now assumed to
2033 be a modern version that takes two-args (since we can't test it).
2034
2035 DEVELOPER RELATED:
2036
2037 - The scripts in the testsuite dir were cleaned up a bit and a few
2038 new tests added.
2039
2040 - Some new diffs were added to the patches dir, and some accepted
2041 ones were removed.
2042
2043\f
c7be6dec
WD
2044NEWS for rsync 2.6.2 (30 Apr 2004)
2045Protocol: 28 (unchanged)
2046Changes since 2.6.1:
2047
2048 BUG FIXES:
2049
2050 - Fixed a major bug in the sorting of the filenames when --relative
2051 is used for some sources (just sources such as "/" and "/*" were
2052 affected). This fix ensures that we ask for the right file-list
2053 item when requesting changes from the sender.
2054
2055 - Rsync now checks the return value of the close() function to
2056 better report disk-full problems on an NFS file system.
2057
2058 - Restored the old daemon-server behavior of logging error messages
2059 rather than returning them to the user. (A better long-term fix
2060 will be sought in the future.)
2061
2062 - An obscure uninitialized-variable bug was fixed in the uid/gid
2063 code. (This bug probably had no ill effects.)
2064
2065 BUILD CHANGES:
2066
2067 - Got rid of the configure check for sys/sysctl.h (it wasn't used
2068 and was causing a problem on some systems). Also improved the
2069 broken-largefile-locking test to try to avoid failure due to an
2070 NFS build-dir.
2071
2072 - Fixed a compile problem on systems that don't define
2073 AI_NUMERICHOST.
2074
2075 - Fixed a compile problem in the popt source for compilers that
2076 don't support __attribute__.
2077
2078 DEVELOPER RELATED:
2079
2080 - Improved the testsuite's "merge" test to work on OSF1.
2081
2082 - Two new diffs were added to the patches dir.
2083
2084\f
2085NEWS for rsync 2.6.1 (26 Apr 2004)
2086Protocol: 28 (changed)
2087Changes since 2.6.0:
2088
2089 SECURITY FIXES:
2090
2091 - Paths sent to an rsync daemon are more thoroughly sanitized when
2092 chroot is not used. If you're running a non-read-only rsync
2093 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
2094 user privs you run rsync under is anything above "nobody".
2095
2096 ENHANCEMENTS:
2097
2098 - Lower memory use, more optimal transfer of data over the socket,
2099 and lower CPU usage (see the INTERNAL section for details).
2100
2101 - The RSYNC_PROXY environment variable can now contain a
2102 "USER:PASS@" prefix before the "HOST:PORT" information.
2103 (Bardur Arantsson)
2104
2105 - The --progress output now mentions how far along in the transfer
2106 we are, including both a count of files transferred and a
2107 percentage of the total file-count that we've processed. It also
2108 shows better current-rate-of-transfer and remaining-transfer-time
2109 values.
2110
2111 - Documentation changes now attempt to describe some often mis-
2112 understood features more clearly.
2113
2114 BUG FIXES:
2115
2116 - When -x (--one-file-system) is combined with -L (--copy-links) or
2117 --copy-unsafe-links, no symlinked files are skipped, even if the
2118 referent file is on a different filesystem.
2119
2120 - The --link-dest code now works properly for a non-root user when
2121 (1) the UIDs of the source and destination differ and -o was
2122 specified, or (2) when the group of the source can't be used on
2123 the destination and -g was specified.
2124
2125 - Fixed a bug in the handling of -H (hard-links) that might cause
2126 the expanded PATH/NAME value of the current item to get
2127 overwritten (due to an expanded-name caching bug).
2128
2129 - We now reset the "new data has been sent" flag at the start of
2130 each file we send. This makes sure that an interrupted transfer
2131 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 2132 than the current basis file when no new data has been transferred
c7be6dec
WD
2133 over the wire for that file.
2134
2135 - Fixed a byte-order problem in --batch-mode on big-endian machines.
2136 (Jay Fenlason)
2137
2138 - When using --cvs-exclude, the exclude items we get from a
2139 per-directory's .cvsignore file once again only affect that one
2140 directory (not all following directories too). The items are also
2141 now properly word-split and parsed without any +/- prefix parsing.
2142
2143 - When specifying the USER@HOST: prefix for a file, the USER part
2144 can now contain an '@', if needed (i.e. the last '@' is used to
2145 find the HOST, not the first).
2146
2147 - Fixed some bugs in the handling of group IDs for non-root users:
2148 (1) It properly handles a group that the sender didn't have a name
2149 for (it would previously skip changing the group on any files in
2150 that group). (2) If --numeric-ids is used, rsync no longer
2151 attempts to set groups that the user doesn't have the permission
2152 to set.
2153
2154 - Fixed the "refuse options" setting in the rsyncd.conf file.
2155
2156 - Improved the -x (--one-file-system) flag's handling of any mount-
2157 point directories we encounter. It is both more optimal (in that
2158 it no longer does a useless scan of the contents of the mount-
2159 point dirs) and also fixes a bug where a remapped mount of the
2160 original filesystem could get discovered in a subdir we should be
2161 ignoring.
2162
2163 - Rsync no longer discards a double-slash at the start of a filename
2164 when trying to open the file. It also no longer constructs names
2165 that start with a double slash (unless the user supplied them).
2166
2167 - Path-specifying options to a daemon should now work the same with
2168 or without chroot turned on. Previously, such a option (such as
2169 --link-dest) would get its absolute path munged into a relative
2170 one if chroot was not on, making that setting fairly useless.
2171 Rsync now transforms the path into one that is based on the
2172 module's base dir when chroot is not enabled.
2173
2174 - Fixed a compatibility problem interacting with older rsync
2175 versions that might send us an empty --suffix value without
2176 telling us that --backup-dir was specified.
2177
2178 - The "hosts allow" option for a daemon-over-remote-shell process
2179 now has improved support for IPv6 addresses and a fix for systems
2180 that have a length field in their socket structs.
2181
2182 - Fixed the ability to request an empty backup --suffix when sending
2183 files to an rsync daemon.
2184
920240a6
WD
2185 - Fixed an option-parsing bug when --files-from was sent to a server
2186 sender.
2187
c7be6dec
WD
2188 INTERNAL:
2189
2190 - Most of the I/O is now buffered, which results in a pretty large
2191 speedup when running under MS Windows. (Craig Barratt)
2192
2193 - Optimizations to the name-handling/comparing code have made some
2194 significant reductions in user-CPU time for large file sets.
2195
2196 - Some cleanup of the variable types make the code more consistent.
2197
2198 - Reduced memory requirements of hard link preservation.
2199 (J.W. Schultz)
2200
2201 - Implemented a new algorithm for hard-link handling that speeds up
2202 the code significantly. (J.W. Schultz and Wayne Davison)
2203
2204 - The --hard-link option now uses the first existing file in the
2205 group of linked files as the basis for the transfer. This
2206 prevents the sub-optimal transfer of a file's data when a new
2207 hardlink is added on the sending side and it sorts alphabetically
2208 earlier in the list than the files that are already present on the
2209 receiving side.
2210
2211 - Dropped support for protocol versions less than 20 (2.3.0 released
2212 15 Mar 1999) and activated warnings for protocols less than 25
2213 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
2214 severally)
2215
2216 - More optimal data transmission for --hard-links (protocol 28).
2217
2218 - More optimal data transmission for --checksum (protocol 28).
2219
2220 - Less memory is used when --checksum is specified.
2221
2222 - Less memory is used in the file list (a per-file savings).
2223
2224 - The generator is now better about not modifying the file list
2225 during the transfer in order to avoid a copy-on-write memory
2226 bifurcation (on systems where fork() uses shared memory).
2227 Previously, rsync's shared memory would slowly become unshared,
2228 resulting in real memory usage nearly doubling on the receiving
2229 side by the end of the transfer. Now, as long as permissions
2230 are being preserved, the shared memory should remain that way
2231 for the entire transfer.
2232
2233 - Changed hardlink info and file_struct + strings to use allocation
2234 pools. This reduces memory use for large file-sets and permits
2235 freeing memory to the OS. (J.W. Schultz)
2236
2237 - The 2 pipes used between the receiver and generator processes
2238 (which are forked on the same machine) were reduced to 1 pipe and
2239 the protocol improved so that (1) it is now impossible to have the
2240 "redo" pipe fill up and hang rsync, and (2) trailing messages from
2241 the receiver don't get lost on their way through the generator
2242 over to the sender (which mainly affected hard-link messages and
2243 verbose --stats output).
2244
2245 - Improved the internal uid/gid code to be more portable and a
2246 little more optimized.
2247
2248 - The device numbers sent when using --devices are now sent as
2249 separate major/minor values with 32-bit accuracy (protocol 28).
2250 Previously, the copied devices were sent as a single 32-bit
2251 number. This will make inter-operation of 64-bit binaries more
2252 compatible with their 32-bit brethren (with both ends of the
2253 connection are using protocol 28). Note that optimizations in the
2254 binary protocol for sending the device numbers often results in
2255 fewer bytes being used than before, even though more precision is
2256 now available.
2257
2258 - Some cleanup of the exclude/include structures and its code made
2259 things clearer (internally), simpler, and more efficient.
2260
2261 - The reading & writing of the file-list in batch-mode is now
2262 handled by the same code that sends & receives the list over the
2263 wire. This makes it much easier to maintain. (Note that the
2264 batch code is still considered to be experimental.)
2265
2266 BUILD CHANGES:
2267
2268 - The configure script now accepts --with-rsyncd-conf=PATH to
2269 override the default value of the /etc/rsyncd.conf file.
2270
2271 - Fixed configure bug when running "./configure --disable-ipv6".
2272
2273 - Fixed compilation problem on Tru64 Unix (having to do with
2274 sockaddr.sa_len and sockaddr.sin_len).
2275
2276 DEVELOPER RELATED:
2277
2278 - Fixed "make test" bug when build dir is not the source dir.
2279
2280 - Added a couple extra diffs in the "patches" dir, removed the ones
2281 that got applied, and rebuilt the rest.
2282
2283\f
0f1aa0d3
WD
2284NEWS for rsync 2.6.0 (1 Jan 2004)
2285Protocol: 27 (changed)
2286Changes since 2.5.7:
2287
2288 ENHANCEMENTS:
2289
2290 * "ssh" is now the default remote shell for rsync. If you want to
2291 change this, configure like this: "./configure --with-rsh=rsh".
2292
2293 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
2294 Note that --from0 affects the line-ending character for all the
2295 files read by the --*-from options. (Wayne Davison)
2296
2297 * Length of csum2 is now per-file starting with protocol version
2298 27. (J.W. Schultz)
2299
2300 * Per-file dynamic block size is now sqrt(file length). The
2301 per-file checksum size is determined according to an algorithm
2302 provided by Donovan Baarda which reduces the probability of rsync
2303 algorithm corrupting data and falling back using the whole md4
2304 checksums. (J.W. Schultz, Donovan Baarda)
2305
2306 * The --stats option no longer includes the (debug) malloc summary
2307 unless the verbose option was specified at least twice.
2308
2309 * Added a new error/warning code for when files vanish from the
2310 sending side. Made vanished source files not interfere with the
2311 file-deletion pass when --delete-after was specified.
2312
2313 * Various trailing-info sections are now preceded by a newline.
2314
2315 BUG FIXES:
2316
2317 * Fixed several exclude/include matching bugs when using wild-cards.
2318 This has a several user-visible effects, all of which make the
2319 matching more consistent and intuitive. This should hopefully not
2320 cause anyone problems since it makes the matching work more like
2321 what people are expecting. (Wayne Davison)
2322
2323 - A pattern with a "**" no longer causes a "*" to match slashes.
2324 For example, with "/*/foo/**", "foo" must be 2 levels deep.
2325 [If your string has BOTH "*" and "**" wildcards, changing the
2326 "*" wildcards to "**" will provide the old behavior in all
2327 versions.]
2328
2329 - "**/foo" now matches at the base of the transfer (like /foo
2330 does). [Use "/**/foo" to get the old behavior in all versions.]
2331
2332 - A non-anchored wildcard term floats to match beyond the base of
2333 the transfer. E.g. "CVS/R*" matches at the end of the path,
2334 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
2335 to get the old behavior in all versions.]
2336
2337 - Including a "**" in the match term causes it to be matched
2338 against the entire path, not just the name portion, even if
2339 there aren't any interior slashes in the term. E.g. "foo**bar"
2340 would exclude "/path/foo-bar" (just like before) as well as
2341 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
2342 old behavior in all versions.]
2343
2344 * The exclude list specified in the daemon's config file is now
2345 properly applied to the pulled items no matter how deep the
2346 user's file-args are in the source tree. (Wayne Davison)
2347
2348 * For protocol version >= 27, mdfour_tail() is called when the
2349 block size (including checksum_seed) is a multiple of 64.
2350 Previously it was not called, giving the wrong MD4 checksum.
2351 (Craig Barratt)
2352
2353 * For protocol version >= 27, a 64 bit bit counter is used in
2354 mdfour.c as required by the RFC. Previously only a 32 bit bit
2355 counter was used, causing incorrect MD4 file checksums for
2356 file sizes >= 512MB - 4. (Craig Barratt)
2357
2358 * Fixed a crash bug when interacting with older rsync versions and
2359 multiple files of the same name are destined for the same dir.
2360 (Wayne Davison)
2361
2362 * Keep tmp names from overflowing MAXPATHLEN.
2363
2364 * Make --link-dest honor the absence of -p, -o, and -g.
2365
2366 * Made rsync treat a trailing slash in the destination in a more
2367 consistent manner.
2368
2369 * Fixed file I/O error detection. (John Van Essen)
2370
2371 * Fixed bogus "malformed address {hostname}" message in rsyncd log
2372 when checking IP address against hostnames from "hosts allow"
2373 and "hosts deny" parameters in config file.
2374
2375 * Print heap statistics when verbose >= 2 instead of when >= 1.
2376
2377 * Fixed a compression (-z) bug when syncing a mostly-matching file
2378 that contains already-compressed data. (Yasuoka Masahiko and
2379 Wayne Davison)
2380
2381 * Fixed a bug in the --backup code that could cause deleted files
2382 to not get backed up.
2383
2384 * When the backup code makes new directories, create them with mode
2385 0700 instead of 0755 (since the directory permissions in the
2386 backup tree are not yet copied from the main tree).
2387
2388 * Call setgroups() in a more portable manner.
2389
2390 * Improved file-related error messages to better indicate exactly
2391 what pathname failed. (Wayne Davison)
2392
2393 * Fixed some bugs in the handling of --delete and --exclude when
2394 using the --relative (-R) option. (Wayne Davison)
2395
2396 * Fixed bug that prevented regular files from replacing
2397 special files and caused a directory in --link-dest or
2398 --compare-dest to block the creation of a file with the
2399 same path. A directory still cannot be replaced by a
2400 regular file unless --delete specified. (J.W. Schultz)
2401
2402 * Detect and report when open or opendir succeed but read and
2403 readdir fail caused by network filesystem issues and truncated
2404 files. (David Norwood, Michael Brown, J.W. Schultz)
2405
2406 * Added a fix that should give ssh time to restore the tty settings
2407 if the user presses Ctrl-C at an ssh password prompt.
2408
2409 INTERNAL:
2410
2411 * Eliminated vestigial support for old versions that we stopped
2412 supporting. (J.W. Schultz)
2413
2414 * Simplified some of the option-parsing code. (Wayne Davison)
2415
2416 * Some cleanup made to the exclude code, as well as some new
2417 defines added to enhance readability. (Wayne Davison)
2418
2419 * Changed the protocol-version code so that it can interact at a
2420 lower protocol level than the maximum supported by both sides.
2421 Added an undocumented option, --protocol=N, to force the value
2422 we advertise to the other side (primarily for testing purposes).
2423 (Wayne Davison)
2424
2425\f
276877cf
WD
2426NEWS for rsync 2.5.7 (4 Dec 2003)
2427Protocol: 26 (unchanged)
2428Changes since 2.5.6:
2429
2430 SECURITY FIXES:
2431
2432 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
2433 Russell, Andrea Barisani)
2434
2435\f
2436NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
2437Protocol: 26 (unchanged)
2438Changes since 2.5.5:
2439
2440 ENHANCEMENTS:
2441
2442 * The --delete-after option now implies --delete. (Wayne Davison)
2443
2444 * The --suffix option can now be used with --backup-dir. (Michael
2445 Zimmerman)
2446
a923437b 2447 * Combining "::" syntax with the --rsh/-e option now uses the
276877cf
WD
2448 specified remote-shell as a transport to talk to a (newly-spawned)
2449 server-daemon. This allows someone to use daemon features, such
2450 as modules, over a secure protocol, such as ssh. (JD Paul)
2451
2452 * The rsync:// syntax for daemon connections is now accepted in the
2453 destination field.
2454
2455 * If the file name given to --include-from or --exclude-from is "-",
2456 rsync will read from standard input. (J.W. Schultz)
2457
2458 * New option --link-dest which is like --compare-dest except that
2459 unchanged files are hard-linked in to the destination directory.
2460 (J.W. Schultz)
2461
2462 * Don't report an error if an excluded file disappears during an
2463 rsync run. (Eugene Chupriyanov and Bo Kersey)
2464
2465 * Added .svn to --cvs-exclude list to support subversion. (Jon
2466 Middleton)
2467
2468 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
2469 and "hosts deny" fields. (Hideaki Yoshifuji)
2470
2471 * Changed exclude file handling to permit DOS or MAC style line
2472 terminations. (J.W. Schultz)
2473
2474 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
2475 (Dave Dykstra)
2476
2477 BUG FIXES:
2478
2479 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
2480 L. Allen, Martin Pool)
2481
2482 * Generate each file's rolling-checksum data as we send it, not
2483 in a separate (memory-eating) pass before hand. This prevents
2484 timeout errors on really large files. (Stefan Nehlsen)
2485
2486 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
2487
2488 * Better handling of some client-server errors. (Martin Pool)
2489
2490 * Fixed a crash that would occur when sending a list of files that
2491 contains a duplicate name (if it sorts to the end of the file
2492 list) and using --delete. (Wayne Davison)
2493
2494 * Fixed the file-name duplicate-removal code when dealing with multiple
2495 dups in a row. (Wayne Davison)
2496
2497 * Fixed a bug that caused rsync to lose the exit status of its child
2498 processes and sometimes return an exit code of 0 instead of showing
2499 an error. (David R. Staples, Dave Dykstra)
2500
2501 * Fixed bug in --copy-unsafe-links that caused it to be completely
2502 broken. (Dave Dykstra)
2503
2504 * Prevent infinite recursion in cleanup code under certain circumstances.
2505 (Sviatoslav Sviridov and Marc Espie)
2506
2507 * Fixed a bug that prevented rsync from creating intervening directories
2508 when --relative-paths/-R is set. (Craig Barratt)
2509
2510 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
2511
2512 INTERNAL:
2513
2514 * Many code cleanups and improved internal documentation. (Martin
2515 Pool, Nelson Beebe)
2516
2517 * Portability fixes. (Dave Dykstra and Wayne Davison)
2518
2519 * More test cases. (Martin Pool)
2520
2521 * Some test-case fixes. (Brian Poole, Wayne Davison)
2522
2523 * Updated included popt to the latest vendor drop, version 1.6.4.
2524 (Jos Backus)
2525
2526 * Updated config.guess and config.sub to latest versions; this
2527 means rsync should build on more platforms. (Paul Green)
2528
2529\f
2530NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
2531Protocol: 26 (unchanged)
2532Changes since 2.5.4:
54c7298c
MP
2533
2534 ENHANCEMENTS:
2535
2536 * With --progress, when a transfer is complete show the time taken;
2537 otherwise show expected time to complete. (Cameron Simpson)
2538
2539 * Make "make install-strip" works properly, and "make install"
2540 accepts a DESTDIR variable for help in building binary packages.
2541 (Peter Breitenlohner, Greg Louis)
2542
2543 * If configured with --enable-maintainer-mode, then on receipt of
2544 a fatal signal rsync will try to open an xterm running gdb,
2545 similarly to Samba's "panic action" or GNOME's bug-buddy.
2546 (Martin Pool)
2547
2548
2549 BUG FIXES:
2550
2551 * Fix situation where failure to fork (e.g. because out of process
2552 slots) would cause rsync to kill all processes owned by the
2553 current user. Yes, really! (Paul Haas, Martin Pool)
2554
2555 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
2556
2557 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
2558 Pool.)
2559
2560 * Fix --whole-file problem that caused it to be the default even
2561 for remote connections. (Martin Pool, Frank Schulz)
2562
2563 * Work around bug in Mac OS X mkdir(2), which cannot handle
2564 trailing slashes.
2565 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
2566 (Martin Pool)
2567
2568 * Improved network error handling. (Greg A. Woods)
2569
2570\f
276877cf
WD
2571NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
2572Protocol: 26 (unchanged)
2573Changes since 2.5.3:
c9a66d41
MP
2574
2575 BUG FIXES:
2576
2577 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
2578 Tridgell) (CVE CAN-2002-0059)
276877cf 2579
c9a66d41
MP
2580 ENHANCEMENTS:
2581
2582 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
2583 (Note that rsync still uses a custom version of zlib; you can
2584 not just link against a system library. See zlib/README.rsync)
2585
2586 * Additional test cases for --compress. (Martin Pool)
2587
2588\f
276877cf
WD
2589NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
2590Protocol: 26 (unchanged)
2591Changes since 2.5.2:
d40fb723
MP
2592
2593 SECURITY FIXES:
2594
2595 * Make sure that supplementary groups are removed from a server
2596 process after changing uid and gid. (Ethan Benson) (Debian bug
2597 #132272, CVE CAN-2002-0080)
2598
2599 BUG FIXES:
2600
2601 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
2602 CAN-2002-0059)
2603
276877cf 2604 * Fixed problem that in many cases caused the error message
d40fb723
MP
2605 unexpected read size of 0 in map_ptr
2606 and resulted in the wrong data being copied.
2607
2608 * Fixed compilation errors on some systems caused by the use of
2609 "unsigned int64" in rsync.h.
2610
2611 * Fixed problem on systems such as Sunos4 that do not support realloc
2612 on a NULL pointer; error was "out of memory in flist_expand".
2613
2614 * Fix for rsync server processes hanging around after the client
2615 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
2616
2617 * Cope with BSD systems on which mkdir() will not accept a trailing
2618 slash.
2619
2620 ENHANCEMENTS:
2621
2622 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
2623 rsync still uses a custom version of zlib; you can not just link
2624 against a system library. See zlib/README.rsync)
276877cf 2625
d40fb723
MP
2626 * Command to initiate connections is only shown with -vv, rather
2627 than -v as in 2.5.2. Output from plain -v is more similar to
2628 what was historically used so as not to break scripts that try
2629 to parse the output.
2630
2631 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
2632
2633 * Made the --write-batch and --read-batch options actually work
2634 and added documentation in the man page (Jos Backus)
2635
2636 * If the daemon is unable to fork a child to accept a connection,
2637 print an error message. (Colin Walters)
2638
276877cf
WD
2639\f
2640NEWS for rsync 2.5.2 (26 Jan 2002)
2641Protocol: 26 (changed)
2642Changes since 2.5.1:
97efa5c3
MP
2643
2644 SECURITY FIXES:
2645
2646 * Signedness security patch from Sebastian Krahmer
2647 <krahmer@suse.de> -- in some cases we were not sufficiently
2648 careful about reading integers from the network.
2649
2650 BUG FIXES:
2651
2652 * Fix possible string mangling in log files.
2653
2654 * Fix for setting local address of outgoing sockets.
2655
2656 * Better handling of hardlinks and devices on platforms with
2657 64-bit dev_t or ino_t.
2658
2659 * Name resolution on machines supporting IPv6 is improved.
2660
2661 * Fix for device nodes. (dann frazier) (Debian #129135)
2662
2663 ENHANCEMENTS:
2664
2665 * With -v, rsync now shows the command used to initiate an ssh/rsh
2666 connection.
2667
2668 * --statistics now shows memory heap usage on platforms that
276877cf 2669 support mallinfo().
97efa5c3
MP
2670
2671 * "The Ted T'so school of program optimization": make progress
2672 visible and people will think it's faster. (With --progress,
2673 rsync will show you how many files it has seen as it builds the
2674 file_list, giving some indication that it has not hung.)
2675
2676 * Improvements to batch mode support. This is still experimental
2677 but testing would be welcome. (Jos Backus)
276877cf 2678
97efa5c3
MP
2679 * New --ignore-existing option, patch previously distributed with
2680 Vipul's Razor. (Debian #124286)
2681
276877cf
WD
2682\f
2683NEWS for rsync 2.5.1 (3 Jan 2002)
2684Protocol: 25 (unchanged)
2685Changes since 2.5.0:
2686
2687 BUG FIXES:
499957d9 2688
499957d9
MP
2689 * Fix for segfault in --daemon mode configuration parser. (Paul
2690 Mackerras)
2691
2692 * Correct string<->address parsing for both IPv4 and 6.
2693 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
2694 Hagino)
2695
2696 * Various fixes for IPv6 support. (Dave Dykstra)
2697
2698 * rsync.1 typo fix. (Matt Kraai)
2699
2700 * Test suite typo fixes. (Tom Schmidt)
2701
2702 * rsync.1 grammar and clarity improvements. (Edward
2703 Welbourne)
2704
2705 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
2706
2707 ENHANCEMENTS:
2708
2709 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
2710 multiple of bytes/s) and estimated time to completion. (Rik
2711 Faith)
2712
499957d9 2713 * --no-detach option, required to run as a W32 service and also
276877cf
WD
2714 useful when running on Unix under daemontools, AIX's SRC, or a
2715 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
2716
2717 * Clearer error messages for some conditions.
2718
c9a66d41 2719\f
276877cf
WD
2720NEWS for rsync 2.5.0 (30 Nov 2001)
2721Protocol: 25 (changed)
2722Changes since 2.4.6:
d313ae7d
MP
2723
2724 ANNOUNCEMENTS
2725
2726 * Martin Pool <mbp@samba.org> is now a co-maintainer.
2727
2728 NEW FEATURES
2729
2730 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
2731
2732 * Shell wildcards are allowed in "auth users" lines.
2733
2734 * Merged UNC rsync+ patch to support creation of standalone patch
2735 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
2736 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
2737
2738 * IPv6 support based on a patch from KAME.net, on systems
2739 including modern versions of Linux, Solaris, and HP-UX. Also
2740 includes IPv6 compatibility functions for old OSs by the
2741 Internet Software Consortium, Paul Vixie, the OpenSSH
2742 portability project, and OpenBSD.
2743
2744 ENHANCEMENTS
2745
2746 * Include/exclude cluestick: with -vv, print out whether files are
2747 included or excluded and why.
2748
2749 * Many error messages have more friendly explanations and more
2750 details.
2751
2752 * Manual page improvements plus scanty protocol documentation.
2753
2754 * When running as --daemon in the background and using a "log
2755 file" rsyncd.conf directive, close the log file every time it is
2756 open when going to sleep on the socket. This allows the log
2757 file to get cleaned out by another process.
2758
2759 * Change to using libpopt rather than getopt for processing
2760 options. This makes the code cleaner and the behaviour more
2761 consistent across platforms. popt is included and built if not
2762 installed on the platform.
2763
2764 * More details in --version, including note about whether 64-bit
2765 files, symlinks and hardlinks are supported.
2766
2767 * MD4 code may use less CPU cycles.
2768
2769 * Use mkstemp on systems where it is secure. If we use mktemp,
2770 explain that we do it in a secure way.
2771
2772 * --whole-file is the default when source and target are on the
2773 local machine.
2774
2775 BUG FIXES:
2776
2777 * Fix for various bugs causing rsync to hang.
2778
2779 * Attempt to fix Large File Summit support on AIX.
2780
2781 * Attempt to fix error handling lockup bug.
2782
2783 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 2784 to transfer fail to transfer.
d313ae7d
MP
2785
2786 * For log messages containing ridiculously long strings that might
2787 overflow a buffer rsync no longer aborts, but rather prints an
2788 ellipsis at the end of the string. (Patch from Ed Santiago.)
2789
2790 PLATFORMS:
2791
2792 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
2793
2794 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 2795 scripts. It is not required to simply build rsync.
d313ae7d
MP
2796
2797 * Platforms thought to work in this release:
2798
2799 Cray SV1 UNICOS 10.0.0.8 cc
2800 Debian Linux 2.2 UltraSparc gcc
2801 Debian Linux testing/unstable ARM gcc
2802 FreeBSD 3.3-RELEASE i386 cc
2803 FreeBSD 4.1.1-RELEASE i386 cc
2804 FreeBSD 4.3-STABLE i386 cc
2805 HP PA-RISC HP-UX 10.20 gcc
2806 HP PA-RISC HP-UX 11.11 cc
2807 IRIX 6.5 MIPS cc
2808 IRIX 6.5 MIPS gcc
2809 Mac OS X PPC (--disable-ipv6) cc
2810 NetBSD 1.5 i386 gcc
2811 NetBSD Current i386 cc
2812 OpenBSD 2.5 Sparc gcc
2813 OpenBSD 2.9 i386 cc
2814 OpenBSD Current i386 cc
2815 RedHat 6.2 i386 gcc
2816 RedHat 6.2 i386 insure++
2817 RedHat 7.0 i386 gcc
2818 RedHat 7.1 i386 (Kernel 2.4.10) gcc
2819 Slackware 8.0 i686 (Kernel 2.4.10)
2820 Solaris 8 UltraSparc cc
2821 Solaris 8 UltraSparc gcc
2822 Solaris 8 i386 gcc
2823 SuSE 7.1 i386 gcc2.95.2
2824 SuSE 7.1 ppc gcc2.95.2
2825 i386-pc-sco3.2v5.0.5 cc
2826 i386-pc-sco3.2v5.0.5 gcc
2827 powerpc-ibm-aix4.3.3.0 cc
2828 i686-unknown-sysv5UnixWare7.1.0 gcc
2829 i686-unknown-sysv5UnixWare7.1.0 cc
2830
2831 TESTING:
2832
2833 * The existing test.sh script by Phil Hands has been merged into a
2834 test framework that works from both "make check" and the Samba
2835 build farm.
3742bf3a
S
2836\f
2837Partial Protocol History
f7e48a5c 2838 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
93f3fbf7 2839 ?? ??? 2008 3.1.0 30
db8f3f73 2840 29 Jun 2008 3.0.3 30
8ba802f3 2841 08 Apr 2008 3.0.2 30
325c2432 2842 03 Apr 2008 3.0.1 30
4cb6197b 2843 01 Mar 2008 3.0.0 11 Nov 2006 30
0c6d7952 2844 06 Nov 2006 2.6.9 29
4177f09b 2845 22 Apr 2006 2.6.8 29
a058cbc4 2846 11 Mar 2006 2.6.7 29
cbc63b9b 2847 28 Jul 2005 2.6.6 29
2dfe1c37 2848 01 Jun 2005 2.6.5 29
f7e48a5c 2849 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 2850 30 Sep 2004 2.6.3 28
c7be6dec
WD
2851 30 Apr 2004 2.6.2 28
2852 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
2853 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
2854 04 Dec 2003 2.5.7 26
2855 26 Jan 2003 2.5.6 26
2856 02 Apr 2002 2.5.5 26
2857 13 Mar 2002 2.5.4 26
2858 11 Mar 2002 2.5.3 26
2859 26 Jan 2002 2.5.2 11 Jan 2002 26
2860 03 Jan 2002 2.5.1 25
2861 30 Nov 2001 2.5.0 23 Aug 2001 25
2862 06 Sep 2000 2.4.6 24
2863 19 Aug 2000 2.4.5 24
2864 29 Jul 2000 2.4.4 24
2865 09 Apr 2000 2.4.3 24
2866 30 Mar 2000 2.4.2 24
2867 30 Jan 2000 2.4.1 29 Jan 2000 24
2868 29 Jan 2000 2.4.0 28 Jan 2000 23
2869 25 Jan 2000 2.3.3 23 Jan 2000 22
2870 08 Nov 1999 2.3.2 26 Jun 1999 21
2871 06 Apr 1999 2.3.1 20
2872 15 Mar 1999 2.3.0 15 Mar 1999 20
2873 25 Nov 1998 2.2.1 19
2874 03 Nov 1998 2.2.0 19
2875 09 Sep 1998 2.1.1 19
2876 20 Jul 1998 2.1.0 19
2877 17 Jul 1998 2.0.19 19
2878 18 Jun 1998 2.0.17 19
2879 01 Jun 1998 2.0.16 19
2880 27 May 1998 2.0.13 27 May 1998 19
2881 26 May 1998 2.0.12 18
2882 22 May 1998 2.0.11 18
2883 18 May 1998 2.0.9 18 May 1998 18
2884 17 May 1998 2.0.8 17
2885 15 May 1998 2.0.1 17
2886 14 May 1998 2.0.0 17
2887 17 Apr 1998 1.7.4 17
2888 13 Apr 1998 1.7.3 17
2889 05 Apr 1998 1.7.2 17
2890 26 Mar 1998 1.7.1 17
2891 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
2892 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
2893
2894* DATE OF COMMIT is the date the protocol change was committed to CVS.