Preparing for release of 3.0.2
[rsync/rsync.git] / OLDNEWS
CommitLineData
0917f581
WD
1NEWS for rsync 3.0.1 (3 Apr 2008)
2Protocol: 30 (unchanged)
3Changes since 3.0.0:
4
5 NOTABLE CHANGES IN BEHAVIOR:
6
7 - Added the 'c'-flag to the itemizing of non-regular files so that the
8 itemized output doesn't get hidden if there were no attribute changes,
9 and also so that the itemizing of a --copy-links run will distinguish
10 between copying an identical non-regular file and the creation of a
11 revised version with a new value (e.g. a changed symlink referent, a
12 new device number, etc.).
13
14 BUG FIXES:
15
16 - Fixed a crash bug when a single-use rsync daemon (via remote shell) was
17 run without specifying a --config=FILE option.
18
19 - Fixed a crash when backing up a directory that has a default ACL.
20
21 - Fixed a bug in the handling of xattr values that could cause rsync to
22 not think that a file's extended attributes are up-to-date.
23
24 - Fixed the working of --fake-super with --link-dest and --xattrs.
25
26 - Fixed a hang when combining --dry-run with --remove-source-files.
27
28 - Fixed a bug with --iconv's handling of files that cannot be converted:
29 a failed name can no longer cause a transfer failure.
30
31 - Fixed the building of the rounding.h file on systems that need custom
32 CPPFLAGS to be used. Also improved the error reporting if the building
33 of rounding.h fails.
34
35 - Fixed the use of the --protect-args (-s) option when talking to a daemon.
36
37 - Fixed the --ignore-existing option's protection of files on the receiver
38 that are non-regular files on the sender (e.g. if a symlink or a dir on
39 the sender is trying to replace a file on the receiver). The reverse
40 protection (protecting a dir/symlink/device from being replaced by a
41 file) was already working.
42
43 - Fixed an assert failure if --hard-links is combined with an option that
44 can skip a file in a set of hard-linked files (i.e. --ignore-existing,
45 --append, etc.), without skipping all the files in the set.
46
47 - Avoid setting the modify time on a directory that already has the right
48 modify time set. This avoids tweaking the dir's ctime.
49
50 - Improved the daemon-exclude handling to do a better job of applying the
51 exclude rules to path entries. It also sends the user an error just as
52 if the files were actually missing (instead of silently ignoring the
53 user's args), and avoids sending the user the filter-action messages
54 for these non-user-initiated rules.
55
56 - Fixed some glitches with the dry-run code's missing-directory
57 handling, including a problem when combined with --fuzzy.
58
59 - Fixed some glitches with the skipped-directory handling.
60
61 - Fixed the 'T'-flag itemizing of symlinks when --time isn't preserved.
62
63 - Fixed a glitch in the itemizing of permissions with the -E option.
64
65 - The --append option's restricting of transfers to those that add data no
66 longer prevents the updating of non-content changes to otherwise up-to-
67 date files (i.e. those with the same content but differing permissions,
68 ownership, xattrs, etc.).
69
70 - Don't allow --fake-super to be specified with -XX (double --xattrs)
71 because the options conflict. If a daemon has "fake super" enabled,
72 it automatically downgrades a -XX request to -X.
73
74 - Fixed a couple bugs in the parsing of daemon-config excludes that could
75 make a floating exclude rule get treated as matching an absolute path.
76
77 - A daemon doesn't try to auto-refuse the "iconv" option if iconv-support
78 wasn't compiled in to the daemon (avoiding a warning in the logs).
79
80 - Fixed the inclusion of per-dir merge files from implied dirs.
81
82 - Fixed the support/rrsync script to work with the latest options that
83 rsync sends (including its flag-specifying use of -e to the server).
84
85 ENHANCEMENTS:
86
87 - Added the --old-dirs (--old-d) option to make it easier for a user to
88 ask for file-listings with older rsync versions (this is easier than
89 having to type "-r --exclude='/*/*'" manually).
90
91 - When getting an error while asking an older rsync daemon for a file
92 listing, rsync will try to notice if the error is a rejection of the
93 --dirs (-d) option and let the user know how to work around the issue.
94
95 - Added a few more --no-OPTION overrides.
96
97 - Improved the documentation of the --append option.
98
99 - Improved the documentation of the filter/exclude/include daemon
100 parameters.
101
102 INTERNAL:
103
104 - Fixed a couple minor bugs in the included popt library (ones which I
105 sent to the official popt project for inclusion in the 1.14 release).
106
107 - Fixed a stat() call that should have been do_stat() so that the proper
108 normal/64-bit stat() function gets called. (Was in an area that should
109 not have caused problems, though.)
110
111 - Changed the file-glob code to do a directory scan without using the
112 "glob" and "glob.h". This lets us do the globbing with less memory
113 churn, and also avoid adding daemon-excluded items to the returned
114 args.
115
116 DEVELOPER RELATED:
117
118 - The configure script tries to get the user's compiler to not warn about
119 unused function parameters if the build is not including one or more of
120 the ACL/xattrs/iconv features.
121
122 - The configure script now has better checks for figuring out if the
123 included popt code should be used or not.
124
125 - Fixed two testsuite glitches: avoid a failure if someone's "cd" command
126 outputs the current directory when cd-ing to a relative path, and made
127 the itemized test query how rsync was built to determine if it should
128 expect hard-linked symlinks or not.
129
130 - Updated the testsuite to verify that various bug fixes remain fixed.
131
132 - The RPM spec file was updated to have: (1) comments for how to use the
133 rsync-patch tar file, and (2) an /etc/xinetd.d/rsync file.
134
135 - Updated the build scripts to work with a revised FTP directory
136 structure.
137
138\f
3cbe640d
WD
139NEWS for rsync 3.0.0 (1 Mar 2008)
140Protocol: 30 (changed)
141Changes since 2.6.9:
142
143 NOTABLE CHANGES IN BEHAVIOR:
144
145 - The handling of implied directories when using --relative has changed to
146 send them as directories (e.g. no implied dir is ever sent as a symlink).
147 This avoids unexpected behavior and should not adversely affect most
148 people. If you're one of those rare individuals who relied upon having
149 an implied dir be duplicated as a symlink, you should specify the
150 transfer of the symlink and the transfer of the referent directory as
151 separate args. (See also --keep-dirlinks and --no-implied-dirs.)
152 Also, exclude rules no longer have a partial effect on implied dirs.
153
154 - Requesting a remote file-listing without specifying -r (--recursive) now
155 sends the -d (--dirs) option to the remote rsync rather than sending -r
156 along with an extra exclude of /*/*. If the remote rsync does not
157 understand the -d option (i.e. it is 2.6.3 or older), you will need to
158 either turn off -d (--no-d), or specify -r --exclude='/*/*' manually.
159
160 - In --dry-run mode, the last line of the verbose summary text is output
161 with a "(DRY RUN)" suffix to help remind you that no updates were made.
162 Similarly, --only-write-batch outputs "(BATCH ONLY)".
163
164 - A writable rsync daemon with "use chroot" disabled now defaults to a
165 symlink-munging behavior designed to make symlinks safer while also
166 allowing absolute symlinks to be stored and retrieved. This also has
167 the effect of making symlinks unusable while they're in the daemon's
168 hierarchy. See the daemon's "munge symlinks" parameter for details.
169
170 - Starting up an extra copy of an rsync daemon will not clobber the pidfile
171 for the running daemon -- if the pidfile exists, the new daemon will exit
172 with an error. This means that your wrapper script that starts the rsync
173 daemon should be made to handle lock-breaking (if you want any automatic
174 breaking of locks to be done).
175
176 BUG FIXES:
177
178 - A daemon with "use chroot = no" and excluded items listed in the daemon
179 config file now properly checks an absolute-path arg specified for these
180 options: --compare-dest, --link-dest, --copy-dest, --partial-dir,
181 --backup-dir, --temp-dir, and --files-from.
182
183 - A daemon can now be told to disable all user- and group-name translation
184 on a per-module basis. This avoids a potential problem with a writable
185 daemon module that has "use chroot" enabled -- if precautions weren't
186 taken, a user could try to add a missing library and get rsync to use
187 it. This makes rsync safer by default, and more configurable when id-
188 translation is not desired. See the daemon's "numeric ids" parameter
189 for full details.
190
191 - A chroot daemon can now indicate which part of its path should affect the
192 chroot call, and which part should become an inside-chroot path for the
193 module. This allows you to have outside-the-transfer paths (such as for
194 libraries) even when you enable chroot protection. The idiom used in the
195 rsyncd.conf file is: path = /chroot/dirs/./dirs/inside
196
197 - If a file's data arrived successfully on the receiving side but the
198 rename of the temporary file to the destination file failed AND the
199 --remove-source-files (or the deprecated --remove-sent-files) option
200 was specified, rsync no longer erroneously removes the associated
201 source file.
202
203 - Fixed the output of -ii when combined with one of the --*-dest options:
204 it now itemizes all the items, not just the changed ones.
205
206 - Made the output of all file types consistent when using a --*-dest
207 option. Prior versions would output too many creation events for
208 matching items.
209
210 - The code that waits for a child pid now handles being interrupted by a
211 signal. This fixes a problem with the pre-xfer exec function not being
212 able to get the exit status from the script.
213
214 - A negated filter rule (i.e. with a '!' modifier) no longer loses the
215 negation when sending the filter rules to the remote rsync.
216
217 - Fixed a problem with the --out-format (aka --log-format) option %f: it
218 no longer outputs superfluous directory info for a non-daemon rsync.
219
220 - Fixed a problem with -vv (double --verbose) and --stats when "pushing"
221 files (which includes local copies). Version 2.6.9 would complete the
222 copy, but exit with an error when the receiver output its memory stats.
223
224 - If --password-file is used on a non-daemon transfer, rsync now complains
225 and exits. This should help users figure out that they can't use this
226 option to control a remote shell's password prompt.
227
228 - Make sure that directory permissions of a newly-created destination
229 directory are handled right when --perms is left off.
230
231 - The itemized output of a newly-created destination directory is now
232 output as a creation event, not a change event.
233
234 - Improved --hard-link so that more corner cases are handled correctly
235 when combined with options such as --link-dest and/or --ignore-existing.
236
237 - The --append option no longer updates a file that has the same size.
238
239 - Fixed a bug when combining --backup and --backup-dir with --inplace:
240 any missing backup directories are now created.
241
242 - Fixed a bug when using --backup and --inplace with --whole-file or
243 --read-batch: backup files are actually created now.
244
245 - The daemon pidfile is checked and created sooner in the startup sequence.
246
247 - If a daemon module's "path" value is not an absolute pathname, the code
248 now makes it absolute internally (making it work properly).
249
250 - Ensure that a temporary file always has owner-write permission while we
251 are writing to it. This avoids problems with some network filesystems
252 when transfering read-only files.
253
254 - Any errors output about password-file reading no longer cause an error at
255 the end of the run about a partial transfer.
256
257 - The --read-batch option for protocol 30 now ensures that several more
258 options are set correctly for the current batch file: --iconv, --acls,
259 --xattrs, --inplace, --append, and --append-verify.
260
261 - Using --only-write-batch to a daemon receiver now works properly (older
262 versions would update some files while writing the batch).
263
264 - Avoid outputting a "file has vanished" message when the file is a broken
265 symlink and --copy-unsafe-links or --copy-dirlinks is used (the code
266 already handled this for --copy-links).
267
268 - Fixed the combination of --only-write-batch and --dry-run.
269
270 - Fixed rsync's ability to remove files that are not writable by the file's
271 owner when rsync is running as the same user.
272
273 ENHANCEMENTS:
274
275 - A new incremental-recursion algorithm is now used when rsync is talking
276 to another 3.x version. This starts the transfer going more quickly
277 (before all the files have been found), and requires much less memory.
278 See the --recursive option in the manpage for some restrictions.
279
280 - Lowered memory use in the non-incremental-recursion algorithm for typical
281 option values (usually saving from 21-29 bytes per file).
282
283 - The default --delete algorithm is now --delete-during when talking to a
284 3.x rsync. This is a faster scan than using --delete-before (which is
285 the default when talking to older rsync versions), and is compatible with
286 the new incremental recursion mode.
287
288 - Rsync now allows multiple remote-source args to be specified rather than
289 having to rely on a special space-splitting side-effect of the remote-
290 shell. Additional remote args must specify the same host or an empty one
291 (e.g. empty: :file1 or ::module/file2). For example, this means that
292 local use of brace expansion now works: rsync -av host:dir/{f1,f2} .
293
294 - Added the --protect-args (-s) option, that tells rsync to send most of
295 the command-line args at the start of the transfer rather than as args
296 to the remote-shell command. This protects them from space-splitting,
297 and only interprets basic wildcard special shell characters (*?[).
298
299 - Added the --delete-delay option, which is a more efficient way to delete
300 files at the end of the transfer without needing a separate delete pass.
301
302 - Added the --acls (-A) option to preserve Access Control Lists. This is
303 an improved version of the prior patch that was available, and it even
304 supports OS X ACLs. If you need to have backward compatibility with old,
305 ACL-patched versions of rsync, apply the acls.diff file from the patches
306 dir.
307
308 - Added the --xattrs (-X) option to preserve extended attributes. This is
309 an improved version of the prior patch that was available, and it even
310 supports OS X xattrs (which includes their resource fork data). If you
311 need to have backward compatibility with old, xattr-patched versions of
312 rsync, apply the xattrs.diff file from the patches dir.
313
314 - Added the --fake-super option that allows a non-super user to preserve
315 all attributes of a file by using a special extended-attribute idiom.
316 It even supports the storing of foreign ACL data on your backup server.
317 There is also an analogous "fake super" parameter for an rsync daemon.
318
319 - Added the --iconv option, which allows rsync to convert filenames from
320 one character-set to another during the transfer. The default is to
321 make this feature available as long as your system has iconv_open().
322 If compilation fails, specify --disable-iconv to configure, and then
323 rebuild. If you want rsync to perform character-set conversions by
324 default, you can specify --enable-iconv=CONVERT_STRING with the default
325 value for the --iconv option that you wish to use. For example,
326 "--enable-iconv=." is a good choice. See the rsync manpage for an
327 explanation of the --iconv option's settings.
328
329 - A new daemon config parameter, "charset", lets you control the character-
330 set that is used during an --iconv transfer to/from a daemon module. You
331 can also set your daemon to refuse "no-iconv" if you want to force the
332 client to use an --iconv transfer (requiring an rsync 3.x client).
333
334 - Added the --skip-compress=LIST option to override the default list of
335 file suffixes that will not be compressed when using --compress (-z).
336
337 - The daemon's default for "dont compress" was extended to include:
338 *.7z *.mp[34] *.mov *.avi *.ogg *.jpg *.jpeg
339 The name-matching routine was also optimized to run more quickly.
340
341 - The --max-delete option now outputs a warning if it skipped any file
342 deletions, including a count of how many deletions were skipped. (Older
343 versions just silently stopped deleting things.)
344
345 - You may specify --max-delete=0 to a 3.0.0 client to request that it warn
346 about extraneous files without deleting anything. If you're not sure
347 what version the client is, you can use the less-obvious --max-delete=-1,
348 as both old and new versions will treat that as the same request (though
349 older versions don't warn).
350
351 - The --hard-link option now uses less memory on both the sending and
352 receiving side for all protocol versions. For protocol 30, the use of a
353 hashtable on the sending side allows us to more efficiently convey to the
354 receiver what files are linked together. This reduces the amount of data
355 sent over the socket by a considerable margin (rather than adding more
356 data), and limits the in-memory storage of the device+inode information
357 to just the sending side for the new protocol 30, or to the receiving
358 side when speaking an older protocol (note that older rsync versions kept
359 the device+inode information on both sides).
360
361 - The filter rules now support a perishable ("p") modifier that marks rules
362 that should not have an effect in a directory that is being deleted. e.g.
363 -f '-p .svn/' would only affect "live" .svn directories.
364
365 - Rsync checks all the alternate-destination args for validity (e.g.
366 --link-dest). This lets the user know when they specified a directory
367 that does not exist.
368
0f715920
WD
369 - If we get an ENOSYS error setting the time on a symlink, we don't
370 complain about it anymore (for those systems that even support the
371 setting of the modify-time on a symlink).
3cbe640d
WD
372
373 - Protocol 30 now uses MD5 checksums instead of MD4.
374
375 - Changed the --append option to not checksum the existing data in the
376 destination file, which speeds up file appending.
377
378 - Added the --append-verify option, which works like the older --append
379 option (verifying the existing data in the destination file). For
380 compatibility with older rsync versions, any use of --append that is
381 talking protocol 29 or older will revert to the --append-verify method.
382
383 - Added the --contimeout=SECONDS option that lets the user specify a
384 connection timeout for rsync daemon access.
385
386 - Documented and extended the support for the RSYNC_CONNECT_PROG variable
387 that can be used to enhance the client side of a daemon connection.
388
389 - Improved the dashes and double-quotes in the nroff manpage output.
390
391 - Rsync now supports a lot more --no-OPTION override options.
392
393 INTERNAL:
394
395 - The file-list sorting algorithm now uses a sort that keeps any same-
396 named items in the same order as they were specified. This allows
397 rsync to always ensure that the first of the duplicates is the one
398 that will be included in the copy. The new sort is also faster
399 than the glibc version of qsort() and mergesort().
400
401 - Rsync now supports the transfer of 64-bit timestamps (time_t values).
402
403 - Made the file-deletion code use a little less stack when recursing
404 through a directory hierarchy of extraneous files.
405
406 - Fixed a build problem with older (2.x) versions of gcc.
407
408 - Added some isType() functions that make dealing with signed characters
409 easier without forcing variables via casts.
410
411 - Changed strcat/strcpy/sprintf function calls to use safer versions.
412
413 - Upgraded the included popt version to 1.10.2 and improved its use of
414 string-handling functions.
415
416 - Added missing prototypes for compatibility functions from the lib dir.
417
418 - Configure determines if iconv() has a const arg, allowing us to avoid a
419 compiler warning.
420
421 - Made the sending of some numbers more efficient for protocol 30.
422
423 - Make sure that a daemon process doesn't mind if the client was weird and
424 omitted the --server option.
425
426 - There are more internal logging categories available in protocol 30 than
427 the age-old FINFO and FERROR, including FERROR_XFER and FWARN. These new
428 categories allow some errors and warnings to go to stderr without causing
429 an erroneous end-of-run warning about some files not being able to be
430 transferred.
431
432 - Improved the use of "const" on pointers.
433
434 - Improved J.W.'s pool_alloc routines to add a way of incrementally freeing
435 older sections of a pool's memory.
436
437 - The getaddrinfo.c compatibility code in the "lib" dir was replaced with
438 some new code (derived from samba, derived from PostgreSQL) that has a
439 better license than the old code.
440
441 DEVELOPER RELATED:
442
443 - Rsync is now licensed under the GPLv3 or later.
444
445 - Rsync is now being maintained in a "git" repository instead of CVS
446 (though the old CVS repository still exists for historical access).
447 Several maintenance scripts were updated to work with git.
448
449 - Generated files are no longer committed into the source repository. The
450 autoconf and autoheader commands are now automatically run during the
451 normal use of "configure" and "make". The latest dev versions of all
452 generated files can also be copied from the samba.org web site (see the
453 prepare-source script's fetch option).
454
455 - The "patches" directory of diff files is now built from branches in the
456 rsync git repository (branch patch/FOO creates file patches/FOO.diff).
457 This directory is now distributed in a separate separate tar file named
458 rsync-patches-VERSION.tar.gz instead of the main rsync-VERSION.tar.gz.
459
460 - The proto.h file is now built using a simple perl script rather than a
461 complex awk script, which proved to be more widely compatible.
462
463 - When running the tests, we now put our per-test temp dirs into a sub-
464 directory named testtmp (which is created, if missing). This allows
465 someone to symlink the testtmp directory to another filesystem (which is
466 useful if the build dir's filesystem does not support ACLs and xattrs,
467 but another filesystem does).
468
469 - Rsync now has a way of handling protocol-version changes during the
470 development of a new protocol version. This causes any out-of-sync
471 versions to speak an older protocol rather than fail in a cryptic manner.
472 This addition makes it safer to deploy a pre-release version that may
473 interact with the public. This new exchange of sub-version info does not
474 interfere with the {MIN,MAX}_PROTOCOL_VERSION checking algorithm (which
475 does not have enough range to allow the main protocol number to be
476 incremented for every minor tweak in that happens during development).
477
478 - The csprotocol.txt file was updated to mention the daemon protocol change
479 in the 3.0.0 release.
480
481\f
2955529b
WD
482NEWS for rsync 2.6.9 (6 Nov 2006)
483Protocol: 29 (unchanged)
484Changes since 2.6.8:
485
486 BUG FIXES:
487
488 - If rsync is interrupted via a handled signal (such as SIGINT), it will
489 once again clean-up its temp file from the destination dir.
490
491 - Fixed an overzealous sanitizing bug in the handling of the --link-dest,
492 --copy-dest, and --compare-dest options to a daemon without chroot: if
493 the copy's destination dir is deeper than the top of the module's path,
494 these options now accept a safe number of parent-dir (../) references
495 (since these options are relative to the destination dir). The old code
496 incorrectly chopped off all "../" prefixes for these options, no matter
497 how deep the destination directory was in the module's hierarchy.
498
499 - Fixed a bug where a deferred info/error/log message could get sent
500 directly to the sender instead of being handled by rwrite() in the
501 generator. This fixes an "unexpected tag 3" fatal error, and should
502 also fix a potential problem where a deferred info/error message from
503 the receiver might bypass the log file and get sent only to the client
504 process. (These problems could only affect an rsync daemon that was
505 receiving files.)
506
507 - Fixed a bug when --inplace was combined with a --*-dest option and we
508 update a file's data using an alternate basis file. The code now
509 notices that it needs to copy the matching data from the basis file
510 instead of (wrongly) assuming that it was already present in the file.
511
512 - Fixed a bug where using --dry-run with a --*-dest option with a path
513 relative to a directory that does not yet exist: the affected option
514 gets its proper path value so that the output of the dry-run is right.
515
516 - Fixed a bug in the %f logfile escape when receiving files: the
517 destination path is now included in the output (e.g. you can now tell
518 when a user specifies a subdir inside a module).
519
520 - If the receiving side fails to create a directory, it will now skip
521 trying to update everything that is inside that directory.
522
523 - If --link-dest is specified with --checksum but without --times, rsync
524 will now allow a hard-link to be created to a matching link-dest file
525 even when the file's modify-time doesn't match the server's file.
526
527 - The daemon now calls more timezone-using functions prior to doing a
528 chroot. This should help some C libraries to generate proper timestamps
529 from inside a chrooted daemon (and to not try to access /etc/timezone
530 over and over again).
531
532 - Fixed a bug in the handling of an absolute --partial-dir=ABS_PATH option:
533 it now deletes an alternate basis file from the partial-dir that was used
534 to successfully update a destination file.
535
536 - Fixed a bug in the handling of --delete-excluded when using a per-dir
537 merge file: the merge file is now honored on the receiving side, and
538 only its unqualified include/exclude commands are ignored (just as is
539 done for global include/excludes).
540
541 - Fixed a recent bug where --delete was not working when transferring from
542 the root (/) of the filesystem with --relative enabled.
543
544 - Fixed a recent bug where an --exclude='*' could affect the root (/) of
545 the filesystem with --relative enabled.
546
547 - When --inplace creates a file, it is now created with owner read/write
548 permissions (0600) instead of no permissions at all. This avoids a
549 problem continuing a transfer that was interrupted (since --inplace
550 will not update a file that has no write permissions).
551
552 - If either --remove-source-files or --remove-sent-files is enabled and we
553 are unable to remove the source file, rsync now outputs an error.
554
555 - Fixed a bug in the daemon's "incoming chmod" rule: newly-created
556 directories no longer get the 'F' (file) rules applied to them.
557
558 - Fixed an infinite loop bug when a filter rule was rejected due to being
559 overly long.
560
561 - When the server receives a --partial-dir option from the client, it no
562 longer runs the client-side code that adds an assumed filter rule (since
563 the client will be sending us the rules in the usual manner, and they
564 may have chosen to override the auto-added rule).
565
566 ENHANCEMENTS:
567
568 - Added the --log-file=FILE and --log-file-format=FORMAT options. These
569 can be used to tell any rsync to output what it is doing to a log file.
570 They work with a client rsync, a non-daemon server rsync (see the man
571 page for instructions), and also allows the overriding of rsyncd.conf
572 settings when starting a daemon.
573
574 - The --log-format option was renamed to be --out-format to avoid confusing
575 it with affecting the log-file output. (The old option remains as an
576 alias for the new to preserve backward compatibility.)
577
578 - Made "log file" and "syslog facility" settable on a per-module basis in
579 the daemon's config file.
580
581 - Added the --remove-source-files option as a replacement for the (now
582 deprecated) --remove-sent-files option. This new option removes all
583 non-dirs from the source directories, even if the file was already
584 up-to-date. This fixes a problem where interrupting an rsync that
585 was using --remove-sent-files and restarting it could leave behind
586 a file that the earlier rsync synchronized, but didn't get to remove.
587 (The deprecated --remove-sent-files is still understood for now, and
588 still behaves in the same way as before.)
589
590 - Added the option --no-motd to suppress the message-of-the-day output
591 from a daemon when doing a copy. (See the manpage for a caveat.)
592
593 - Added a new environment variable to the pre-/post-xfer exec commands (in
594 the daemon's config file): RSYNC_PID. This value will be the same in
4eeaa162
WD
595 both the pre- and post-xfer commands, so it can be used as a unique ID
596 if the pre-xfer command wants to cache some arg/request info for the
597 post-xfer command.
2955529b
WD
598
599 INTERNAL:
600
601 - Did a code audit using IBM's code-checker program and made several
602 changes, including: replacing most of the strcpy() and sprintf()
603 calls with strlcpy(), snprintf(), and memcpy(), adding a 0-value to
604 an enum that had been intermingling a literal 0 with the defined enum
605 values, silencing some uninitialized memory checks, marking some
606 functions with a "noreturn" attribute, and changing an "if" that
607 could never succeed on some platforms into a pre-processor directive
608 that conditionally compiles the code.
609
610 - Fixed a potential bug in f_name_cmp() when both the args are a
611 top-level "." dir (which doesn't happen in normal operations).
612
613 - Changed exit_cleanup() so that it can never return instead of exit.
614 The old code might return if it found the exit_cleanup() function
615 was being called recursively. The new code is segmented so that
616 any recursive calls move on to the next step of the exit-processing.
617
618 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
619 define it.
620
621 DEVELOPER RELATED:
622
623 - The acls.diff and xattrs.diff patches have received a bunch of work to
624 make them much closer to being acceptable in the main distribution.
625 The xattrs patch also has some preliminary Mac OS X and FreeBSD
626 compatibility code that various system types to exchange extended
627 file-attributes.
628
629 - A new diff in the patches dir, fake-root.diff, allows rsync to
630 maintain a backup hierarchy with full owner, group, and device info
631 without actually running as root. It does this using a special
632 extended attribute, so it depends on xattrs.diff (which depends on
633 acls.diff).
634
635 - The rsync.yo and rsyncd.conf.yo files have been updated to work
636 better with the latest yodl 2.x releases.
637
638 - Updated config.guess and config.sub to their 2006-07-02 versions.
639
640 - Updated various files to include the latest FSF address and to have
641 consistent opening comments.
642
643\f
60ef8ed1
WD
644NEWS for rsync 2.6.8 (22 Apr 2006)
645Protocol: 29 (unchanged)
646Changes since 2.6.7:
647
648 BUG FIXES:
649
650 - Fixed a bug in the exclude code where an anchored exclude without any
651 wildcards fails to match an absolute source arg, but only when --relative
652 is in effect.
653
654 - Improved the I/O code for the generator to fix a potential hang when the
655 receiver gets an EOF on the socket but the generator's select() call
656 never indicates that the socket is writable for it to be notified about
657 the EOF. (This can happen when using stunnel).
658
659 - Fixed a problem with the file-reading code where a failed read (such as
660 that caused by a bad sector) would not advance the file's read-position
661 beyond the failed read's data.
662
663 - Fixed a logging bug where the "log file" directive was not being honored
664 in a single-use daemon (one spawned by a remote-shell connection or by
665 init).
666
667 - If rsync cannot honor the --delete option, we output an error and exit
668 instead of silently ignoring the option.
669
670 - Fixed a bug in the --link-dest code that prevented special files (such as
671 fifos) from being linked.
672
673 - The ability to hard-link symlinks and special files is now determined at
674 configure time instead of at runtime. This fixes a bug with --link-dest
675 creating a hard-link to a symlink's referent on a BSD system.
676
677 ENHANCEMENTS:
678
679 - In daemon mode, if rsync fails to bind to the requested port, the
680 error(s) returned by socket() and/or bind() are now logged.
681
682 - When we output a fatal error, we now output the version of rsync in the
683 message.
684
685 - Improved the documentation for the --owner and --group options.
686
687 - The rsyncstats script in "support" has an improved line-parsing regex
688 that is easier to read and also makes it to parse syslog-generated lines.
689
690 - A new script in "support": file-attr-restore, can be used to restore the
691 attributes of a file-set (the permissions, ownership, and group info)
692 taken from the cached output of a "find ARG... -ls" command.
693
694 DEVELOPER RELATED:
695
696 - Removed the unused function write_int_named(), the unused variable
697 io_read_phase, and the rarely used variable io_write_phase. This also
698 elides the confusing 'phase "unknown"' part of one error message.
699
700 - Removed two unused configure checks and two related (also unused)
701 compatibility functions.
702
703 - The xattrs.diff patch received a security fix that prevents a potential
704 buffer overflow in the receive_xattr() code.
705
706 - The acls.diff patch has been improved quite a bit, with more to come.
707
708 - A new patch was added: log-file.diff. This contains an early version of
709 a future option, --log-file=FILE, that will allow any rsync to log its
710 actions to a file (something that only a daemon supports at present).
711
712\f
f171bf5b
WD
713NEWS for rsync 2.6.7 (11 Mar 2006)
714Protocol: 29 (unchanged)
715Changes since 2.6.6:
716
717 OUTPUT CHANGES:
718
719 - The letter 'D' in the itemized output was being used for both devices
720 (character or block) as well as other special files (such as fifos and
721 named sockets). This has changed to separate non-device special files
722 under the 'S' designation (e.g. "cS+++++++ path/fifo"). See also the
723 "--specials" option, below.
724
725 - The way rsync escapes unreadable characters has changed. First, rsync
726 now has support for recognizing valid multibyte character sequences in
727 your current locale, allowing it to escape fewer characters than before
728 for a locale such as UTF-8. Second, it now uses an escape idiom of
729 "\#123", which is the literal string "\#" followed by exactly 3 octal
730 digits. Rsync no longer doubles a backslash character in a filename
731 (e.g. it used to output "foo\\bar" when copying "foo\bar") -- now it only
732 escapes a backslash that is followed by a hash-sign and 3 digits (0-9)
733 (e.g. it will output "foo\#134#789" when copying "foo\#789"). See also
734 the --8-bit-output (-8) option, mentioned below.
735
736 Script writers: the local rsync is the one that outputs escaped names,
737 so if you need to support unescaping of filenames for older rsyncs, I'd
738 suggest that you parse the output of "rsync --version" and only use the
739 old unescaping rules for 2.6.5 and 2.6.6.
740
741 BUG FIXES:
742
743 - Fixed a really old bug that caused --checksum (-c) to checksum all the
744 files encountered during the delete scan (ouch).
745
746 - Fixed a potential hang in a remote generator: when the receiver gets a
747 read-error on the socket, it now signals the generator about this so that
748 the generator does not try to send any of the terminating error messages
749 to the client (avoiding a potential hang in some setups).
750
751 - Made hard-links work with symlinks and devices again.
752
753 - If the sender gets an early EOF reading a source file, we propagate this
754 error to the receiver so that it can discard the file and try requesting
755 it again (which is the existing behavior for other kinds of read errors).
756
757 - If a device-file/special-file changes permissions, rsync now updates the
758 permissions without recreating the file.
759
760 - If the user specifies a remote-host for both the source and destination,
761 we now output a syntax error rather than trying to open the destination
762 hostspec as a filename.
763
764 - When --inplace creates a new destination file, rsync now creates it with
765 permissions 0600 instead of 0000 -- this makes restarting possible when
766 the transfer gets interrupted in the middle of sending a new file.
767
768 - Reject the combination of --inplace and --sparse since the sparse-output
769 algorithm doesn't work when overwriting existing data.
770
771 - Fixed the directory name in the error that is output when pop_dir()
772 fails.
773
774 - Really fixed the parsing of a "!" entry in .cvsignore files this time.
775
776 - If the generator gets a stat() error on a file, output it (this used to
777 require at least -vv for the error to be seen).
778
779 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle
780 the exit status properly and generate a better error.
781
782 - Fixed some glitches in the double-verbose output when using --copy-dest,
783 --link-dest, or --compare-dest. Also improved how the verbose output
784 handles hard-links (within the transfer) that had an up-to-date alternate
785 "dest" file, and copied files (via --copy-dest).
786
787 - Fixed the matching of the dont-compress items (e.g. *.gz) against files
788 that have a path component containing a slash.
789
549a3efb
WD
790 - If the code reading a filter/exclude file gets an EINTR error, rsync now
791 clears the error flag on the file handle so it can keep on reading.
f171bf5b
WD
792
793 - If --relative is active, the sending side cleans up trailing "/" or "/."
794 suffixes to avoid triggering a bug in older rsync versions. Also, we now
795 reject a ".." dir if it would be sent as a relative dir.
796
797 - If a non-directory is in the way of a directory and rsync is run with
798 --dry-run and --delete, rsync no longer complains about not being able
799 to opendir() the not-yet present directory.
800
801 - When --list-only is used and a non-existent local destination dir was
802 also specified as a destination, rsync no longer generates a warning
803 about being unable to create the missing directory.
804
805 - Fixed some problems with --relative --no-implied-dirs when the
806 destination directory did not yet exist: we can now create a symlink or
807 device when it is the first thing in the missing dir, and --fuzzy no
808 longer complains about being unable to open the missing dir.
809
810 - Fixed a bug where the --copy-links option would not affect implied
811 directories without --copy-unsafe-links (see --relative).
812
813 - Got rid of the need for --force to be used in some circumstances with
814 --delete-after (making it consistent with --delete-before/-during).
815
816 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this
817 when a file is too large (rsync handles the write error).
818
819 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it
820 was not properly padded with trailing '=' chars. This only affects a
821 user that need to use a password-authenticated proxy for an outgoing
822 daemon-rsync connection.
823
824 - If we're transferring an empty directory to a new name, rsync no longer
825 forces S_IWUSR if it wasn't already set, nor does it accidentally leave
826 it set.
827
828 - Fixed a bug in the debug output (-vvvvv) that could mention the wrong
829 checksum for the current file offset.
830
831 - Rsync no longer allows a single directory to be copied over a non-
832 directory destination arg.
833
834 ENHANCEMENTS:
835
836 - Added the --append option that makes rsync append data onto files that
837 are longer on the source than the destination (this includes new files).
838
839 - Added the --min-size=SIZE option to exclude small files from the
840 transfer.
841
842 - Added the --compress-level option to allow you to set how aggressive
843 rsync's compression should be (this option implies --compress).
844
845 - Enhanced the parsing of the SIZE value for --min-size and --max-size to
846 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
847 and off-by-one values too (e.g. --max-size=8mb-1).
848
849 - Added the --8-bit-output (-8) option, which tells rsync to avoid escaping
850 high-bit characters that it thinks are unreadable in the current locale.
851
852 - The new option --human-readable (-h) changes the output of --progress,
853 --stats, and the end-of-run summary to be easier to read. If repeated,
854 the units become powers of 1024 instead of powers of 1000. (The old
855 meaning of -h, as a shorthand for --help, still works as long as you
856 just use it on its own, as in "rsync -h".)
857
858 - If lutimes() and/or lchmod() are around, use them to allow the
859 preservation of attributes on symlinks.
860
861 - The --link-dest option now affects symlinks and devices (when possible).
862
863 - Added two config items to the rsyncd.conf parsing: "pre-xfer exec" and
864 "post-xfer exec". These allow a command to be specified on a per-module
865 basis that will be run before and/or after a daemon-mode transfer. (See
866 the man page for a list of the environment variables that are set with
867 information about the transfer.)
868
869 - When using the --relative option, you can now insert a dot dir in
870 the source path to indicate where the replication of the source dirs
871 should start. For example, if you specify a source path of
872 rsync://host/module/foo/bar/./baz/dir with -R, rsync will now only
873 replicate the "baz/dir" part of the source path (note: a trailing
874 dot dir is unaffected unless it also has a trailing slash).
875
876 - Added some new --no-FOO options that make it easier to override unwanted
877 implied or default options. For example, "-a --no-o" (aka "--archive
878 --no-owner") can be used to turn off the preservation of file ownership
879 that is implied by -a.
880
881 - Added the --chmod=MODE option that allows the destination permissions to
882 be changed from the source permissions. E.g. --chmod=g+w,o-rwx
883
884 - Added the "incoming chmod" and "outgoing chmod" daemon options that allow
885 a module to specify what permissions changes should be applied to all
886 files copied to and from the daemon.
887
888 - Allow the --temp-dir option to be specified when starting a daemon, which
889 sets the default temporary directory for incoming files.
890
891 - If --delete is combined with --dirs without --recursive, rsync will now
892 delete in any directory whose content is being synchronized.
893
894 - If --backup is combined with --delete without --backup-dir (and without
895 --delete-excluded), we add a "protect" filter-rule to ensure that files
896 with the backup suffix are not deleted.
897
898 - The file-count stats that are output by --progress were improved to
899 better indicate what the numbers mean. For instance, the output:
900 "(xfer#5, to-check=8383/9999)" indicates that this was the fifth file
901 to be transferred, and we still need to check 8383 more files out of
902 a total of 9999.
903
904 - The include/exclude code now allows a dir/*** directive (with 3 trailing
905 stars) to match both the dir itself as well as all the content below the
906 dir (dir/** would not match the dir).
907
908 - Added the --prune-empty-dirs (-m) option that makes the receiving rsync
909 discard empty chains of directories from the file-list. This makes it
910 easier to selectively copy files from a source hierarchy and end up with
911 just the directories needed to hold the resulting files.
912
913 - If the --itemize-changes (-i) option is repeated, rsync now includes
914 unchanged files in the itemized output (similar to -vv, but without all
915 the other verbose messages that can get in the way). Of course, the
916 client must be version 2.6.7 for this to work, but the remote rsync only
917 needs to be 2.6.7 if you're pushing files.
918
919 - Added the --specials option to tell rsync to copy non-device special
920 files (which rsync now attempts even as a normal user). The --devices
921 option now requests the copying of just devices (character and block).
922 The -D option still requests both (e.g. --devices and --specials), -a
923 still implies -D, and non-root users still get a silent downgrade that
924 omits device copying.
925
926 - Added the --super option to make the receiver always attempt super-user
927 activities. This is useful for systems that allow things such as devices
928 to be created or ownership to be set without being UID 0, and is also
929 useful for someone who wants to ensure that errors will be output if the
930 receiving rsync isn't being run as root.
931
932 - Added the --sockopts option for those few who want to customize the TCP
933 options used to contact a daemon rsync.
934
935 - Added a way for the --temp-dir option to be combined with a partial-dir
936 setting that lets rsync avoid non-atomic updates (for those times when
937 --temp-dir is not being used because space is tight).
938
939 - A new support script, files-to-excludes, will transform a list of files
940 into a set of include/exclude directives that will copy those files.
941
942 - A new option, --executability (-E) can be used to preserve just the
943 execute bit on files, for those times when using the --perms option is
944 not desired.
945
946 - The daemon now logs each connection and also each module-list request
947 that it receives.
948
949 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B
950 (permission bits, e.g. "rwxr-xrwt").
951
952 - The --dry-run option no longer forces the enabling of --verbose.
953
954 - The --remove-sent-files option now does a better job of incrementally
955 removing the sent files on the sending side (older versions tended to
956 clump up all the removals at the end).
957
958 - A daemon now supersedes its minimal SIGCHLD handler with the standard
959 PID-remembering version after forking. This ensures that the generator
960 can get the child-exit status from the receiver.
961
962 - Use of the --bwlimit option no longer interferes with the remote rsync
963 sending error messages about invalid/refused options.
964
965 - Rsync no longer returns a usage error when used with one local source arg
966 and no destination: this now implies the --list-only option, just like
967 the comparable situation with a remote source arg.
968
969 - Added the --copy-dirlinks option, a more limited version of --copy-links.
970
971 - Various documentation improvements, including: a better synopsis, some
972 improved examples, a better discussion of the presence and absence of
973 --perms (including how it interacts with the new --executability and
974 --chmod options), an extended discussion of --temp-dir, an improved
975 discussion of --partial-dir, a better description of rsync's pattern
976 matching characters, an improved --no-implied-dirs section, and the
977 documenting of what the --stats option outputs.
978
979 - Various new and updated diffs in the patches dir, including: acls.diff,
980 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
981
982 INTERNAL:
983
984 - We now use sigaction() and sigprocmask() if possible, and fall back on
985 signal() if not. Using sigprocmask() ensures that rsync enables all the
986 signals that it needs, just in case it was started in a masked state.
987
988 - Some buffer sizes were expanded a bit, particularly on systems where
989 MAXPATHLEN is overly small (e.g. cygwin).
990
991 - If io_printf() tries to format more data than fits in the buffer, exit
992 with an error instead of transmitting a truncated buffer.
993
994 - If a va_copy macro is defined, lib/snprintf.c will use it when defining
995 the VA_COPY macro.
996
997 - Reduced the amount of stack memory needed for each level of directory
998 recursion by nearly MAXPATHLEN bytes.
999
1000 - The wildmatch function was extended to allow an array of strings to be
1001 supplied as the string to match. This allows the exclude code to do less
1002 string copying.
1003
1004 - Got rid of the safe_fname() function (and all the myriad calls) and
1005 replaced it with a new function in the log.c code that filters all the
1006 output going to the terminal.
1007
1008 - Unified the f_name() and the f_name_to() functions.
1009
1010 - Improved the hash-table code the sender uses to handle checksums to make
1011 it use slightly less memory and run just a little faster.
1012
1013 DEVELOPER RELATED:
1014
1015 - The diffs in the patches dir now require "patch -p1 <DIFF" instead of
1016 the previous -p0. Also, the version included in the release tar now
1017 affect generated files (e.g. configure, rsync.1, proto.h, etc.), so
1018 it is no longer necessary to run autoconf and/or yodl unless you're
1019 applying a patch that was checked out from CVS.
1020
1021 - Several diffs in the patches dir now use the proper --enable-FOO
1022 configure option instead of --with-FOO to turn on the inclusion of
1023 the newly patched feature.
1024
1025 - There is a new script, "prepare-source" than can be used to update the
1026 various generated files (proto.h, configure, etc.) even before configure
1027 has created the Makefile (this is mainly useful when patching the source
1028 with a patch that doesn't affect generated files).
1029
1030 - The testsuite now sets HOME so that it won't be affected by a file such
1031 as ~/.popt.
1032
1033\f
f90f7149
WD
1034NEWS for rsync 2.6.6 (28 Jul 2005)
1035Protocol: 29 (unchanged)
1036Changes since 2.6.5:
1037
1038 SECURITY FIXES:
1039
1040 - The zlib code was upgraded to version 1.2.3 in order to make it more
1041 secure. While the widely-publicized security problem in zlib 1.2.2 did
1042 not affect rsync, another security problem surfaced that affects rsync's
1043 zlib 1.1.4.
1044
1045 BUG FIXES:
1046
1047 - The setting of flist->high in clean_flist() was wrong for an empty list.
1048 This could cause flist_find() to crash in certain rare circumstances
1049 (e.g. if just the right directory setup was around when --fuzzy was
1050 combined with --link-dest).
1051
1052 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
1053 (1) Without -i it would output the name of each hard-linked file as
1054 though it had been changed; it now outputs a "is hard linked" message for
1055 the file. (2) With -i it would output all dots for the unchanged
1056 attributes of a hard-link; it now changes those dots to spaces, as is
1057 done for other totally unchanged items.
f90f7149
WD
1058
1059 - When backing up a changed symlink or device, get rid of any old backup
1060 item so that we don't get an "already exists" error.
1061
1062 - A couple places that were comparing a local and a remote modification-
1063 time were not honoring the --modify-window option.
1064
1065 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
1066 set too often (if some non-significant mode bits differed).
1067
1068 - Fixed a really old, minor bug that could cause rsync to warn about being
1069 unable to mkdir() a path that ends in "/." because it just created the
1070 directory (required --relative, --no-implied-dirs, a source path that
1071 ended in either a trailing slash or a trailing "/.", and a non-existing
1072 destination dir to tickle the bug in a recent version).
1073
1074 ENHANCEMENTS:
1075
1076 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
1077 per-module basis (which now matches the documentation).
1078
1079 - The support/rrsync script has been upgraded to verify the args of options
1080 that take args (instead of rejecting any such options). The script was
1081 also changed to try to be more secure and to fix a problem in the parsing
1082 of a pull operation that has multiple sources.
1083
1084 - Improved the documentation that explains the difference between a
1085 normal daemon transfer and a daemon-over remote-shell transfer.
1086
1087 - Some of the diffs supplied in the patches dir were fixed and/or
1088 improved.
1089
1090 BUILD CHANGES:
1091
1092 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
1093 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
1094 find in the /etc/group file).
1095
1096 - Added a test to the test suite, itemized.test, that tests the output of
1097 -i (log-format w/%i) and some double-verbose messages.
1098
1099\f
a1c75ed0
WD
1100NEWS for rsync 2.6.5 (1 Jun 2005)
1101Protocol: 29 (unchanged)
1102Changes since 2.6.4:
1103
1104 OUTPUT CHANGES:
1105
1106 - Non-printable chars in filenames are now output using backslash-
1107 escaped characters rather than '?'s. Any non-printable character is
1108 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
1109 is now output as "\\". Rsync also uses your locale setting, which
1110 can make it treat fewer high-bit characters as non-printable.
1111
1112 - If rsync received an empty file-list when pulling files, it would
1113 output a "nothing to do" message and exit with a 0 (success) exit
1114 status, even if the remote rsync returned an error (it did not do
1115 this under the same conditions when pushing files). This was changed
1116 to make the pulling behavior the same as the pushing behavior: we
1117 now do the normal end-of-run outputting (depending on options) and
1118 exit with the appropriate exit status.
1119
1120 BUG FIXES:
1121
1122 - A crash bug was fixed when a daemon had its "path" set to "/", did
1123 not have chroot enabled, and used some anchored excludes in the
1124 rsyncd.conf file.
1125
1126 - Fixed a bug in the transfer of a single file when -H is specified
1127 (rsync would either infinite loop or perhaps crash).
1128
1129 - Fixed a case where the generator might try (and fail) to tweak the
1130 write-permissions of a read-only directory in list-only mode (this
1131 only caused an annoying warning message).
1132
1133 - If --compare-dest or --link-dest uses a locally-copied file as the
1134 basis for an updated version, log this better when --verbose or -i
1135 is in effect.
1136
1137 - Fixed the accidental disabling of --backup during the --delete-after
1138 processing.
1139
1140 - Restored the ability to use the --address option in client mode (in
1141 addition to its use in daemon mode).
1142
1143 - Make sure that some temporary progress information from the delete
1144 processing does not get left on the screen when it is followed by a
1145 newline.
1146
1147 - When --existing skips a directory with extra verbosity, refer to it
1148 as a "directory", not a "file".
1149
1150 - When transferring a single file to a different-named file, any
1151 generator messages that are source-file related no longer refer to
1152 the file by the destination filename.
1153
1154 - Fixed a bug where hard-linking a group of files might fail if the
1155 generator hasn't created a needed destination directory yet.
1156
1157 - Fixed a bug where a hard-linked group of files that is newly-linked
1158 to a file in a --link-dest dir doesn't link the files from the rest
1159 of the cluster.
1160
1161 - When deleting files with the --one-file-system (-x) option set, rsync
1162 no longer tries to remove files from inside a mount-point on the
1163 receiving side. Also, we don't complain about being unable to remove
1164 the mount-point dir.
1165
1166 - Fixed a compatibility problem when using --cvs-ignore (-C) and
1167 sending files to an older rsync without using --delete.
1168
1169 - Make sure that a "- !" or "+ !" include/exclude pattern does not
1170 trigger the list-clearing action that is reserved for "!".
1171
1172 - Avoid a timeout in the generator when the sender/receiver aren't
1173 handling the generator's checksum output quickly enough.
1174
1175 - Fixed the omission of some directories in the delete processing when
1176 --relative (-R) was combined with a source path that had a trailing
1177 slash.
1178
1179 - Fixed a case where rsync would erroneously delete some files and then
1180 re-transfer them when the options --relative (-R) and --recursive
1181 (-r) were both enabled (along with --delete) and a source path had a
1182 trailing slash.
1183
1184 - Make sure that --max-size doesn't affect a device or a symlink.
1185
1186 - Make sure that a system with a really small MAXPATHLEN does not cause
1187 the buffers in readfd_unbuffered() to be too small to receive normal
1188 messages. (This mainly affected Cygwin.)
1189
1190 - If a source pathname ends with a filename of "..", treat it as if
1191 "../" had been specified (so that we don't copy files to the parent
1192 dir of the destination).
1193
1194 - If --delete is combined with a file-listing rsync command (i.e. no
1195 transfer is happening), avoid outputting a warning that we couldn't
1196 delete anything.
1197
1198 - If --stats is specified with --delete-after, ensure that all the
1199 "deleting" messages are output before the statistics.
1200
1201 - Improved one "if" in the deletion code that was only checking errno
1202 for ENOTEMPTY when it should have also been checking for EEXIST (for
1203 compatibility with OS variations).
1204
1205 ENHANCEMENTS:
1206
1207 - Added the --only-write-batch=FILE option that may be used (instead
1208 of --write-batch=FILE) to create a batch file without doing any
1209 actual updating of the destination. This allows you to divert all
1210 the file-updating data away from a slow data link (as long as you
1211 are pushing the data to the remote server when creating the batch).
1212
1213 - When the generator is taking a long time to fill up its output buffer
1214 (e.g. if the transferred files are few, small, or missing), it now
1215 periodically flushes the output buffer so that the sender/receiver
1216 can get started on the files sooner rather than later.
1217
1218 - Improved the keep-alive code to handle a long silence between the
1219 sender and the receiver that can occur when the sender is receiving
1220 the checksum data for a large file.
1221
1222 - Improved the auth-errors that are logged by the daemon to include
1223 some information on why the authorization failed: wrong user,
1224 password mismatch, etc. (The client-visible message is unchanged!)
1225
1226 - Improved the client's handling of an "@ERROR" from a daemon so that
1227 it does not complain about an unexpectedly closed socket (since we
1228 really did expect the socket to close).
1229
1230 - If the daemon can't open the log-file specified in rsyncd.conf, fall
1231 back to using syslog and log an appropriate warning. This is better
1232 than what was typically a totally silent (and fatal) failure (since a
1233 daemon is not usually run with the --no-detach option that was
1234 necessary to see the error on stderr).
1235
1236 - The man pages now consistently refer to an rsync daemon as a "daemon"
1237 instead of a "server" (to distinguish it from the server process in a
1238 non-daemon transfer).
1239
1240 - Made a small change to the rrsync script (restricted rsync -- in the
1241 support dir) to make a read-only server reject all --remove-* options
1242 when sending files (to future-proof it against the possibility of
1243 other similar options being added at some point).
1244
1245 INTERNAL:
1246
1247 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
1248 better discern which filename characters need to be escaped in
1249 messages (which should result in fewer escaped characters in some
1250 locales).
1251
1252 - Improved the naming of the log-file open/reopen/close functions.
1253
1254 - Removed some protocol-compatibility code that was only needed to help
1255 someone running a pre-release of 2.6.4.
1256
1257 BUILD CHANGES:
1258
1259 - Added configure option "--disable-locale" to disable any use of
1260 setlocale() in the binary.
1261
1262 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
1263 rsync from being built without symlink or hard-link support.
1264
1265 - Only #define HAVE_REMSH if it is going to be set to 1.
1266
1267 - Configure now disables the use of mkstemp() under HP-UX (since they
1268 refuse to fix its broken handling of large files).
1269
1270 - Configure now explicitly checks for the lseek64() function so that
1271 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
1272 presence based on the presence of the off64_t type.
1273
1274 - Configure no longer mentions the change in the default remote-shell
1275 (from rsh to ssh) that occurred for the 2.6.0 release.
1276
1277 - Some minor enhancements to the test scripts.
1278
1279 - Added a few new *.diff files to the patches dir, including a patch
1280 that enables the optional copying of extended attributes.
1281
1282\f
1ad6a7f6
WD
1283NEWS for rsync 2.6.4 (30 March 2005)
1284Protocol: 29 (changed)
1285Changes since 2.6.3:
1286
1287 OUTPUT CHANGES:
1288
1289 - When rsync deletes a directory and outputs a verbose message about
1290 it, it now appends a trailing slash to the name instead of (only
1291 sometimes) outputting a preceding "directory " string.
1292
1293 - The --stats output will contain file-list time-statistics if both
1294 sides are 2.6.4, or if the local side is 2.6.4 and the files are
1295 being pushed (since the stats come from the sending side).
1296 (Requires protocol 29 for a pull.)
1297
1298 - The "%o" (operation) log-format escape now has a third value (besides
1299 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
1300 This changes the way deletions are logged in the daemon's log file.
1301
1302 - When the --log-format option is combined with --verbose, rsync now
1303 avoids outputting the name of the file twice in most circumstances.
1304 As long as the --log-format item does not refer to any post-transfer
1305 items (such as %b or %c), the --log-format message is output prior to
1306 the transfer, so --verbose is now the equivalent of a --log-format of
1307 '%n%L' (which outputs the name and any link info). If the log output
1308 must occur after the transfer to be complete, the only time the name
1309 is also output prior to the transfer is when --progress was specified
1310 (so that the name will precede the progress stats, and the full
1311 --log-format output will come after).
97e3c50c 1312
7c2a83c6
WD
1313 - Non-printable characters in filenames are replaced with a '?' to
1314 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
1315
1316 BUG FIXES:
1317
1318 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
1319 was only treating it as a special token in an rsync include/exclude
1320 file).
1321
1322 - The combination of --verbose and --dry-run now mentions the full list
1323 of changes that would be output without --dry-run.
1324
1325 - Avoid a mkdir warning when removing a directory in the destination
1326 that already exists in the --backup-dir.
1327
1328 - An OS that has a binary mode for its files (such as cygwin) needed
1329 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 1330 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
1331
1332 - Fixed a potential hang when verbosity is high, the client side is
1333 the sender, and the file-list is large.
1334
1335 - Fixed a potential protocol-corrupting bug where the generator could
1336 merge a message from the receiver into the middle of a multiplexed
1337 packet of data if only part of that data had been written out to the
1338 socket when the message from the generator arrived.
1339
1340 - We now check if the OS doesn't support using mknod() for creating
1341 FIFOs and sockets, and compile-in some compatibility code using
1342 mkfifo() and socket() when necessary.
1343
1344 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
1345 if the --max-delete limit is exceeded during a run, we now output a
1346 warning about this at the end of the run and exit with a new error
1347 code (25).
1348
1349 - One place in the code wasn't checking if fork() failed.
1350
1351 - The "ignore nonreadable" daemon parameter used to erroneously affect
1352 readable symlinks that pointed to a non-existent file.
1353
1354 - If the OS does not have lchown() and a chown() of a symlink will
1355 affect the referent of a symlink (as it should), we no longer try
1356 to set the user and group of a symlink.
1357
1358 - The generator now properly runs the hard-link loop and the dir-time
1359 rewriting loop after we're sure that the redo phase is complete.
1360
1361 - When --backup was specified with --partial-dir=DIR, where DIR is a
1362 relative path, the backup code was erroneously trying to backup a
1363 file that was put into the partial-dir.
1364
1365 - If a file gets resent in a single transfer and the --backup option is
1366 enabled along with --inplace, rsync no longer performs a duplicate
1367 backup (it used to overwrite the first backup with the failed file).
1368
1369 - One call to flush_write_file() was not being checked for an error.
1370
1371 - The --no-relative option was not being sent from the client to a
1372 server sender.
1373
1374 - If an rsync daemon specified "dont compress = ..." for a file and the
1375 client tried to specify --compress, the libz code was not handling a
1376 compression level of 0 properly. This could cause a transfer failure
1377 if the block-size for a file was large enough (e.g. rsync might have
1378 exited with an error for large files).
1379
1380 - Fixed a bug that would sometimes surface when using --compress and
1381 sending a file with a block-size larger than 64K (either manually
1382 specified, or computed due to the file being really large). Prior
1383 versions of rsync would sometimes fail to decompress the data
1384 properly, and thus the transferred file would fail its verification.
1385
1386 - If a daemon can't open the specified log file (i.e. syslog is not
1387 being used), die without crashing. We also output an error about
1388 the failure on stderr (which will only be seen if --no-detach was
1389 specified) and exit with a new error code (6).
1390
1391 - A local transfer no longer duplicates all its include/exclude options
1392 (since the forked process already has a copy of the exclude list,
1393 there's no need to send them a set of duplicates).
1394
7eb2ecda
WD
1395 - The output of the items that are being updated by the generator (dirs,
1396 symlinks, devices) is now intermingled in the proper order with the
1397 output from the items that the receiver is updating (regular files)
1398 when pulling. This misordering was particularly bad when --progress
1399 was specified. (Requires protocol 29.)
1ad6a7f6
WD
1400
1401 - When --timeout is specified, lulls that occur in the transfer while
1402 the generator is doing work that does not generate socket traffic
1403 (looking for changed files, deleting files, doing directory-time
1404 touch-ups, etc.) will cause a new keep-alive packet to be sent that
1405 should keep the transfer going as long as the generator continues to
1406 make progress. (Requires protocol 29.)
1407
1408 - The stat size of a device is not added to the total file size of the
1409 items in the transfer (the size might be undefined on some OSes).
1410
1411 - Fixed a problem with refused-option messages sometimes not making it
1412 back to the client side when a remote --files-from was in effect and
1413 the daemon was the receiver.
1414
0f9941dc 1415 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
1416 (the preserved) attributes from the version in the compare-dest DIR.
1417
1418 - When rsync is copying files into a write-protected directory, fixed
1419 the change-report output for the directory so that we don't report
1420 an identical directory as changed.
1421
1422 ENHANCEMENTS:
1423
1424 - Rsync now supports popt's option aliases, which means that you can
1425 use /etc/popt and/or ~/.popt to create your own option aliases.
1426
1427 - Added the --delete-during (--del) option which will delete files
1428 from the receiving side incrementally as each directory in the
1429 transfer is being processed. This makes it more efficient than the
1430 default, before-the-transfer behavior, which is now also available as
1431 --delete-before (and is still the default --delete-WHEN option that
1432 will be chosen if --delete or --delete-excluded is specified without
1433 a --delete-WHEN choice). All the --del* options infer --delete, so
1434 an rsync daemon that refuses "delete" will still refuse to allow any
1435 file-deleting options (including the new --remove-sent-files option).
1436
1437 - All the --delete-WHEN options are now more memory efficient:
1438 Previously an duplicate set of file-list objects was created on the
1439 receiving side for the entire destination hierarchy. The new
1440 algorithm only creates one directory of objects at a time (for files
1441 inside the transfer).
1442
1443 - Added the --copy-dest option, which works like --link-dest except
1444 that it locally copies identical files instead of hard-linking them.
1445
1446 - Added support for specifying multiple --compare-dest, --copy-dest, or
1447 --link-dest options, but only of a single type. (Promoted from the
1448 patches dir and enhanced.) (Requires protocol 29.)
1449
1450 - Added the --max-size option. (Promoted from the patches dir.)
1451
1452 - The daemon-mode options are now separated from the normal rsync
1453 options so that they can't be mixed together. This makes it
1454 impossible to start a daemon that has improper default option values
1455 (which could cause problems when a client connects, such as hanging
1456 or crashing).
1457
1458 - The --bwlimit option may now be used in combination with --daemon
1459 to specify both a default value for the daemon side and a value
1460 that cannot be exceeded by a user-specified --bwlimit option.
1461
1462 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
1463 the patches dir.) Also added "address". The command-line options
1464 take precedence over a config-file option, as expected.
1465
1466 - In _exit_cleanup(): when we are exiting with a partially-received
1467 file, we now flush any data in the write-cache before closing the
1468 partial file.
1469
1470 - The --inplace support was enhanced to work with --compare-dest,
1471 --link-dest, and (the new) --copy-dest options. (Requires protocol
1472 29.)
1473
1474 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
1475 without recursion. Any directories that are encountered are created
1476 on the destination. Specifying a directory with a trailing slash
1477 copies its immediate contents to the destination.
1478
1479 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
1480
1481 - Added the --list-only option, which is mainly a way for the client to
1482 put the server into listing mode without needing to resort to any
1483 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
1484 for a non-recursive listing). This option is used automatically
1485 (behind the scenes) when a modern rsync speaks to a modern daemon,
1486 but may also be specified manually if you want to force the use of
1487 the --list-only option over a remote-shell connection.
1488
1489 - Added the --omit-dir-times (-O) option, which will avoid updating
1490 the modified time for directories when --times was specified. This
1491 option will avoid an extra pass through the file-list at the end of
1492 the transfer (to tweak all the directory times), which may provide
1493 an appreciable speedup for a really large transfer. (Promoted from
1494 the patches dir.)
1495
1496 - Added the --filter (-f) option and its helper option, -F. Filter
1497 rules are an extension to the existing include/exclude handling
1498 that also supports nested filter files as well as per-directory
1499 filter files (like .cvsignore, but with full filter-rule parsing).
1500 This new option was chosen in order to ensure that all existing
1501 include/exclude processing remained 100% compatible with older
1502 versions. Protocol 29 is needed for full filter-rule support, but
1503 backward-compatible rules work with earlier protocol versions.
1504 (Promoted from the patches dir and enhanced.)
1505
1506 - Added the --delay-updates option that puts all updated files into
1507 a temporary directory (by default ".~tmp~", but settable via the
1508 --partial-dir=DIR option) until the end of the transfer. This
1509 makes the updates a little more atomic for a large transfer.
1510
1511 - If rsync is put into the background, any output from --progress is
1512 reduced.
1513
1514 - Documented the "max verbosity" setting for rsyncd.conf. (This
1515 setting was added a couple releases ago, but left undocumented.)
1516
1517 - The sender and the generator now double-check the file-list index
1518 they are given, and refuse to try to do a file transfer on a
1519 non-file index (since that would indicate that something had gone
1520 very wrong).
1521
1522 - Added the --itemize-changes (-i) option, which is a way to output a
1523 more detailed list of what files changed and in what way. The effect
1524 is the same as specifying a --log-format of "%i %n%L" (see both the
1525 rsync and rsyncd.conf manpages). Works with --dry-run too.
1526
1527 - Added the --fuzzy (-y) option, which attempts to find a basis file
1528 for a file that is being created from scratch. The current algorithm
1529 only looks in the destination directory for the created file, but it
1530 does attempt to find a match based on size/mod-time (in case the file
1531 was renamed with no other changes) as well as based on a fuzzy
1532 name-matching algorithm. This option requires protocol 29 because it
1533 needs the new file-sorting order. (Promoted from patches dir and
1534 enhanced.) (Requires protocol 29.)
1535
1536 - Added the --remove-sent-files option, which lets you move files
1537 between systems.
1538
1539 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
1540 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
1541 literals in the rsync://HOST:PORT/PATH format.)
1542
1543 - When rsync recurses to build the file list, it no longer keeps open
1544 one or more directory handles from the dir's parent dirs.
1545
1546 - When building under windows, the default for --daemon is now to
1547 avoid detaching, requiring the new --detach option to force rsync
1548 to detach.
1549
1550 - The --dry-run option can now be combined with either --write-batch or
1551 --read-batch, allowing you to run a do-nothing test command to see
1552 what would happen without --dry-run.
1553
1554 - The daemon's "read only" config item now sets an internal read_only
1555 variable that makes extra sure that no write/delete calls on the
1556 read-only side can succeed.
1557
1558 - The log-format % escapes can now have a numeric field width in
1559 between the % and the escape letter (e.g. "%-40n %08p").
1560
1561 - Improved the option descriptions in the --help text.
1562
1563 SUPPORT FILES:
1564
1565 - Added atomic-rsync to the support dir: a perl script that will
1566 transfer some files using rsync, and then move the updated files into
1567 place all at once at the end of the transfer. Only works when
1568 pulling, and uses --link-dest and a parallel hierarchy of files to
1569 effect its update.
1570
1571 - Added mnt-excl to the support dir: a perl script that takes the
1572 /proc/mounts file and translates it into a set of excludes that will
1573 exclude all mount points (even mapped mounts to the same disk). The
1574 excludes are made relative to the specified source dir and properly
1575 anchored.
1576
1577 - Added savetransfer.c to the support dir: a C program that can make
1578 a copy of all the data that flows over the wire. This lets you test
1579 for data corruption (by saving the data on both the sending side and
1580 the receiving side) and provides one way to debug a protocol error.
1581
1582 - Added rrsync to the support dir: this is an updated version of Joe
1583 Smith's restricted rsync perl script. This helps to ensure that only
1584 certain rsync commands can be run by an ssh invocation.
1585
1586 INTERNAL:
1587
1588 - Added better checking of the checksum-header values that come over
1589 the socket.
1590
1591 - Merged a variety of file-deleting functions into a single function so
1592 that it is easier to maintain.
1593
1594 - Improved the type of some variables (particularly blocksize vars) for
1595 consistency and proper size.
1596
1597 - Got rid of the uint64 type (which we didn't need).
1598
1599 - Use a slightly more compatible set of core #include directives.
1600
1601 - Defined int32 in a way that ensures that the build dies if we can't
1602 find a variable with at least 32 bits.
1603
1604 PROTOCOL DIFFERENCES FOR VERSION 29:
1605
1606 - A 16-bit flag-word is transmitted after every file-list index. This
1607 indicates what is changing between the sender and the receiver. The
1608 generator now transmits an index and a flag-word to indicate when
1609 dirs and symlinks have changed (instead of producing a message),
1610 which makes the outputting of the information more consistent and
1611 less prone to screen corruption (because the local receiver/sender is
1612 now outputting all the file-change info messages).
1613
1614 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
1615 in the flag-word and the name of the file that was linked immediately
1616 follows in vstring format (see below).
1617
1618 - If a file is being transferred with an alternate-basis file, the
1619 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
1620 byte follows, indicating what type of basis file was chosen. If that
1621 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
1622 is set in the flag-word and the name of the match in vstring format
1623 follows the basis byte. A vstring is a variable length string that
1624 has its size written prior to the string, and no terminating null.
1625 If the string is from 1-127 bytes, the length is a single byte. If
1626 it is from 128-32767 bytes, the length is written as ((len >> 8) |
1627 0x80) followed by (len % 0x100).
1628
1629 - The sending of exclude names is done using filter-rule syntax. This
1630 means that all names have a prefixed rule indicator, even excludes
1631 (which used to be sent as a bare pattern, when possible). The -C
1632 option will include the per-dir .cvsignore merge file in the list of
1633 filter rules so it is positioned correctly (unlike in some older
1634 transfer scenarios).
1635
1636 - Rsync sorts the filename list in a different way: it sorts the subdir
1637 names after the non-subdir names for each dir's contents, and it
1638 always puts a dir's contents immediately after the dir's name in the
1639 list. (Previously an item named "foo.txt" would sort in between
1640 directory "foo/" and "foo/bar".)
1641
1642 - When talking to a protocol 29 rsync daemon, a list-only request
1643 is able to note this before the options are sent over the wire and
1644 the new --list-only option is included in the options.
1645
1646 - When the --stats bytes are sent over the wire (or stored in a batch),
1647 they now include two elapsed-time values: one for how long it took to
1648 build the file-list, and one for how long it took to send it over the
1649 wire (each expressed in thousandths of a second).
1650
1651 - When --delete-excluded is specified with some filter rules (AKA
1652 excludes), a client sender will now initiate a send of the rules to
1653 the receiver (older protocols used to omit the sending of excludes in
1654 this situation since there were no receiver-specific rules that
1655 survived --delete-excluded back then). Note that, as with all the
1656 filter-list sending, only items that are significant to the other
1657 side will actually be sent over the wire, so the filter-rule list
1658 that is sent in this scenario is often empty.
1659
1660 - An index equal to the file-list count is sent as a keep-alive packet
1661 from the generator to the sender, which then forwards it on to the
1662 receiver. This normally invalid index is only a valid keep-alive
1663 packet if the 16-bit flag-word that follows it contains a single bit
1664 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
1665
1666 - A protocol-29 batch file includes a bit for the setting of the --dirs
1667 option and for the setting of the --compress option. Also, the shell
1668 script created by --write-batch will use the --filter option instead
1669 of --exclude-from to capture any filter rules.
1670
1671 BUILD CHANGES:
1672
1673 - Handle an operating system that use mkdev() in place of makedev().
1674
1675 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
1676
1677\f
ca39ebf9
WD
1678NEWS for rsync 2.6.3 (30 Sep 2004)
1679Protocol: 28 (unchanged)
1680Changes since 2.6.2:
1681
1682 SECURITY FIXES:
1683
1684 - A bug in the sanitize_path routine (which affects a non-chrooted
1685 rsync daemon) could allow a user to craft a pathname that would get
1686 transformed into an absolute path for certain options (but not for
1687 file-transfer names). If you're running an rsync daemon with chroot
1688 disabled, *please upgrade*, ESPECIALLY if the user privs you run
1689 rsync under is anything above "nobody".
1690
1691 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
1692
1693 - Please note that the 2-line footer (output when verbose) now uses the
1694 term "sent" instead of "wrote" and "received" instead of "read". If
1695 you are not parsing the numeric values out of this footer, a script
1696 would be better off using the empty line prior to the footer as the
1697 indicator that the verbose output is over.
1698
1699 - The output from the --stats option was similarly affected to change
1700 "written" to "sent" and "read" to "received".
1701
1702 - Rsync ensures that a filename that contains a newline gets mentioned
1703 with each newline transformed into a question mark (which prevents a
1704 filename from causing an empty line to be output).
1705
1706 - The "backed up ..." message that is output when at least 2 --verbose
1707 options are specified is now the same both with and without the
1708 --backup-dir option.
1709
1710 BUG FIXES:
1711
1712 - Fixed a crash bug that might appear when --delete was used and
1713 multiple source directories were specified.
1714
1715 - Fixed a 32-bit truncation of the file length when generating the
1716 checksums.
1717
1718 - The --backup code no longer attempts to create some directories
1719 over and over again (generating warnings along the way).
1720
1721 - Fixed a bug in the reading of the secrets file (by the daemon) and
1722 the password file (by the client): the files no longer need to be
1723 terminated by a newline for their content to be read in.
1724
1725 - If a file has a read error on the sending side or the reconstructed
1726 data doesn't match the expected checksum (perhaps due to the basis
1727 file changing during the transfer), the receiver will no longer
1728 retain the resulting file unless the --partial option was specified.
1729 (Note: for the read-error detection to work, neither side can be
1730 older than 2.6.3 -- older receivers will always retain the file, and
1731 older senders don't tell the receiver that the file had a read
1732 error.)
1733
1734 - If a file gets resent in a single transfer and the --backup option
1735 is enabled, rsync no longer performs a duplicate backup (it used to
1736 overwrite the original file in the backup area).
1737
1738 - Files specified in the daemon's "exclude" or "exclude from" config
1739 items are now excluded from being uploaded (assuming that the module
1740 allows uploading at all) in addition to the old download exclusion.
1741
1742 - Got rid of a potential hang in the receiver when near the end of a
1743 phase.
1744
1745 - When using --backup without a --backup-dir, rsync no longer preserves
1746 the modify time on directories. This avoids confusing NFS.
1747
1748 - When --copy-links (-L) is specified, we now output a separate error
1749 for a symlink that has no referent instead of claiming that a file
1750 "vanished".
1751
1752 - The --copy-links (-L) option no longer has the side-effect of telling
1753 the receiving side to follow symlinks. See the --keep-dirlinks
1754 option (mentioned below) for a way to specify that behavior.
1755
1756 - Error messages from the daemon server's option-parsing (such as
1757 refused options) are now successfully transferred back to the client
1758 (the server used to fail to send the message because the socket
1759 wasn't in the right state for the message to get through).
1760
1761 - Most transfer errors that occur during a daemon transfer are now
1762 returned to the user in addition to being logged (some messages are
1763 intended to be daemon-only and are not affected by this).
1764
1765 - Fixed a bug in the daemon authentication code when using one of the
1766 batch-processing options.
1767
1768 - We try to work around some buggy IPv6 implementations that fail to
1769 implement IPV6_V6ONLY. This should fix the "address in use" error
1770 that some daemons get when running on an OS with a buggy IPv6
1771 implementation. Also, if the new code gets this error, we might
1772 suggest that the user specify --ipv4 or --ipv6 (if we think it will
1773 help).
1774
1775 - When the remote rsync dies, make a better effort to recover any error
1776 messages it may have sent before dying (the local rsync used to just
1777 die with a socket-write error).
1778
1779 - When using --delete and a --backup-dir that contains files that are
1780 hard-linked to their destination equivalents, rsync now makes sure
1781 that removed files really get removed (avoids a really weird rename()
1782 behavior).
1783
1784 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
1785 the int64 type is defined as an off_t and it actually has 64-bits.
1786
1787 - Added a configure check for open64() without mkstemp64() so that we
1788 can avoid using mkstemp() when such a combination is encountered.
1789 This bypasses a problem writing out large temp files on OSes such as
1790 AIX and HP-UX.
1791
1792 - Fixed an age-old crash problem with --read-batch on a local copy
1793 (rsync was improperly assuming --whole-file for the local copy).
1794
1795 - When --dry-run (-n) is used and the destination directory does not
1796 exist, rsync now produces a correct report of files that would be
1797 sent instead of dying with a chdir() error.
1798
1799 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
1800 with an error instead of waiting for the connection to finish.
1801
1802 - Fixed an ssh interaction that could cause output to be lost when the
1803 user chose to combine the output of rsync's stdout and stderr (e.g.
1804 using the "2>&1").
1805
920240a6
WD
1806 - Fixed an option-parsing bug when --files-from got passed to a daemon.
1807
ca39ebf9
WD
1808 ENHANCEMENTS:
1809
1810 - Added the --partial-dir=DIR option that lets you specify where to
1811 (temporarily) put a partially transferred file (instead of over-
1812 writing the destination file). E.g. --partial-dir=.rsync-partial
1813 Also added support for the RSYNC_PARTIAL_DIR environment variable
1814 that, when found, transforms a regular --partial option (such as
1815 the convenient -P option) into one that also specifies a directory.
1816
1817 - Added --keep-dirlinks (-K), which allows you to symlink a directory
1818 onto another partition on the receiving side and have rsync treat it
1819 as matching a normal directory from the sender.
1820
1821 - Added the --inplace option that tells rsync to write each destination
1822 file without using a temporary file. The matching of existing data
1823 in the destination file can be severely limited by this, but there
1824 are also cases where this is more efficient (such as appending data).
1825 Use only when needed (see the man page for more details).
1826
1827 - Added the "write only" option for the daemon's config file.
1828
1829 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
1830 and documented all these options in the man page.
1831
1832 - Improved the handling of the --bwlimit option so that it's less
1833 bursty, more accurate, and works properly over a larger range of
1834 values.
1835
1836 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
1837 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
1838
1839 - Added the --checksum-seed=N option for advanced users.
1840
1841 - Batch writing/reading has a brand-new implementation that is simpler,
1842 fixes a few weird problems with the old code (such as no longer
1843 sprinkling the batch files into different dirs or even onto different
1844 systems), and is much less intrusive into the code (making it easier
1845 to maintain for the future). The new code generates just one data
1846 file instead of three, which makes it possible to read the batch on
1847 stdin via a remote shell. Also, the old requirement of forcing the
1848 same fixed checksum-seed for all batch processing has been removed.
1849
1850 - If an rsync daemon has a module set with "list = no" (which hides its
1851 presence in the list of available modules), a user that fails to
1852 authenticate gets the same "unknown module" error that they would get
1853 if the module were actually unknown (while still logging the real
1854 error to the daemon's log file). This prevents fishing for module
1855 names.
1856
1857 - The daemon's "refuse options" config item now allows you to match
1858 option names using wildcards and/or the single-letter option names.
1859
1860 - Each transferred file now gets its permissions and modified-time
1861 updated before the temp-file gets moved into place. Previously, the
1862 finished file would have a very brief window where its permissions
1863 disallowed all group and world access.
1864
1865 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
1866 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
1867
1868 - The daemon's wildcard expanding code can now handle more than 1000
1869 filenames (it's now limited by memory instead of having a hard-wired
1870 limit).
1871
1872 INTERNAL:
1873
1874 - Some cleanup in the exclude code has saved some per-exclude memory
1875 and made the code easier to maintain.
1876
1877 - Improved the argv-overflow checking for a remote command that has a
1878 lot of args.
1879
1880 - Use rsyserr() in the various places that were still calling rprintf()
1881 with strerror() as an arg.
1882
1883 - If an rsync daemon is listening on multiple sockets (to handle both
1884 IPv4 and IPv6 to a single port), we now close all the unneeded file
1885 handles after we accept a connection (we used to close just one of
1886 them).
1887
1888 - Optimized the handling of larger block sizes (rsync used to slow to a
1889 crawl if the block size got too large).
1890
1891 - Optimized away a loop in hash_search().
1892
1893 - Some improvements to the sanitize_path() and clean_fname() functions
1894 makes them more efficient and produce better results (while still
1895 being compatible with the file-name cleaning that gets done on both
1896 sides when sending the file-list).
1897
1898 - Got rid of alloc_sanitize_path() after adding a destination-buffer
1899 arg to sanitize_path() made it possible to put all the former's
1900 functionality into the latter.
1901
1902 - The file-list that is output when at least 4 verbose options are
1903 specified reports the uid value on the sender even when rsync is
1904 not running as root (since we might be sending to a root receiver).
1905
1906 BUILD CHANGES:
1907
1908 - Added a "gen" target to rebuild most of the generated files,
1909 including configure, config.h.in, the man pages, and proto.h.
1910
1911 - If "make proto" doesn't find some changes in the prototypes, the
1912 proto.h file is left untouched (its time-stamp used to always be
1913 updated).
1914
1915 - The variable $STRIP (that is optionally set by the install-strip
1916 target's rule) was changed to $INSTALL_STRIP because some systems
1917 have $STRIP already set in the environment.
1918
1919 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
1920
1921 - When cross-compiling, the gettimeofday() function is now assumed to
1922 be a modern version that takes two-args (since we can't test it).
1923
1924 DEVELOPER RELATED:
1925
1926 - The scripts in the testsuite dir were cleaned up a bit and a few
1927 new tests added.
1928
1929 - Some new diffs were added to the patches dir, and some accepted
1930 ones were removed.
1931
1932\f
c7be6dec
WD
1933NEWS for rsync 2.6.2 (30 Apr 2004)
1934Protocol: 28 (unchanged)
1935Changes since 2.6.1:
1936
1937 BUG FIXES:
1938
1939 - Fixed a major bug in the sorting of the filenames when --relative
1940 is used for some sources (just sources such as "/" and "/*" were
1941 affected). This fix ensures that we ask for the right file-list
1942 item when requesting changes from the sender.
1943
1944 - Rsync now checks the return value of the close() function to
1945 better report disk-full problems on an NFS file system.
1946
1947 - Restored the old daemon-server behavior of logging error messages
1948 rather than returning them to the user. (A better long-term fix
1949 will be sought in the future.)
1950
1951 - An obscure uninitialized-variable bug was fixed in the uid/gid
1952 code. (This bug probably had no ill effects.)
1953
1954 BUILD CHANGES:
1955
1956 - Got rid of the configure check for sys/sysctl.h (it wasn't used
1957 and was causing a problem on some systems). Also improved the
1958 broken-largefile-locking test to try to avoid failure due to an
1959 NFS build-dir.
1960
1961 - Fixed a compile problem on systems that don't define
1962 AI_NUMERICHOST.
1963
1964 - Fixed a compile problem in the popt source for compilers that
1965 don't support __attribute__.
1966
1967 DEVELOPER RELATED:
1968
1969 - Improved the testsuite's "merge" test to work on OSF1.
1970
1971 - Two new diffs were added to the patches dir.
1972
1973\f
1974NEWS for rsync 2.6.1 (26 Apr 2004)
1975Protocol: 28 (changed)
1976Changes since 2.6.0:
1977
1978 SECURITY FIXES:
1979
1980 - Paths sent to an rsync daemon are more thoroughly sanitized when
1981 chroot is not used. If you're running a non-read-only rsync
1982 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
1983 user privs you run rsync under is anything above "nobody".
1984
1985 ENHANCEMENTS:
1986
1987 - Lower memory use, more optimal transfer of data over the socket,
1988 and lower CPU usage (see the INTERNAL section for details).
1989
1990 - The RSYNC_PROXY environment variable can now contain a
1991 "USER:PASS@" prefix before the "HOST:PORT" information.
1992 (Bardur Arantsson)
1993
1994 - The --progress output now mentions how far along in the transfer
1995 we are, including both a count of files transferred and a
1996 percentage of the total file-count that we've processed. It also
1997 shows better current-rate-of-transfer and remaining-transfer-time
1998 values.
1999
2000 - Documentation changes now attempt to describe some often mis-
2001 understood features more clearly.
2002
2003 BUG FIXES:
2004
2005 - When -x (--one-file-system) is combined with -L (--copy-links) or
2006 --copy-unsafe-links, no symlinked files are skipped, even if the
2007 referent file is on a different filesystem.
2008
2009 - The --link-dest code now works properly for a non-root user when
2010 (1) the UIDs of the source and destination differ and -o was
2011 specified, or (2) when the group of the source can't be used on
2012 the destination and -g was specified.
2013
2014 - Fixed a bug in the handling of -H (hard-links) that might cause
2015 the expanded PATH/NAME value of the current item to get
2016 overwritten (due to an expanded-name caching bug).
2017
2018 - We now reset the "new data has been sent" flag at the start of
2019 each file we send. This makes sure that an interrupted transfer
2020 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 2021 than the current basis file when no new data has been transferred
c7be6dec
WD
2022 over the wire for that file.
2023
2024 - Fixed a byte-order problem in --batch-mode on big-endian machines.
2025 (Jay Fenlason)
2026
2027 - When using --cvs-exclude, the exclude items we get from a
2028 per-directory's .cvsignore file once again only affect that one
2029 directory (not all following directories too). The items are also
2030 now properly word-split and parsed without any +/- prefix parsing.
2031
2032 - When specifying the USER@HOST: prefix for a file, the USER part
2033 can now contain an '@', if needed (i.e. the last '@' is used to
2034 find the HOST, not the first).
2035
2036 - Fixed some bugs in the handling of group IDs for non-root users:
2037 (1) It properly handles a group that the sender didn't have a name
2038 for (it would previously skip changing the group on any files in
2039 that group). (2) If --numeric-ids is used, rsync no longer
2040 attempts to set groups that the user doesn't have the permission
2041 to set.
2042
2043 - Fixed the "refuse options" setting in the rsyncd.conf file.
2044
2045 - Improved the -x (--one-file-system) flag's handling of any mount-
2046 point directories we encounter. It is both more optimal (in that
2047 it no longer does a useless scan of the contents of the mount-
2048 point dirs) and also fixes a bug where a remapped mount of the
2049 original filesystem could get discovered in a subdir we should be
2050 ignoring.
2051
2052 - Rsync no longer discards a double-slash at the start of a filename
2053 when trying to open the file. It also no longer constructs names
2054 that start with a double slash (unless the user supplied them).
2055
2056 - Path-specifying options to a daemon should now work the same with
2057 or without chroot turned on. Previously, such a option (such as
2058 --link-dest) would get its absolute path munged into a relative
2059 one if chroot was not on, making that setting fairly useless.
2060 Rsync now transforms the path into one that is based on the
2061 module's base dir when chroot is not enabled.
2062
2063 - Fixed a compatibility problem interacting with older rsync
2064 versions that might send us an empty --suffix value without
2065 telling us that --backup-dir was specified.
2066
2067 - The "hosts allow" option for a daemon-over-remote-shell process
2068 now has improved support for IPv6 addresses and a fix for systems
2069 that have a length field in their socket structs.
2070
2071 - Fixed the ability to request an empty backup --suffix when sending
2072 files to an rsync daemon.
2073
920240a6
WD
2074 - Fixed an option-parsing bug when --files-from was sent to a server
2075 sender.
2076
c7be6dec
WD
2077 INTERNAL:
2078
2079 - Most of the I/O is now buffered, which results in a pretty large
2080 speedup when running under MS Windows. (Craig Barratt)
2081
2082 - Optimizations to the name-handling/comparing code have made some
2083 significant reductions in user-CPU time for large file sets.
2084
2085 - Some cleanup of the variable types make the code more consistent.
2086
2087 - Reduced memory requirements of hard link preservation.
2088 (J.W. Schultz)
2089
2090 - Implemented a new algorithm for hard-link handling that speeds up
2091 the code significantly. (J.W. Schultz and Wayne Davison)
2092
2093 - The --hard-link option now uses the first existing file in the
2094 group of linked files as the basis for the transfer. This
2095 prevents the sub-optimal transfer of a file's data when a new
2096 hardlink is added on the sending side and it sorts alphabetically
2097 earlier in the list than the files that are already present on the
2098 receiving side.
2099
2100 - Dropped support for protocol versions less than 20 (2.3.0 released
2101 15 Mar 1999) and activated warnings for protocols less than 25
2102 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
2103 severally)
2104
2105 - More optimal data transmission for --hard-links (protocol 28).
2106
2107 - More optimal data transmission for --checksum (protocol 28).
2108
2109 - Less memory is used when --checksum is specified.
2110
2111 - Less memory is used in the file list (a per-file savings).
2112
2113 - The generator is now better about not modifying the file list
2114 during the transfer in order to avoid a copy-on-write memory
2115 bifurcation (on systems where fork() uses shared memory).
2116 Previously, rsync's shared memory would slowly become unshared,
2117 resulting in real memory usage nearly doubling on the receiving
2118 side by the end of the transfer. Now, as long as permissions
2119 are being preserved, the shared memory should remain that way
2120 for the entire transfer.
2121
2122 - Changed hardlink info and file_struct + strings to use allocation
2123 pools. This reduces memory use for large file-sets and permits
2124 freeing memory to the OS. (J.W. Schultz)
2125
2126 - The 2 pipes used between the receiver and generator processes
2127 (which are forked on the same machine) were reduced to 1 pipe and
2128 the protocol improved so that (1) it is now impossible to have the
2129 "redo" pipe fill up and hang rsync, and (2) trailing messages from
2130 the receiver don't get lost on their way through the generator
2131 over to the sender (which mainly affected hard-link messages and
2132 verbose --stats output).
2133
2134 - Improved the internal uid/gid code to be more portable and a
2135 little more optimized.
2136
2137 - The device numbers sent when using --devices are now sent as
2138 separate major/minor values with 32-bit accuracy (protocol 28).
2139 Previously, the copied devices were sent as a single 32-bit
2140 number. This will make inter-operation of 64-bit binaries more
2141 compatible with their 32-bit brethren (with both ends of the
2142 connection are using protocol 28). Note that optimizations in the
2143 binary protocol for sending the device numbers often results in
2144 fewer bytes being used than before, even though more precision is
2145 now available.
2146
2147 - Some cleanup of the exclude/include structures and its code made
2148 things clearer (internally), simpler, and more efficient.
2149
2150 - The reading & writing of the file-list in batch-mode is now
2151 handled by the same code that sends & receives the list over the
2152 wire. This makes it much easier to maintain. (Note that the
2153 batch code is still considered to be experimental.)
2154
2155 BUILD CHANGES:
2156
2157 - The configure script now accepts --with-rsyncd-conf=PATH to
2158 override the default value of the /etc/rsyncd.conf file.
2159
2160 - Fixed configure bug when running "./configure --disable-ipv6".
2161
2162 - Fixed compilation problem on Tru64 Unix (having to do with
2163 sockaddr.sa_len and sockaddr.sin_len).
2164
2165 DEVELOPER RELATED:
2166
2167 - Fixed "make test" bug when build dir is not the source dir.
2168
2169 - Added a couple extra diffs in the "patches" dir, removed the ones
2170 that got applied, and rebuilt the rest.
2171
2172\f
0f1aa0d3
WD
2173NEWS for rsync 2.6.0 (1 Jan 2004)
2174Protocol: 27 (changed)
2175Changes since 2.5.7:
2176
2177 ENHANCEMENTS:
2178
2179 * "ssh" is now the default remote shell for rsync. If you want to
2180 change this, configure like this: "./configure --with-rsh=rsh".
2181
2182 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
2183 Note that --from0 affects the line-ending character for all the
2184 files read by the --*-from options. (Wayne Davison)
2185
2186 * Length of csum2 is now per-file starting with protocol version
2187 27. (J.W. Schultz)
2188
2189 * Per-file dynamic block size is now sqrt(file length). The
2190 per-file checksum size is determined according to an algorithm
2191 provided by Donovan Baarda which reduces the probability of rsync
2192 algorithm corrupting data and falling back using the whole md4
2193 checksums. (J.W. Schultz, Donovan Baarda)
2194
2195 * The --stats option no longer includes the (debug) malloc summary
2196 unless the verbose option was specified at least twice.
2197
2198 * Added a new error/warning code for when files vanish from the
2199 sending side. Made vanished source files not interfere with the
2200 file-deletion pass when --delete-after was specified.
2201
2202 * Various trailing-info sections are now preceded by a newline.
2203
2204 BUG FIXES:
2205
2206 * Fixed several exclude/include matching bugs when using wild-cards.
2207 This has a several user-visible effects, all of which make the
2208 matching more consistent and intuitive. This should hopefully not
2209 cause anyone problems since it makes the matching work more like
2210 what people are expecting. (Wayne Davison)
2211
2212 - A pattern with a "**" no longer causes a "*" to match slashes.
2213 For example, with "/*/foo/**", "foo" must be 2 levels deep.
2214 [If your string has BOTH "*" and "**" wildcards, changing the
2215 "*" wildcards to "**" will provide the old behavior in all
2216 versions.]
2217
2218 - "**/foo" now matches at the base of the transfer (like /foo
2219 does). [Use "/**/foo" to get the old behavior in all versions.]
2220
2221 - A non-anchored wildcard term floats to match beyond the base of
2222 the transfer. E.g. "CVS/R*" matches at the end of the path,
2223 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
2224 to get the old behavior in all versions.]
2225
2226 - Including a "**" in the match term causes it to be matched
2227 against the entire path, not just the name portion, even if
2228 there aren't any interior slashes in the term. E.g. "foo**bar"
2229 would exclude "/path/foo-bar" (just like before) as well as
2230 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
2231 old behavior in all versions.]
2232
2233 * The exclude list specified in the daemon's config file is now
2234 properly applied to the pulled items no matter how deep the
2235 user's file-args are in the source tree. (Wayne Davison)
2236
2237 * For protocol version >= 27, mdfour_tail() is called when the
2238 block size (including checksum_seed) is a multiple of 64.
2239 Previously it was not called, giving the wrong MD4 checksum.
2240 (Craig Barratt)
2241
2242 * For protocol version >= 27, a 64 bit bit counter is used in
2243 mdfour.c as required by the RFC. Previously only a 32 bit bit
2244 counter was used, causing incorrect MD4 file checksums for
2245 file sizes >= 512MB - 4. (Craig Barratt)
2246
2247 * Fixed a crash bug when interacting with older rsync versions and
2248 multiple files of the same name are destined for the same dir.
2249 (Wayne Davison)
2250
2251 * Keep tmp names from overflowing MAXPATHLEN.
2252
2253 * Make --link-dest honor the absence of -p, -o, and -g.
2254
2255 * Made rsync treat a trailing slash in the destination in a more
2256 consistent manner.
2257
2258 * Fixed file I/O error detection. (John Van Essen)
2259
2260 * Fixed bogus "malformed address {hostname}" message in rsyncd log
2261 when checking IP address against hostnames from "hosts allow"
2262 and "hosts deny" parameters in config file.
2263
2264 * Print heap statistics when verbose >= 2 instead of when >= 1.
2265
2266 * Fixed a compression (-z) bug when syncing a mostly-matching file
2267 that contains already-compressed data. (Yasuoka Masahiko and
2268 Wayne Davison)
2269
2270 * Fixed a bug in the --backup code that could cause deleted files
2271 to not get backed up.
2272
2273 * When the backup code makes new directories, create them with mode
2274 0700 instead of 0755 (since the directory permissions in the
2275 backup tree are not yet copied from the main tree).
2276
2277 * Call setgroups() in a more portable manner.
2278
2279 * Improved file-related error messages to better indicate exactly
2280 what pathname failed. (Wayne Davison)
2281
2282 * Fixed some bugs in the handling of --delete and --exclude when
2283 using the --relative (-R) option. (Wayne Davison)
2284
2285 * Fixed bug that prevented regular files from replacing
2286 special files and caused a directory in --link-dest or
2287 --compare-dest to block the creation of a file with the
2288 same path. A directory still cannot be replaced by a
2289 regular file unless --delete specified. (J.W. Schultz)
2290
2291 * Detect and report when open or opendir succeed but read and
2292 readdir fail caused by network filesystem issues and truncated
2293 files. (David Norwood, Michael Brown, J.W. Schultz)
2294
2295 * Added a fix that should give ssh time to restore the tty settings
2296 if the user presses Ctrl-C at an ssh password prompt.
2297
2298 INTERNAL:
2299
2300 * Eliminated vestigial support for old versions that we stopped
2301 supporting. (J.W. Schultz)
2302
2303 * Simplified some of the option-parsing code. (Wayne Davison)
2304
2305 * Some cleanup made to the exclude code, as well as some new
2306 defines added to enhance readability. (Wayne Davison)
2307
2308 * Changed the protocol-version code so that it can interact at a
2309 lower protocol level than the maximum supported by both sides.
2310 Added an undocumented option, --protocol=N, to force the value
2311 we advertise to the other side (primarily for testing purposes).
2312 (Wayne Davison)
2313
2314\f
276877cf
WD
2315NEWS for rsync 2.5.7 (4 Dec 2003)
2316Protocol: 26 (unchanged)
2317Changes since 2.5.6:
2318
2319 SECURITY FIXES:
2320
2321 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
2322 Russell, Andrea Barisani)
2323
2324\f
2325NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
2326Protocol: 26 (unchanged)
2327Changes since 2.5.5:
2328
2329 ENHANCEMENTS:
2330
2331 * The --delete-after option now implies --delete. (Wayne Davison)
2332
2333 * The --suffix option can now be used with --backup-dir. (Michael
2334 Zimmerman)
2335
a923437b 2336 * Combining "::" syntax with the --rsh/-e option now uses the
276877cf
WD
2337 specified remote-shell as a transport to talk to a (newly-spawned)
2338 server-daemon. This allows someone to use daemon features, such
2339 as modules, over a secure protocol, such as ssh. (JD Paul)
2340
2341 * The rsync:// syntax for daemon connections is now accepted in the
2342 destination field.
2343
2344 * If the file name given to --include-from or --exclude-from is "-",
2345 rsync will read from standard input. (J.W. Schultz)
2346
2347 * New option --link-dest which is like --compare-dest except that
2348 unchanged files are hard-linked in to the destination directory.
2349 (J.W. Schultz)
2350
2351 * Don't report an error if an excluded file disappears during an
2352 rsync run. (Eugene Chupriyanov and Bo Kersey)
2353
2354 * Added .svn to --cvs-exclude list to support subversion. (Jon
2355 Middleton)
2356
2357 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
2358 and "hosts deny" fields. (Hideaki Yoshifuji)
2359
2360 * Changed exclude file handling to permit DOS or MAC style line
2361 terminations. (J.W. Schultz)
2362
2363 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
2364 (Dave Dykstra)
2365
2366 BUG FIXES:
2367
2368 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
2369 L. Allen, Martin Pool)
2370
2371 * Generate each file's rolling-checksum data as we send it, not
2372 in a separate (memory-eating) pass before hand. This prevents
2373 timeout errors on really large files. (Stefan Nehlsen)
2374
2375 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
2376
2377 * Better handling of some client-server errors. (Martin Pool)
2378
2379 * Fixed a crash that would occur when sending a list of files that
2380 contains a duplicate name (if it sorts to the end of the file
2381 list) and using --delete. (Wayne Davison)
2382
2383 * Fixed the file-name duplicate-removal code when dealing with multiple
2384 dups in a row. (Wayne Davison)
2385
2386 * Fixed a bug that caused rsync to lose the exit status of its child
2387 processes and sometimes return an exit code of 0 instead of showing
2388 an error. (David R. Staples, Dave Dykstra)
2389
2390 * Fixed bug in --copy-unsafe-links that caused it to be completely
2391 broken. (Dave Dykstra)
2392
2393 * Prevent infinite recursion in cleanup code under certain circumstances.
2394 (Sviatoslav Sviridov and Marc Espie)
2395
2396 * Fixed a bug that prevented rsync from creating intervening directories
2397 when --relative-paths/-R is set. (Craig Barratt)
2398
2399 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
2400
2401 INTERNAL:
2402
2403 * Many code cleanups and improved internal documentation. (Martin
2404 Pool, Nelson Beebe)
2405
2406 * Portability fixes. (Dave Dykstra and Wayne Davison)
2407
2408 * More test cases. (Martin Pool)
2409
2410 * Some test-case fixes. (Brian Poole, Wayne Davison)
2411
2412 * Updated included popt to the latest vendor drop, version 1.6.4.
2413 (Jos Backus)
2414
2415 * Updated config.guess and config.sub to latest versions; this
2416 means rsync should build on more platforms. (Paul Green)
2417
2418\f
2419NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
2420Protocol: 26 (unchanged)
2421Changes since 2.5.4:
54c7298c
MP
2422
2423 ENHANCEMENTS:
2424
2425 * With --progress, when a transfer is complete show the time taken;
2426 otherwise show expected time to complete. (Cameron Simpson)
2427
2428 * Make "make install-strip" works properly, and "make install"
2429 accepts a DESTDIR variable for help in building binary packages.
2430 (Peter Breitenlohner, Greg Louis)
2431
2432 * If configured with --enable-maintainer-mode, then on receipt of
2433 a fatal signal rsync will try to open an xterm running gdb,
2434 similarly to Samba's "panic action" or GNOME's bug-buddy.
2435 (Martin Pool)
2436
2437
2438 BUG FIXES:
2439
2440 * Fix situation where failure to fork (e.g. because out of process
2441 slots) would cause rsync to kill all processes owned by the
2442 current user. Yes, really! (Paul Haas, Martin Pool)
2443
2444 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
2445
2446 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
2447 Pool.)
2448
2449 * Fix --whole-file problem that caused it to be the default even
2450 for remote connections. (Martin Pool, Frank Schulz)
2451
2452 * Work around bug in Mac OS X mkdir(2), which cannot handle
2453 trailing slashes.
2454 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
2455 (Martin Pool)
2456
2457 * Improved network error handling. (Greg A. Woods)
2458
2459\f
276877cf
WD
2460NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
2461Protocol: 26 (unchanged)
2462Changes since 2.5.3:
c9a66d41
MP
2463
2464 BUG FIXES:
2465
2466 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
2467 Tridgell) (CVE CAN-2002-0059)
276877cf 2468
c9a66d41
MP
2469 ENHANCEMENTS:
2470
2471 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
2472 (Note that rsync still uses a custom version of zlib; you can
2473 not just link against a system library. See zlib/README.rsync)
2474
2475 * Additional test cases for --compress. (Martin Pool)
2476
2477\f
276877cf
WD
2478NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
2479Protocol: 26 (unchanged)
2480Changes since 2.5.2:
d40fb723
MP
2481
2482 SECURITY FIXES:
2483
2484 * Make sure that supplementary groups are removed from a server
2485 process after changing uid and gid. (Ethan Benson) (Debian bug
2486 #132272, CVE CAN-2002-0080)
2487
2488 BUG FIXES:
2489
2490 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
2491 CAN-2002-0059)
2492
276877cf 2493 * Fixed problem that in many cases caused the error message
d40fb723
MP
2494 unexpected read size of 0 in map_ptr
2495 and resulted in the wrong data being copied.
2496
2497 * Fixed compilation errors on some systems caused by the use of
2498 "unsigned int64" in rsync.h.
2499
2500 * Fixed problem on systems such as Sunos4 that do not support realloc
2501 on a NULL pointer; error was "out of memory in flist_expand".
2502
2503 * Fix for rsync server processes hanging around after the client
2504 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
2505
2506 * Cope with BSD systems on which mkdir() will not accept a trailing
2507 slash.
2508
2509 ENHANCEMENTS:
2510
2511 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
2512 rsync still uses a custom version of zlib; you can not just link
2513 against a system library. See zlib/README.rsync)
276877cf 2514
d40fb723
MP
2515 * Command to initiate connections is only shown with -vv, rather
2516 than -v as in 2.5.2. Output from plain -v is more similar to
2517 what was historically used so as not to break scripts that try
2518 to parse the output.
2519
2520 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
2521
2522 * Made the --write-batch and --read-batch options actually work
2523 and added documentation in the man page (Jos Backus)
2524
2525 * If the daemon is unable to fork a child to accept a connection,
2526 print an error message. (Colin Walters)
2527
276877cf
WD
2528\f
2529NEWS for rsync 2.5.2 (26 Jan 2002)
2530Protocol: 26 (changed)
2531Changes since 2.5.1:
97efa5c3
MP
2532
2533 SECURITY FIXES:
2534
2535 * Signedness security patch from Sebastian Krahmer
2536 <krahmer@suse.de> -- in some cases we were not sufficiently
2537 careful about reading integers from the network.
2538
2539 BUG FIXES:
2540
2541 * Fix possible string mangling in log files.
2542
2543 * Fix for setting local address of outgoing sockets.
2544
2545 * Better handling of hardlinks and devices on platforms with
2546 64-bit dev_t or ino_t.
2547
2548 * Name resolution on machines supporting IPv6 is improved.
2549
2550 * Fix for device nodes. (dann frazier) (Debian #129135)
2551
2552 ENHANCEMENTS:
2553
2554 * With -v, rsync now shows the command used to initiate an ssh/rsh
2555 connection.
2556
2557 * --statistics now shows memory heap usage on platforms that
276877cf 2558 support mallinfo().
97efa5c3
MP
2559
2560 * "The Ted T'so school of program optimization": make progress
2561 visible and people will think it's faster. (With --progress,
2562 rsync will show you how many files it has seen as it builds the
2563 file_list, giving some indication that it has not hung.)
2564
2565 * Improvements to batch mode support. This is still experimental
2566 but testing would be welcome. (Jos Backus)
276877cf 2567
97efa5c3
MP
2568 * New --ignore-existing option, patch previously distributed with
2569 Vipul's Razor. (Debian #124286)
2570
276877cf
WD
2571\f
2572NEWS for rsync 2.5.1 (3 Jan 2002)
2573Protocol: 25 (unchanged)
2574Changes since 2.5.0:
2575
2576 BUG FIXES:
499957d9 2577
499957d9
MP
2578 * Fix for segfault in --daemon mode configuration parser. (Paul
2579 Mackerras)
2580
2581 * Correct string<->address parsing for both IPv4 and 6.
2582 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
2583 Hagino)
2584
2585 * Various fixes for IPv6 support. (Dave Dykstra)
2586
2587 * rsync.1 typo fix. (Matt Kraai)
2588
2589 * Test suite typo fixes. (Tom Schmidt)
2590
2591 * rsync.1 grammar and clarity improvements. (Edward
2592 Welbourne)
2593
2594 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
2595
2596 ENHANCEMENTS:
2597
2598 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
2599 multiple of bytes/s) and estimated time to completion. (Rik
2600 Faith)
2601
499957d9 2602 * --no-detach option, required to run as a W32 service and also
276877cf
WD
2603 useful when running on Unix under daemontools, AIX's SRC, or a
2604 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
2605
2606 * Clearer error messages for some conditions.
2607
c9a66d41 2608\f
276877cf
WD
2609NEWS for rsync 2.5.0 (30 Nov 2001)
2610Protocol: 25 (changed)
2611Changes since 2.4.6:
d313ae7d
MP
2612
2613 ANNOUNCEMENTS
2614
2615 * Martin Pool <mbp@samba.org> is now a co-maintainer.
2616
2617 NEW FEATURES
2618
2619 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
2620
2621 * Shell wildcards are allowed in "auth users" lines.
2622
2623 * Merged UNC rsync+ patch to support creation of standalone patch
2624 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
2625 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
2626
2627 * IPv6 support based on a patch from KAME.net, on systems
2628 including modern versions of Linux, Solaris, and HP-UX. Also
2629 includes IPv6 compatibility functions for old OSs by the
2630 Internet Software Consortium, Paul Vixie, the OpenSSH
2631 portability project, and OpenBSD.
2632
2633 ENHANCEMENTS
2634
2635 * Include/exclude cluestick: with -vv, print out whether files are
2636 included or excluded and why.
2637
2638 * Many error messages have more friendly explanations and more
2639 details.
2640
2641 * Manual page improvements plus scanty protocol documentation.
2642
2643 * When running as --daemon in the background and using a "log
2644 file" rsyncd.conf directive, close the log file every time it is
2645 open when going to sleep on the socket. This allows the log
2646 file to get cleaned out by another process.
2647
2648 * Change to using libpopt rather than getopt for processing
2649 options. This makes the code cleaner and the behaviour more
2650 consistent across platforms. popt is included and built if not
2651 installed on the platform.
2652
2653 * More details in --version, including note about whether 64-bit
2654 files, symlinks and hardlinks are supported.
2655
2656 * MD4 code may use less CPU cycles.
2657
2658 * Use mkstemp on systems where it is secure. If we use mktemp,
2659 explain that we do it in a secure way.
2660
2661 * --whole-file is the default when source and target are on the
2662 local machine.
2663
2664 BUG FIXES:
2665
2666 * Fix for various bugs causing rsync to hang.
2667
2668 * Attempt to fix Large File Summit support on AIX.
2669
2670 * Attempt to fix error handling lockup bug.
2671
2672 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 2673 to transfer fail to transfer.
d313ae7d
MP
2674
2675 * For log messages containing ridiculously long strings that might
2676 overflow a buffer rsync no longer aborts, but rather prints an
2677 ellipsis at the end of the string. (Patch from Ed Santiago.)
2678
2679 PLATFORMS:
2680
2681 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
2682
2683 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 2684 scripts. It is not required to simply build rsync.
d313ae7d
MP
2685
2686 * Platforms thought to work in this release:
2687
2688 Cray SV1 UNICOS 10.0.0.8 cc
2689 Debian Linux 2.2 UltraSparc gcc
2690 Debian Linux testing/unstable ARM gcc
2691 FreeBSD 3.3-RELEASE i386 cc
2692 FreeBSD 4.1.1-RELEASE i386 cc
2693 FreeBSD 4.3-STABLE i386 cc
2694 HP PA-RISC HP-UX 10.20 gcc
2695 HP PA-RISC HP-UX 11.11 cc
2696 IRIX 6.5 MIPS cc
2697 IRIX 6.5 MIPS gcc
2698 Mac OS X PPC (--disable-ipv6) cc
2699 NetBSD 1.5 i386 gcc
2700 NetBSD Current i386 cc
2701 OpenBSD 2.5 Sparc gcc
2702 OpenBSD 2.9 i386 cc
2703 OpenBSD Current i386 cc
2704 RedHat 6.2 i386 gcc
2705 RedHat 6.2 i386 insure++
2706 RedHat 7.0 i386 gcc
2707 RedHat 7.1 i386 (Kernel 2.4.10) gcc
2708 Slackware 8.0 i686 (Kernel 2.4.10)
2709 Solaris 8 UltraSparc cc
2710 Solaris 8 UltraSparc gcc
2711 Solaris 8 i386 gcc
2712 SuSE 7.1 i386 gcc2.95.2
2713 SuSE 7.1 ppc gcc2.95.2
2714 i386-pc-sco3.2v5.0.5 cc
2715 i386-pc-sco3.2v5.0.5 gcc
2716 powerpc-ibm-aix4.3.3.0 cc
2717 i686-unknown-sysv5UnixWare7.1.0 gcc
2718 i686-unknown-sysv5UnixWare7.1.0 cc
2719
2720 TESTING:
2721
2722 * The existing test.sh script by Phil Hands has been merged into a
2723 test framework that works from both "make check" and the Samba
2724 build farm.
3742bf3a
S
2725\f
2726Partial Protocol History
f7e48a5c 2727 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
8ba802f3 2728 08 Apr 2008 3.0.2 30
325c2432 2729 03 Apr 2008 3.0.1 30
4cb6197b 2730 01 Mar 2008 3.0.0 11 Nov 2006 30
0c6d7952 2731 06 Nov 2006 2.6.9 29
4177f09b 2732 22 Apr 2006 2.6.8 29
a058cbc4 2733 11 Mar 2006 2.6.7 29
cbc63b9b 2734 28 Jul 2005 2.6.6 29
2dfe1c37 2735 01 Jun 2005 2.6.5 29
f7e48a5c 2736 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 2737 30 Sep 2004 2.6.3 28
c7be6dec
WD
2738 30 Apr 2004 2.6.2 28
2739 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
2740 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
2741 04 Dec 2003 2.5.7 26
2742 26 Jan 2003 2.5.6 26
2743 02 Apr 2002 2.5.5 26
2744 13 Mar 2002 2.5.4 26
2745 11 Mar 2002 2.5.3 26
2746 26 Jan 2002 2.5.2 11 Jan 2002 26
2747 03 Jan 2002 2.5.1 25
2748 30 Nov 2001 2.5.0 23 Aug 2001 25
2749 06 Sep 2000 2.4.6 24
2750 19 Aug 2000 2.4.5 24
2751 29 Jul 2000 2.4.4 24
2752 09 Apr 2000 2.4.3 24
2753 30 Mar 2000 2.4.2 24
2754 30 Jan 2000 2.4.1 29 Jan 2000 24
2755 29 Jan 2000 2.4.0 28 Jan 2000 23
2756 25 Jan 2000 2.3.3 23 Jan 2000 22
2757 08 Nov 1999 2.3.2 26 Jun 1999 21
2758 06 Apr 1999 2.3.1 20
2759 15 Mar 1999 2.3.0 15 Mar 1999 20
2760 25 Nov 1998 2.2.1 19
2761 03 Nov 1998 2.2.0 19
2762 09 Sep 1998 2.1.1 19
2763 20 Jul 1998 2.1.0 19
2764 17 Jul 1998 2.0.19 19
2765 18 Jun 1998 2.0.17 19
2766 01 Jun 1998 2.0.16 19
2767 27 May 1998 2.0.13 27 May 1998 19
2768 26 May 1998 2.0.12 18
2769 22 May 1998 2.0.11 18
2770 18 May 1998 2.0.9 18 May 1998 18
2771 17 May 1998 2.0.8 17
2772 15 May 1998 2.0.1 17
2773 14 May 1998 2.0.0 17
2774 17 Apr 1998 1.7.4 17
2775 13 Apr 1998 1.7.3 17
2776 05 Apr 1998 1.7.2 17
2777 26 Mar 1998 1.7.1 17
2778 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
2779 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
2780
2781* DATE OF COMMIT is the date the protocol change was committed to CVS.