Some improvements from Matt.
[rsync/rsync.git] / OLDNEWS
CommitLineData
2955529b
WD
1NEWS for rsync 2.6.9 (6 Nov 2006)
2Protocol: 29 (unchanged)
3Changes since 2.6.8:
4
5 BUG FIXES:
6
7 - If rsync is interrupted via a handled signal (such as SIGINT), it will
8 once again clean-up its temp file from the destination dir.
9
10 - Fixed an overzealous sanitizing bug in the handling of the --link-dest,
11 --copy-dest, and --compare-dest options to a daemon without chroot: if
12 the copy's destination dir is deeper than the top of the module's path,
13 these options now accept a safe number of parent-dir (../) references
14 (since these options are relative to the destination dir). The old code
15 incorrectly chopped off all "../" prefixes for these options, no matter
16 how deep the destination directory was in the module's hierarchy.
17
18 - Fixed a bug where a deferred info/error/log message could get sent
19 directly to the sender instead of being handled by rwrite() in the
20 generator. This fixes an "unexpected tag 3" fatal error, and should
21 also fix a potential problem where a deferred info/error message from
22 the receiver might bypass the log file and get sent only to the client
23 process. (These problems could only affect an rsync daemon that was
24 receiving files.)
25
26 - Fixed a bug when --inplace was combined with a --*-dest option and we
27 update a file's data using an alternate basis file. The code now
28 notices that it needs to copy the matching data from the basis file
29 instead of (wrongly) assuming that it was already present in the file.
30
31 - Fixed a bug where using --dry-run with a --*-dest option with a path
32 relative to a directory that does not yet exist: the affected option
33 gets its proper path value so that the output of the dry-run is right.
34
35 - Fixed a bug in the %f logfile escape when receiving files: the
36 destination path is now included in the output (e.g. you can now tell
37 when a user specifies a subdir inside a module).
38
39 - If the receiving side fails to create a directory, it will now skip
40 trying to update everything that is inside that directory.
41
42 - If --link-dest is specified with --checksum but without --times, rsync
43 will now allow a hard-link to be created to a matching link-dest file
44 even when the file's modify-time doesn't match the server's file.
45
46 - The daemon now calls more timezone-using functions prior to doing a
47 chroot. This should help some C libraries to generate proper timestamps
48 from inside a chrooted daemon (and to not try to access /etc/timezone
49 over and over again).
50
51 - Fixed a bug in the handling of an absolute --partial-dir=ABS_PATH option:
52 it now deletes an alternate basis file from the partial-dir that was used
53 to successfully update a destination file.
54
55 - Fixed a bug in the handling of --delete-excluded when using a per-dir
56 merge file: the merge file is now honored on the receiving side, and
57 only its unqualified include/exclude commands are ignored (just as is
58 done for global include/excludes).
59
60 - Fixed a recent bug where --delete was not working when transferring from
61 the root (/) of the filesystem with --relative enabled.
62
63 - Fixed a recent bug where an --exclude='*' could affect the root (/) of
64 the filesystem with --relative enabled.
65
66 - When --inplace creates a file, it is now created with owner read/write
67 permissions (0600) instead of no permissions at all. This avoids a
68 problem continuing a transfer that was interrupted (since --inplace
69 will not update a file that has no write permissions).
70
71 - If either --remove-source-files or --remove-sent-files is enabled and we
72 are unable to remove the source file, rsync now outputs an error.
73
74 - Fixed a bug in the daemon's "incoming chmod" rule: newly-created
75 directories no longer get the 'F' (file) rules applied to them.
76
77 - Fixed an infinite loop bug when a filter rule was rejected due to being
78 overly long.
79
80 - When the server receives a --partial-dir option from the client, it no
81 longer runs the client-side code that adds an assumed filter rule (since
82 the client will be sending us the rules in the usual manner, and they
83 may have chosen to override the auto-added rule).
84
85 ENHANCEMENTS:
86
87 - Added the --log-file=FILE and --log-file-format=FORMAT options. These
88 can be used to tell any rsync to output what it is doing to a log file.
89 They work with a client rsync, a non-daemon server rsync (see the man
90 page for instructions), and also allows the overriding of rsyncd.conf
91 settings when starting a daemon.
92
93 - The --log-format option was renamed to be --out-format to avoid confusing
94 it with affecting the log-file output. (The old option remains as an
95 alias for the new to preserve backward compatibility.)
96
97 - Made "log file" and "syslog facility" settable on a per-module basis in
98 the daemon's config file.
99
100 - Added the --remove-source-files option as a replacement for the (now
101 deprecated) --remove-sent-files option. This new option removes all
102 non-dirs from the source directories, even if the file was already
103 up-to-date. This fixes a problem where interrupting an rsync that
104 was using --remove-sent-files and restarting it could leave behind
105 a file that the earlier rsync synchronized, but didn't get to remove.
106 (The deprecated --remove-sent-files is still understood for now, and
107 still behaves in the same way as before.)
108
109 - Added the option --no-motd to suppress the message-of-the-day output
110 from a daemon when doing a copy. (See the manpage for a caveat.)
111
112 - Added a new environment variable to the pre-/post-xfer exec commands (in
113 the daemon's config file): RSYNC_PID. This value will be the same in
114 both the pre- and post-xfer commands, so it can be used if the pre-xfer
115 command wants to cache some arg/request info for the post-xfer command.
116
117 INTERNAL:
118
119 - Did a code audit using IBM's code-checker program and made several
120 changes, including: replacing most of the strcpy() and sprintf()
121 calls with strlcpy(), snprintf(), and memcpy(), adding a 0-value to
122 an enum that had been intermingling a literal 0 with the defined enum
123 values, silencing some uninitialized memory checks, marking some
124 functions with a "noreturn" attribute, and changing an "if" that
125 could never succeed on some platforms into a pre-processor directive
126 that conditionally compiles the code.
127
128 - Fixed a potential bug in f_name_cmp() when both the args are a
129 top-level "." dir (which doesn't happen in normal operations).
130
131 - Changed exit_cleanup() so that it can never return instead of exit.
132 The old code might return if it found the exit_cleanup() function
133 was being called recursively. The new code is segmented so that
134 any recursive calls move on to the next step of the exit-processing.
135
136 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
137 define it.
138
139 DEVELOPER RELATED:
140
141 - The acls.diff and xattrs.diff patches have received a bunch of work to
142 make them much closer to being acceptable in the main distribution.
143 The xattrs patch also has some preliminary Mac OS X and FreeBSD
144 compatibility code that various system types to exchange extended
145 file-attributes.
146
147 - A new diff in the patches dir, fake-root.diff, allows rsync to
148 maintain a backup hierarchy with full owner, group, and device info
149 without actually running as root. It does this using a special
150 extended attribute, so it depends on xattrs.diff (which depends on
151 acls.diff).
152
153 - The rsync.yo and rsyncd.conf.yo files have been updated to work
154 better with the latest yodl 2.x releases.
155
156 - Updated config.guess and config.sub to their 2006-07-02 versions.
157
158 - Updated various files to include the latest FSF address and to have
159 consistent opening comments.
160
161\f
60ef8ed1
WD
162NEWS for rsync 2.6.8 (22 Apr 2006)
163Protocol: 29 (unchanged)
164Changes since 2.6.7:
165
166 BUG FIXES:
167
168 - Fixed a bug in the exclude code where an anchored exclude without any
169 wildcards fails to match an absolute source arg, but only when --relative
170 is in effect.
171
172 - Improved the I/O code for the generator to fix a potential hang when the
173 receiver gets an EOF on the socket but the generator's select() call
174 never indicates that the socket is writable for it to be notified about
175 the EOF. (This can happen when using stunnel).
176
177 - Fixed a problem with the file-reading code where a failed read (such as
178 that caused by a bad sector) would not advance the file's read-position
179 beyond the failed read's data.
180
181 - Fixed a logging bug where the "log file" directive was not being honored
182 in a single-use daemon (one spawned by a remote-shell connection or by
183 init).
184
185 - If rsync cannot honor the --delete option, we output an error and exit
186 instead of silently ignoring the option.
187
188 - Fixed a bug in the --link-dest code that prevented special files (such as
189 fifos) from being linked.
190
191 - The ability to hard-link symlinks and special files is now determined at
192 configure time instead of at runtime. This fixes a bug with --link-dest
193 creating a hard-link to a symlink's referent on a BSD system.
194
195 ENHANCEMENTS:
196
197 - In daemon mode, if rsync fails to bind to the requested port, the
198 error(s) returned by socket() and/or bind() are now logged.
199
200 - When we output a fatal error, we now output the version of rsync in the
201 message.
202
203 - Improved the documentation for the --owner and --group options.
204
205 - The rsyncstats script in "support" has an improved line-parsing regex
206 that is easier to read and also makes it to parse syslog-generated lines.
207
208 - A new script in "support": file-attr-restore, can be used to restore the
209 attributes of a file-set (the permissions, ownership, and group info)
210 taken from the cached output of a "find ARG... -ls" command.
211
212 DEVELOPER RELATED:
213
214 - Removed the unused function write_int_named(), the unused variable
215 io_read_phase, and the rarely used variable io_write_phase. This also
216 elides the confusing 'phase "unknown"' part of one error message.
217
218 - Removed two unused configure checks and two related (also unused)
219 compatibility functions.
220
221 - The xattrs.diff patch received a security fix that prevents a potential
222 buffer overflow in the receive_xattr() code.
223
224 - The acls.diff patch has been improved quite a bit, with more to come.
225
226 - A new patch was added: log-file.diff. This contains an early version of
227 a future option, --log-file=FILE, that will allow any rsync to log its
228 actions to a file (something that only a daemon supports at present).
229
230\f
f171bf5b
WD
231NEWS for rsync 2.6.7 (11 Mar 2006)
232Protocol: 29 (unchanged)
233Changes since 2.6.6:
234
235 OUTPUT CHANGES:
236
237 - The letter 'D' in the itemized output was being used for both devices
238 (character or block) as well as other special files (such as fifos and
239 named sockets). This has changed to separate non-device special files
240 under the 'S' designation (e.g. "cS+++++++ path/fifo"). See also the
241 "--specials" option, below.
242
243 - The way rsync escapes unreadable characters has changed. First, rsync
244 now has support for recognizing valid multibyte character sequences in
245 your current locale, allowing it to escape fewer characters than before
246 for a locale such as UTF-8. Second, it now uses an escape idiom of
247 "\#123", which is the literal string "\#" followed by exactly 3 octal
248 digits. Rsync no longer doubles a backslash character in a filename
249 (e.g. it used to output "foo\\bar" when copying "foo\bar") -- now it only
250 escapes a backslash that is followed by a hash-sign and 3 digits (0-9)
251 (e.g. it will output "foo\#134#789" when copying "foo\#789"). See also
252 the --8-bit-output (-8) option, mentioned below.
253
254 Script writers: the local rsync is the one that outputs escaped names,
255 so if you need to support unescaping of filenames for older rsyncs, I'd
256 suggest that you parse the output of "rsync --version" and only use the
257 old unescaping rules for 2.6.5 and 2.6.6.
258
259 BUG FIXES:
260
261 - Fixed a really old bug that caused --checksum (-c) to checksum all the
262 files encountered during the delete scan (ouch).
263
264 - Fixed a potential hang in a remote generator: when the receiver gets a
265 read-error on the socket, it now signals the generator about this so that
266 the generator does not try to send any of the terminating error messages
267 to the client (avoiding a potential hang in some setups).
268
269 - Made hard-links work with symlinks and devices again.
270
271 - If the sender gets an early EOF reading a source file, we propagate this
272 error to the receiver so that it can discard the file and try requesting
273 it again (which is the existing behavior for other kinds of read errors).
274
275 - If a device-file/special-file changes permissions, rsync now updates the
276 permissions without recreating the file.
277
278 - If the user specifies a remote-host for both the source and destination,
279 we now output a syntax error rather than trying to open the destination
280 hostspec as a filename.
281
282 - When --inplace creates a new destination file, rsync now creates it with
283 permissions 0600 instead of 0000 -- this makes restarting possible when
284 the transfer gets interrupted in the middle of sending a new file.
285
286 - Reject the combination of --inplace and --sparse since the sparse-output
287 algorithm doesn't work when overwriting existing data.
288
289 - Fixed the directory name in the error that is output when pop_dir()
290 fails.
291
292 - Really fixed the parsing of a "!" entry in .cvsignore files this time.
293
294 - If the generator gets a stat() error on a file, output it (this used to
295 require at least -vv for the error to be seen).
296
297 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle
298 the exit status properly and generate a better error.
299
300 - Fixed some glitches in the double-verbose output when using --copy-dest,
301 --link-dest, or --compare-dest. Also improved how the verbose output
302 handles hard-links (within the transfer) that had an up-to-date alternate
303 "dest" file, and copied files (via --copy-dest).
304
305 - Fixed the matching of the dont-compress items (e.g. *.gz) against files
306 that have a path component containing a slash.
307
308 - If code reading a filter/exclude file an EINTR error, rsync now clears
309 the error flag on the file handle so it can keep on reading.
310
311 - If --relative is active, the sending side cleans up trailing "/" or "/."
312 suffixes to avoid triggering a bug in older rsync versions. Also, we now
313 reject a ".." dir if it would be sent as a relative dir.
314
315 - If a non-directory is in the way of a directory and rsync is run with
316 --dry-run and --delete, rsync no longer complains about not being able
317 to opendir() the not-yet present directory.
318
319 - When --list-only is used and a non-existent local destination dir was
320 also specified as a destination, rsync no longer generates a warning
321 about being unable to create the missing directory.
322
323 - Fixed some problems with --relative --no-implied-dirs when the
324 destination directory did not yet exist: we can now create a symlink or
325 device when it is the first thing in the missing dir, and --fuzzy no
326 longer complains about being unable to open the missing dir.
327
328 - Fixed a bug where the --copy-links option would not affect implied
329 directories without --copy-unsafe-links (see --relative).
330
331 - Got rid of the need for --force to be used in some circumstances with
332 --delete-after (making it consistent with --delete-before/-during).
333
334 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this
335 when a file is too large (rsync handles the write error).
336
337 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it
338 was not properly padded with trailing '=' chars. This only affects a
339 user that need to use a password-authenticated proxy for an outgoing
340 daemon-rsync connection.
341
342 - If we're transferring an empty directory to a new name, rsync no longer
343 forces S_IWUSR if it wasn't already set, nor does it accidentally leave
344 it set.
345
346 - Fixed a bug in the debug output (-vvvvv) that could mention the wrong
347 checksum for the current file offset.
348
349 - Rsync no longer allows a single directory to be copied over a non-
350 directory destination arg.
351
352 ENHANCEMENTS:
353
354 - Added the --append option that makes rsync append data onto files that
355 are longer on the source than the destination (this includes new files).
356
357 - Added the --min-size=SIZE option to exclude small files from the
358 transfer.
359
360 - Added the --compress-level option to allow you to set how aggressive
361 rsync's compression should be (this option implies --compress).
362
363 - Enhanced the parsing of the SIZE value for --min-size and --max-size to
364 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
365 and off-by-one values too (e.g. --max-size=8mb-1).
366
367 - Added the --8-bit-output (-8) option, which tells rsync to avoid escaping
368 high-bit characters that it thinks are unreadable in the current locale.
369
370 - The new option --human-readable (-h) changes the output of --progress,
371 --stats, and the end-of-run summary to be easier to read. If repeated,
372 the units become powers of 1024 instead of powers of 1000. (The old
373 meaning of -h, as a shorthand for --help, still works as long as you
374 just use it on its own, as in "rsync -h".)
375
376 - If lutimes() and/or lchmod() are around, use them to allow the
377 preservation of attributes on symlinks.
378
379 - The --link-dest option now affects symlinks and devices (when possible).
380
381 - Added two config items to the rsyncd.conf parsing: "pre-xfer exec" and
382 "post-xfer exec". These allow a command to be specified on a per-module
383 basis that will be run before and/or after a daemon-mode transfer. (See
384 the man page for a list of the environment variables that are set with
385 information about the transfer.)
386
387 - When using the --relative option, you can now insert a dot dir in
388 the source path to indicate where the replication of the source dirs
389 should start. For example, if you specify a source path of
390 rsync://host/module/foo/bar/./baz/dir with -R, rsync will now only
391 replicate the "baz/dir" part of the source path (note: a trailing
392 dot dir is unaffected unless it also has a trailing slash).
393
394 - Added some new --no-FOO options that make it easier to override unwanted
395 implied or default options. For example, "-a --no-o" (aka "--archive
396 --no-owner") can be used to turn off the preservation of file ownership
397 that is implied by -a.
398
399 - Added the --chmod=MODE option that allows the destination permissions to
400 be changed from the source permissions. E.g. --chmod=g+w,o-rwx
401
402 - Added the "incoming chmod" and "outgoing chmod" daemon options that allow
403 a module to specify what permissions changes should be applied to all
404 files copied to and from the daemon.
405
406 - Allow the --temp-dir option to be specified when starting a daemon, which
407 sets the default temporary directory for incoming files.
408
409 - If --delete is combined with --dirs without --recursive, rsync will now
410 delete in any directory whose content is being synchronized.
411
412 - If --backup is combined with --delete without --backup-dir (and without
413 --delete-excluded), we add a "protect" filter-rule to ensure that files
414 with the backup suffix are not deleted.
415
416 - The file-count stats that are output by --progress were improved to
417 better indicate what the numbers mean. For instance, the output:
418 "(xfer#5, to-check=8383/9999)" indicates that this was the fifth file
419 to be transferred, and we still need to check 8383 more files out of
420 a total of 9999.
421
422 - The include/exclude code now allows a dir/*** directive (with 3 trailing
423 stars) to match both the dir itself as well as all the content below the
424 dir (dir/** would not match the dir).
425
426 - Added the --prune-empty-dirs (-m) option that makes the receiving rsync
427 discard empty chains of directories from the file-list. This makes it
428 easier to selectively copy files from a source hierarchy and end up with
429 just the directories needed to hold the resulting files.
430
431 - If the --itemize-changes (-i) option is repeated, rsync now includes
432 unchanged files in the itemized output (similar to -vv, but without all
433 the other verbose messages that can get in the way). Of course, the
434 client must be version 2.6.7 for this to work, but the remote rsync only
435 needs to be 2.6.7 if you're pushing files.
436
437 - Added the --specials option to tell rsync to copy non-device special
438 files (which rsync now attempts even as a normal user). The --devices
439 option now requests the copying of just devices (character and block).
440 The -D option still requests both (e.g. --devices and --specials), -a
441 still implies -D, and non-root users still get a silent downgrade that
442 omits device copying.
443
444 - Added the --super option to make the receiver always attempt super-user
445 activities. This is useful for systems that allow things such as devices
446 to be created or ownership to be set without being UID 0, and is also
447 useful for someone who wants to ensure that errors will be output if the
448 receiving rsync isn't being run as root.
449
450 - Added the --sockopts option for those few who want to customize the TCP
451 options used to contact a daemon rsync.
452
453 - Added a way for the --temp-dir option to be combined with a partial-dir
454 setting that lets rsync avoid non-atomic updates (for those times when
455 --temp-dir is not being used because space is tight).
456
457 - A new support script, files-to-excludes, will transform a list of files
458 into a set of include/exclude directives that will copy those files.
459
460 - A new option, --executability (-E) can be used to preserve just the
461 execute bit on files, for those times when using the --perms option is
462 not desired.
463
464 - The daemon now logs each connection and also each module-list request
465 that it receives.
466
467 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B
468 (permission bits, e.g. "rwxr-xrwt").
469
470 - The --dry-run option no longer forces the enabling of --verbose.
471
472 - The --remove-sent-files option now does a better job of incrementally
473 removing the sent files on the sending side (older versions tended to
474 clump up all the removals at the end).
475
476 - A daemon now supersedes its minimal SIGCHLD handler with the standard
477 PID-remembering version after forking. This ensures that the generator
478 can get the child-exit status from the receiver.
479
480 - Use of the --bwlimit option no longer interferes with the remote rsync
481 sending error messages about invalid/refused options.
482
483 - Rsync no longer returns a usage error when used with one local source arg
484 and no destination: this now implies the --list-only option, just like
485 the comparable situation with a remote source arg.
486
487 - Added the --copy-dirlinks option, a more limited version of --copy-links.
488
489 - Various documentation improvements, including: a better synopsis, some
490 improved examples, a better discussion of the presence and absence of
491 --perms (including how it interacts with the new --executability and
492 --chmod options), an extended discussion of --temp-dir, an improved
493 discussion of --partial-dir, a better description of rsync's pattern
494 matching characters, an improved --no-implied-dirs section, and the
495 documenting of what the --stats option outputs.
496
497 - Various new and updated diffs in the patches dir, including: acls.diff,
498 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
499
500 INTERNAL:
501
502 - We now use sigaction() and sigprocmask() if possible, and fall back on
503 signal() if not. Using sigprocmask() ensures that rsync enables all the
504 signals that it needs, just in case it was started in a masked state.
505
506 - Some buffer sizes were expanded a bit, particularly on systems where
507 MAXPATHLEN is overly small (e.g. cygwin).
508
509 - If io_printf() tries to format more data than fits in the buffer, exit
510 with an error instead of transmitting a truncated buffer.
511
512 - If a va_copy macro is defined, lib/snprintf.c will use it when defining
513 the VA_COPY macro.
514
515 - Reduced the amount of stack memory needed for each level of directory
516 recursion by nearly MAXPATHLEN bytes.
517
518 - The wildmatch function was extended to allow an array of strings to be
519 supplied as the string to match. This allows the exclude code to do less
520 string copying.
521
522 - Got rid of the safe_fname() function (and all the myriad calls) and
523 replaced it with a new function in the log.c code that filters all the
524 output going to the terminal.
525
526 - Unified the f_name() and the f_name_to() functions.
527
528 - Improved the hash-table code the sender uses to handle checksums to make
529 it use slightly less memory and run just a little faster.
530
531 DEVELOPER RELATED:
532
533 - The diffs in the patches dir now require "patch -p1 <DIFF" instead of
534 the previous -p0. Also, the version included in the release tar now
535 affect generated files (e.g. configure, rsync.1, proto.h, etc.), so
536 it is no longer necessary to run autoconf and/or yodl unless you're
537 applying a patch that was checked out from CVS.
538
539 - Several diffs in the patches dir now use the proper --enable-FOO
540 configure option instead of --with-FOO to turn on the inclusion of
541 the newly patched feature.
542
543 - There is a new script, "prepare-source" than can be used to update the
544 various generated files (proto.h, configure, etc.) even before configure
545 has created the Makefile (this is mainly useful when patching the source
546 with a patch that doesn't affect generated files).
547
548 - The testsuite now sets HOME so that it won't be affected by a file such
549 as ~/.popt.
550
551\f
f90f7149
WD
552NEWS for rsync 2.6.6 (28 Jul 2005)
553Protocol: 29 (unchanged)
554Changes since 2.6.5:
555
556 SECURITY FIXES:
557
558 - The zlib code was upgraded to version 1.2.3 in order to make it more
559 secure. While the widely-publicized security problem in zlib 1.2.2 did
560 not affect rsync, another security problem surfaced that affects rsync's
561 zlib 1.1.4.
562
563 BUG FIXES:
564
565 - The setting of flist->high in clean_flist() was wrong for an empty list.
566 This could cause flist_find() to crash in certain rare circumstances
567 (e.g. if just the right directory setup was around when --fuzzy was
568 combined with --link-dest).
569
570 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
571 (1) Without -i it would output the name of each hard-linked file as
572 though it had been changed; it now outputs a "is hard linked" message for
573 the file. (2) With -i it would output all dots for the unchanged
574 attributes of a hard-link; it now changes those dots to spaces, as is
575 done for other totally unchanged items.
f90f7149
WD
576
577 - When backing up a changed symlink or device, get rid of any old backup
578 item so that we don't get an "already exists" error.
579
580 - A couple places that were comparing a local and a remote modification-
581 time were not honoring the --modify-window option.
582
583 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
584 set too often (if some non-significant mode bits differed).
585
586 - Fixed a really old, minor bug that could cause rsync to warn about being
587 unable to mkdir() a path that ends in "/." because it just created the
588 directory (required --relative, --no-implied-dirs, a source path that
589 ended in either a trailing slash or a trailing "/.", and a non-existing
590 destination dir to tickle the bug in a recent version).
591
592 ENHANCEMENTS:
593
594 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
595 per-module basis (which now matches the documentation).
596
597 - The support/rrsync script has been upgraded to verify the args of options
598 that take args (instead of rejecting any such options). The script was
599 also changed to try to be more secure and to fix a problem in the parsing
600 of a pull operation that has multiple sources.
601
602 - Improved the documentation that explains the difference between a
603 normal daemon transfer and a daemon-over remote-shell transfer.
604
605 - Some of the diffs supplied in the patches dir were fixed and/or
606 improved.
607
608 BUILD CHANGES:
609
610 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
611 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
612 find in the /etc/group file).
613
614 - Added a test to the test suite, itemized.test, that tests the output of
615 -i (log-format w/%i) and some double-verbose messages.
616
617\f
a1c75ed0
WD
618NEWS for rsync 2.6.5 (1 Jun 2005)
619Protocol: 29 (unchanged)
620Changes since 2.6.4:
621
622 OUTPUT CHANGES:
623
624 - Non-printable chars in filenames are now output using backslash-
625 escaped characters rather than '?'s. Any non-printable character is
626 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
627 is now output as "\\". Rsync also uses your locale setting, which
628 can make it treat fewer high-bit characters as non-printable.
629
630 - If rsync received an empty file-list when pulling files, it would
631 output a "nothing to do" message and exit with a 0 (success) exit
632 status, even if the remote rsync returned an error (it did not do
633 this under the same conditions when pushing files). This was changed
634 to make the pulling behavior the same as the pushing behavior: we
635 now do the normal end-of-run outputting (depending on options) and
636 exit with the appropriate exit status.
637
638 BUG FIXES:
639
640 - A crash bug was fixed when a daemon had its "path" set to "/", did
641 not have chroot enabled, and used some anchored excludes in the
642 rsyncd.conf file.
643
644 - Fixed a bug in the transfer of a single file when -H is specified
645 (rsync would either infinite loop or perhaps crash).
646
647 - Fixed a case where the generator might try (and fail) to tweak the
648 write-permissions of a read-only directory in list-only mode (this
649 only caused an annoying warning message).
650
651 - If --compare-dest or --link-dest uses a locally-copied file as the
652 basis for an updated version, log this better when --verbose or -i
653 is in effect.
654
655 - Fixed the accidental disabling of --backup during the --delete-after
656 processing.
657
658 - Restored the ability to use the --address option in client mode (in
659 addition to its use in daemon mode).
660
661 - Make sure that some temporary progress information from the delete
662 processing does not get left on the screen when it is followed by a
663 newline.
664
665 - When --existing skips a directory with extra verbosity, refer to it
666 as a "directory", not a "file".
667
668 - When transferring a single file to a different-named file, any
669 generator messages that are source-file related no longer refer to
670 the file by the destination filename.
671
672 - Fixed a bug where hard-linking a group of files might fail if the
673 generator hasn't created a needed destination directory yet.
674
675 - Fixed a bug where a hard-linked group of files that is newly-linked
676 to a file in a --link-dest dir doesn't link the files from the rest
677 of the cluster.
678
679 - When deleting files with the --one-file-system (-x) option set, rsync
680 no longer tries to remove files from inside a mount-point on the
681 receiving side. Also, we don't complain about being unable to remove
682 the mount-point dir.
683
684 - Fixed a compatibility problem when using --cvs-ignore (-C) and
685 sending files to an older rsync without using --delete.
686
687 - Make sure that a "- !" or "+ !" include/exclude pattern does not
688 trigger the list-clearing action that is reserved for "!".
689
690 - Avoid a timeout in the generator when the sender/receiver aren't
691 handling the generator's checksum output quickly enough.
692
693 - Fixed the omission of some directories in the delete processing when
694 --relative (-R) was combined with a source path that had a trailing
695 slash.
696
697 - Fixed a case where rsync would erroneously delete some files and then
698 re-transfer them when the options --relative (-R) and --recursive
699 (-r) were both enabled (along with --delete) and a source path had a
700 trailing slash.
701
702 - Make sure that --max-size doesn't affect a device or a symlink.
703
704 - Make sure that a system with a really small MAXPATHLEN does not cause
705 the buffers in readfd_unbuffered() to be too small to receive normal
706 messages. (This mainly affected Cygwin.)
707
708 - If a source pathname ends with a filename of "..", treat it as if
709 "../" had been specified (so that we don't copy files to the parent
710 dir of the destination).
711
712 - If --delete is combined with a file-listing rsync command (i.e. no
713 transfer is happening), avoid outputting a warning that we couldn't
714 delete anything.
715
716 - If --stats is specified with --delete-after, ensure that all the
717 "deleting" messages are output before the statistics.
718
719 - Improved one "if" in the deletion code that was only checking errno
720 for ENOTEMPTY when it should have also been checking for EEXIST (for
721 compatibility with OS variations).
722
723 ENHANCEMENTS:
724
725 - Added the --only-write-batch=FILE option that may be used (instead
726 of --write-batch=FILE) to create a batch file without doing any
727 actual updating of the destination. This allows you to divert all
728 the file-updating data away from a slow data link (as long as you
729 are pushing the data to the remote server when creating the batch).
730
731 - When the generator is taking a long time to fill up its output buffer
732 (e.g. if the transferred files are few, small, or missing), it now
733 periodically flushes the output buffer so that the sender/receiver
734 can get started on the files sooner rather than later.
735
736 - Improved the keep-alive code to handle a long silence between the
737 sender and the receiver that can occur when the sender is receiving
738 the checksum data for a large file.
739
740 - Improved the auth-errors that are logged by the daemon to include
741 some information on why the authorization failed: wrong user,
742 password mismatch, etc. (The client-visible message is unchanged!)
743
744 - Improved the client's handling of an "@ERROR" from a daemon so that
745 it does not complain about an unexpectedly closed socket (since we
746 really did expect the socket to close).
747
748 - If the daemon can't open the log-file specified in rsyncd.conf, fall
749 back to using syslog and log an appropriate warning. This is better
750 than what was typically a totally silent (and fatal) failure (since a
751 daemon is not usually run with the --no-detach option that was
752 necessary to see the error on stderr).
753
754 - The man pages now consistently refer to an rsync daemon as a "daemon"
755 instead of a "server" (to distinguish it from the server process in a
756 non-daemon transfer).
757
758 - Made a small change to the rrsync script (restricted rsync -- in the
759 support dir) to make a read-only server reject all --remove-* options
760 when sending files (to future-proof it against the possibility of
761 other similar options being added at some point).
762
763 INTERNAL:
764
765 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
766 better discern which filename characters need to be escaped in
767 messages (which should result in fewer escaped characters in some
768 locales).
769
770 - Improved the naming of the log-file open/reopen/close functions.
771
772 - Removed some protocol-compatibility code that was only needed to help
773 someone running a pre-release of 2.6.4.
774
775 BUILD CHANGES:
776
777 - Added configure option "--disable-locale" to disable any use of
778 setlocale() in the binary.
779
780 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
781 rsync from being built without symlink or hard-link support.
782
783 - Only #define HAVE_REMSH if it is going to be set to 1.
784
785 - Configure now disables the use of mkstemp() under HP-UX (since they
786 refuse to fix its broken handling of large files).
787
788 - Configure now explicitly checks for the lseek64() function so that
789 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
790 presence based on the presence of the off64_t type.
791
792 - Configure no longer mentions the change in the default remote-shell
793 (from rsh to ssh) that occurred for the 2.6.0 release.
794
795 - Some minor enhancements to the test scripts.
796
797 - Added a few new *.diff files to the patches dir, including a patch
798 that enables the optional copying of extended attributes.
799
800\f
1ad6a7f6
WD
801NEWS for rsync 2.6.4 (30 March 2005)
802Protocol: 29 (changed)
803Changes since 2.6.3:
804
805 OUTPUT CHANGES:
806
807 - When rsync deletes a directory and outputs a verbose message about
808 it, it now appends a trailing slash to the name instead of (only
809 sometimes) outputting a preceding "directory " string.
810
811 - The --stats output will contain file-list time-statistics if both
812 sides are 2.6.4, or if the local side is 2.6.4 and the files are
813 being pushed (since the stats come from the sending side).
814 (Requires protocol 29 for a pull.)
815
816 - The "%o" (operation) log-format escape now has a third value (besides
817 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
818 This changes the way deletions are logged in the daemon's log file.
819
820 - When the --log-format option is combined with --verbose, rsync now
821 avoids outputting the name of the file twice in most circumstances.
822 As long as the --log-format item does not refer to any post-transfer
823 items (such as %b or %c), the --log-format message is output prior to
824 the transfer, so --verbose is now the equivalent of a --log-format of
825 '%n%L' (which outputs the name and any link info). If the log output
826 must occur after the transfer to be complete, the only time the name
827 is also output prior to the transfer is when --progress was specified
828 (so that the name will precede the progress stats, and the full
829 --log-format output will come after).
97e3c50c 830
7c2a83c6
WD
831 - Non-printable characters in filenames are replaced with a '?' to
832 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
833
834 BUG FIXES:
835
836 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
837 was only treating it as a special token in an rsync include/exclude
838 file).
839
840 - The combination of --verbose and --dry-run now mentions the full list
841 of changes that would be output without --dry-run.
842
843 - Avoid a mkdir warning when removing a directory in the destination
844 that already exists in the --backup-dir.
845
846 - An OS that has a binary mode for its files (such as cygwin) needed
847 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 848 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
849
850 - Fixed a potential hang when verbosity is high, the client side is
851 the sender, and the file-list is large.
852
853 - Fixed a potential protocol-corrupting bug where the generator could
854 merge a message from the receiver into the middle of a multiplexed
855 packet of data if only part of that data had been written out to the
856 socket when the message from the generator arrived.
857
858 - We now check if the OS doesn't support using mknod() for creating
859 FIFOs and sockets, and compile-in some compatibility code using
860 mkfifo() and socket() when necessary.
861
862 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
863 if the --max-delete limit is exceeded during a run, we now output a
864 warning about this at the end of the run and exit with a new error
865 code (25).
866
867 - One place in the code wasn't checking if fork() failed.
868
869 - The "ignore nonreadable" daemon parameter used to erroneously affect
870 readable symlinks that pointed to a non-existent file.
871
872 - If the OS does not have lchown() and a chown() of a symlink will
873 affect the referent of a symlink (as it should), we no longer try
874 to set the user and group of a symlink.
875
876 - The generator now properly runs the hard-link loop and the dir-time
877 rewriting loop after we're sure that the redo phase is complete.
878
879 - When --backup was specified with --partial-dir=DIR, where DIR is a
880 relative path, the backup code was erroneously trying to backup a
881 file that was put into the partial-dir.
882
883 - If a file gets resent in a single transfer and the --backup option is
884 enabled along with --inplace, rsync no longer performs a duplicate
885 backup (it used to overwrite the first backup with the failed file).
886
887 - One call to flush_write_file() was not being checked for an error.
888
889 - The --no-relative option was not being sent from the client to a
890 server sender.
891
892 - If an rsync daemon specified "dont compress = ..." for a file and the
893 client tried to specify --compress, the libz code was not handling a
894 compression level of 0 properly. This could cause a transfer failure
895 if the block-size for a file was large enough (e.g. rsync might have
896 exited with an error for large files).
897
898 - Fixed a bug that would sometimes surface when using --compress and
899 sending a file with a block-size larger than 64K (either manually
900 specified, or computed due to the file being really large). Prior
901 versions of rsync would sometimes fail to decompress the data
902 properly, and thus the transferred file would fail its verification.
903
904 - If a daemon can't open the specified log file (i.e. syslog is not
905 being used), die without crashing. We also output an error about
906 the failure on stderr (which will only be seen if --no-detach was
907 specified) and exit with a new error code (6).
908
909 - A local transfer no longer duplicates all its include/exclude options
910 (since the forked process already has a copy of the exclude list,
911 there's no need to send them a set of duplicates).
912
7eb2ecda
WD
913 - The output of the items that are being updated by the generator (dirs,
914 symlinks, devices) is now intermingled in the proper order with the
915 output from the items that the receiver is updating (regular files)
916 when pulling. This misordering was particularly bad when --progress
917 was specified. (Requires protocol 29.)
1ad6a7f6
WD
918
919 - When --timeout is specified, lulls that occur in the transfer while
920 the generator is doing work that does not generate socket traffic
921 (looking for changed files, deleting files, doing directory-time
922 touch-ups, etc.) will cause a new keep-alive packet to be sent that
923 should keep the transfer going as long as the generator continues to
924 make progress. (Requires protocol 29.)
925
926 - The stat size of a device is not added to the total file size of the
927 items in the transfer (the size might be undefined on some OSes).
928
929 - Fixed a problem with refused-option messages sometimes not making it
930 back to the client side when a remote --files-from was in effect and
931 the daemon was the receiver.
932
0f9941dc 933 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
934 (the preserved) attributes from the version in the compare-dest DIR.
935
936 - When rsync is copying files into a write-protected directory, fixed
937 the change-report output for the directory so that we don't report
938 an identical directory as changed.
939
940 ENHANCEMENTS:
941
942 - Rsync now supports popt's option aliases, which means that you can
943 use /etc/popt and/or ~/.popt to create your own option aliases.
944
945 - Added the --delete-during (--del) option which will delete files
946 from the receiving side incrementally as each directory in the
947 transfer is being processed. This makes it more efficient than the
948 default, before-the-transfer behavior, which is now also available as
949 --delete-before (and is still the default --delete-WHEN option that
950 will be chosen if --delete or --delete-excluded is specified without
951 a --delete-WHEN choice). All the --del* options infer --delete, so
952 an rsync daemon that refuses "delete" will still refuse to allow any
953 file-deleting options (including the new --remove-sent-files option).
954
955 - All the --delete-WHEN options are now more memory efficient:
956 Previously an duplicate set of file-list objects was created on the
957 receiving side for the entire destination hierarchy. The new
958 algorithm only creates one directory of objects at a time (for files
959 inside the transfer).
960
961 - Added the --copy-dest option, which works like --link-dest except
962 that it locally copies identical files instead of hard-linking them.
963
964 - Added support for specifying multiple --compare-dest, --copy-dest, or
965 --link-dest options, but only of a single type. (Promoted from the
966 patches dir and enhanced.) (Requires protocol 29.)
967
968 - Added the --max-size option. (Promoted from the patches dir.)
969
970 - The daemon-mode options are now separated from the normal rsync
971 options so that they can't be mixed together. This makes it
972 impossible to start a daemon that has improper default option values
973 (which could cause problems when a client connects, such as hanging
974 or crashing).
975
976 - The --bwlimit option may now be used in combination with --daemon
977 to specify both a default value for the daemon side and a value
978 that cannot be exceeded by a user-specified --bwlimit option.
979
980 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
981 the patches dir.) Also added "address". The command-line options
982 take precedence over a config-file option, as expected.
983
984 - In _exit_cleanup(): when we are exiting with a partially-received
985 file, we now flush any data in the write-cache before closing the
986 partial file.
987
988 - The --inplace support was enhanced to work with --compare-dest,
989 --link-dest, and (the new) --copy-dest options. (Requires protocol
990 29.)
991
992 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
993 without recursion. Any directories that are encountered are created
994 on the destination. Specifying a directory with a trailing slash
995 copies its immediate contents to the destination.
996
997 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
998
999 - Added the --list-only option, which is mainly a way for the client to
1000 put the server into listing mode without needing to resort to any
1001 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
1002 for a non-recursive listing). This option is used automatically
1003 (behind the scenes) when a modern rsync speaks to a modern daemon,
1004 but may also be specified manually if you want to force the use of
1005 the --list-only option over a remote-shell connection.
1006
1007 - Added the --omit-dir-times (-O) option, which will avoid updating
1008 the modified time for directories when --times was specified. This
1009 option will avoid an extra pass through the file-list at the end of
1010 the transfer (to tweak all the directory times), which may provide
1011 an appreciable speedup for a really large transfer. (Promoted from
1012 the patches dir.)
1013
1014 - Added the --filter (-f) option and its helper option, -F. Filter
1015 rules are an extension to the existing include/exclude handling
1016 that also supports nested filter files as well as per-directory
1017 filter files (like .cvsignore, but with full filter-rule parsing).
1018 This new option was chosen in order to ensure that all existing
1019 include/exclude processing remained 100% compatible with older
1020 versions. Protocol 29 is needed for full filter-rule support, but
1021 backward-compatible rules work with earlier protocol versions.
1022 (Promoted from the patches dir and enhanced.)
1023
1024 - Added the --delay-updates option that puts all updated files into
1025 a temporary directory (by default ".~tmp~", but settable via the
1026 --partial-dir=DIR option) until the end of the transfer. This
1027 makes the updates a little more atomic for a large transfer.
1028
1029 - If rsync is put into the background, any output from --progress is
1030 reduced.
1031
1032 - Documented the "max verbosity" setting for rsyncd.conf. (This
1033 setting was added a couple releases ago, but left undocumented.)
1034
1035 - The sender and the generator now double-check the file-list index
1036 they are given, and refuse to try to do a file transfer on a
1037 non-file index (since that would indicate that something had gone
1038 very wrong).
1039
1040 - Added the --itemize-changes (-i) option, which is a way to output a
1041 more detailed list of what files changed and in what way. The effect
1042 is the same as specifying a --log-format of "%i %n%L" (see both the
1043 rsync and rsyncd.conf manpages). Works with --dry-run too.
1044
1045 - Added the --fuzzy (-y) option, which attempts to find a basis file
1046 for a file that is being created from scratch. The current algorithm
1047 only looks in the destination directory for the created file, but it
1048 does attempt to find a match based on size/mod-time (in case the file
1049 was renamed with no other changes) as well as based on a fuzzy
1050 name-matching algorithm. This option requires protocol 29 because it
1051 needs the new file-sorting order. (Promoted from patches dir and
1052 enhanced.) (Requires protocol 29.)
1053
1054 - Added the --remove-sent-files option, which lets you move files
1055 between systems.
1056
1057 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
1058 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
1059 literals in the rsync://HOST:PORT/PATH format.)
1060
1061 - When rsync recurses to build the file list, it no longer keeps open
1062 one or more directory handles from the dir's parent dirs.
1063
1064 - When building under windows, the default for --daemon is now to
1065 avoid detaching, requiring the new --detach option to force rsync
1066 to detach.
1067
1068 - The --dry-run option can now be combined with either --write-batch or
1069 --read-batch, allowing you to run a do-nothing test command to see
1070 what would happen without --dry-run.
1071
1072 - The daemon's "read only" config item now sets an internal read_only
1073 variable that makes extra sure that no write/delete calls on the
1074 read-only side can succeed.
1075
1076 - The log-format % escapes can now have a numeric field width in
1077 between the % and the escape letter (e.g. "%-40n %08p").
1078
1079 - Improved the option descriptions in the --help text.
1080
1081 SUPPORT FILES:
1082
1083 - Added atomic-rsync to the support dir: a perl script that will
1084 transfer some files using rsync, and then move the updated files into
1085 place all at once at the end of the transfer. Only works when
1086 pulling, and uses --link-dest and a parallel hierarchy of files to
1087 effect its update.
1088
1089 - Added mnt-excl to the support dir: a perl script that takes the
1090 /proc/mounts file and translates it into a set of excludes that will
1091 exclude all mount points (even mapped mounts to the same disk). The
1092 excludes are made relative to the specified source dir and properly
1093 anchored.
1094
1095 - Added savetransfer.c to the support dir: a C program that can make
1096 a copy of all the data that flows over the wire. This lets you test
1097 for data corruption (by saving the data on both the sending side and
1098 the receiving side) and provides one way to debug a protocol error.
1099
1100 - Added rrsync to the support dir: this is an updated version of Joe
1101 Smith's restricted rsync perl script. This helps to ensure that only
1102 certain rsync commands can be run by an ssh invocation.
1103
1104 INTERNAL:
1105
1106 - Added better checking of the checksum-header values that come over
1107 the socket.
1108
1109 - Merged a variety of file-deleting functions into a single function so
1110 that it is easier to maintain.
1111
1112 - Improved the type of some variables (particularly blocksize vars) for
1113 consistency and proper size.
1114
1115 - Got rid of the uint64 type (which we didn't need).
1116
1117 - Use a slightly more compatible set of core #include directives.
1118
1119 - Defined int32 in a way that ensures that the build dies if we can't
1120 find a variable with at least 32 bits.
1121
1122 PROTOCOL DIFFERENCES FOR VERSION 29:
1123
1124 - A 16-bit flag-word is transmitted after every file-list index. This
1125 indicates what is changing between the sender and the receiver. The
1126 generator now transmits an index and a flag-word to indicate when
1127 dirs and symlinks have changed (instead of producing a message),
1128 which makes the outputting of the information more consistent and
1129 less prone to screen corruption (because the local receiver/sender is
1130 now outputting all the file-change info messages).
1131
1132 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
1133 in the flag-word and the name of the file that was linked immediately
1134 follows in vstring format (see below).
1135
1136 - If a file is being transferred with an alternate-basis file, the
1137 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
1138 byte follows, indicating what type of basis file was chosen. If that
1139 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
1140 is set in the flag-word and the name of the match in vstring format
1141 follows the basis byte. A vstring is a variable length string that
1142 has its size written prior to the string, and no terminating null.
1143 If the string is from 1-127 bytes, the length is a single byte. If
1144 it is from 128-32767 bytes, the length is written as ((len >> 8) |
1145 0x80) followed by (len % 0x100).
1146
1147 - The sending of exclude names is done using filter-rule syntax. This
1148 means that all names have a prefixed rule indicator, even excludes
1149 (which used to be sent as a bare pattern, when possible). The -C
1150 option will include the per-dir .cvsignore merge file in the list of
1151 filter rules so it is positioned correctly (unlike in some older
1152 transfer scenarios).
1153
1154 - Rsync sorts the filename list in a different way: it sorts the subdir
1155 names after the non-subdir names for each dir's contents, and it
1156 always puts a dir's contents immediately after the dir's name in the
1157 list. (Previously an item named "foo.txt" would sort in between
1158 directory "foo/" and "foo/bar".)
1159
1160 - When talking to a protocol 29 rsync daemon, a list-only request
1161 is able to note this before the options are sent over the wire and
1162 the new --list-only option is included in the options.
1163
1164 - When the --stats bytes are sent over the wire (or stored in a batch),
1165 they now include two elapsed-time values: one for how long it took to
1166 build the file-list, and one for how long it took to send it over the
1167 wire (each expressed in thousandths of a second).
1168
1169 - When --delete-excluded is specified with some filter rules (AKA
1170 excludes), a client sender will now initiate a send of the rules to
1171 the receiver (older protocols used to omit the sending of excludes in
1172 this situation since there were no receiver-specific rules that
1173 survived --delete-excluded back then). Note that, as with all the
1174 filter-list sending, only items that are significant to the other
1175 side will actually be sent over the wire, so the filter-rule list
1176 that is sent in this scenario is often empty.
1177
1178 - An index equal to the file-list count is sent as a keep-alive packet
1179 from the generator to the sender, which then forwards it on to the
1180 receiver. This normally invalid index is only a valid keep-alive
1181 packet if the 16-bit flag-word that follows it contains a single bit
1182 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
1183
1184 - A protocol-29 batch file includes a bit for the setting of the --dirs
1185 option and for the setting of the --compress option. Also, the shell
1186 script created by --write-batch will use the --filter option instead
1187 of --exclude-from to capture any filter rules.
1188
1189 BUILD CHANGES:
1190
1191 - Handle an operating system that use mkdev() in place of makedev().
1192
1193 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
1194
1195\f
ca39ebf9
WD
1196NEWS for rsync 2.6.3 (30 Sep 2004)
1197Protocol: 28 (unchanged)
1198Changes since 2.6.2:
1199
1200 SECURITY FIXES:
1201
1202 - A bug in the sanitize_path routine (which affects a non-chrooted
1203 rsync daemon) could allow a user to craft a pathname that would get
1204 transformed into an absolute path for certain options (but not for
1205 file-transfer names). If you're running an rsync daemon with chroot
1206 disabled, *please upgrade*, ESPECIALLY if the user privs you run
1207 rsync under is anything above "nobody".
1208
1209 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
1210
1211 - Please note that the 2-line footer (output when verbose) now uses the
1212 term "sent" instead of "wrote" and "received" instead of "read". If
1213 you are not parsing the numeric values out of this footer, a script
1214 would be better off using the empty line prior to the footer as the
1215 indicator that the verbose output is over.
1216
1217 - The output from the --stats option was similarly affected to change
1218 "written" to "sent" and "read" to "received".
1219
1220 - Rsync ensures that a filename that contains a newline gets mentioned
1221 with each newline transformed into a question mark (which prevents a
1222 filename from causing an empty line to be output).
1223
1224 - The "backed up ..." message that is output when at least 2 --verbose
1225 options are specified is now the same both with and without the
1226 --backup-dir option.
1227
1228 BUG FIXES:
1229
1230 - Fixed a crash bug that might appear when --delete was used and
1231 multiple source directories were specified.
1232
1233 - Fixed a 32-bit truncation of the file length when generating the
1234 checksums.
1235
1236 - The --backup code no longer attempts to create some directories
1237 over and over again (generating warnings along the way).
1238
1239 - Fixed a bug in the reading of the secrets file (by the daemon) and
1240 the password file (by the client): the files no longer need to be
1241 terminated by a newline for their content to be read in.
1242
1243 - If a file has a read error on the sending side or the reconstructed
1244 data doesn't match the expected checksum (perhaps due to the basis
1245 file changing during the transfer), the receiver will no longer
1246 retain the resulting file unless the --partial option was specified.
1247 (Note: for the read-error detection to work, neither side can be
1248 older than 2.6.3 -- older receivers will always retain the file, and
1249 older senders don't tell the receiver that the file had a read
1250 error.)
1251
1252 - If a file gets resent in a single transfer and the --backup option
1253 is enabled, rsync no longer performs a duplicate backup (it used to
1254 overwrite the original file in the backup area).
1255
1256 - Files specified in the daemon's "exclude" or "exclude from" config
1257 items are now excluded from being uploaded (assuming that the module
1258 allows uploading at all) in addition to the old download exclusion.
1259
1260 - Got rid of a potential hang in the receiver when near the end of a
1261 phase.
1262
1263 - When using --backup without a --backup-dir, rsync no longer preserves
1264 the modify time on directories. This avoids confusing NFS.
1265
1266 - When --copy-links (-L) is specified, we now output a separate error
1267 for a symlink that has no referent instead of claiming that a file
1268 "vanished".
1269
1270 - The --copy-links (-L) option no longer has the side-effect of telling
1271 the receiving side to follow symlinks. See the --keep-dirlinks
1272 option (mentioned below) for a way to specify that behavior.
1273
1274 - Error messages from the daemon server's option-parsing (such as
1275 refused options) are now successfully transferred back to the client
1276 (the server used to fail to send the message because the socket
1277 wasn't in the right state for the message to get through).
1278
1279 - Most transfer errors that occur during a daemon transfer are now
1280 returned to the user in addition to being logged (some messages are
1281 intended to be daemon-only and are not affected by this).
1282
1283 - Fixed a bug in the daemon authentication code when using one of the
1284 batch-processing options.
1285
1286 - We try to work around some buggy IPv6 implementations that fail to
1287 implement IPV6_V6ONLY. This should fix the "address in use" error
1288 that some daemons get when running on an OS with a buggy IPv6
1289 implementation. Also, if the new code gets this error, we might
1290 suggest that the user specify --ipv4 or --ipv6 (if we think it will
1291 help).
1292
1293 - When the remote rsync dies, make a better effort to recover any error
1294 messages it may have sent before dying (the local rsync used to just
1295 die with a socket-write error).
1296
1297 - When using --delete and a --backup-dir that contains files that are
1298 hard-linked to their destination equivalents, rsync now makes sure
1299 that removed files really get removed (avoids a really weird rename()
1300 behavior).
1301
1302 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
1303 the int64 type is defined as an off_t and it actually has 64-bits.
1304
1305 - Added a configure check for open64() without mkstemp64() so that we
1306 can avoid using mkstemp() when such a combination is encountered.
1307 This bypasses a problem writing out large temp files on OSes such as
1308 AIX and HP-UX.
1309
1310 - Fixed an age-old crash problem with --read-batch on a local copy
1311 (rsync was improperly assuming --whole-file for the local copy).
1312
1313 - When --dry-run (-n) is used and the destination directory does not
1314 exist, rsync now produces a correct report of files that would be
1315 sent instead of dying with a chdir() error.
1316
1317 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
1318 with an error instead of waiting for the connection to finish.
1319
1320 - Fixed an ssh interaction that could cause output to be lost when the
1321 user chose to combine the output of rsync's stdout and stderr (e.g.
1322 using the "2>&1").
1323
920240a6
WD
1324 - Fixed an option-parsing bug when --files-from got passed to a daemon.
1325
ca39ebf9
WD
1326 ENHANCEMENTS:
1327
1328 - Added the --partial-dir=DIR option that lets you specify where to
1329 (temporarily) put a partially transferred file (instead of over-
1330 writing the destination file). E.g. --partial-dir=.rsync-partial
1331 Also added support for the RSYNC_PARTIAL_DIR environment variable
1332 that, when found, transforms a regular --partial option (such as
1333 the convenient -P option) into one that also specifies a directory.
1334
1335 - Added --keep-dirlinks (-K), which allows you to symlink a directory
1336 onto another partition on the receiving side and have rsync treat it
1337 as matching a normal directory from the sender.
1338
1339 - Added the --inplace option that tells rsync to write each destination
1340 file without using a temporary file. The matching of existing data
1341 in the destination file can be severely limited by this, but there
1342 are also cases where this is more efficient (such as appending data).
1343 Use only when needed (see the man page for more details).
1344
1345 - Added the "write only" option for the daemon's config file.
1346
1347 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
1348 and documented all these options in the man page.
1349
1350 - Improved the handling of the --bwlimit option so that it's less
1351 bursty, more accurate, and works properly over a larger range of
1352 values.
1353
1354 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
1355 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
1356
1357 - Added the --checksum-seed=N option for advanced users.
1358
1359 - Batch writing/reading has a brand-new implementation that is simpler,
1360 fixes a few weird problems with the old code (such as no longer
1361 sprinkling the batch files into different dirs or even onto different
1362 systems), and is much less intrusive into the code (making it easier
1363 to maintain for the future). The new code generates just one data
1364 file instead of three, which makes it possible to read the batch on
1365 stdin via a remote shell. Also, the old requirement of forcing the
1366 same fixed checksum-seed for all batch processing has been removed.
1367
1368 - If an rsync daemon has a module set with "list = no" (which hides its
1369 presence in the list of available modules), a user that fails to
1370 authenticate gets the same "unknown module" error that they would get
1371 if the module were actually unknown (while still logging the real
1372 error to the daemon's log file). This prevents fishing for module
1373 names.
1374
1375 - The daemon's "refuse options" config item now allows you to match
1376 option names using wildcards and/or the single-letter option names.
1377
1378 - Each transferred file now gets its permissions and modified-time
1379 updated before the temp-file gets moved into place. Previously, the
1380 finished file would have a very brief window where its permissions
1381 disallowed all group and world access.
1382
1383 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
1384 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
1385
1386 - The daemon's wildcard expanding code can now handle more than 1000
1387 filenames (it's now limited by memory instead of having a hard-wired
1388 limit).
1389
1390 INTERNAL:
1391
1392 - Some cleanup in the exclude code has saved some per-exclude memory
1393 and made the code easier to maintain.
1394
1395 - Improved the argv-overflow checking for a remote command that has a
1396 lot of args.
1397
1398 - Use rsyserr() in the various places that were still calling rprintf()
1399 with strerror() as an arg.
1400
1401 - If an rsync daemon is listening on multiple sockets (to handle both
1402 IPv4 and IPv6 to a single port), we now close all the unneeded file
1403 handles after we accept a connection (we used to close just one of
1404 them).
1405
1406 - Optimized the handling of larger block sizes (rsync used to slow to a
1407 crawl if the block size got too large).
1408
1409 - Optimized away a loop in hash_search().
1410
1411 - Some improvements to the sanitize_path() and clean_fname() functions
1412 makes them more efficient and produce better results (while still
1413 being compatible with the file-name cleaning that gets done on both
1414 sides when sending the file-list).
1415
1416 - Got rid of alloc_sanitize_path() after adding a destination-buffer
1417 arg to sanitize_path() made it possible to put all the former's
1418 functionality into the latter.
1419
1420 - The file-list that is output when at least 4 verbose options are
1421 specified reports the uid value on the sender even when rsync is
1422 not running as root (since we might be sending to a root receiver).
1423
1424 BUILD CHANGES:
1425
1426 - Added a "gen" target to rebuild most of the generated files,
1427 including configure, config.h.in, the man pages, and proto.h.
1428
1429 - If "make proto" doesn't find some changes in the prototypes, the
1430 proto.h file is left untouched (its time-stamp used to always be
1431 updated).
1432
1433 - The variable $STRIP (that is optionally set by the install-strip
1434 target's rule) was changed to $INSTALL_STRIP because some systems
1435 have $STRIP already set in the environment.
1436
1437 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
1438
1439 - When cross-compiling, the gettimeofday() function is now assumed to
1440 be a modern version that takes two-args (since we can't test it).
1441
1442 DEVELOPER RELATED:
1443
1444 - The scripts in the testsuite dir were cleaned up a bit and a few
1445 new tests added.
1446
1447 - Some new diffs were added to the patches dir, and some accepted
1448 ones were removed.
1449
1450\f
c7be6dec
WD
1451NEWS for rsync 2.6.2 (30 Apr 2004)
1452Protocol: 28 (unchanged)
1453Changes since 2.6.1:
1454
1455 BUG FIXES:
1456
1457 - Fixed a major bug in the sorting of the filenames when --relative
1458 is used for some sources (just sources such as "/" and "/*" were
1459 affected). This fix ensures that we ask for the right file-list
1460 item when requesting changes from the sender.
1461
1462 - Rsync now checks the return value of the close() function to
1463 better report disk-full problems on an NFS file system.
1464
1465 - Restored the old daemon-server behavior of logging error messages
1466 rather than returning them to the user. (A better long-term fix
1467 will be sought in the future.)
1468
1469 - An obscure uninitialized-variable bug was fixed in the uid/gid
1470 code. (This bug probably had no ill effects.)
1471
1472 BUILD CHANGES:
1473
1474 - Got rid of the configure check for sys/sysctl.h (it wasn't used
1475 and was causing a problem on some systems). Also improved the
1476 broken-largefile-locking test to try to avoid failure due to an
1477 NFS build-dir.
1478
1479 - Fixed a compile problem on systems that don't define
1480 AI_NUMERICHOST.
1481
1482 - Fixed a compile problem in the popt source for compilers that
1483 don't support __attribute__.
1484
1485 DEVELOPER RELATED:
1486
1487 - Improved the testsuite's "merge" test to work on OSF1.
1488
1489 - Two new diffs were added to the patches dir.
1490
1491\f
1492NEWS for rsync 2.6.1 (26 Apr 2004)
1493Protocol: 28 (changed)
1494Changes since 2.6.0:
1495
1496 SECURITY FIXES:
1497
1498 - Paths sent to an rsync daemon are more thoroughly sanitized when
1499 chroot is not used. If you're running a non-read-only rsync
1500 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
1501 user privs you run rsync under is anything above "nobody".
1502
1503 ENHANCEMENTS:
1504
1505 - Lower memory use, more optimal transfer of data over the socket,
1506 and lower CPU usage (see the INTERNAL section for details).
1507
1508 - The RSYNC_PROXY environment variable can now contain a
1509 "USER:PASS@" prefix before the "HOST:PORT" information.
1510 (Bardur Arantsson)
1511
1512 - The --progress output now mentions how far along in the transfer
1513 we are, including both a count of files transferred and a
1514 percentage of the total file-count that we've processed. It also
1515 shows better current-rate-of-transfer and remaining-transfer-time
1516 values.
1517
1518 - Documentation changes now attempt to describe some often mis-
1519 understood features more clearly.
1520
1521 BUG FIXES:
1522
1523 - When -x (--one-file-system) is combined with -L (--copy-links) or
1524 --copy-unsafe-links, no symlinked files are skipped, even if the
1525 referent file is on a different filesystem.
1526
1527 - The --link-dest code now works properly for a non-root user when
1528 (1) the UIDs of the source and destination differ and -o was
1529 specified, or (2) when the group of the source can't be used on
1530 the destination and -g was specified.
1531
1532 - Fixed a bug in the handling of -H (hard-links) that might cause
1533 the expanded PATH/NAME value of the current item to get
1534 overwritten (due to an expanded-name caching bug).
1535
1536 - We now reset the "new data has been sent" flag at the start of
1537 each file we send. This makes sure that an interrupted transfer
1538 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 1539 than the current basis file when no new data has been transferred
c7be6dec
WD
1540 over the wire for that file.
1541
1542 - Fixed a byte-order problem in --batch-mode on big-endian machines.
1543 (Jay Fenlason)
1544
1545 - When using --cvs-exclude, the exclude items we get from a
1546 per-directory's .cvsignore file once again only affect that one
1547 directory (not all following directories too). The items are also
1548 now properly word-split and parsed without any +/- prefix parsing.
1549
1550 - When specifying the USER@HOST: prefix for a file, the USER part
1551 can now contain an '@', if needed (i.e. the last '@' is used to
1552 find the HOST, not the first).
1553
1554 - Fixed some bugs in the handling of group IDs for non-root users:
1555 (1) It properly handles a group that the sender didn't have a name
1556 for (it would previously skip changing the group on any files in
1557 that group). (2) If --numeric-ids is used, rsync no longer
1558 attempts to set groups that the user doesn't have the permission
1559 to set.
1560
1561 - Fixed the "refuse options" setting in the rsyncd.conf file.
1562
1563 - Improved the -x (--one-file-system) flag's handling of any mount-
1564 point directories we encounter. It is both more optimal (in that
1565 it no longer does a useless scan of the contents of the mount-
1566 point dirs) and also fixes a bug where a remapped mount of the
1567 original filesystem could get discovered in a subdir we should be
1568 ignoring.
1569
1570 - Rsync no longer discards a double-slash at the start of a filename
1571 when trying to open the file. It also no longer constructs names
1572 that start with a double slash (unless the user supplied them).
1573
1574 - Path-specifying options to a daemon should now work the same with
1575 or without chroot turned on. Previously, such a option (such as
1576 --link-dest) would get its absolute path munged into a relative
1577 one if chroot was not on, making that setting fairly useless.
1578 Rsync now transforms the path into one that is based on the
1579 module's base dir when chroot is not enabled.
1580
1581 - Fixed a compatibility problem interacting with older rsync
1582 versions that might send us an empty --suffix value without
1583 telling us that --backup-dir was specified.
1584
1585 - The "hosts allow" option for a daemon-over-remote-shell process
1586 now has improved support for IPv6 addresses and a fix for systems
1587 that have a length field in their socket structs.
1588
1589 - Fixed the ability to request an empty backup --suffix when sending
1590 files to an rsync daemon.
1591
920240a6
WD
1592 - Fixed an option-parsing bug when --files-from was sent to a server
1593 sender.
1594
c7be6dec
WD
1595 INTERNAL:
1596
1597 - Most of the I/O is now buffered, which results in a pretty large
1598 speedup when running under MS Windows. (Craig Barratt)
1599
1600 - Optimizations to the name-handling/comparing code have made some
1601 significant reductions in user-CPU time for large file sets.
1602
1603 - Some cleanup of the variable types make the code more consistent.
1604
1605 - Reduced memory requirements of hard link preservation.
1606 (J.W. Schultz)
1607
1608 - Implemented a new algorithm for hard-link handling that speeds up
1609 the code significantly. (J.W. Schultz and Wayne Davison)
1610
1611 - The --hard-link option now uses the first existing file in the
1612 group of linked files as the basis for the transfer. This
1613 prevents the sub-optimal transfer of a file's data when a new
1614 hardlink is added on the sending side and it sorts alphabetically
1615 earlier in the list than the files that are already present on the
1616 receiving side.
1617
1618 - Dropped support for protocol versions less than 20 (2.3.0 released
1619 15 Mar 1999) and activated warnings for protocols less than 25
1620 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
1621 severally)
1622
1623 - More optimal data transmission for --hard-links (protocol 28).
1624
1625 - More optimal data transmission for --checksum (protocol 28).
1626
1627 - Less memory is used when --checksum is specified.
1628
1629 - Less memory is used in the file list (a per-file savings).
1630
1631 - The generator is now better about not modifying the file list
1632 during the transfer in order to avoid a copy-on-write memory
1633 bifurcation (on systems where fork() uses shared memory).
1634 Previously, rsync's shared memory would slowly become unshared,
1635 resulting in real memory usage nearly doubling on the receiving
1636 side by the end of the transfer. Now, as long as permissions
1637 are being preserved, the shared memory should remain that way
1638 for the entire transfer.
1639
1640 - Changed hardlink info and file_struct + strings to use allocation
1641 pools. This reduces memory use for large file-sets and permits
1642 freeing memory to the OS. (J.W. Schultz)
1643
1644 - The 2 pipes used between the receiver and generator processes
1645 (which are forked on the same machine) were reduced to 1 pipe and
1646 the protocol improved so that (1) it is now impossible to have the
1647 "redo" pipe fill up and hang rsync, and (2) trailing messages from
1648 the receiver don't get lost on their way through the generator
1649 over to the sender (which mainly affected hard-link messages and
1650 verbose --stats output).
1651
1652 - Improved the internal uid/gid code to be more portable and a
1653 little more optimized.
1654
1655 - The device numbers sent when using --devices are now sent as
1656 separate major/minor values with 32-bit accuracy (protocol 28).
1657 Previously, the copied devices were sent as a single 32-bit
1658 number. This will make inter-operation of 64-bit binaries more
1659 compatible with their 32-bit brethren (with both ends of the
1660 connection are using protocol 28). Note that optimizations in the
1661 binary protocol for sending the device numbers often results in
1662 fewer bytes being used than before, even though more precision is
1663 now available.
1664
1665 - Some cleanup of the exclude/include structures and its code made
1666 things clearer (internally), simpler, and more efficient.
1667
1668 - The reading & writing of the file-list in batch-mode is now
1669 handled by the same code that sends & receives the list over the
1670 wire. This makes it much easier to maintain. (Note that the
1671 batch code is still considered to be experimental.)
1672
1673 BUILD CHANGES:
1674
1675 - The configure script now accepts --with-rsyncd-conf=PATH to
1676 override the default value of the /etc/rsyncd.conf file.
1677
1678 - Fixed configure bug when running "./configure --disable-ipv6".
1679
1680 - Fixed compilation problem on Tru64 Unix (having to do with
1681 sockaddr.sa_len and sockaddr.sin_len).
1682
1683 DEVELOPER RELATED:
1684
1685 - Fixed "make test" bug when build dir is not the source dir.
1686
1687 - Added a couple extra diffs in the "patches" dir, removed the ones
1688 that got applied, and rebuilt the rest.
1689
1690\f
0f1aa0d3
WD
1691NEWS for rsync 2.6.0 (1 Jan 2004)
1692Protocol: 27 (changed)
1693Changes since 2.5.7:
1694
1695 ENHANCEMENTS:
1696
1697 * "ssh" is now the default remote shell for rsync. If you want to
1698 change this, configure like this: "./configure --with-rsh=rsh".
1699
1700 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
1701 Note that --from0 affects the line-ending character for all the
1702 files read by the --*-from options. (Wayne Davison)
1703
1704 * Length of csum2 is now per-file starting with protocol version
1705 27. (J.W. Schultz)
1706
1707 * Per-file dynamic block size is now sqrt(file length). The
1708 per-file checksum size is determined according to an algorithm
1709 provided by Donovan Baarda which reduces the probability of rsync
1710 algorithm corrupting data and falling back using the whole md4
1711 checksums. (J.W. Schultz, Donovan Baarda)
1712
1713 * The --stats option no longer includes the (debug) malloc summary
1714 unless the verbose option was specified at least twice.
1715
1716 * Added a new error/warning code for when files vanish from the
1717 sending side. Made vanished source files not interfere with the
1718 file-deletion pass when --delete-after was specified.
1719
1720 * Various trailing-info sections are now preceded by a newline.
1721
1722 BUG FIXES:
1723
1724 * Fixed several exclude/include matching bugs when using wild-cards.
1725 This has a several user-visible effects, all of which make the
1726 matching more consistent and intuitive. This should hopefully not
1727 cause anyone problems since it makes the matching work more like
1728 what people are expecting. (Wayne Davison)
1729
1730 - A pattern with a "**" no longer causes a "*" to match slashes.
1731 For example, with "/*/foo/**", "foo" must be 2 levels deep.
1732 [If your string has BOTH "*" and "**" wildcards, changing the
1733 "*" wildcards to "**" will provide the old behavior in all
1734 versions.]
1735
1736 - "**/foo" now matches at the base of the transfer (like /foo
1737 does). [Use "/**/foo" to get the old behavior in all versions.]
1738
1739 - A non-anchored wildcard term floats to match beyond the base of
1740 the transfer. E.g. "CVS/R*" matches at the end of the path,
1741 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
1742 to get the old behavior in all versions.]
1743
1744 - Including a "**" in the match term causes it to be matched
1745 against the entire path, not just the name portion, even if
1746 there aren't any interior slashes in the term. E.g. "foo**bar"
1747 would exclude "/path/foo-bar" (just like before) as well as
1748 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
1749 old behavior in all versions.]
1750
1751 * The exclude list specified in the daemon's config file is now
1752 properly applied to the pulled items no matter how deep the
1753 user's file-args are in the source tree. (Wayne Davison)
1754
1755 * For protocol version >= 27, mdfour_tail() is called when the
1756 block size (including checksum_seed) is a multiple of 64.
1757 Previously it was not called, giving the wrong MD4 checksum.
1758 (Craig Barratt)
1759
1760 * For protocol version >= 27, a 64 bit bit counter is used in
1761 mdfour.c as required by the RFC. Previously only a 32 bit bit
1762 counter was used, causing incorrect MD4 file checksums for
1763 file sizes >= 512MB - 4. (Craig Barratt)
1764
1765 * Fixed a crash bug when interacting with older rsync versions and
1766 multiple files of the same name are destined for the same dir.
1767 (Wayne Davison)
1768
1769 * Keep tmp names from overflowing MAXPATHLEN.
1770
1771 * Make --link-dest honor the absence of -p, -o, and -g.
1772
1773 * Made rsync treat a trailing slash in the destination in a more
1774 consistent manner.
1775
1776 * Fixed file I/O error detection. (John Van Essen)
1777
1778 * Fixed bogus "malformed address {hostname}" message in rsyncd log
1779 when checking IP address against hostnames from "hosts allow"
1780 and "hosts deny" parameters in config file.
1781
1782 * Print heap statistics when verbose >= 2 instead of when >= 1.
1783
1784 * Fixed a compression (-z) bug when syncing a mostly-matching file
1785 that contains already-compressed data. (Yasuoka Masahiko and
1786 Wayne Davison)
1787
1788 * Fixed a bug in the --backup code that could cause deleted files
1789 to not get backed up.
1790
1791 * When the backup code makes new directories, create them with mode
1792 0700 instead of 0755 (since the directory permissions in the
1793 backup tree are not yet copied from the main tree).
1794
1795 * Call setgroups() in a more portable manner.
1796
1797 * Improved file-related error messages to better indicate exactly
1798 what pathname failed. (Wayne Davison)
1799
1800 * Fixed some bugs in the handling of --delete and --exclude when
1801 using the --relative (-R) option. (Wayne Davison)
1802
1803 * Fixed bug that prevented regular files from replacing
1804 special files and caused a directory in --link-dest or
1805 --compare-dest to block the creation of a file with the
1806 same path. A directory still cannot be replaced by a
1807 regular file unless --delete specified. (J.W. Schultz)
1808
1809 * Detect and report when open or opendir succeed but read and
1810 readdir fail caused by network filesystem issues and truncated
1811 files. (David Norwood, Michael Brown, J.W. Schultz)
1812
1813 * Added a fix that should give ssh time to restore the tty settings
1814 if the user presses Ctrl-C at an ssh password prompt.
1815
1816 INTERNAL:
1817
1818 * Eliminated vestigial support for old versions that we stopped
1819 supporting. (J.W. Schultz)
1820
1821 * Simplified some of the option-parsing code. (Wayne Davison)
1822
1823 * Some cleanup made to the exclude code, as well as some new
1824 defines added to enhance readability. (Wayne Davison)
1825
1826 * Changed the protocol-version code so that it can interact at a
1827 lower protocol level than the maximum supported by both sides.
1828 Added an undocumented option, --protocol=N, to force the value
1829 we advertise to the other side (primarily for testing purposes).
1830 (Wayne Davison)
1831
1832\f
276877cf
WD
1833NEWS for rsync 2.5.7 (4 Dec 2003)
1834Protocol: 26 (unchanged)
1835Changes since 2.5.6:
1836
1837 SECURITY FIXES:
1838
1839 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
1840 Russell, Andrea Barisani)
1841
1842\f
1843NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
1844Protocol: 26 (unchanged)
1845Changes since 2.5.5:
1846
1847 ENHANCEMENTS:
1848
1849 * The --delete-after option now implies --delete. (Wayne Davison)
1850
1851 * The --suffix option can now be used with --backup-dir. (Michael
1852 Zimmerman)
1853
a923437b 1854 * Combining "::" syntax with the --rsh/-e option now uses the
276877cf
WD
1855 specified remote-shell as a transport to talk to a (newly-spawned)
1856 server-daemon. This allows someone to use daemon features, such
1857 as modules, over a secure protocol, such as ssh. (JD Paul)
1858
1859 * The rsync:// syntax for daemon connections is now accepted in the
1860 destination field.
1861
1862 * If the file name given to --include-from or --exclude-from is "-",
1863 rsync will read from standard input. (J.W. Schultz)
1864
1865 * New option --link-dest which is like --compare-dest except that
1866 unchanged files are hard-linked in to the destination directory.
1867 (J.W. Schultz)
1868
1869 * Don't report an error if an excluded file disappears during an
1870 rsync run. (Eugene Chupriyanov and Bo Kersey)
1871
1872 * Added .svn to --cvs-exclude list to support subversion. (Jon
1873 Middleton)
1874
1875 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
1876 and "hosts deny" fields. (Hideaki Yoshifuji)
1877
1878 * Changed exclude file handling to permit DOS or MAC style line
1879 terminations. (J.W. Schultz)
1880
1881 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
1882 (Dave Dykstra)
1883
1884 BUG FIXES:
1885
1886 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
1887 L. Allen, Martin Pool)
1888
1889 * Generate each file's rolling-checksum data as we send it, not
1890 in a separate (memory-eating) pass before hand. This prevents
1891 timeout errors on really large files. (Stefan Nehlsen)
1892
1893 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
1894
1895 * Better handling of some client-server errors. (Martin Pool)
1896
1897 * Fixed a crash that would occur when sending a list of files that
1898 contains a duplicate name (if it sorts to the end of the file
1899 list) and using --delete. (Wayne Davison)
1900
1901 * Fixed the file-name duplicate-removal code when dealing with multiple
1902 dups in a row. (Wayne Davison)
1903
1904 * Fixed a bug that caused rsync to lose the exit status of its child
1905 processes and sometimes return an exit code of 0 instead of showing
1906 an error. (David R. Staples, Dave Dykstra)
1907
1908 * Fixed bug in --copy-unsafe-links that caused it to be completely
1909 broken. (Dave Dykstra)
1910
1911 * Prevent infinite recursion in cleanup code under certain circumstances.
1912 (Sviatoslav Sviridov and Marc Espie)
1913
1914 * Fixed a bug that prevented rsync from creating intervening directories
1915 when --relative-paths/-R is set. (Craig Barratt)
1916
1917 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
1918
1919 INTERNAL:
1920
1921 * Many code cleanups and improved internal documentation. (Martin
1922 Pool, Nelson Beebe)
1923
1924 * Portability fixes. (Dave Dykstra and Wayne Davison)
1925
1926 * More test cases. (Martin Pool)
1927
1928 * Some test-case fixes. (Brian Poole, Wayne Davison)
1929
1930 * Updated included popt to the latest vendor drop, version 1.6.4.
1931 (Jos Backus)
1932
1933 * Updated config.guess and config.sub to latest versions; this
1934 means rsync should build on more platforms. (Paul Green)
1935
1936\f
1937NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
1938Protocol: 26 (unchanged)
1939Changes since 2.5.4:
54c7298c
MP
1940
1941 ENHANCEMENTS:
1942
1943 * With --progress, when a transfer is complete show the time taken;
1944 otherwise show expected time to complete. (Cameron Simpson)
1945
1946 * Make "make install-strip" works properly, and "make install"
1947 accepts a DESTDIR variable for help in building binary packages.
1948 (Peter Breitenlohner, Greg Louis)
1949
1950 * If configured with --enable-maintainer-mode, then on receipt of
1951 a fatal signal rsync will try to open an xterm running gdb,
1952 similarly to Samba's "panic action" or GNOME's bug-buddy.
1953 (Martin Pool)
1954
1955
1956 BUG FIXES:
1957
1958 * Fix situation where failure to fork (e.g. because out of process
1959 slots) would cause rsync to kill all processes owned by the
1960 current user. Yes, really! (Paul Haas, Martin Pool)
1961
1962 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
1963
1964 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
1965 Pool.)
1966
1967 * Fix --whole-file problem that caused it to be the default even
1968 for remote connections. (Martin Pool, Frank Schulz)
1969
1970 * Work around bug in Mac OS X mkdir(2), which cannot handle
1971 trailing slashes.
1972 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
1973 (Martin Pool)
1974
1975 * Improved network error handling. (Greg A. Woods)
1976
1977\f
276877cf
WD
1978NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
1979Protocol: 26 (unchanged)
1980Changes since 2.5.3:
c9a66d41
MP
1981
1982 BUG FIXES:
1983
1984 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
1985 Tridgell) (CVE CAN-2002-0059)
276877cf 1986
c9a66d41
MP
1987 ENHANCEMENTS:
1988
1989 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
1990 (Note that rsync still uses a custom version of zlib; you can
1991 not just link against a system library. See zlib/README.rsync)
1992
1993 * Additional test cases for --compress. (Martin Pool)
1994
1995\f
276877cf
WD
1996NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
1997Protocol: 26 (unchanged)
1998Changes since 2.5.2:
d40fb723
MP
1999
2000 SECURITY FIXES:
2001
2002 * Make sure that supplementary groups are removed from a server
2003 process after changing uid and gid. (Ethan Benson) (Debian bug
2004 #132272, CVE CAN-2002-0080)
2005
2006 BUG FIXES:
2007
2008 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
2009 CAN-2002-0059)
2010
276877cf 2011 * Fixed problem that in many cases caused the error message
d40fb723
MP
2012 unexpected read size of 0 in map_ptr
2013 and resulted in the wrong data being copied.
2014
2015 * Fixed compilation errors on some systems caused by the use of
2016 "unsigned int64" in rsync.h.
2017
2018 * Fixed problem on systems such as Sunos4 that do not support realloc
2019 on a NULL pointer; error was "out of memory in flist_expand".
2020
2021 * Fix for rsync server processes hanging around after the client
2022 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
2023
2024 * Cope with BSD systems on which mkdir() will not accept a trailing
2025 slash.
2026
2027 ENHANCEMENTS:
2028
2029 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
2030 rsync still uses a custom version of zlib; you can not just link
2031 against a system library. See zlib/README.rsync)
276877cf 2032
d40fb723
MP
2033 * Command to initiate connections is only shown with -vv, rather
2034 than -v as in 2.5.2. Output from plain -v is more similar to
2035 what was historically used so as not to break scripts that try
2036 to parse the output.
2037
2038 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
2039
2040 * Made the --write-batch and --read-batch options actually work
2041 and added documentation in the man page (Jos Backus)
2042
2043 * If the daemon is unable to fork a child to accept a connection,
2044 print an error message. (Colin Walters)
2045
276877cf
WD
2046\f
2047NEWS for rsync 2.5.2 (26 Jan 2002)
2048Protocol: 26 (changed)
2049Changes since 2.5.1:
97efa5c3
MP
2050
2051 SECURITY FIXES:
2052
2053 * Signedness security patch from Sebastian Krahmer
2054 <krahmer@suse.de> -- in some cases we were not sufficiently
2055 careful about reading integers from the network.
2056
2057 BUG FIXES:
2058
2059 * Fix possible string mangling in log files.
2060
2061 * Fix for setting local address of outgoing sockets.
2062
2063 * Better handling of hardlinks and devices on platforms with
2064 64-bit dev_t or ino_t.
2065
2066 * Name resolution on machines supporting IPv6 is improved.
2067
2068 * Fix for device nodes. (dann frazier) (Debian #129135)
2069
2070 ENHANCEMENTS:
2071
2072 * With -v, rsync now shows the command used to initiate an ssh/rsh
2073 connection.
2074
2075 * --statistics now shows memory heap usage on platforms that
276877cf 2076 support mallinfo().
97efa5c3
MP
2077
2078 * "The Ted T'so school of program optimization": make progress
2079 visible and people will think it's faster. (With --progress,
2080 rsync will show you how many files it has seen as it builds the
2081 file_list, giving some indication that it has not hung.)
2082
2083 * Improvements to batch mode support. This is still experimental
2084 but testing would be welcome. (Jos Backus)
276877cf 2085
97efa5c3
MP
2086 * New --ignore-existing option, patch previously distributed with
2087 Vipul's Razor. (Debian #124286)
2088
276877cf
WD
2089\f
2090NEWS for rsync 2.5.1 (3 Jan 2002)
2091Protocol: 25 (unchanged)
2092Changes since 2.5.0:
2093
2094 BUG FIXES:
499957d9 2095
499957d9
MP
2096 * Fix for segfault in --daemon mode configuration parser. (Paul
2097 Mackerras)
2098
2099 * Correct string<->address parsing for both IPv4 and 6.
2100 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
2101 Hagino)
2102
2103 * Various fixes for IPv6 support. (Dave Dykstra)
2104
2105 * rsync.1 typo fix. (Matt Kraai)
2106
2107 * Test suite typo fixes. (Tom Schmidt)
2108
2109 * rsync.1 grammar and clarity improvements. (Edward
2110 Welbourne)
2111
2112 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
2113
2114 ENHANCEMENTS:
2115
2116 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
2117 multiple of bytes/s) and estimated time to completion. (Rik
2118 Faith)
2119
499957d9 2120 * --no-detach option, required to run as a W32 service and also
276877cf
WD
2121 useful when running on Unix under daemontools, AIX's SRC, or a
2122 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
2123
2124 * Clearer error messages for some conditions.
2125
c9a66d41 2126\f
276877cf
WD
2127NEWS for rsync 2.5.0 (30 Nov 2001)
2128Protocol: 25 (changed)
2129Changes since 2.4.6:
d313ae7d
MP
2130
2131 ANNOUNCEMENTS
2132
2133 * Martin Pool <mbp@samba.org> is now a co-maintainer.
2134
2135 NEW FEATURES
2136
2137 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
2138
2139 * Shell wildcards are allowed in "auth users" lines.
2140
2141 * Merged UNC rsync+ patch to support creation of standalone patch
2142 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
2143 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
2144
2145 * IPv6 support based on a patch from KAME.net, on systems
2146 including modern versions of Linux, Solaris, and HP-UX. Also
2147 includes IPv6 compatibility functions for old OSs by the
2148 Internet Software Consortium, Paul Vixie, the OpenSSH
2149 portability project, and OpenBSD.
2150
2151 ENHANCEMENTS
2152
2153 * Include/exclude cluestick: with -vv, print out whether files are
2154 included or excluded and why.
2155
2156 * Many error messages have more friendly explanations and more
2157 details.
2158
2159 * Manual page improvements plus scanty protocol documentation.
2160
2161 * When running as --daemon in the background and using a "log
2162 file" rsyncd.conf directive, close the log file every time it is
2163 open when going to sleep on the socket. This allows the log
2164 file to get cleaned out by another process.
2165
2166 * Change to using libpopt rather than getopt for processing
2167 options. This makes the code cleaner and the behaviour more
2168 consistent across platforms. popt is included and built if not
2169 installed on the platform.
2170
2171 * More details in --version, including note about whether 64-bit
2172 files, symlinks and hardlinks are supported.
2173
2174 * MD4 code may use less CPU cycles.
2175
2176 * Use mkstemp on systems where it is secure. If we use mktemp,
2177 explain that we do it in a secure way.
2178
2179 * --whole-file is the default when source and target are on the
2180 local machine.
2181
2182 BUG FIXES:
2183
2184 * Fix for various bugs causing rsync to hang.
2185
2186 * Attempt to fix Large File Summit support on AIX.
2187
2188 * Attempt to fix error handling lockup bug.
2189
2190 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 2191 to transfer fail to transfer.
d313ae7d
MP
2192
2193 * For log messages containing ridiculously long strings that might
2194 overflow a buffer rsync no longer aborts, but rather prints an
2195 ellipsis at the end of the string. (Patch from Ed Santiago.)
2196
2197 PLATFORMS:
2198
2199 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
2200
2201 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 2202 scripts. It is not required to simply build rsync.
d313ae7d
MP
2203
2204 * Platforms thought to work in this release:
2205
2206 Cray SV1 UNICOS 10.0.0.8 cc
2207 Debian Linux 2.2 UltraSparc gcc
2208 Debian Linux testing/unstable ARM gcc
2209 FreeBSD 3.3-RELEASE i386 cc
2210 FreeBSD 4.1.1-RELEASE i386 cc
2211 FreeBSD 4.3-STABLE i386 cc
2212 HP PA-RISC HP-UX 10.20 gcc
2213 HP PA-RISC HP-UX 11.11 cc
2214 IRIX 6.5 MIPS cc
2215 IRIX 6.5 MIPS gcc
2216 Mac OS X PPC (--disable-ipv6) cc
2217 NetBSD 1.5 i386 gcc
2218 NetBSD Current i386 cc
2219 OpenBSD 2.5 Sparc gcc
2220 OpenBSD 2.9 i386 cc
2221 OpenBSD Current i386 cc
2222 RedHat 6.2 i386 gcc
2223 RedHat 6.2 i386 insure++
2224 RedHat 7.0 i386 gcc
2225 RedHat 7.1 i386 (Kernel 2.4.10) gcc
2226 Slackware 8.0 i686 (Kernel 2.4.10)
2227 Solaris 8 UltraSparc cc
2228 Solaris 8 UltraSparc gcc
2229 Solaris 8 i386 gcc
2230 SuSE 7.1 i386 gcc2.95.2
2231 SuSE 7.1 ppc gcc2.95.2
2232 i386-pc-sco3.2v5.0.5 cc
2233 i386-pc-sco3.2v5.0.5 gcc
2234 powerpc-ibm-aix4.3.3.0 cc
2235 i686-unknown-sysv5UnixWare7.1.0 gcc
2236 i686-unknown-sysv5UnixWare7.1.0 cc
2237
2238 TESTING:
2239
2240 * The existing test.sh script by Phil Hands has been merged into a
2241 test framework that works from both "make check" and the Samba
2242 build farm.
3742bf3a
S
2243\f
2244Partial Protocol History
f7e48a5c 2245 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
21068d8e 2246 ?? ??? 2007 3.0.0 11 Nov 2006 30
0c6d7952 2247 06 Nov 2006 2.6.9 29
4177f09b 2248 22 Apr 2006 2.6.8 29
a058cbc4 2249 11 Mar 2006 2.6.7 29
cbc63b9b 2250 28 Jul 2005 2.6.6 29
2dfe1c37 2251 01 Jun 2005 2.6.5 29
f7e48a5c 2252 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 2253 30 Sep 2004 2.6.3 28
c7be6dec
WD
2254 30 Apr 2004 2.6.2 28
2255 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
2256 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
2257 04 Dec 2003 2.5.7 26
2258 26 Jan 2003 2.5.6 26
2259 02 Apr 2002 2.5.5 26
2260 13 Mar 2002 2.5.4 26
2261 11 Mar 2002 2.5.3 26
2262 26 Jan 2002 2.5.2 11 Jan 2002 26
2263 03 Jan 2002 2.5.1 25
2264 30 Nov 2001 2.5.0 23 Aug 2001 25
2265 06 Sep 2000 2.4.6 24
2266 19 Aug 2000 2.4.5 24
2267 29 Jul 2000 2.4.4 24
2268 09 Apr 2000 2.4.3 24
2269 30 Mar 2000 2.4.2 24
2270 30 Jan 2000 2.4.1 29 Jan 2000 24
2271 29 Jan 2000 2.4.0 28 Jan 2000 23
2272 25 Jan 2000 2.3.3 23 Jan 2000 22
2273 08 Nov 1999 2.3.2 26 Jun 1999 21
2274 06 Apr 1999 2.3.1 20
2275 15 Mar 1999 2.3.0 15 Mar 1999 20
2276 25 Nov 1998 2.2.1 19
2277 03 Nov 1998 2.2.0 19
2278 09 Sep 1998 2.1.1 19
2279 20 Jul 1998 2.1.0 19
2280 17 Jul 1998 2.0.19 19
2281 18 Jun 1998 2.0.17 19
2282 01 Jun 1998 2.0.16 19
2283 27 May 1998 2.0.13 27 May 1998 19
2284 26 May 1998 2.0.12 18
2285 22 May 1998 2.0.11 18
2286 18 May 1998 2.0.9 18 May 1998 18
2287 17 May 1998 2.0.8 17
2288 15 May 1998 2.0.1 17
2289 14 May 1998 2.0.0 17
2290 17 Apr 1998 1.7.4 17
2291 13 Apr 1998 1.7.3 17
2292 05 Apr 1998 1.7.2 17
2293 26 Mar 1998 1.7.1 17
2294 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
2295 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
2296
2297* DATE OF COMMIT is the date the protocol change was committed to CVS.