Mention the ignoring of SIGXFSZ.
[rsync/rsync.git] / OLDNEWS
CommitLineData
f90f7149
WD
1NEWS for rsync 2.6.6 (28 Jul 2005)
2Protocol: 29 (unchanged)
3Changes since 2.6.5:
4
5 SECURITY FIXES:
6
7 - The zlib code was upgraded to version 1.2.3 in order to make it more
8 secure. While the widely-publicized security problem in zlib 1.2.2 did
9 not affect rsync, another security problem surfaced that affects rsync's
10 zlib 1.1.4.
11
12 BUG FIXES:
13
14 - The setting of flist->high in clean_flist() was wrong for an empty list.
15 This could cause flist_find() to crash in certain rare circumstances
16 (e.g. if just the right directory setup was around when --fuzzy was
17 combined with --link-dest).
18
19 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
20 (1) Without -i it would output the name of each hard-linked file as
21 though it had been changed; it now outputs a "is hard linked" message for
22 the file. (2) With -i it would output all dots for the unchanged
23 attributes of a hard-link; it now changes those dots to spaces, as is
24 done for other totally unchanged items.
f90f7149
WD
25
26 - When backing up a changed symlink or device, get rid of any old backup
27 item so that we don't get an "already exists" error.
28
29 - A couple places that were comparing a local and a remote modification-
30 time were not honoring the --modify-window option.
31
32 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
33 set too often (if some non-significant mode bits differed).
34
35 - Fixed a really old, minor bug that could cause rsync to warn about being
36 unable to mkdir() a path that ends in "/." because it just created the
37 directory (required --relative, --no-implied-dirs, a source path that
38 ended in either a trailing slash or a trailing "/.", and a non-existing
39 destination dir to tickle the bug in a recent version).
40
41 ENHANCEMENTS:
42
43 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
44 per-module basis (which now matches the documentation).
45
46 - The support/rrsync script has been upgraded to verify the args of options
47 that take args (instead of rejecting any such options). The script was
48 also changed to try to be more secure and to fix a problem in the parsing
49 of a pull operation that has multiple sources.
50
51 - Improved the documentation that explains the difference between a
52 normal daemon transfer and a daemon-over remote-shell transfer.
53
54 - Some of the diffs supplied in the patches dir were fixed and/or
55 improved.
56
57 BUILD CHANGES:
58
59 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
60 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
61 find in the /etc/group file).
62
63 - Added a test to the test suite, itemized.test, that tests the output of
64 -i (log-format w/%i) and some double-verbose messages.
65
66\f
a1c75ed0
WD
67NEWS for rsync 2.6.5 (1 Jun 2005)
68Protocol: 29 (unchanged)
69Changes since 2.6.4:
70
71 OUTPUT CHANGES:
72
73 - Non-printable chars in filenames are now output using backslash-
74 escaped characters rather than '?'s. Any non-printable character is
75 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
76 is now output as "\\". Rsync also uses your locale setting, which
77 can make it treat fewer high-bit characters as non-printable.
78
79 - If rsync received an empty file-list when pulling files, it would
80 output a "nothing to do" message and exit with a 0 (success) exit
81 status, even if the remote rsync returned an error (it did not do
82 this under the same conditions when pushing files). This was changed
83 to make the pulling behavior the same as the pushing behavior: we
84 now do the normal end-of-run outputting (depending on options) and
85 exit with the appropriate exit status.
86
87 BUG FIXES:
88
89 - A crash bug was fixed when a daemon had its "path" set to "/", did
90 not have chroot enabled, and used some anchored excludes in the
91 rsyncd.conf file.
92
93 - Fixed a bug in the transfer of a single file when -H is specified
94 (rsync would either infinite loop or perhaps crash).
95
96 - Fixed a case where the generator might try (and fail) to tweak the
97 write-permissions of a read-only directory in list-only mode (this
98 only caused an annoying warning message).
99
100 - If --compare-dest or --link-dest uses a locally-copied file as the
101 basis for an updated version, log this better when --verbose or -i
102 is in effect.
103
104 - Fixed the accidental disabling of --backup during the --delete-after
105 processing.
106
107 - Restored the ability to use the --address option in client mode (in
108 addition to its use in daemon mode).
109
110 - Make sure that some temporary progress information from the delete
111 processing does not get left on the screen when it is followed by a
112 newline.
113
114 - When --existing skips a directory with extra verbosity, refer to it
115 as a "directory", not a "file".
116
117 - When transferring a single file to a different-named file, any
118 generator messages that are source-file related no longer refer to
119 the file by the destination filename.
120
121 - Fixed a bug where hard-linking a group of files might fail if the
122 generator hasn't created a needed destination directory yet.
123
124 - Fixed a bug where a hard-linked group of files that is newly-linked
125 to a file in a --link-dest dir doesn't link the files from the rest
126 of the cluster.
127
128 - When deleting files with the --one-file-system (-x) option set, rsync
129 no longer tries to remove files from inside a mount-point on the
130 receiving side. Also, we don't complain about being unable to remove
131 the mount-point dir.
132
133 - Fixed a compatibility problem when using --cvs-ignore (-C) and
134 sending files to an older rsync without using --delete.
135
136 - Make sure that a "- !" or "+ !" include/exclude pattern does not
137 trigger the list-clearing action that is reserved for "!".
138
139 - Avoid a timeout in the generator when the sender/receiver aren't
140 handling the generator's checksum output quickly enough.
141
142 - Fixed the omission of some directories in the delete processing when
143 --relative (-R) was combined with a source path that had a trailing
144 slash.
145
146 - Fixed a case where rsync would erroneously delete some files and then
147 re-transfer them when the options --relative (-R) and --recursive
148 (-r) were both enabled (along with --delete) and a source path had a
149 trailing slash.
150
151 - Make sure that --max-size doesn't affect a device or a symlink.
152
153 - Make sure that a system with a really small MAXPATHLEN does not cause
154 the buffers in readfd_unbuffered() to be too small to receive normal
155 messages. (This mainly affected Cygwin.)
156
157 - If a source pathname ends with a filename of "..", treat it as if
158 "../" had been specified (so that we don't copy files to the parent
159 dir of the destination).
160
161 - If --delete is combined with a file-listing rsync command (i.e. no
162 transfer is happening), avoid outputting a warning that we couldn't
163 delete anything.
164
165 - If --stats is specified with --delete-after, ensure that all the
166 "deleting" messages are output before the statistics.
167
168 - Improved one "if" in the deletion code that was only checking errno
169 for ENOTEMPTY when it should have also been checking for EEXIST (for
170 compatibility with OS variations).
171
172 ENHANCEMENTS:
173
174 - Added the --only-write-batch=FILE option that may be used (instead
175 of --write-batch=FILE) to create a batch file without doing any
176 actual updating of the destination. This allows you to divert all
177 the file-updating data away from a slow data link (as long as you
178 are pushing the data to the remote server when creating the batch).
179
180 - When the generator is taking a long time to fill up its output buffer
181 (e.g. if the transferred files are few, small, or missing), it now
182 periodically flushes the output buffer so that the sender/receiver
183 can get started on the files sooner rather than later.
184
185 - Improved the keep-alive code to handle a long silence between the
186 sender and the receiver that can occur when the sender is receiving
187 the checksum data for a large file.
188
189 - Improved the auth-errors that are logged by the daemon to include
190 some information on why the authorization failed: wrong user,
191 password mismatch, etc. (The client-visible message is unchanged!)
192
193 - Improved the client's handling of an "@ERROR" from a daemon so that
194 it does not complain about an unexpectedly closed socket (since we
195 really did expect the socket to close).
196
197 - If the daemon can't open the log-file specified in rsyncd.conf, fall
198 back to using syslog and log an appropriate warning. This is better
199 than what was typically a totally silent (and fatal) failure (since a
200 daemon is not usually run with the --no-detach option that was
201 necessary to see the error on stderr).
202
203 - The man pages now consistently refer to an rsync daemon as a "daemon"
204 instead of a "server" (to distinguish it from the server process in a
205 non-daemon transfer).
206
207 - Made a small change to the rrsync script (restricted rsync -- in the
208 support dir) to make a read-only server reject all --remove-* options
209 when sending files (to future-proof it against the possibility of
210 other similar options being added at some point).
211
212 INTERNAL:
213
214 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
215 better discern which filename characters need to be escaped in
216 messages (which should result in fewer escaped characters in some
217 locales).
218
219 - Improved the naming of the log-file open/reopen/close functions.
220
221 - Removed some protocol-compatibility code that was only needed to help
222 someone running a pre-release of 2.6.4.
223
224 BUILD CHANGES:
225
226 - Added configure option "--disable-locale" to disable any use of
227 setlocale() in the binary.
228
229 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
230 rsync from being built without symlink or hard-link support.
231
232 - Only #define HAVE_REMSH if it is going to be set to 1.
233
234 - Configure now disables the use of mkstemp() under HP-UX (since they
235 refuse to fix its broken handling of large files).
236
237 - Configure now explicitly checks for the lseek64() function so that
238 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
239 presence based on the presence of the off64_t type.
240
241 - Configure no longer mentions the change in the default remote-shell
242 (from rsh to ssh) that occurred for the 2.6.0 release.
243
244 - Some minor enhancements to the test scripts.
245
246 - Added a few new *.diff files to the patches dir, including a patch
247 that enables the optional copying of extended attributes.
248
249\f
1ad6a7f6
WD
250NEWS for rsync 2.6.4 (30 March 2005)
251Protocol: 29 (changed)
252Changes since 2.6.3:
253
254 OUTPUT CHANGES:
255
256 - When rsync deletes a directory and outputs a verbose message about
257 it, it now appends a trailing slash to the name instead of (only
258 sometimes) outputting a preceding "directory " string.
259
260 - The --stats output will contain file-list time-statistics if both
261 sides are 2.6.4, or if the local side is 2.6.4 and the files are
262 being pushed (since the stats come from the sending side).
263 (Requires protocol 29 for a pull.)
264
265 - The "%o" (operation) log-format escape now has a third value (besides
266 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
267 This changes the way deletions are logged in the daemon's log file.
268
269 - When the --log-format option is combined with --verbose, rsync now
270 avoids outputting the name of the file twice in most circumstances.
271 As long as the --log-format item does not refer to any post-transfer
272 items (such as %b or %c), the --log-format message is output prior to
273 the transfer, so --verbose is now the equivalent of a --log-format of
274 '%n%L' (which outputs the name and any link info). If the log output
275 must occur after the transfer to be complete, the only time the name
276 is also output prior to the transfer is when --progress was specified
277 (so that the name will precede the progress stats, and the full
278 --log-format output will come after).
97e3c50c 279
7c2a83c6
WD
280 - Non-printable characters in filenames are replaced with a '?' to
281 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
282
283 BUG FIXES:
284
285 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
286 was only treating it as a special token in an rsync include/exclude
287 file).
288
289 - The combination of --verbose and --dry-run now mentions the full list
290 of changes that would be output without --dry-run.
291
292 - Avoid a mkdir warning when removing a directory in the destination
293 that already exists in the --backup-dir.
294
295 - An OS that has a binary mode for its files (such as cygwin) needed
296 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 297 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
298
299 - Fixed a potential hang when verbosity is high, the client side is
300 the sender, and the file-list is large.
301
302 - Fixed a potential protocol-corrupting bug where the generator could
303 merge a message from the receiver into the middle of a multiplexed
304 packet of data if only part of that data had been written out to the
305 socket when the message from the generator arrived.
306
307 - We now check if the OS doesn't support using mknod() for creating
308 FIFOs and sockets, and compile-in some compatibility code using
309 mkfifo() and socket() when necessary.
310
311 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
312 if the --max-delete limit is exceeded during a run, we now output a
313 warning about this at the end of the run and exit with a new error
314 code (25).
315
316 - One place in the code wasn't checking if fork() failed.
317
318 - The "ignore nonreadable" daemon parameter used to erroneously affect
319 readable symlinks that pointed to a non-existent file.
320
321 - If the OS does not have lchown() and a chown() of a symlink will
322 affect the referent of a symlink (as it should), we no longer try
323 to set the user and group of a symlink.
324
325 - The generator now properly runs the hard-link loop and the dir-time
326 rewriting loop after we're sure that the redo phase is complete.
327
328 - When --backup was specified with --partial-dir=DIR, where DIR is a
329 relative path, the backup code was erroneously trying to backup a
330 file that was put into the partial-dir.
331
332 - If a file gets resent in a single transfer and the --backup option is
333 enabled along with --inplace, rsync no longer performs a duplicate
334 backup (it used to overwrite the first backup with the failed file).
335
336 - One call to flush_write_file() was not being checked for an error.
337
338 - The --no-relative option was not being sent from the client to a
339 server sender.
340
341 - If an rsync daemon specified "dont compress = ..." for a file and the
342 client tried to specify --compress, the libz code was not handling a
343 compression level of 0 properly. This could cause a transfer failure
344 if the block-size for a file was large enough (e.g. rsync might have
345 exited with an error for large files).
346
347 - Fixed a bug that would sometimes surface when using --compress and
348 sending a file with a block-size larger than 64K (either manually
349 specified, or computed due to the file being really large). Prior
350 versions of rsync would sometimes fail to decompress the data
351 properly, and thus the transferred file would fail its verification.
352
353 - If a daemon can't open the specified log file (i.e. syslog is not
354 being used), die without crashing. We also output an error about
355 the failure on stderr (which will only be seen if --no-detach was
356 specified) and exit with a new error code (6).
357
358 - A local transfer no longer duplicates all its include/exclude options
359 (since the forked process already has a copy of the exclude list,
360 there's no need to send them a set of duplicates).
361
362 - When --progress is specified, the output of items that the generator
363 is creating (e.g. dirs, symlinks) is now integrated into the progress
364 output without overlapping it. (Requires protocol 29.)
365
366 - When --timeout is specified, lulls that occur in the transfer while
367 the generator is doing work that does not generate socket traffic
368 (looking for changed files, deleting files, doing directory-time
369 touch-ups, etc.) will cause a new keep-alive packet to be sent that
370 should keep the transfer going as long as the generator continues to
371 make progress. (Requires protocol 29.)
372
373 - The stat size of a device is not added to the total file size of the
374 items in the transfer (the size might be undefined on some OSes).
375
376 - Fixed a problem with refused-option messages sometimes not making it
377 back to the client side when a remote --files-from was in effect and
378 the daemon was the receiver.
379
0f9941dc 380 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
381 (the preserved) attributes from the version in the compare-dest DIR.
382
383 - When rsync is copying files into a write-protected directory, fixed
384 the change-report output for the directory so that we don't report
385 an identical directory as changed.
386
387 ENHANCEMENTS:
388
389 - Rsync now supports popt's option aliases, which means that you can
390 use /etc/popt and/or ~/.popt to create your own option aliases.
391
392 - Added the --delete-during (--del) option which will delete files
393 from the receiving side incrementally as each directory in the
394 transfer is being processed. This makes it more efficient than the
395 default, before-the-transfer behavior, which is now also available as
396 --delete-before (and is still the default --delete-WHEN option that
397 will be chosen if --delete or --delete-excluded is specified without
398 a --delete-WHEN choice). All the --del* options infer --delete, so
399 an rsync daemon that refuses "delete" will still refuse to allow any
400 file-deleting options (including the new --remove-sent-files option).
401
402 - All the --delete-WHEN options are now more memory efficient:
403 Previously an duplicate set of file-list objects was created on the
404 receiving side for the entire destination hierarchy. The new
405 algorithm only creates one directory of objects at a time (for files
406 inside the transfer).
407
408 - Added the --copy-dest option, which works like --link-dest except
409 that it locally copies identical files instead of hard-linking them.
410
411 - Added support for specifying multiple --compare-dest, --copy-dest, or
412 --link-dest options, but only of a single type. (Promoted from the
413 patches dir and enhanced.) (Requires protocol 29.)
414
415 - Added the --max-size option. (Promoted from the patches dir.)
416
417 - The daemon-mode options are now separated from the normal rsync
418 options so that they can't be mixed together. This makes it
419 impossible to start a daemon that has improper default option values
420 (which could cause problems when a client connects, such as hanging
421 or crashing).
422
423 - The --bwlimit option may now be used in combination with --daemon
424 to specify both a default value for the daemon side and a value
425 that cannot be exceeded by a user-specified --bwlimit option.
426
427 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
428 the patches dir.) Also added "address". The command-line options
429 take precedence over a config-file option, as expected.
430
431 - In _exit_cleanup(): when we are exiting with a partially-received
432 file, we now flush any data in the write-cache before closing the
433 partial file.
434
435 - The --inplace support was enhanced to work with --compare-dest,
436 --link-dest, and (the new) --copy-dest options. (Requires protocol
437 29.)
438
439 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
440 without recursion. Any directories that are encountered are created
441 on the destination. Specifying a directory with a trailing slash
442 copies its immediate contents to the destination.
443
444 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
445
446 - Added the --list-only option, which is mainly a way for the client to
447 put the server into listing mode without needing to resort to any
448 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
449 for a non-recursive listing). This option is used automatically
450 (behind the scenes) when a modern rsync speaks to a modern daemon,
451 but may also be specified manually if you want to force the use of
452 the --list-only option over a remote-shell connection.
453
454 - Added the --omit-dir-times (-O) option, which will avoid updating
455 the modified time for directories when --times was specified. This
456 option will avoid an extra pass through the file-list at the end of
457 the transfer (to tweak all the directory times), which may provide
458 an appreciable speedup for a really large transfer. (Promoted from
459 the patches dir.)
460
461 - Added the --filter (-f) option and its helper option, -F. Filter
462 rules are an extension to the existing include/exclude handling
463 that also supports nested filter files as well as per-directory
464 filter files (like .cvsignore, but with full filter-rule parsing).
465 This new option was chosen in order to ensure that all existing
466 include/exclude processing remained 100% compatible with older
467 versions. Protocol 29 is needed for full filter-rule support, but
468 backward-compatible rules work with earlier protocol versions.
469 (Promoted from the patches dir and enhanced.)
470
471 - Added the --delay-updates option that puts all updated files into
472 a temporary directory (by default ".~tmp~", but settable via the
473 --partial-dir=DIR option) until the end of the transfer. This
474 makes the updates a little more atomic for a large transfer.
475
476 - If rsync is put into the background, any output from --progress is
477 reduced.
478
479 - Documented the "max verbosity" setting for rsyncd.conf. (This
480 setting was added a couple releases ago, but left undocumented.)
481
482 - The sender and the generator now double-check the file-list index
483 they are given, and refuse to try to do a file transfer on a
484 non-file index (since that would indicate that something had gone
485 very wrong).
486
487 - Added the --itemize-changes (-i) option, which is a way to output a
488 more detailed list of what files changed and in what way. The effect
489 is the same as specifying a --log-format of "%i %n%L" (see both the
490 rsync and rsyncd.conf manpages). Works with --dry-run too.
491
492 - Added the --fuzzy (-y) option, which attempts to find a basis file
493 for a file that is being created from scratch. The current algorithm
494 only looks in the destination directory for the created file, but it
495 does attempt to find a match based on size/mod-time (in case the file
496 was renamed with no other changes) as well as based on a fuzzy
497 name-matching algorithm. This option requires protocol 29 because it
498 needs the new file-sorting order. (Promoted from patches dir and
499 enhanced.) (Requires protocol 29.)
500
501 - Added the --remove-sent-files option, which lets you move files
502 between systems.
503
504 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
505 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
506 literals in the rsync://HOST:PORT/PATH format.)
507
508 - When rsync recurses to build the file list, it no longer keeps open
509 one or more directory handles from the dir's parent dirs.
510
511 - When building under windows, the default for --daemon is now to
512 avoid detaching, requiring the new --detach option to force rsync
513 to detach.
514
515 - The --dry-run option can now be combined with either --write-batch or
516 --read-batch, allowing you to run a do-nothing test command to see
517 what would happen without --dry-run.
518
519 - The daemon's "read only" config item now sets an internal read_only
520 variable that makes extra sure that no write/delete calls on the
521 read-only side can succeed.
522
523 - The log-format % escapes can now have a numeric field width in
524 between the % and the escape letter (e.g. "%-40n %08p").
525
526 - Improved the option descriptions in the --help text.
527
528 SUPPORT FILES:
529
530 - Added atomic-rsync to the support dir: a perl script that will
531 transfer some files using rsync, and then move the updated files into
532 place all at once at the end of the transfer. Only works when
533 pulling, and uses --link-dest and a parallel hierarchy of files to
534 effect its update.
535
536 - Added mnt-excl to the support dir: a perl script that takes the
537 /proc/mounts file and translates it into a set of excludes that will
538 exclude all mount points (even mapped mounts to the same disk). The
539 excludes are made relative to the specified source dir and properly
540 anchored.
541
542 - Added savetransfer.c to the support dir: a C program that can make
543 a copy of all the data that flows over the wire. This lets you test
544 for data corruption (by saving the data on both the sending side and
545 the receiving side) and provides one way to debug a protocol error.
546
547 - Added rrsync to the support dir: this is an updated version of Joe
548 Smith's restricted rsync perl script. This helps to ensure that only
549 certain rsync commands can be run by an ssh invocation.
550
551 INTERNAL:
552
553 - Added better checking of the checksum-header values that come over
554 the socket.
555
556 - Merged a variety of file-deleting functions into a single function so
557 that it is easier to maintain.
558
559 - Improved the type of some variables (particularly blocksize vars) for
560 consistency and proper size.
561
562 - Got rid of the uint64 type (which we didn't need).
563
564 - Use a slightly more compatible set of core #include directives.
565
566 - Defined int32 in a way that ensures that the build dies if we can't
567 find a variable with at least 32 bits.
568
569 PROTOCOL DIFFERENCES FOR VERSION 29:
570
571 - A 16-bit flag-word is transmitted after every file-list index. This
572 indicates what is changing between the sender and the receiver. The
573 generator now transmits an index and a flag-word to indicate when
574 dirs and symlinks have changed (instead of producing a message),
575 which makes the outputting of the information more consistent and
576 less prone to screen corruption (because the local receiver/sender is
577 now outputting all the file-change info messages).
578
579 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
580 in the flag-word and the name of the file that was linked immediately
581 follows in vstring format (see below).
582
583 - If a file is being transferred with an alternate-basis file, the
584 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
585 byte follows, indicating what type of basis file was chosen. If that
586 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
587 is set in the flag-word and the name of the match in vstring format
588 follows the basis byte. A vstring is a variable length string that
589 has its size written prior to the string, and no terminating null.
590 If the string is from 1-127 bytes, the length is a single byte. If
591 it is from 128-32767 bytes, the length is written as ((len >> 8) |
592 0x80) followed by (len % 0x100).
593
594 - The sending of exclude names is done using filter-rule syntax. This
595 means that all names have a prefixed rule indicator, even excludes
596 (which used to be sent as a bare pattern, when possible). The -C
597 option will include the per-dir .cvsignore merge file in the list of
598 filter rules so it is positioned correctly (unlike in some older
599 transfer scenarios).
600
601 - Rsync sorts the filename list in a different way: it sorts the subdir
602 names after the non-subdir names for each dir's contents, and it
603 always puts a dir's contents immediately after the dir's name in the
604 list. (Previously an item named "foo.txt" would sort in between
605 directory "foo/" and "foo/bar".)
606
607 - When talking to a protocol 29 rsync daemon, a list-only request
608 is able to note this before the options are sent over the wire and
609 the new --list-only option is included in the options.
610
611 - When the --stats bytes are sent over the wire (or stored in a batch),
612 they now include two elapsed-time values: one for how long it took to
613 build the file-list, and one for how long it took to send it over the
614 wire (each expressed in thousandths of a second).
615
616 - When --delete-excluded is specified with some filter rules (AKA
617 excludes), a client sender will now initiate a send of the rules to
618 the receiver (older protocols used to omit the sending of excludes in
619 this situation since there were no receiver-specific rules that
620 survived --delete-excluded back then). Note that, as with all the
621 filter-list sending, only items that are significant to the other
622 side will actually be sent over the wire, so the filter-rule list
623 that is sent in this scenario is often empty.
624
625 - An index equal to the file-list count is sent as a keep-alive packet
626 from the generator to the sender, which then forwards it on to the
627 receiver. This normally invalid index is only a valid keep-alive
628 packet if the 16-bit flag-word that follows it contains a single bit
629 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
630
631 - A protocol-29 batch file includes a bit for the setting of the --dirs
632 option and for the setting of the --compress option. Also, the shell
633 script created by --write-batch will use the --filter option instead
634 of --exclude-from to capture any filter rules.
635
636 BUILD CHANGES:
637
638 - Handle an operating system that use mkdev() in place of makedev().
639
640 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
641
642\f
ca39ebf9
WD
643NEWS for rsync 2.6.3 (30 Sep 2004)
644Protocol: 28 (unchanged)
645Changes since 2.6.2:
646
647 SECURITY FIXES:
648
649 - A bug in the sanitize_path routine (which affects a non-chrooted
650 rsync daemon) could allow a user to craft a pathname that would get
651 transformed into an absolute path for certain options (but not for
652 file-transfer names). If you're running an rsync daemon with chroot
653 disabled, *please upgrade*, ESPECIALLY if the user privs you run
654 rsync under is anything above "nobody".
655
656 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
657
658 - Please note that the 2-line footer (output when verbose) now uses the
659 term "sent" instead of "wrote" and "received" instead of "read". If
660 you are not parsing the numeric values out of this footer, a script
661 would be better off using the empty line prior to the footer as the
662 indicator that the verbose output is over.
663
664 - The output from the --stats option was similarly affected to change
665 "written" to "sent" and "read" to "received".
666
667 - Rsync ensures that a filename that contains a newline gets mentioned
668 with each newline transformed into a question mark (which prevents a
669 filename from causing an empty line to be output).
670
671 - The "backed up ..." message that is output when at least 2 --verbose
672 options are specified is now the same both with and without the
673 --backup-dir option.
674
675 BUG FIXES:
676
677 - Fixed a crash bug that might appear when --delete was used and
678 multiple source directories were specified.
679
680 - Fixed a 32-bit truncation of the file length when generating the
681 checksums.
682
683 - The --backup code no longer attempts to create some directories
684 over and over again (generating warnings along the way).
685
686 - Fixed a bug in the reading of the secrets file (by the daemon) and
687 the password file (by the client): the files no longer need to be
688 terminated by a newline for their content to be read in.
689
690 - If a file has a read error on the sending side or the reconstructed
691 data doesn't match the expected checksum (perhaps due to the basis
692 file changing during the transfer), the receiver will no longer
693 retain the resulting file unless the --partial option was specified.
694 (Note: for the read-error detection to work, neither side can be
695 older than 2.6.3 -- older receivers will always retain the file, and
696 older senders don't tell the receiver that the file had a read
697 error.)
698
699 - If a file gets resent in a single transfer and the --backup option
700 is enabled, rsync no longer performs a duplicate backup (it used to
701 overwrite the original file in the backup area).
702
703 - Files specified in the daemon's "exclude" or "exclude from" config
704 items are now excluded from being uploaded (assuming that the module
705 allows uploading at all) in addition to the old download exclusion.
706
707 - Got rid of a potential hang in the receiver when near the end of a
708 phase.
709
710 - When using --backup without a --backup-dir, rsync no longer preserves
711 the modify time on directories. This avoids confusing NFS.
712
713 - When --copy-links (-L) is specified, we now output a separate error
714 for a symlink that has no referent instead of claiming that a file
715 "vanished".
716
717 - The --copy-links (-L) option no longer has the side-effect of telling
718 the receiving side to follow symlinks. See the --keep-dirlinks
719 option (mentioned below) for a way to specify that behavior.
720
721 - Error messages from the daemon server's option-parsing (such as
722 refused options) are now successfully transferred back to the client
723 (the server used to fail to send the message because the socket
724 wasn't in the right state for the message to get through).
725
726 - Most transfer errors that occur during a daemon transfer are now
727 returned to the user in addition to being logged (some messages are
728 intended to be daemon-only and are not affected by this).
729
730 - Fixed a bug in the daemon authentication code when using one of the
731 batch-processing options.
732
733 - We try to work around some buggy IPv6 implementations that fail to
734 implement IPV6_V6ONLY. This should fix the "address in use" error
735 that some daemons get when running on an OS with a buggy IPv6
736 implementation. Also, if the new code gets this error, we might
737 suggest that the user specify --ipv4 or --ipv6 (if we think it will
738 help).
739
740 - When the remote rsync dies, make a better effort to recover any error
741 messages it may have sent before dying (the local rsync used to just
742 die with a socket-write error).
743
744 - When using --delete and a --backup-dir that contains files that are
745 hard-linked to their destination equivalents, rsync now makes sure
746 that removed files really get removed (avoids a really weird rename()
747 behavior).
748
749 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
750 the int64 type is defined as an off_t and it actually has 64-bits.
751
752 - Added a configure check for open64() without mkstemp64() so that we
753 can avoid using mkstemp() when such a combination is encountered.
754 This bypasses a problem writing out large temp files on OSes such as
755 AIX and HP-UX.
756
757 - Fixed an age-old crash problem with --read-batch on a local copy
758 (rsync was improperly assuming --whole-file for the local copy).
759
760 - When --dry-run (-n) is used and the destination directory does not
761 exist, rsync now produces a correct report of files that would be
762 sent instead of dying with a chdir() error.
763
764 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
765 with an error instead of waiting for the connection to finish.
766
767 - Fixed an ssh interaction that could cause output to be lost when the
768 user chose to combine the output of rsync's stdout and stderr (e.g.
769 using the "2>&1").
770
771 ENHANCEMENTS:
772
773 - Added the --partial-dir=DIR option that lets you specify where to
774 (temporarily) put a partially transferred file (instead of over-
775 writing the destination file). E.g. --partial-dir=.rsync-partial
776 Also added support for the RSYNC_PARTIAL_DIR environment variable
777 that, when found, transforms a regular --partial option (such as
778 the convenient -P option) into one that also specifies a directory.
779
780 - Added --keep-dirlinks (-K), which allows you to symlink a directory
781 onto another partition on the receiving side and have rsync treat it
782 as matching a normal directory from the sender.
783
784 - Added the --inplace option that tells rsync to write each destination
785 file without using a temporary file. The matching of existing data
786 in the destination file can be severely limited by this, but there
787 are also cases where this is more efficient (such as appending data).
788 Use only when needed (see the man page for more details).
789
790 - Added the "write only" option for the daemon's config file.
791
792 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
793 and documented all these options in the man page.
794
795 - Improved the handling of the --bwlimit option so that it's less
796 bursty, more accurate, and works properly over a larger range of
797 values.
798
799 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
800 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
801
802 - Added the --checksum-seed=N option for advanced users.
803
804 - Batch writing/reading has a brand-new implementation that is simpler,
805 fixes a few weird problems with the old code (such as no longer
806 sprinkling the batch files into different dirs or even onto different
807 systems), and is much less intrusive into the code (making it easier
808 to maintain for the future). The new code generates just one data
809 file instead of three, which makes it possible to read the batch on
810 stdin via a remote shell. Also, the old requirement of forcing the
811 same fixed checksum-seed for all batch processing has been removed.
812
813 - If an rsync daemon has a module set with "list = no" (which hides its
814 presence in the list of available modules), a user that fails to
815 authenticate gets the same "unknown module" error that they would get
816 if the module were actually unknown (while still logging the real
817 error to the daemon's log file). This prevents fishing for module
818 names.
819
820 - The daemon's "refuse options" config item now allows you to match
821 option names using wildcards and/or the single-letter option names.
822
823 - Each transferred file now gets its permissions and modified-time
824 updated before the temp-file gets moved into place. Previously, the
825 finished file would have a very brief window where its permissions
826 disallowed all group and world access.
827
828 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
829 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
830
831 - The daemon's wildcard expanding code can now handle more than 1000
832 filenames (it's now limited by memory instead of having a hard-wired
833 limit).
834
835 INTERNAL:
836
837 - Some cleanup in the exclude code has saved some per-exclude memory
838 and made the code easier to maintain.
839
840 - Improved the argv-overflow checking for a remote command that has a
841 lot of args.
842
843 - Use rsyserr() in the various places that were still calling rprintf()
844 with strerror() as an arg.
845
846 - If an rsync daemon is listening on multiple sockets (to handle both
847 IPv4 and IPv6 to a single port), we now close all the unneeded file
848 handles after we accept a connection (we used to close just one of
849 them).
850
851 - Optimized the handling of larger block sizes (rsync used to slow to a
852 crawl if the block size got too large).
853
854 - Optimized away a loop in hash_search().
855
856 - Some improvements to the sanitize_path() and clean_fname() functions
857 makes them more efficient and produce better results (while still
858 being compatible with the file-name cleaning that gets done on both
859 sides when sending the file-list).
860
861 - Got rid of alloc_sanitize_path() after adding a destination-buffer
862 arg to sanitize_path() made it possible to put all the former's
863 functionality into the latter.
864
865 - The file-list that is output when at least 4 verbose options are
866 specified reports the uid value on the sender even when rsync is
867 not running as root (since we might be sending to a root receiver).
868
869 BUILD CHANGES:
870
871 - Added a "gen" target to rebuild most of the generated files,
872 including configure, config.h.in, the man pages, and proto.h.
873
874 - If "make proto" doesn't find some changes in the prototypes, the
875 proto.h file is left untouched (its time-stamp used to always be
876 updated).
877
878 - The variable $STRIP (that is optionally set by the install-strip
879 target's rule) was changed to $INSTALL_STRIP because some systems
880 have $STRIP already set in the environment.
881
882 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
883
884 - When cross-compiling, the gettimeofday() function is now assumed to
885 be a modern version that takes two-args (since we can't test it).
886
887 DEVELOPER RELATED:
888
889 - The scripts in the testsuite dir were cleaned up a bit and a few
890 new tests added.
891
892 - Some new diffs were added to the patches dir, and some accepted
893 ones were removed.
894
895\f
c7be6dec
WD
896NEWS for rsync 2.6.2 (30 Apr 2004)
897Protocol: 28 (unchanged)
898Changes since 2.6.1:
899
900 BUG FIXES:
901
902 - Fixed a major bug in the sorting of the filenames when --relative
903 is used for some sources (just sources such as "/" and "/*" were
904 affected). This fix ensures that we ask for the right file-list
905 item when requesting changes from the sender.
906
907 - Rsync now checks the return value of the close() function to
908 better report disk-full problems on an NFS file system.
909
910 - Restored the old daemon-server behavior of logging error messages
911 rather than returning them to the user. (A better long-term fix
912 will be sought in the future.)
913
914 - An obscure uninitialized-variable bug was fixed in the uid/gid
915 code. (This bug probably had no ill effects.)
916
917 BUILD CHANGES:
918
919 - Got rid of the configure check for sys/sysctl.h (it wasn't used
920 and was causing a problem on some systems). Also improved the
921 broken-largefile-locking test to try to avoid failure due to an
922 NFS build-dir.
923
924 - Fixed a compile problem on systems that don't define
925 AI_NUMERICHOST.
926
927 - Fixed a compile problem in the popt source for compilers that
928 don't support __attribute__.
929
930 DEVELOPER RELATED:
931
932 - Improved the testsuite's "merge" test to work on OSF1.
933
934 - Two new diffs were added to the patches dir.
935
936\f
937NEWS for rsync 2.6.1 (26 Apr 2004)
938Protocol: 28 (changed)
939Changes since 2.6.0:
940
941 SECURITY FIXES:
942
943 - Paths sent to an rsync daemon are more thoroughly sanitized when
944 chroot is not used. If you're running a non-read-only rsync
945 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
946 user privs you run rsync under is anything above "nobody".
947
948 ENHANCEMENTS:
949
950 - Lower memory use, more optimal transfer of data over the socket,
951 and lower CPU usage (see the INTERNAL section for details).
952
953 - The RSYNC_PROXY environment variable can now contain a
954 "USER:PASS@" prefix before the "HOST:PORT" information.
955 (Bardur Arantsson)
956
957 - The --progress output now mentions how far along in the transfer
958 we are, including both a count of files transferred and a
959 percentage of the total file-count that we've processed. It also
960 shows better current-rate-of-transfer and remaining-transfer-time
961 values.
962
963 - Documentation changes now attempt to describe some often mis-
964 understood features more clearly.
965
966 BUG FIXES:
967
968 - When -x (--one-file-system) is combined with -L (--copy-links) or
969 --copy-unsafe-links, no symlinked files are skipped, even if the
970 referent file is on a different filesystem.
971
972 - The --link-dest code now works properly for a non-root user when
973 (1) the UIDs of the source and destination differ and -o was
974 specified, or (2) when the group of the source can't be used on
975 the destination and -g was specified.
976
977 - Fixed a bug in the handling of -H (hard-links) that might cause
978 the expanded PATH/NAME value of the current item to get
979 overwritten (due to an expanded-name caching bug).
980
981 - We now reset the "new data has been sent" flag at the start of
982 each file we send. This makes sure that an interrupted transfer
983 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 984 than the current basis file when no new data has been transferred
c7be6dec
WD
985 over the wire for that file.
986
987 - Fixed a byte-order problem in --batch-mode on big-endian machines.
988 (Jay Fenlason)
989
990 - When using --cvs-exclude, the exclude items we get from a
991 per-directory's .cvsignore file once again only affect that one
992 directory (not all following directories too). The items are also
993 now properly word-split and parsed without any +/- prefix parsing.
994
995 - When specifying the USER@HOST: prefix for a file, the USER part
996 can now contain an '@', if needed (i.e. the last '@' is used to
997 find the HOST, not the first).
998
999 - Fixed some bugs in the handling of group IDs for non-root users:
1000 (1) It properly handles a group that the sender didn't have a name
1001 for (it would previously skip changing the group on any files in
1002 that group). (2) If --numeric-ids is used, rsync no longer
1003 attempts to set groups that the user doesn't have the permission
1004 to set.
1005
1006 - Fixed the "refuse options" setting in the rsyncd.conf file.
1007
1008 - Improved the -x (--one-file-system) flag's handling of any mount-
1009 point directories we encounter. It is both more optimal (in that
1010 it no longer does a useless scan of the contents of the mount-
1011 point dirs) and also fixes a bug where a remapped mount of the
1012 original filesystem could get discovered in a subdir we should be
1013 ignoring.
1014
1015 - Rsync no longer discards a double-slash at the start of a filename
1016 when trying to open the file. It also no longer constructs names
1017 that start with a double slash (unless the user supplied them).
1018
1019 - Path-specifying options to a daemon should now work the same with
1020 or without chroot turned on. Previously, such a option (such as
1021 --link-dest) would get its absolute path munged into a relative
1022 one if chroot was not on, making that setting fairly useless.
1023 Rsync now transforms the path into one that is based on the
1024 module's base dir when chroot is not enabled.
1025
1026 - Fixed a compatibility problem interacting with older rsync
1027 versions that might send us an empty --suffix value without
1028 telling us that --backup-dir was specified.
1029
1030 - The "hosts allow" option for a daemon-over-remote-shell process
1031 now has improved support for IPv6 addresses and a fix for systems
1032 that have a length field in their socket structs.
1033
1034 - Fixed the ability to request an empty backup --suffix when sending
1035 files to an rsync daemon.
1036
1037 INTERNAL:
1038
1039 - Most of the I/O is now buffered, which results in a pretty large
1040 speedup when running under MS Windows. (Craig Barratt)
1041
1042 - Optimizations to the name-handling/comparing code have made some
1043 significant reductions in user-CPU time for large file sets.
1044
1045 - Some cleanup of the variable types make the code more consistent.
1046
1047 - Reduced memory requirements of hard link preservation.
1048 (J.W. Schultz)
1049
1050 - Implemented a new algorithm for hard-link handling that speeds up
1051 the code significantly. (J.W. Schultz and Wayne Davison)
1052
1053 - The --hard-link option now uses the first existing file in the
1054 group of linked files as the basis for the transfer. This
1055 prevents the sub-optimal transfer of a file's data when a new
1056 hardlink is added on the sending side and it sorts alphabetically
1057 earlier in the list than the files that are already present on the
1058 receiving side.
1059
1060 - Dropped support for protocol versions less than 20 (2.3.0 released
1061 15 Mar 1999) and activated warnings for protocols less than 25
1062 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
1063 severally)
1064
1065 - More optimal data transmission for --hard-links (protocol 28).
1066
1067 - More optimal data transmission for --checksum (protocol 28).
1068
1069 - Less memory is used when --checksum is specified.
1070
1071 - Less memory is used in the file list (a per-file savings).
1072
1073 - The generator is now better about not modifying the file list
1074 during the transfer in order to avoid a copy-on-write memory
1075 bifurcation (on systems where fork() uses shared memory).
1076 Previously, rsync's shared memory would slowly become unshared,
1077 resulting in real memory usage nearly doubling on the receiving
1078 side by the end of the transfer. Now, as long as permissions
1079 are being preserved, the shared memory should remain that way
1080 for the entire transfer.
1081
1082 - Changed hardlink info and file_struct + strings to use allocation
1083 pools. This reduces memory use for large file-sets and permits
1084 freeing memory to the OS. (J.W. Schultz)
1085
1086 - The 2 pipes used between the receiver and generator processes
1087 (which are forked on the same machine) were reduced to 1 pipe and
1088 the protocol improved so that (1) it is now impossible to have the
1089 "redo" pipe fill up and hang rsync, and (2) trailing messages from
1090 the receiver don't get lost on their way through the generator
1091 over to the sender (which mainly affected hard-link messages and
1092 verbose --stats output).
1093
1094 - Improved the internal uid/gid code to be more portable and a
1095 little more optimized.
1096
1097 - The device numbers sent when using --devices are now sent as
1098 separate major/minor values with 32-bit accuracy (protocol 28).
1099 Previously, the copied devices were sent as a single 32-bit
1100 number. This will make inter-operation of 64-bit binaries more
1101 compatible with their 32-bit brethren (with both ends of the
1102 connection are using protocol 28). Note that optimizations in the
1103 binary protocol for sending the device numbers often results in
1104 fewer bytes being used than before, even though more precision is
1105 now available.
1106
1107 - Some cleanup of the exclude/include structures and its code made
1108 things clearer (internally), simpler, and more efficient.
1109
1110 - The reading & writing of the file-list in batch-mode is now
1111 handled by the same code that sends & receives the list over the
1112 wire. This makes it much easier to maintain. (Note that the
1113 batch code is still considered to be experimental.)
1114
1115 BUILD CHANGES:
1116
1117 - The configure script now accepts --with-rsyncd-conf=PATH to
1118 override the default value of the /etc/rsyncd.conf file.
1119
1120 - Fixed configure bug when running "./configure --disable-ipv6".
1121
1122 - Fixed compilation problem on Tru64 Unix (having to do with
1123 sockaddr.sa_len and sockaddr.sin_len).
1124
1125 DEVELOPER RELATED:
1126
1127 - Fixed "make test" bug when build dir is not the source dir.
1128
1129 - Added a couple extra diffs in the "patches" dir, removed the ones
1130 that got applied, and rebuilt the rest.
1131
1132\f
0f1aa0d3
WD
1133NEWS for rsync 2.6.0 (1 Jan 2004)
1134Protocol: 27 (changed)
1135Changes since 2.5.7:
1136
1137 ENHANCEMENTS:
1138
1139 * "ssh" is now the default remote shell for rsync. If you want to
1140 change this, configure like this: "./configure --with-rsh=rsh".
1141
1142 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
1143 Note that --from0 affects the line-ending character for all the
1144 files read by the --*-from options. (Wayne Davison)
1145
1146 * Length of csum2 is now per-file starting with protocol version
1147 27. (J.W. Schultz)
1148
1149 * Per-file dynamic block size is now sqrt(file length). The
1150 per-file checksum size is determined according to an algorithm
1151 provided by Donovan Baarda which reduces the probability of rsync
1152 algorithm corrupting data and falling back using the whole md4
1153 checksums. (J.W. Schultz, Donovan Baarda)
1154
1155 * The --stats option no longer includes the (debug) malloc summary
1156 unless the verbose option was specified at least twice.
1157
1158 * Added a new error/warning code for when files vanish from the
1159 sending side. Made vanished source files not interfere with the
1160 file-deletion pass when --delete-after was specified.
1161
1162 * Various trailing-info sections are now preceded by a newline.
1163
1164 BUG FIXES:
1165
1166 * Fixed several exclude/include matching bugs when using wild-cards.
1167 This has a several user-visible effects, all of which make the
1168 matching more consistent and intuitive. This should hopefully not
1169 cause anyone problems since it makes the matching work more like
1170 what people are expecting. (Wayne Davison)
1171
1172 - A pattern with a "**" no longer causes a "*" to match slashes.
1173 For example, with "/*/foo/**", "foo" must be 2 levels deep.
1174 [If your string has BOTH "*" and "**" wildcards, changing the
1175 "*" wildcards to "**" will provide the old behavior in all
1176 versions.]
1177
1178 - "**/foo" now matches at the base of the transfer (like /foo
1179 does). [Use "/**/foo" to get the old behavior in all versions.]
1180
1181 - A non-anchored wildcard term floats to match beyond the base of
1182 the transfer. E.g. "CVS/R*" matches at the end of the path,
1183 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
1184 to get the old behavior in all versions.]
1185
1186 - Including a "**" in the match term causes it to be matched
1187 against the entire path, not just the name portion, even if
1188 there aren't any interior slashes in the term. E.g. "foo**bar"
1189 would exclude "/path/foo-bar" (just like before) as well as
1190 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
1191 old behavior in all versions.]
1192
1193 * The exclude list specified in the daemon's config file is now
1194 properly applied to the pulled items no matter how deep the
1195 user's file-args are in the source tree. (Wayne Davison)
1196
1197 * For protocol version >= 27, mdfour_tail() is called when the
1198 block size (including checksum_seed) is a multiple of 64.
1199 Previously it was not called, giving the wrong MD4 checksum.
1200 (Craig Barratt)
1201
1202 * For protocol version >= 27, a 64 bit bit counter is used in
1203 mdfour.c as required by the RFC. Previously only a 32 bit bit
1204 counter was used, causing incorrect MD4 file checksums for
1205 file sizes >= 512MB - 4. (Craig Barratt)
1206
1207 * Fixed a crash bug when interacting with older rsync versions and
1208 multiple files of the same name are destined for the same dir.
1209 (Wayne Davison)
1210
1211 * Keep tmp names from overflowing MAXPATHLEN.
1212
1213 * Make --link-dest honor the absence of -p, -o, and -g.
1214
1215 * Made rsync treat a trailing slash in the destination in a more
1216 consistent manner.
1217
1218 * Fixed file I/O error detection. (John Van Essen)
1219
1220 * Fixed bogus "malformed address {hostname}" message in rsyncd log
1221 when checking IP address against hostnames from "hosts allow"
1222 and "hosts deny" parameters in config file.
1223
1224 * Print heap statistics when verbose >= 2 instead of when >= 1.
1225
1226 * Fixed a compression (-z) bug when syncing a mostly-matching file
1227 that contains already-compressed data. (Yasuoka Masahiko and
1228 Wayne Davison)
1229
1230 * Fixed a bug in the --backup code that could cause deleted files
1231 to not get backed up.
1232
1233 * When the backup code makes new directories, create them with mode
1234 0700 instead of 0755 (since the directory permissions in the
1235 backup tree are not yet copied from the main tree).
1236
1237 * Call setgroups() in a more portable manner.
1238
1239 * Improved file-related error messages to better indicate exactly
1240 what pathname failed. (Wayne Davison)
1241
1242 * Fixed some bugs in the handling of --delete and --exclude when
1243 using the --relative (-R) option. (Wayne Davison)
1244
1245 * Fixed bug that prevented regular files from replacing
1246 special files and caused a directory in --link-dest or
1247 --compare-dest to block the creation of a file with the
1248 same path. A directory still cannot be replaced by a
1249 regular file unless --delete specified. (J.W. Schultz)
1250
1251 * Detect and report when open or opendir succeed but read and
1252 readdir fail caused by network filesystem issues and truncated
1253 files. (David Norwood, Michael Brown, J.W. Schultz)
1254
1255 * Added a fix that should give ssh time to restore the tty settings
1256 if the user presses Ctrl-C at an ssh password prompt.
1257
1258 INTERNAL:
1259
1260 * Eliminated vestigial support for old versions that we stopped
1261 supporting. (J.W. Schultz)
1262
1263 * Simplified some of the option-parsing code. (Wayne Davison)
1264
1265 * Some cleanup made to the exclude code, as well as some new
1266 defines added to enhance readability. (Wayne Davison)
1267
1268 * Changed the protocol-version code so that it can interact at a
1269 lower protocol level than the maximum supported by both sides.
1270 Added an undocumented option, --protocol=N, to force the value
1271 we advertise to the other side (primarily for testing purposes).
1272 (Wayne Davison)
1273
1274\f
276877cf
WD
1275NEWS for rsync 2.5.7 (4 Dec 2003)
1276Protocol: 26 (unchanged)
1277Changes since 2.5.6:
1278
1279 SECURITY FIXES:
1280
1281 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
1282 Russell, Andrea Barisani)
1283
1284\f
1285NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
1286Protocol: 26 (unchanged)
1287Changes since 2.5.5:
1288
1289 ENHANCEMENTS:
1290
1291 * The --delete-after option now implies --delete. (Wayne Davison)
1292
1293 * The --suffix option can now be used with --backup-dir. (Michael
1294 Zimmerman)
1295
1296 * Combining "::" syntax with the -rsh/-e option now uses the
1297 specified remote-shell as a transport to talk to a (newly-spawned)
1298 server-daemon. This allows someone to use daemon features, such
1299 as modules, over a secure protocol, such as ssh. (JD Paul)
1300
1301 * The rsync:// syntax for daemon connections is now accepted in the
1302 destination field.
1303
1304 * If the file name given to --include-from or --exclude-from is "-",
1305 rsync will read from standard input. (J.W. Schultz)
1306
1307 * New option --link-dest which is like --compare-dest except that
1308 unchanged files are hard-linked in to the destination directory.
1309 (J.W. Schultz)
1310
1311 * Don't report an error if an excluded file disappears during an
1312 rsync run. (Eugene Chupriyanov and Bo Kersey)
1313
1314 * Added .svn to --cvs-exclude list to support subversion. (Jon
1315 Middleton)
1316
1317 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
1318 and "hosts deny" fields. (Hideaki Yoshifuji)
1319
1320 * Changed exclude file handling to permit DOS or MAC style line
1321 terminations. (J.W. Schultz)
1322
1323 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
1324 (Dave Dykstra)
1325
1326 BUG FIXES:
1327
1328 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
1329 L. Allen, Martin Pool)
1330
1331 * Generate each file's rolling-checksum data as we send it, not
1332 in a separate (memory-eating) pass before hand. This prevents
1333 timeout errors on really large files. (Stefan Nehlsen)
1334
1335 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
1336
1337 * Better handling of some client-server errors. (Martin Pool)
1338
1339 * Fixed a crash that would occur when sending a list of files that
1340 contains a duplicate name (if it sorts to the end of the file
1341 list) and using --delete. (Wayne Davison)
1342
1343 * Fixed the file-name duplicate-removal code when dealing with multiple
1344 dups in a row. (Wayne Davison)
1345
1346 * Fixed a bug that caused rsync to lose the exit status of its child
1347 processes and sometimes return an exit code of 0 instead of showing
1348 an error. (David R. Staples, Dave Dykstra)
1349
1350 * Fixed bug in --copy-unsafe-links that caused it to be completely
1351 broken. (Dave Dykstra)
1352
1353 * Prevent infinite recursion in cleanup code under certain circumstances.
1354 (Sviatoslav Sviridov and Marc Espie)
1355
1356 * Fixed a bug that prevented rsync from creating intervening directories
1357 when --relative-paths/-R is set. (Craig Barratt)
1358
1359 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
1360
1361 INTERNAL:
1362
1363 * Many code cleanups and improved internal documentation. (Martin
1364 Pool, Nelson Beebe)
1365
1366 * Portability fixes. (Dave Dykstra and Wayne Davison)
1367
1368 * More test cases. (Martin Pool)
1369
1370 * Some test-case fixes. (Brian Poole, Wayne Davison)
1371
1372 * Updated included popt to the latest vendor drop, version 1.6.4.
1373 (Jos Backus)
1374
1375 * Updated config.guess and config.sub to latest versions; this
1376 means rsync should build on more platforms. (Paul Green)
1377
1378\f
1379NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
1380Protocol: 26 (unchanged)
1381Changes since 2.5.4:
54c7298c
MP
1382
1383 ENHANCEMENTS:
1384
1385 * With --progress, when a transfer is complete show the time taken;
1386 otherwise show expected time to complete. (Cameron Simpson)
1387
1388 * Make "make install-strip" works properly, and "make install"
1389 accepts a DESTDIR variable for help in building binary packages.
1390 (Peter Breitenlohner, Greg Louis)
1391
1392 * If configured with --enable-maintainer-mode, then on receipt of
1393 a fatal signal rsync will try to open an xterm running gdb,
1394 similarly to Samba's "panic action" or GNOME's bug-buddy.
1395 (Martin Pool)
1396
1397
1398 BUG FIXES:
1399
1400 * Fix situation where failure to fork (e.g. because out of process
1401 slots) would cause rsync to kill all processes owned by the
1402 current user. Yes, really! (Paul Haas, Martin Pool)
1403
1404 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
1405
1406 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
1407 Pool.)
1408
1409 * Fix --whole-file problem that caused it to be the default even
1410 for remote connections. (Martin Pool, Frank Schulz)
1411
1412 * Work around bug in Mac OS X mkdir(2), which cannot handle
1413 trailing slashes.
1414 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
1415 (Martin Pool)
1416
1417 * Improved network error handling. (Greg A. Woods)
1418
1419\f
276877cf
WD
1420NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
1421Protocol: 26 (unchanged)
1422Changes since 2.5.3:
c9a66d41
MP
1423
1424 BUG FIXES:
1425
1426 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
1427 Tridgell) (CVE CAN-2002-0059)
276877cf 1428
c9a66d41
MP
1429 ENHANCEMENTS:
1430
1431 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
1432 (Note that rsync still uses a custom version of zlib; you can
1433 not just link against a system library. See zlib/README.rsync)
1434
1435 * Additional test cases for --compress. (Martin Pool)
1436
1437\f
276877cf
WD
1438NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
1439Protocol: 26 (unchanged)
1440Changes since 2.5.2:
d40fb723
MP
1441
1442 SECURITY FIXES:
1443
1444 * Make sure that supplementary groups are removed from a server
1445 process after changing uid and gid. (Ethan Benson) (Debian bug
1446 #132272, CVE CAN-2002-0080)
1447
1448 BUG FIXES:
1449
1450 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
1451 CAN-2002-0059)
1452
276877cf 1453 * Fixed problem that in many cases caused the error message
d40fb723
MP
1454 unexpected read size of 0 in map_ptr
1455 and resulted in the wrong data being copied.
1456
1457 * Fixed compilation errors on some systems caused by the use of
1458 "unsigned int64" in rsync.h.
1459
1460 * Fixed problem on systems such as Sunos4 that do not support realloc
1461 on a NULL pointer; error was "out of memory in flist_expand".
1462
1463 * Fix for rsync server processes hanging around after the client
1464 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
1465
1466 * Cope with BSD systems on which mkdir() will not accept a trailing
1467 slash.
1468
1469 ENHANCEMENTS:
1470
1471 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
1472 rsync still uses a custom version of zlib; you can not just link
1473 against a system library. See zlib/README.rsync)
276877cf 1474
d40fb723
MP
1475 * Command to initiate connections is only shown with -vv, rather
1476 than -v as in 2.5.2. Output from plain -v is more similar to
1477 what was historically used so as not to break scripts that try
1478 to parse the output.
1479
1480 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
1481
1482 * Made the --write-batch and --read-batch options actually work
1483 and added documentation in the man page (Jos Backus)
1484
1485 * If the daemon is unable to fork a child to accept a connection,
1486 print an error message. (Colin Walters)
1487
276877cf
WD
1488\f
1489NEWS for rsync 2.5.2 (26 Jan 2002)
1490Protocol: 26 (changed)
1491Changes since 2.5.1:
97efa5c3
MP
1492
1493 SECURITY FIXES:
1494
1495 * Signedness security patch from Sebastian Krahmer
1496 <krahmer@suse.de> -- in some cases we were not sufficiently
1497 careful about reading integers from the network.
1498
1499 BUG FIXES:
1500
1501 * Fix possible string mangling in log files.
1502
1503 * Fix for setting local address of outgoing sockets.
1504
1505 * Better handling of hardlinks and devices on platforms with
1506 64-bit dev_t or ino_t.
1507
1508 * Name resolution on machines supporting IPv6 is improved.
1509
1510 * Fix for device nodes. (dann frazier) (Debian #129135)
1511
1512 ENHANCEMENTS:
1513
1514 * With -v, rsync now shows the command used to initiate an ssh/rsh
1515 connection.
1516
1517 * --statistics now shows memory heap usage on platforms that
276877cf 1518 support mallinfo().
97efa5c3
MP
1519
1520 * "The Ted T'so school of program optimization": make progress
1521 visible and people will think it's faster. (With --progress,
1522 rsync will show you how many files it has seen as it builds the
1523 file_list, giving some indication that it has not hung.)
1524
1525 * Improvements to batch mode support. This is still experimental
1526 but testing would be welcome. (Jos Backus)
276877cf 1527
97efa5c3
MP
1528 * New --ignore-existing option, patch previously distributed with
1529 Vipul's Razor. (Debian #124286)
1530
276877cf
WD
1531\f
1532NEWS for rsync 2.5.1 (3 Jan 2002)
1533Protocol: 25 (unchanged)
1534Changes since 2.5.0:
1535
1536 BUG FIXES:
499957d9 1537
499957d9
MP
1538 * Fix for segfault in --daemon mode configuration parser. (Paul
1539 Mackerras)
1540
1541 * Correct string<->address parsing for both IPv4 and 6.
1542 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
1543 Hagino)
1544
1545 * Various fixes for IPv6 support. (Dave Dykstra)
1546
1547 * rsync.1 typo fix. (Matt Kraai)
1548
1549 * Test suite typo fixes. (Tom Schmidt)
1550
1551 * rsync.1 grammar and clarity improvements. (Edward
1552 Welbourne)
1553
1554 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
1555
1556 ENHANCEMENTS:
1557
1558 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
1559 multiple of bytes/s) and estimated time to completion. (Rik
1560 Faith)
1561
499957d9 1562 * --no-detach option, required to run as a W32 service and also
276877cf
WD
1563 useful when running on Unix under daemontools, AIX's SRC, or a
1564 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
1565
1566 * Clearer error messages for some conditions.
1567
c9a66d41 1568\f
276877cf
WD
1569NEWS for rsync 2.5.0 (30 Nov 2001)
1570Protocol: 25 (changed)
1571Changes since 2.4.6:
d313ae7d
MP
1572
1573 ANNOUNCEMENTS
1574
1575 * Martin Pool <mbp@samba.org> is now a co-maintainer.
1576
1577 NEW FEATURES
1578
1579 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
1580
1581 * Shell wildcards are allowed in "auth users" lines.
1582
1583 * Merged UNC rsync+ patch to support creation of standalone patch
1584 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
1585 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
1586
1587 * IPv6 support based on a patch from KAME.net, on systems
1588 including modern versions of Linux, Solaris, and HP-UX. Also
1589 includes IPv6 compatibility functions for old OSs by the
1590 Internet Software Consortium, Paul Vixie, the OpenSSH
1591 portability project, and OpenBSD.
1592
1593 ENHANCEMENTS
1594
1595 * Include/exclude cluestick: with -vv, print out whether files are
1596 included or excluded and why.
1597
1598 * Many error messages have more friendly explanations and more
1599 details.
1600
1601 * Manual page improvements plus scanty protocol documentation.
1602
1603 * When running as --daemon in the background and using a "log
1604 file" rsyncd.conf directive, close the log file every time it is
1605 open when going to sleep on the socket. This allows the log
1606 file to get cleaned out by another process.
1607
1608 * Change to using libpopt rather than getopt for processing
1609 options. This makes the code cleaner and the behaviour more
1610 consistent across platforms. popt is included and built if not
1611 installed on the platform.
1612
1613 * More details in --version, including note about whether 64-bit
1614 files, symlinks and hardlinks are supported.
1615
1616 * MD4 code may use less CPU cycles.
1617
1618 * Use mkstemp on systems where it is secure. If we use mktemp,
1619 explain that we do it in a secure way.
1620
1621 * --whole-file is the default when source and target are on the
1622 local machine.
1623
1624 BUG FIXES:
1625
1626 * Fix for various bugs causing rsync to hang.
1627
1628 * Attempt to fix Large File Summit support on AIX.
1629
1630 * Attempt to fix error handling lockup bug.
1631
1632 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 1633 to transfer fail to transfer.
d313ae7d
MP
1634
1635 * For log messages containing ridiculously long strings that might
1636 overflow a buffer rsync no longer aborts, but rather prints an
1637 ellipsis at the end of the string. (Patch from Ed Santiago.)
1638
1639 PLATFORMS:
1640
1641 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
1642
1643 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 1644 scripts. It is not required to simply build rsync.
d313ae7d
MP
1645
1646 * Platforms thought to work in this release:
1647
1648 Cray SV1 UNICOS 10.0.0.8 cc
1649 Debian Linux 2.2 UltraSparc gcc
1650 Debian Linux testing/unstable ARM gcc
1651 FreeBSD 3.3-RELEASE i386 cc
1652 FreeBSD 4.1.1-RELEASE i386 cc
1653 FreeBSD 4.3-STABLE i386 cc
1654 HP PA-RISC HP-UX 10.20 gcc
1655 HP PA-RISC HP-UX 11.11 cc
1656 IRIX 6.5 MIPS cc
1657 IRIX 6.5 MIPS gcc
1658 Mac OS X PPC (--disable-ipv6) cc
1659 NetBSD 1.5 i386 gcc
1660 NetBSD Current i386 cc
1661 OpenBSD 2.5 Sparc gcc
1662 OpenBSD 2.9 i386 cc
1663 OpenBSD Current i386 cc
1664 RedHat 6.2 i386 gcc
1665 RedHat 6.2 i386 insure++
1666 RedHat 7.0 i386 gcc
1667 RedHat 7.1 i386 (Kernel 2.4.10) gcc
1668 Slackware 8.0 i686 (Kernel 2.4.10)
1669 Solaris 8 UltraSparc cc
1670 Solaris 8 UltraSparc gcc
1671 Solaris 8 i386 gcc
1672 SuSE 7.1 i386 gcc2.95.2
1673 SuSE 7.1 ppc gcc2.95.2
1674 i386-pc-sco3.2v5.0.5 cc
1675 i386-pc-sco3.2v5.0.5 gcc
1676 powerpc-ibm-aix4.3.3.0 cc
1677 i686-unknown-sysv5UnixWare7.1.0 gcc
1678 i686-unknown-sysv5UnixWare7.1.0 cc
1679
1680 TESTING:
1681
1682 * The existing test.sh script by Phil Hands has been merged into a
1683 test framework that works from both "make check" and the Samba
1684 build farm.
3742bf3a
S
1685\f
1686Partial Protocol History
f7e48a5c 1687 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
2dfe1c37 1688 01 Jun 2005 2.6.5 29
f7e48a5c 1689 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 1690 30 Sep 2004 2.6.3 28
c7be6dec
WD
1691 30 Apr 2004 2.6.2 28
1692 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
1693 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
1694 04 Dec 2003 2.5.7 26
1695 26 Jan 2003 2.5.6 26
1696 02 Apr 2002 2.5.5 26
1697 13 Mar 2002 2.5.4 26
1698 11 Mar 2002 2.5.3 26
1699 26 Jan 2002 2.5.2 11 Jan 2002 26
1700 03 Jan 2002 2.5.1 25
1701 30 Nov 2001 2.5.0 23 Aug 2001 25
1702 06 Sep 2000 2.4.6 24
1703 19 Aug 2000 2.4.5 24
1704 29 Jul 2000 2.4.4 24
1705 09 Apr 2000 2.4.3 24
1706 30 Mar 2000 2.4.2 24
1707 30 Jan 2000 2.4.1 29 Jan 2000 24
1708 29 Jan 2000 2.4.0 28 Jan 2000 23
1709 25 Jan 2000 2.3.3 23 Jan 2000 22
1710 08 Nov 1999 2.3.2 26 Jun 1999 21
1711 06 Apr 1999 2.3.1 20
1712 15 Mar 1999 2.3.0 15 Mar 1999 20
1713 25 Nov 1998 2.2.1 19
1714 03 Nov 1998 2.2.0 19
1715 09 Sep 1998 2.1.1 19
1716 20 Jul 1998 2.1.0 19
1717 17 Jul 1998 2.0.19 19
1718 18 Jun 1998 2.0.17 19
1719 01 Jun 1998 2.0.16 19
1720 27 May 1998 2.0.13 27 May 1998 19
1721 26 May 1998 2.0.12 18
1722 22 May 1998 2.0.11 18
1723 18 May 1998 2.0.9 18 May 1998 18
1724 17 May 1998 2.0.8 17
1725 15 May 1998 2.0.1 17
1726 14 May 1998 2.0.0 17
1727 17 Apr 1998 1.7.4 17
1728 13 Apr 1998 1.7.3 17
1729 05 Apr 1998 1.7.2 17
1730 26 Mar 1998 1.7.1 17
1731 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
1732 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
1733
1734* DATE OF COMMIT is the date the protocol change was committed to CVS.