Fixed a bug where the NEWS file got an extra newline inserted when
[rsync/rsync.git] / OLDNEWS
CommitLineData
f90f7149
WD
1NEWS for rsync 2.6.6 (28 Jul 2005)
2Protocol: 29 (unchanged)
3Changes since 2.6.5:
4
5 SECURITY FIXES:
6
7 - The zlib code was upgraded to version 1.2.3 in order to make it more
8 secure. While the widely-publicized security problem in zlib 1.2.2 did
9 not affect rsync, another security problem surfaced that affects rsync's
10 zlib 1.1.4.
11
12 BUG FIXES:
13
14 - The setting of flist->high in clean_flist() was wrong for an empty list.
15 This could cause flist_find() to crash in certain rare circumstances
16 (e.g. if just the right directory setup was around when --fuzzy was
17 combined with --link-dest).
18
19 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
20 (1) Without -i it would output the name of each hard-linked file as
21 though it had been changed; it now outputs a "is hard linked" message for
22 the file. (2) With -i it would output all dots for the unchanged
23 attributes of a hard-link; it now changes those dots to spaces, as is
24 done for other totally unchanged items.
f90f7149
WD
25
26 - When backing up a changed symlink or device, get rid of any old backup
27 item so that we don't get an "already exists" error.
28
29 - A couple places that were comparing a local and a remote modification-
30 time were not honoring the --modify-window option.
31
32 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
33 set too often (if some non-significant mode bits differed).
34
35 - Fixed a really old, minor bug that could cause rsync to warn about being
36 unable to mkdir() a path that ends in "/." because it just created the
37 directory (required --relative, --no-implied-dirs, a source path that
38 ended in either a trailing slash or a trailing "/.", and a non-existing
39 destination dir to tickle the bug in a recent version).
40
41 ENHANCEMENTS:
42
43 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
44 per-module basis (which now matches the documentation).
45
46 - The support/rrsync script has been upgraded to verify the args of options
47 that take args (instead of rejecting any such options). The script was
48 also changed to try to be more secure and to fix a problem in the parsing
49 of a pull operation that has multiple sources.
50
51 - Improved the documentation that explains the difference between a
52 normal daemon transfer and a daemon-over remote-shell transfer.
53
54 - Some of the diffs supplied in the patches dir were fixed and/or
55 improved.
56
57 BUILD CHANGES:
58
59 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
60 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
61 find in the /etc/group file).
62
63 - Added a test to the test suite, itemized.test, that tests the output of
64 -i (log-format w/%i) and some double-verbose messages.
65
66\f
a1c75ed0
WD
67NEWS for rsync 2.6.5 (1 Jun 2005)
68Protocol: 29 (unchanged)
69Changes since 2.6.4:
70
71 OUTPUT CHANGES:
72
73 - Non-printable chars in filenames are now output using backslash-
74 escaped characters rather than '?'s. Any non-printable character is
75 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
76 is now output as "\\". Rsync also uses your locale setting, which
77 can make it treat fewer high-bit characters as non-printable.
78
79 - If rsync received an empty file-list when pulling files, it would
80 output a "nothing to do" message and exit with a 0 (success) exit
81 status, even if the remote rsync returned an error (it did not do
82 this under the same conditions when pushing files). This was changed
83 to make the pulling behavior the same as the pushing behavior: we
84 now do the normal end-of-run outputting (depending on options) and
85 exit with the appropriate exit status.
86
87 BUG FIXES:
88
89 - A crash bug was fixed when a daemon had its "path" set to "/", did
90 not have chroot enabled, and used some anchored excludes in the
91 rsyncd.conf file.
92
93 - Fixed a bug in the transfer of a single file when -H is specified
94 (rsync would either infinite loop or perhaps crash).
95
96 - Fixed a case where the generator might try (and fail) to tweak the
97 write-permissions of a read-only directory in list-only mode (this
98 only caused an annoying warning message).
99
100 - If --compare-dest or --link-dest uses a locally-copied file as the
101 basis for an updated version, log this better when --verbose or -i
102 is in effect.
103
104 - Fixed the accidental disabling of --backup during the --delete-after
105 processing.
106
107 - Restored the ability to use the --address option in client mode (in
108 addition to its use in daemon mode).
109
110 - Make sure that some temporary progress information from the delete
111 processing does not get left on the screen when it is followed by a
112 newline.
113
114 - When --existing skips a directory with extra verbosity, refer to it
115 as a "directory", not a "file".
116
117 - When transferring a single file to a different-named file, any
118 generator messages that are source-file related no longer refer to
119 the file by the destination filename.
120
121 - Fixed a bug where hard-linking a group of files might fail if the
122 generator hasn't created a needed destination directory yet.
123
124 - Fixed a bug where a hard-linked group of files that is newly-linked
125 to a file in a --link-dest dir doesn't link the files from the rest
126 of the cluster.
127
128 - When deleting files with the --one-file-system (-x) option set, rsync
129 no longer tries to remove files from inside a mount-point on the
130 receiving side. Also, we don't complain about being unable to remove
131 the mount-point dir.
132
133 - Fixed a compatibility problem when using --cvs-ignore (-C) and
134 sending files to an older rsync without using --delete.
135
136 - Make sure that a "- !" or "+ !" include/exclude pattern does not
137 trigger the list-clearing action that is reserved for "!".
138
139 - Avoid a timeout in the generator when the sender/receiver aren't
140 handling the generator's checksum output quickly enough.
141
142 - Fixed the omission of some directories in the delete processing when
143 --relative (-R) was combined with a source path that had a trailing
144 slash.
145
146 - Fixed a case where rsync would erroneously delete some files and then
147 re-transfer them when the options --relative (-R) and --recursive
148 (-r) were both enabled (along with --delete) and a source path had a
149 trailing slash.
150
151 - Make sure that --max-size doesn't affect a device or a symlink.
152
153 - Make sure that a system with a really small MAXPATHLEN does not cause
154 the buffers in readfd_unbuffered() to be too small to receive normal
155 messages. (This mainly affected Cygwin.)
156
157 - If a source pathname ends with a filename of "..", treat it as if
158 "../" had been specified (so that we don't copy files to the parent
159 dir of the destination).
160
161 - If --delete is combined with a file-listing rsync command (i.e. no
162 transfer is happening), avoid outputting a warning that we couldn't
163 delete anything.
164
165 - If --stats is specified with --delete-after, ensure that all the
166 "deleting" messages are output before the statistics.
167
168 - Improved one "if" in the deletion code that was only checking errno
169 for ENOTEMPTY when it should have also been checking for EEXIST (for
170 compatibility with OS variations).
171
172 ENHANCEMENTS:
173
174 - Added the --only-write-batch=FILE option that may be used (instead
175 of --write-batch=FILE) to create a batch file without doing any
176 actual updating of the destination. This allows you to divert all
177 the file-updating data away from a slow data link (as long as you
178 are pushing the data to the remote server when creating the batch).
179
180 - When the generator is taking a long time to fill up its output buffer
181 (e.g. if the transferred files are few, small, or missing), it now
182 periodically flushes the output buffer so that the sender/receiver
183 can get started on the files sooner rather than later.
184
185 - Improved the keep-alive code to handle a long silence between the
186 sender and the receiver that can occur when the sender is receiving
187 the checksum data for a large file.
188
189 - Improved the auth-errors that are logged by the daemon to include
190 some information on why the authorization failed: wrong user,
191 password mismatch, etc. (The client-visible message is unchanged!)
192
193 - Improved the client's handling of an "@ERROR" from a daemon so that
194 it does not complain about an unexpectedly closed socket (since we
195 really did expect the socket to close).
196
197 - If the daemon can't open the log-file specified in rsyncd.conf, fall
198 back to using syslog and log an appropriate warning. This is better
199 than what was typically a totally silent (and fatal) failure (since a
200 daemon is not usually run with the --no-detach option that was
201 necessary to see the error on stderr).
202
203 - The man pages now consistently refer to an rsync daemon as a "daemon"
204 instead of a "server" (to distinguish it from the server process in a
205 non-daemon transfer).
206
207 - Made a small change to the rrsync script (restricted rsync -- in the
208 support dir) to make a read-only server reject all --remove-* options
209 when sending files (to future-proof it against the possibility of
210 other similar options being added at some point).
211
212 INTERNAL:
213
214 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
215 better discern which filename characters need to be escaped in
216 messages (which should result in fewer escaped characters in some
217 locales).
218
219 - Improved the naming of the log-file open/reopen/close functions.
220
221 - Removed some protocol-compatibility code that was only needed to help
222 someone running a pre-release of 2.6.4.
223
224 BUILD CHANGES:
225
226 - Added configure option "--disable-locale" to disable any use of
227 setlocale() in the binary.
228
229 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
230 rsync from being built without symlink or hard-link support.
231
232 - Only #define HAVE_REMSH if it is going to be set to 1.
233
234 - Configure now disables the use of mkstemp() under HP-UX (since they
235 refuse to fix its broken handling of large files).
236
237 - Configure now explicitly checks for the lseek64() function so that
238 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
239 presence based on the presence of the off64_t type.
240
241 - Configure no longer mentions the change in the default remote-shell
242 (from rsh to ssh) that occurred for the 2.6.0 release.
243
244 - Some minor enhancements to the test scripts.
245
246 - Added a few new *.diff files to the patches dir, including a patch
247 that enables the optional copying of extended attributes.
248
249\f
1ad6a7f6
WD
250NEWS for rsync 2.6.4 (30 March 2005)
251Protocol: 29 (changed)
252Changes since 2.6.3:
253
254 OUTPUT CHANGES:
255
256 - When rsync deletes a directory and outputs a verbose message about
257 it, it now appends a trailing slash to the name instead of (only
258 sometimes) outputting a preceding "directory " string.
259
260 - The --stats output will contain file-list time-statistics if both
261 sides are 2.6.4, or if the local side is 2.6.4 and the files are
262 being pushed (since the stats come from the sending side).
263 (Requires protocol 29 for a pull.)
264
265 - The "%o" (operation) log-format escape now has a third value (besides
266 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
267 This changes the way deletions are logged in the daemon's log file.
268
269 - When the --log-format option is combined with --verbose, rsync now
270 avoids outputting the name of the file twice in most circumstances.
271 As long as the --log-format item does not refer to any post-transfer
272 items (such as %b or %c), the --log-format message is output prior to
273 the transfer, so --verbose is now the equivalent of a --log-format of
274 '%n%L' (which outputs the name and any link info). If the log output
275 must occur after the transfer to be complete, the only time the name
276 is also output prior to the transfer is when --progress was specified
277 (so that the name will precede the progress stats, and the full
278 --log-format output will come after).
97e3c50c 279
7c2a83c6
WD
280 - Non-printable characters in filenames are replaced with a '?' to
281 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
282
283 BUG FIXES:
284
285 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
286 was only treating it as a special token in an rsync include/exclude
287 file).
288
289 - The combination of --verbose and --dry-run now mentions the full list
290 of changes that would be output without --dry-run.
291
292 - Avoid a mkdir warning when removing a directory in the destination
293 that already exists in the --backup-dir.
294
295 - An OS that has a binary mode for its files (such as cygwin) needed
296 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 297 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
298
299 - Fixed a potential hang when verbosity is high, the client side is
300 the sender, and the file-list is large.
301
302 - Fixed a potential protocol-corrupting bug where the generator could
303 merge a message from the receiver into the middle of a multiplexed
304 packet of data if only part of that data had been written out to the
305 socket when the message from the generator arrived.
306
307 - We now check if the OS doesn't support using mknod() for creating
308 FIFOs and sockets, and compile-in some compatibility code using
309 mkfifo() and socket() when necessary.
310
311 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
312 if the --max-delete limit is exceeded during a run, we now output a
313 warning about this at the end of the run and exit with a new error
314 code (25).
315
316 - One place in the code wasn't checking if fork() failed.
317
318 - The "ignore nonreadable" daemon parameter used to erroneously affect
319 readable symlinks that pointed to a non-existent file.
320
321 - If the OS does not have lchown() and a chown() of a symlink will
322 affect the referent of a symlink (as it should), we no longer try
323 to set the user and group of a symlink.
324
325 - The generator now properly runs the hard-link loop and the dir-time
326 rewriting loop after we're sure that the redo phase is complete.
327
328 - When --backup was specified with --partial-dir=DIR, where DIR is a
329 relative path, the backup code was erroneously trying to backup a
330 file that was put into the partial-dir.
331
332 - If a file gets resent in a single transfer and the --backup option is
333 enabled along with --inplace, rsync no longer performs a duplicate
334 backup (it used to overwrite the first backup with the failed file).
335
336 - One call to flush_write_file() was not being checked for an error.
337
338 - The --no-relative option was not being sent from the client to a
339 server sender.
340
341 - If an rsync daemon specified "dont compress = ..." for a file and the
342 client tried to specify --compress, the libz code was not handling a
343 compression level of 0 properly. This could cause a transfer failure
344 if the block-size for a file was large enough (e.g. rsync might have
345 exited with an error for large files).
346
347 - Fixed a bug that would sometimes surface when using --compress and
348 sending a file with a block-size larger than 64K (either manually
349 specified, or computed due to the file being really large). Prior
350 versions of rsync would sometimes fail to decompress the data
351 properly, and thus the transferred file would fail its verification.
352
353 - If a daemon can't open the specified log file (i.e. syslog is not
354 being used), die without crashing. We also output an error about
355 the failure on stderr (which will only be seen if --no-detach was
356 specified) and exit with a new error code (6).
357
358 - A local transfer no longer duplicates all its include/exclude options
359 (since the forked process already has a copy of the exclude list,
360 there's no need to send them a set of duplicates).
361
7eb2ecda
WD
362 - The output of the items that are being updated by the generator (dirs,
363 symlinks, devices) is now intermingled in the proper order with the
364 output from the items that the receiver is updating (regular files)
365 when pulling. This misordering was particularly bad when --progress
366 was specified. (Requires protocol 29.)
1ad6a7f6
WD
367
368 - When --timeout is specified, lulls that occur in the transfer while
369 the generator is doing work that does not generate socket traffic
370 (looking for changed files, deleting files, doing directory-time
371 touch-ups, etc.) will cause a new keep-alive packet to be sent that
372 should keep the transfer going as long as the generator continues to
373 make progress. (Requires protocol 29.)
374
375 - The stat size of a device is not added to the total file size of the
376 items in the transfer (the size might be undefined on some OSes).
377
378 - Fixed a problem with refused-option messages sometimes not making it
379 back to the client side when a remote --files-from was in effect and
380 the daemon was the receiver.
381
0f9941dc 382 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
383 (the preserved) attributes from the version in the compare-dest DIR.
384
385 - When rsync is copying files into a write-protected directory, fixed
386 the change-report output for the directory so that we don't report
387 an identical directory as changed.
388
389 ENHANCEMENTS:
390
391 - Rsync now supports popt's option aliases, which means that you can
392 use /etc/popt and/or ~/.popt to create your own option aliases.
393
394 - Added the --delete-during (--del) option which will delete files
395 from the receiving side incrementally as each directory in the
396 transfer is being processed. This makes it more efficient than the
397 default, before-the-transfer behavior, which is now also available as
398 --delete-before (and is still the default --delete-WHEN option that
399 will be chosen if --delete or --delete-excluded is specified without
400 a --delete-WHEN choice). All the --del* options infer --delete, so
401 an rsync daemon that refuses "delete" will still refuse to allow any
402 file-deleting options (including the new --remove-sent-files option).
403
404 - All the --delete-WHEN options are now more memory efficient:
405 Previously an duplicate set of file-list objects was created on the
406 receiving side for the entire destination hierarchy. The new
407 algorithm only creates one directory of objects at a time (for files
408 inside the transfer).
409
410 - Added the --copy-dest option, which works like --link-dest except
411 that it locally copies identical files instead of hard-linking them.
412
413 - Added support for specifying multiple --compare-dest, --copy-dest, or
414 --link-dest options, but only of a single type. (Promoted from the
415 patches dir and enhanced.) (Requires protocol 29.)
416
417 - Added the --max-size option. (Promoted from the patches dir.)
418
419 - The daemon-mode options are now separated from the normal rsync
420 options so that they can't be mixed together. This makes it
421 impossible to start a daemon that has improper default option values
422 (which could cause problems when a client connects, such as hanging
423 or crashing).
424
425 - The --bwlimit option may now be used in combination with --daemon
426 to specify both a default value for the daemon side and a value
427 that cannot be exceeded by a user-specified --bwlimit option.
428
429 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
430 the patches dir.) Also added "address". The command-line options
431 take precedence over a config-file option, as expected.
432
433 - In _exit_cleanup(): when we are exiting with a partially-received
434 file, we now flush any data in the write-cache before closing the
435 partial file.
436
437 - The --inplace support was enhanced to work with --compare-dest,
438 --link-dest, and (the new) --copy-dest options. (Requires protocol
439 29.)
440
441 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
442 without recursion. Any directories that are encountered are created
443 on the destination. Specifying a directory with a trailing slash
444 copies its immediate contents to the destination.
445
446 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
447
448 - Added the --list-only option, which is mainly a way for the client to
449 put the server into listing mode without needing to resort to any
450 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
451 for a non-recursive listing). This option is used automatically
452 (behind the scenes) when a modern rsync speaks to a modern daemon,
453 but may also be specified manually if you want to force the use of
454 the --list-only option over a remote-shell connection.
455
456 - Added the --omit-dir-times (-O) option, which will avoid updating
457 the modified time for directories when --times was specified. This
458 option will avoid an extra pass through the file-list at the end of
459 the transfer (to tweak all the directory times), which may provide
460 an appreciable speedup for a really large transfer. (Promoted from
461 the patches dir.)
462
463 - Added the --filter (-f) option and its helper option, -F. Filter
464 rules are an extension to the existing include/exclude handling
465 that also supports nested filter files as well as per-directory
466 filter files (like .cvsignore, but with full filter-rule parsing).
467 This new option was chosen in order to ensure that all existing
468 include/exclude processing remained 100% compatible with older
469 versions. Protocol 29 is needed for full filter-rule support, but
470 backward-compatible rules work with earlier protocol versions.
471 (Promoted from the patches dir and enhanced.)
472
473 - Added the --delay-updates option that puts all updated files into
474 a temporary directory (by default ".~tmp~", but settable via the
475 --partial-dir=DIR option) until the end of the transfer. This
476 makes the updates a little more atomic for a large transfer.
477
478 - If rsync is put into the background, any output from --progress is
479 reduced.
480
481 - Documented the "max verbosity" setting for rsyncd.conf. (This
482 setting was added a couple releases ago, but left undocumented.)
483
484 - The sender and the generator now double-check the file-list index
485 they are given, and refuse to try to do a file transfer on a
486 non-file index (since that would indicate that something had gone
487 very wrong).
488
489 - Added the --itemize-changes (-i) option, which is a way to output a
490 more detailed list of what files changed and in what way. The effect
491 is the same as specifying a --log-format of "%i %n%L" (see both the
492 rsync and rsyncd.conf manpages). Works with --dry-run too.
493
494 - Added the --fuzzy (-y) option, which attempts to find a basis file
495 for a file that is being created from scratch. The current algorithm
496 only looks in the destination directory for the created file, but it
497 does attempt to find a match based on size/mod-time (in case the file
498 was renamed with no other changes) as well as based on a fuzzy
499 name-matching algorithm. This option requires protocol 29 because it
500 needs the new file-sorting order. (Promoted from patches dir and
501 enhanced.) (Requires protocol 29.)
502
503 - Added the --remove-sent-files option, which lets you move files
504 between systems.
505
506 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
507 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
508 literals in the rsync://HOST:PORT/PATH format.)
509
510 - When rsync recurses to build the file list, it no longer keeps open
511 one or more directory handles from the dir's parent dirs.
512
513 - When building under windows, the default for --daemon is now to
514 avoid detaching, requiring the new --detach option to force rsync
515 to detach.
516
517 - The --dry-run option can now be combined with either --write-batch or
518 --read-batch, allowing you to run a do-nothing test command to see
519 what would happen without --dry-run.
520
521 - The daemon's "read only" config item now sets an internal read_only
522 variable that makes extra sure that no write/delete calls on the
523 read-only side can succeed.
524
525 - The log-format % escapes can now have a numeric field width in
526 between the % and the escape letter (e.g. "%-40n %08p").
527
528 - Improved the option descriptions in the --help text.
529
530 SUPPORT FILES:
531
532 - Added atomic-rsync to the support dir: a perl script that will
533 transfer some files using rsync, and then move the updated files into
534 place all at once at the end of the transfer. Only works when
535 pulling, and uses --link-dest and a parallel hierarchy of files to
536 effect its update.
537
538 - Added mnt-excl to the support dir: a perl script that takes the
539 /proc/mounts file and translates it into a set of excludes that will
540 exclude all mount points (even mapped mounts to the same disk). The
541 excludes are made relative to the specified source dir and properly
542 anchored.
543
544 - Added savetransfer.c to the support dir: a C program that can make
545 a copy of all the data that flows over the wire. This lets you test
546 for data corruption (by saving the data on both the sending side and
547 the receiving side) and provides one way to debug a protocol error.
548
549 - Added rrsync to the support dir: this is an updated version of Joe
550 Smith's restricted rsync perl script. This helps to ensure that only
551 certain rsync commands can be run by an ssh invocation.
552
553 INTERNAL:
554
555 - Added better checking of the checksum-header values that come over
556 the socket.
557
558 - Merged a variety of file-deleting functions into a single function so
559 that it is easier to maintain.
560
561 - Improved the type of some variables (particularly blocksize vars) for
562 consistency and proper size.
563
564 - Got rid of the uint64 type (which we didn't need).
565
566 - Use a slightly more compatible set of core #include directives.
567
568 - Defined int32 in a way that ensures that the build dies if we can't
569 find a variable with at least 32 bits.
570
571 PROTOCOL DIFFERENCES FOR VERSION 29:
572
573 - A 16-bit flag-word is transmitted after every file-list index. This
574 indicates what is changing between the sender and the receiver. The
575 generator now transmits an index and a flag-word to indicate when
576 dirs and symlinks have changed (instead of producing a message),
577 which makes the outputting of the information more consistent and
578 less prone to screen corruption (because the local receiver/sender is
579 now outputting all the file-change info messages).
580
581 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
582 in the flag-word and the name of the file that was linked immediately
583 follows in vstring format (see below).
584
585 - If a file is being transferred with an alternate-basis file, the
586 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
587 byte follows, indicating what type of basis file was chosen. If that
588 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
589 is set in the flag-word and the name of the match in vstring format
590 follows the basis byte. A vstring is a variable length string that
591 has its size written prior to the string, and no terminating null.
592 If the string is from 1-127 bytes, the length is a single byte. If
593 it is from 128-32767 bytes, the length is written as ((len >> 8) |
594 0x80) followed by (len % 0x100).
595
596 - The sending of exclude names is done using filter-rule syntax. This
597 means that all names have a prefixed rule indicator, even excludes
598 (which used to be sent as a bare pattern, when possible). The -C
599 option will include the per-dir .cvsignore merge file in the list of
600 filter rules so it is positioned correctly (unlike in some older
601 transfer scenarios).
602
603 - Rsync sorts the filename list in a different way: it sorts the subdir
604 names after the non-subdir names for each dir's contents, and it
605 always puts a dir's contents immediately after the dir's name in the
606 list. (Previously an item named "foo.txt" would sort in between
607 directory "foo/" and "foo/bar".)
608
609 - When talking to a protocol 29 rsync daemon, a list-only request
610 is able to note this before the options are sent over the wire and
611 the new --list-only option is included in the options.
612
613 - When the --stats bytes are sent over the wire (or stored in a batch),
614 they now include two elapsed-time values: one for how long it took to
615 build the file-list, and one for how long it took to send it over the
616 wire (each expressed in thousandths of a second).
617
618 - When --delete-excluded is specified with some filter rules (AKA
619 excludes), a client sender will now initiate a send of the rules to
620 the receiver (older protocols used to omit the sending of excludes in
621 this situation since there were no receiver-specific rules that
622 survived --delete-excluded back then). Note that, as with all the
623 filter-list sending, only items that are significant to the other
624 side will actually be sent over the wire, so the filter-rule list
625 that is sent in this scenario is often empty.
626
627 - An index equal to the file-list count is sent as a keep-alive packet
628 from the generator to the sender, which then forwards it on to the
629 receiver. This normally invalid index is only a valid keep-alive
630 packet if the 16-bit flag-word that follows it contains a single bit
631 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
632
633 - A protocol-29 batch file includes a bit for the setting of the --dirs
634 option and for the setting of the --compress option. Also, the shell
635 script created by --write-batch will use the --filter option instead
636 of --exclude-from to capture any filter rules.
637
638 BUILD CHANGES:
639
640 - Handle an operating system that use mkdev() in place of makedev().
641
642 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
643
644\f
ca39ebf9
WD
645NEWS for rsync 2.6.3 (30 Sep 2004)
646Protocol: 28 (unchanged)
647Changes since 2.6.2:
648
649 SECURITY FIXES:
650
651 - A bug in the sanitize_path routine (which affects a non-chrooted
652 rsync daemon) could allow a user to craft a pathname that would get
653 transformed into an absolute path for certain options (but not for
654 file-transfer names). If you're running an rsync daemon with chroot
655 disabled, *please upgrade*, ESPECIALLY if the user privs you run
656 rsync under is anything above "nobody".
657
658 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
659
660 - Please note that the 2-line footer (output when verbose) now uses the
661 term "sent" instead of "wrote" and "received" instead of "read". If
662 you are not parsing the numeric values out of this footer, a script
663 would be better off using the empty line prior to the footer as the
664 indicator that the verbose output is over.
665
666 - The output from the --stats option was similarly affected to change
667 "written" to "sent" and "read" to "received".
668
669 - Rsync ensures that a filename that contains a newline gets mentioned
670 with each newline transformed into a question mark (which prevents a
671 filename from causing an empty line to be output).
672
673 - The "backed up ..." message that is output when at least 2 --verbose
674 options are specified is now the same both with and without the
675 --backup-dir option.
676
677 BUG FIXES:
678
679 - Fixed a crash bug that might appear when --delete was used and
680 multiple source directories were specified.
681
682 - Fixed a 32-bit truncation of the file length when generating the
683 checksums.
684
685 - The --backup code no longer attempts to create some directories
686 over and over again (generating warnings along the way).
687
688 - Fixed a bug in the reading of the secrets file (by the daemon) and
689 the password file (by the client): the files no longer need to be
690 terminated by a newline for their content to be read in.
691
692 - If a file has a read error on the sending side or the reconstructed
693 data doesn't match the expected checksum (perhaps due to the basis
694 file changing during the transfer), the receiver will no longer
695 retain the resulting file unless the --partial option was specified.
696 (Note: for the read-error detection to work, neither side can be
697 older than 2.6.3 -- older receivers will always retain the file, and
698 older senders don't tell the receiver that the file had a read
699 error.)
700
701 - If a file gets resent in a single transfer and the --backup option
702 is enabled, rsync no longer performs a duplicate backup (it used to
703 overwrite the original file in the backup area).
704
705 - Files specified in the daemon's "exclude" or "exclude from" config
706 items are now excluded from being uploaded (assuming that the module
707 allows uploading at all) in addition to the old download exclusion.
708
709 - Got rid of a potential hang in the receiver when near the end of a
710 phase.
711
712 - When using --backup without a --backup-dir, rsync no longer preserves
713 the modify time on directories. This avoids confusing NFS.
714
715 - When --copy-links (-L) is specified, we now output a separate error
716 for a symlink that has no referent instead of claiming that a file
717 "vanished".
718
719 - The --copy-links (-L) option no longer has the side-effect of telling
720 the receiving side to follow symlinks. See the --keep-dirlinks
721 option (mentioned below) for a way to specify that behavior.
722
723 - Error messages from the daemon server's option-parsing (such as
724 refused options) are now successfully transferred back to the client
725 (the server used to fail to send the message because the socket
726 wasn't in the right state for the message to get through).
727
728 - Most transfer errors that occur during a daemon transfer are now
729 returned to the user in addition to being logged (some messages are
730 intended to be daemon-only and are not affected by this).
731
732 - Fixed a bug in the daemon authentication code when using one of the
733 batch-processing options.
734
735 - We try to work around some buggy IPv6 implementations that fail to
736 implement IPV6_V6ONLY. This should fix the "address in use" error
737 that some daemons get when running on an OS with a buggy IPv6
738 implementation. Also, if the new code gets this error, we might
739 suggest that the user specify --ipv4 or --ipv6 (if we think it will
740 help).
741
742 - When the remote rsync dies, make a better effort to recover any error
743 messages it may have sent before dying (the local rsync used to just
744 die with a socket-write error).
745
746 - When using --delete and a --backup-dir that contains files that are
747 hard-linked to their destination equivalents, rsync now makes sure
748 that removed files really get removed (avoids a really weird rename()
749 behavior).
750
751 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
752 the int64 type is defined as an off_t and it actually has 64-bits.
753
754 - Added a configure check for open64() without mkstemp64() so that we
755 can avoid using mkstemp() when such a combination is encountered.
756 This bypasses a problem writing out large temp files on OSes such as
757 AIX and HP-UX.
758
759 - Fixed an age-old crash problem with --read-batch on a local copy
760 (rsync was improperly assuming --whole-file for the local copy).
761
762 - When --dry-run (-n) is used and the destination directory does not
763 exist, rsync now produces a correct report of files that would be
764 sent instead of dying with a chdir() error.
765
766 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
767 with an error instead of waiting for the connection to finish.
768
769 - Fixed an ssh interaction that could cause output to be lost when the
770 user chose to combine the output of rsync's stdout and stderr (e.g.
771 using the "2>&1").
772
773 ENHANCEMENTS:
774
775 - Added the --partial-dir=DIR option that lets you specify where to
776 (temporarily) put a partially transferred file (instead of over-
777 writing the destination file). E.g. --partial-dir=.rsync-partial
778 Also added support for the RSYNC_PARTIAL_DIR environment variable
779 that, when found, transforms a regular --partial option (such as
780 the convenient -P option) into one that also specifies a directory.
781
782 - Added --keep-dirlinks (-K), which allows you to symlink a directory
783 onto another partition on the receiving side and have rsync treat it
784 as matching a normal directory from the sender.
785
786 - Added the --inplace option that tells rsync to write each destination
787 file without using a temporary file. The matching of existing data
788 in the destination file can be severely limited by this, but there
789 are also cases where this is more efficient (such as appending data).
790 Use only when needed (see the man page for more details).
791
792 - Added the "write only" option for the daemon's config file.
793
794 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
795 and documented all these options in the man page.
796
797 - Improved the handling of the --bwlimit option so that it's less
798 bursty, more accurate, and works properly over a larger range of
799 values.
800
801 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
802 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
803
804 - Added the --checksum-seed=N option for advanced users.
805
806 - Batch writing/reading has a brand-new implementation that is simpler,
807 fixes a few weird problems with the old code (such as no longer
808 sprinkling the batch files into different dirs or even onto different
809 systems), and is much less intrusive into the code (making it easier
810 to maintain for the future). The new code generates just one data
811 file instead of three, which makes it possible to read the batch on
812 stdin via a remote shell. Also, the old requirement of forcing the
813 same fixed checksum-seed for all batch processing has been removed.
814
815 - If an rsync daemon has a module set with "list = no" (which hides its
816 presence in the list of available modules), a user that fails to
817 authenticate gets the same "unknown module" error that they would get
818 if the module were actually unknown (while still logging the real
819 error to the daemon's log file). This prevents fishing for module
820 names.
821
822 - The daemon's "refuse options" config item now allows you to match
823 option names using wildcards and/or the single-letter option names.
824
825 - Each transferred file now gets its permissions and modified-time
826 updated before the temp-file gets moved into place. Previously, the
827 finished file would have a very brief window where its permissions
828 disallowed all group and world access.
829
830 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
831 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
832
833 - The daemon's wildcard expanding code can now handle more than 1000
834 filenames (it's now limited by memory instead of having a hard-wired
835 limit).
836
837 INTERNAL:
838
839 - Some cleanup in the exclude code has saved some per-exclude memory
840 and made the code easier to maintain.
841
842 - Improved the argv-overflow checking for a remote command that has a
843 lot of args.
844
845 - Use rsyserr() in the various places that were still calling rprintf()
846 with strerror() as an arg.
847
848 - If an rsync daemon is listening on multiple sockets (to handle both
849 IPv4 and IPv6 to a single port), we now close all the unneeded file
850 handles after we accept a connection (we used to close just one of
851 them).
852
853 - Optimized the handling of larger block sizes (rsync used to slow to a
854 crawl if the block size got too large).
855
856 - Optimized away a loop in hash_search().
857
858 - Some improvements to the sanitize_path() and clean_fname() functions
859 makes them more efficient and produce better results (while still
860 being compatible with the file-name cleaning that gets done on both
861 sides when sending the file-list).
862
863 - Got rid of alloc_sanitize_path() after adding a destination-buffer
864 arg to sanitize_path() made it possible to put all the former's
865 functionality into the latter.
866
867 - The file-list that is output when at least 4 verbose options are
868 specified reports the uid value on the sender even when rsync is
869 not running as root (since we might be sending to a root receiver).
870
871 BUILD CHANGES:
872
873 - Added a "gen" target to rebuild most of the generated files,
874 including configure, config.h.in, the man pages, and proto.h.
875
876 - If "make proto" doesn't find some changes in the prototypes, the
877 proto.h file is left untouched (its time-stamp used to always be
878 updated).
879
880 - The variable $STRIP (that is optionally set by the install-strip
881 target's rule) was changed to $INSTALL_STRIP because some systems
882 have $STRIP already set in the environment.
883
884 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
885
886 - When cross-compiling, the gettimeofday() function is now assumed to
887 be a modern version that takes two-args (since we can't test it).
888
889 DEVELOPER RELATED:
890
891 - The scripts in the testsuite dir were cleaned up a bit and a few
892 new tests added.
893
894 - Some new diffs were added to the patches dir, and some accepted
895 ones were removed.
896
897\f
c7be6dec
WD
898NEWS for rsync 2.6.2 (30 Apr 2004)
899Protocol: 28 (unchanged)
900Changes since 2.6.1:
901
902 BUG FIXES:
903
904 - Fixed a major bug in the sorting of the filenames when --relative
905 is used for some sources (just sources such as "/" and "/*" were
906 affected). This fix ensures that we ask for the right file-list
907 item when requesting changes from the sender.
908
909 - Rsync now checks the return value of the close() function to
910 better report disk-full problems on an NFS file system.
911
912 - Restored the old daemon-server behavior of logging error messages
913 rather than returning them to the user. (A better long-term fix
914 will be sought in the future.)
915
916 - An obscure uninitialized-variable bug was fixed in the uid/gid
917 code. (This bug probably had no ill effects.)
918
919 BUILD CHANGES:
920
921 - Got rid of the configure check for sys/sysctl.h (it wasn't used
922 and was causing a problem on some systems). Also improved the
923 broken-largefile-locking test to try to avoid failure due to an
924 NFS build-dir.
925
926 - Fixed a compile problem on systems that don't define
927 AI_NUMERICHOST.
928
929 - Fixed a compile problem in the popt source for compilers that
930 don't support __attribute__.
931
932 DEVELOPER RELATED:
933
934 - Improved the testsuite's "merge" test to work on OSF1.
935
936 - Two new diffs were added to the patches dir.
937
938\f
939NEWS for rsync 2.6.1 (26 Apr 2004)
940Protocol: 28 (changed)
941Changes since 2.6.0:
942
943 SECURITY FIXES:
944
945 - Paths sent to an rsync daemon are more thoroughly sanitized when
946 chroot is not used. If you're running a non-read-only rsync
947 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
948 user privs you run rsync under is anything above "nobody".
949
950 ENHANCEMENTS:
951
952 - Lower memory use, more optimal transfer of data over the socket,
953 and lower CPU usage (see the INTERNAL section for details).
954
955 - The RSYNC_PROXY environment variable can now contain a
956 "USER:PASS@" prefix before the "HOST:PORT" information.
957 (Bardur Arantsson)
958
959 - The --progress output now mentions how far along in the transfer
960 we are, including both a count of files transferred and a
961 percentage of the total file-count that we've processed. It also
962 shows better current-rate-of-transfer and remaining-transfer-time
963 values.
964
965 - Documentation changes now attempt to describe some often mis-
966 understood features more clearly.
967
968 BUG FIXES:
969
970 - When -x (--one-file-system) is combined with -L (--copy-links) or
971 --copy-unsafe-links, no symlinked files are skipped, even if the
972 referent file is on a different filesystem.
973
974 - The --link-dest code now works properly for a non-root user when
975 (1) the UIDs of the source and destination differ and -o was
976 specified, or (2) when the group of the source can't be used on
977 the destination and -g was specified.
978
979 - Fixed a bug in the handling of -H (hard-links) that might cause
980 the expanded PATH/NAME value of the current item to get
981 overwritten (due to an expanded-name caching bug).
982
983 - We now reset the "new data has been sent" flag at the start of
984 each file we send. This makes sure that an interrupted transfer
985 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 986 than the current basis file when no new data has been transferred
c7be6dec
WD
987 over the wire for that file.
988
989 - Fixed a byte-order problem in --batch-mode on big-endian machines.
990 (Jay Fenlason)
991
992 - When using --cvs-exclude, the exclude items we get from a
993 per-directory's .cvsignore file once again only affect that one
994 directory (not all following directories too). The items are also
995 now properly word-split and parsed without any +/- prefix parsing.
996
997 - When specifying the USER@HOST: prefix for a file, the USER part
998 can now contain an '@', if needed (i.e. the last '@' is used to
999 find the HOST, not the first).
1000
1001 - Fixed some bugs in the handling of group IDs for non-root users:
1002 (1) It properly handles a group that the sender didn't have a name
1003 for (it would previously skip changing the group on any files in
1004 that group). (2) If --numeric-ids is used, rsync no longer
1005 attempts to set groups that the user doesn't have the permission
1006 to set.
1007
1008 - Fixed the "refuse options" setting in the rsyncd.conf file.
1009
1010 - Improved the -x (--one-file-system) flag's handling of any mount-
1011 point directories we encounter. It is both more optimal (in that
1012 it no longer does a useless scan of the contents of the mount-
1013 point dirs) and also fixes a bug where a remapped mount of the
1014 original filesystem could get discovered in a subdir we should be
1015 ignoring.
1016
1017 - Rsync no longer discards a double-slash at the start of a filename
1018 when trying to open the file. It also no longer constructs names
1019 that start with a double slash (unless the user supplied them).
1020
1021 - Path-specifying options to a daemon should now work the same with
1022 or without chroot turned on. Previously, such a option (such as
1023 --link-dest) would get its absolute path munged into a relative
1024 one if chroot was not on, making that setting fairly useless.
1025 Rsync now transforms the path into one that is based on the
1026 module's base dir when chroot is not enabled.
1027
1028 - Fixed a compatibility problem interacting with older rsync
1029 versions that might send us an empty --suffix value without
1030 telling us that --backup-dir was specified.
1031
1032 - The "hosts allow" option for a daemon-over-remote-shell process
1033 now has improved support for IPv6 addresses and a fix for systems
1034 that have a length field in their socket structs.
1035
1036 - Fixed the ability to request an empty backup --suffix when sending
1037 files to an rsync daemon.
1038
1039 INTERNAL:
1040
1041 - Most of the I/O is now buffered, which results in a pretty large
1042 speedup when running under MS Windows. (Craig Barratt)
1043
1044 - Optimizations to the name-handling/comparing code have made some
1045 significant reductions in user-CPU time for large file sets.
1046
1047 - Some cleanup of the variable types make the code more consistent.
1048
1049 - Reduced memory requirements of hard link preservation.
1050 (J.W. Schultz)
1051
1052 - Implemented a new algorithm for hard-link handling that speeds up
1053 the code significantly. (J.W. Schultz and Wayne Davison)
1054
1055 - The --hard-link option now uses the first existing file in the
1056 group of linked files as the basis for the transfer. This
1057 prevents the sub-optimal transfer of a file's data when a new
1058 hardlink is added on the sending side and it sorts alphabetically
1059 earlier in the list than the files that are already present on the
1060 receiving side.
1061
1062 - Dropped support for protocol versions less than 20 (2.3.0 released
1063 15 Mar 1999) and activated warnings for protocols less than 25
1064 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
1065 severally)
1066
1067 - More optimal data transmission for --hard-links (protocol 28).
1068
1069 - More optimal data transmission for --checksum (protocol 28).
1070
1071 - Less memory is used when --checksum is specified.
1072
1073 - Less memory is used in the file list (a per-file savings).
1074
1075 - The generator is now better about not modifying the file list
1076 during the transfer in order to avoid a copy-on-write memory
1077 bifurcation (on systems where fork() uses shared memory).
1078 Previously, rsync's shared memory would slowly become unshared,
1079 resulting in real memory usage nearly doubling on the receiving
1080 side by the end of the transfer. Now, as long as permissions
1081 are being preserved, the shared memory should remain that way
1082 for the entire transfer.
1083
1084 - Changed hardlink info and file_struct + strings to use allocation
1085 pools. This reduces memory use for large file-sets and permits
1086 freeing memory to the OS. (J.W. Schultz)
1087
1088 - The 2 pipes used between the receiver and generator processes
1089 (which are forked on the same machine) were reduced to 1 pipe and
1090 the protocol improved so that (1) it is now impossible to have the
1091 "redo" pipe fill up and hang rsync, and (2) trailing messages from
1092 the receiver don't get lost on their way through the generator
1093 over to the sender (which mainly affected hard-link messages and
1094 verbose --stats output).
1095
1096 - Improved the internal uid/gid code to be more portable and a
1097 little more optimized.
1098
1099 - The device numbers sent when using --devices are now sent as
1100 separate major/minor values with 32-bit accuracy (protocol 28).
1101 Previously, the copied devices were sent as a single 32-bit
1102 number. This will make inter-operation of 64-bit binaries more
1103 compatible with their 32-bit brethren (with both ends of the
1104 connection are using protocol 28). Note that optimizations in the
1105 binary protocol for sending the device numbers often results in
1106 fewer bytes being used than before, even though more precision is
1107 now available.
1108
1109 - Some cleanup of the exclude/include structures and its code made
1110 things clearer (internally), simpler, and more efficient.
1111
1112 - The reading & writing of the file-list in batch-mode is now
1113 handled by the same code that sends & receives the list over the
1114 wire. This makes it much easier to maintain. (Note that the
1115 batch code is still considered to be experimental.)
1116
1117 BUILD CHANGES:
1118
1119 - The configure script now accepts --with-rsyncd-conf=PATH to
1120 override the default value of the /etc/rsyncd.conf file.
1121
1122 - Fixed configure bug when running "./configure --disable-ipv6".
1123
1124 - Fixed compilation problem on Tru64 Unix (having to do with
1125 sockaddr.sa_len and sockaddr.sin_len).
1126
1127 DEVELOPER RELATED:
1128
1129 - Fixed "make test" bug when build dir is not the source dir.
1130
1131 - Added a couple extra diffs in the "patches" dir, removed the ones
1132 that got applied, and rebuilt the rest.
1133
1134\f
0f1aa0d3
WD
1135NEWS for rsync 2.6.0 (1 Jan 2004)
1136Protocol: 27 (changed)
1137Changes since 2.5.7:
1138
1139 ENHANCEMENTS:
1140
1141 * "ssh" is now the default remote shell for rsync. If you want to
1142 change this, configure like this: "./configure --with-rsh=rsh".
1143
1144 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
1145 Note that --from0 affects the line-ending character for all the
1146 files read by the --*-from options. (Wayne Davison)
1147
1148 * Length of csum2 is now per-file starting with protocol version
1149 27. (J.W. Schultz)
1150
1151 * Per-file dynamic block size is now sqrt(file length). The
1152 per-file checksum size is determined according to an algorithm
1153 provided by Donovan Baarda which reduces the probability of rsync
1154 algorithm corrupting data and falling back using the whole md4
1155 checksums. (J.W. Schultz, Donovan Baarda)
1156
1157 * The --stats option no longer includes the (debug) malloc summary
1158 unless the verbose option was specified at least twice.
1159
1160 * Added a new error/warning code for when files vanish from the
1161 sending side. Made vanished source files not interfere with the
1162 file-deletion pass when --delete-after was specified.
1163
1164 * Various trailing-info sections are now preceded by a newline.
1165
1166 BUG FIXES:
1167
1168 * Fixed several exclude/include matching bugs when using wild-cards.
1169 This has a several user-visible effects, all of which make the
1170 matching more consistent and intuitive. This should hopefully not
1171 cause anyone problems since it makes the matching work more like
1172 what people are expecting. (Wayne Davison)
1173
1174 - A pattern with a "**" no longer causes a "*" to match slashes.
1175 For example, with "/*/foo/**", "foo" must be 2 levels deep.
1176 [If your string has BOTH "*" and "**" wildcards, changing the
1177 "*" wildcards to "**" will provide the old behavior in all
1178 versions.]
1179
1180 - "**/foo" now matches at the base of the transfer (like /foo
1181 does). [Use "/**/foo" to get the old behavior in all versions.]
1182
1183 - A non-anchored wildcard term floats to match beyond the base of
1184 the transfer. E.g. "CVS/R*" matches at the end of the path,
1185 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
1186 to get the old behavior in all versions.]
1187
1188 - Including a "**" in the match term causes it to be matched
1189 against the entire path, not just the name portion, even if
1190 there aren't any interior slashes in the term. E.g. "foo**bar"
1191 would exclude "/path/foo-bar" (just like before) as well as
1192 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
1193 old behavior in all versions.]
1194
1195 * The exclude list specified in the daemon's config file is now
1196 properly applied to the pulled items no matter how deep the
1197 user's file-args are in the source tree. (Wayne Davison)
1198
1199 * For protocol version >= 27, mdfour_tail() is called when the
1200 block size (including checksum_seed) is a multiple of 64.
1201 Previously it was not called, giving the wrong MD4 checksum.
1202 (Craig Barratt)
1203
1204 * For protocol version >= 27, a 64 bit bit counter is used in
1205 mdfour.c as required by the RFC. Previously only a 32 bit bit
1206 counter was used, causing incorrect MD4 file checksums for
1207 file sizes >= 512MB - 4. (Craig Barratt)
1208
1209 * Fixed a crash bug when interacting with older rsync versions and
1210 multiple files of the same name are destined for the same dir.
1211 (Wayne Davison)
1212
1213 * Keep tmp names from overflowing MAXPATHLEN.
1214
1215 * Make --link-dest honor the absence of -p, -o, and -g.
1216
1217 * Made rsync treat a trailing slash in the destination in a more
1218 consistent manner.
1219
1220 * Fixed file I/O error detection. (John Van Essen)
1221
1222 * Fixed bogus "malformed address {hostname}" message in rsyncd log
1223 when checking IP address against hostnames from "hosts allow"
1224 and "hosts deny" parameters in config file.
1225
1226 * Print heap statistics when verbose >= 2 instead of when >= 1.
1227
1228 * Fixed a compression (-z) bug when syncing a mostly-matching file
1229 that contains already-compressed data. (Yasuoka Masahiko and
1230 Wayne Davison)
1231
1232 * Fixed a bug in the --backup code that could cause deleted files
1233 to not get backed up.
1234
1235 * When the backup code makes new directories, create them with mode
1236 0700 instead of 0755 (since the directory permissions in the
1237 backup tree are not yet copied from the main tree).
1238
1239 * Call setgroups() in a more portable manner.
1240
1241 * Improved file-related error messages to better indicate exactly
1242 what pathname failed. (Wayne Davison)
1243
1244 * Fixed some bugs in the handling of --delete and --exclude when
1245 using the --relative (-R) option. (Wayne Davison)
1246
1247 * Fixed bug that prevented regular files from replacing
1248 special files and caused a directory in --link-dest or
1249 --compare-dest to block the creation of a file with the
1250 same path. A directory still cannot be replaced by a
1251 regular file unless --delete specified. (J.W. Schultz)
1252
1253 * Detect and report when open or opendir succeed but read and
1254 readdir fail caused by network filesystem issues and truncated
1255 files. (David Norwood, Michael Brown, J.W. Schultz)
1256
1257 * Added a fix that should give ssh time to restore the tty settings
1258 if the user presses Ctrl-C at an ssh password prompt.
1259
1260 INTERNAL:
1261
1262 * Eliminated vestigial support for old versions that we stopped
1263 supporting. (J.W. Schultz)
1264
1265 * Simplified some of the option-parsing code. (Wayne Davison)
1266
1267 * Some cleanup made to the exclude code, as well as some new
1268 defines added to enhance readability. (Wayne Davison)
1269
1270 * Changed the protocol-version code so that it can interact at a
1271 lower protocol level than the maximum supported by both sides.
1272 Added an undocumented option, --protocol=N, to force the value
1273 we advertise to the other side (primarily for testing purposes).
1274 (Wayne Davison)
1275
1276\f
276877cf
WD
1277NEWS for rsync 2.5.7 (4 Dec 2003)
1278Protocol: 26 (unchanged)
1279Changes since 2.5.6:
1280
1281 SECURITY FIXES:
1282
1283 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
1284 Russell, Andrea Barisani)
1285
1286\f
1287NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
1288Protocol: 26 (unchanged)
1289Changes since 2.5.5:
1290
1291 ENHANCEMENTS:
1292
1293 * The --delete-after option now implies --delete. (Wayne Davison)
1294
1295 * The --suffix option can now be used with --backup-dir. (Michael
1296 Zimmerman)
1297
1298 * Combining "::" syntax with the -rsh/-e option now uses the
1299 specified remote-shell as a transport to talk to a (newly-spawned)
1300 server-daemon. This allows someone to use daemon features, such
1301 as modules, over a secure protocol, such as ssh. (JD Paul)
1302
1303 * The rsync:// syntax for daemon connections is now accepted in the
1304 destination field.
1305
1306 * If the file name given to --include-from or --exclude-from is "-",
1307 rsync will read from standard input. (J.W. Schultz)
1308
1309 * New option --link-dest which is like --compare-dest except that
1310 unchanged files are hard-linked in to the destination directory.
1311 (J.W. Schultz)
1312
1313 * Don't report an error if an excluded file disappears during an
1314 rsync run. (Eugene Chupriyanov and Bo Kersey)
1315
1316 * Added .svn to --cvs-exclude list to support subversion. (Jon
1317 Middleton)
1318
1319 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
1320 and "hosts deny" fields. (Hideaki Yoshifuji)
1321
1322 * Changed exclude file handling to permit DOS or MAC style line
1323 terminations. (J.W. Schultz)
1324
1325 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
1326 (Dave Dykstra)
1327
1328 BUG FIXES:
1329
1330 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
1331 L. Allen, Martin Pool)
1332
1333 * Generate each file's rolling-checksum data as we send it, not
1334 in a separate (memory-eating) pass before hand. This prevents
1335 timeout errors on really large files. (Stefan Nehlsen)
1336
1337 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
1338
1339 * Better handling of some client-server errors. (Martin Pool)
1340
1341 * Fixed a crash that would occur when sending a list of files that
1342 contains a duplicate name (if it sorts to the end of the file
1343 list) and using --delete. (Wayne Davison)
1344
1345 * Fixed the file-name duplicate-removal code when dealing with multiple
1346 dups in a row. (Wayne Davison)
1347
1348 * Fixed a bug that caused rsync to lose the exit status of its child
1349 processes and sometimes return an exit code of 0 instead of showing
1350 an error. (David R. Staples, Dave Dykstra)
1351
1352 * Fixed bug in --copy-unsafe-links that caused it to be completely
1353 broken. (Dave Dykstra)
1354
1355 * Prevent infinite recursion in cleanup code under certain circumstances.
1356 (Sviatoslav Sviridov and Marc Espie)
1357
1358 * Fixed a bug that prevented rsync from creating intervening directories
1359 when --relative-paths/-R is set. (Craig Barratt)
1360
1361 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
1362
1363 INTERNAL:
1364
1365 * Many code cleanups and improved internal documentation. (Martin
1366 Pool, Nelson Beebe)
1367
1368 * Portability fixes. (Dave Dykstra and Wayne Davison)
1369
1370 * More test cases. (Martin Pool)
1371
1372 * Some test-case fixes. (Brian Poole, Wayne Davison)
1373
1374 * Updated included popt to the latest vendor drop, version 1.6.4.
1375 (Jos Backus)
1376
1377 * Updated config.guess and config.sub to latest versions; this
1378 means rsync should build on more platforms. (Paul Green)
1379
1380\f
1381NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
1382Protocol: 26 (unchanged)
1383Changes since 2.5.4:
54c7298c
MP
1384
1385 ENHANCEMENTS:
1386
1387 * With --progress, when a transfer is complete show the time taken;
1388 otherwise show expected time to complete. (Cameron Simpson)
1389
1390 * Make "make install-strip" works properly, and "make install"
1391 accepts a DESTDIR variable for help in building binary packages.
1392 (Peter Breitenlohner, Greg Louis)
1393
1394 * If configured with --enable-maintainer-mode, then on receipt of
1395 a fatal signal rsync will try to open an xterm running gdb,
1396 similarly to Samba's "panic action" or GNOME's bug-buddy.
1397 (Martin Pool)
1398
1399
1400 BUG FIXES:
1401
1402 * Fix situation where failure to fork (e.g. because out of process
1403 slots) would cause rsync to kill all processes owned by the
1404 current user. Yes, really! (Paul Haas, Martin Pool)
1405
1406 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
1407
1408 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
1409 Pool.)
1410
1411 * Fix --whole-file problem that caused it to be the default even
1412 for remote connections. (Martin Pool, Frank Schulz)
1413
1414 * Work around bug in Mac OS X mkdir(2), which cannot handle
1415 trailing slashes.
1416 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
1417 (Martin Pool)
1418
1419 * Improved network error handling. (Greg A. Woods)
1420
1421\f
276877cf
WD
1422NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
1423Protocol: 26 (unchanged)
1424Changes since 2.5.3:
c9a66d41
MP
1425
1426 BUG FIXES:
1427
1428 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
1429 Tridgell) (CVE CAN-2002-0059)
276877cf 1430
c9a66d41
MP
1431 ENHANCEMENTS:
1432
1433 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
1434 (Note that rsync still uses a custom version of zlib; you can
1435 not just link against a system library. See zlib/README.rsync)
1436
1437 * Additional test cases for --compress. (Martin Pool)
1438
1439\f
276877cf
WD
1440NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
1441Protocol: 26 (unchanged)
1442Changes since 2.5.2:
d40fb723
MP
1443
1444 SECURITY FIXES:
1445
1446 * Make sure that supplementary groups are removed from a server
1447 process after changing uid and gid. (Ethan Benson) (Debian bug
1448 #132272, CVE CAN-2002-0080)
1449
1450 BUG FIXES:
1451
1452 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
1453 CAN-2002-0059)
1454
276877cf 1455 * Fixed problem that in many cases caused the error message
d40fb723
MP
1456 unexpected read size of 0 in map_ptr
1457 and resulted in the wrong data being copied.
1458
1459 * Fixed compilation errors on some systems caused by the use of
1460 "unsigned int64" in rsync.h.
1461
1462 * Fixed problem on systems such as Sunos4 that do not support realloc
1463 on a NULL pointer; error was "out of memory in flist_expand".
1464
1465 * Fix for rsync server processes hanging around after the client
1466 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
1467
1468 * Cope with BSD systems on which mkdir() will not accept a trailing
1469 slash.
1470
1471 ENHANCEMENTS:
1472
1473 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
1474 rsync still uses a custom version of zlib; you can not just link
1475 against a system library. See zlib/README.rsync)
276877cf 1476
d40fb723
MP
1477 * Command to initiate connections is only shown with -vv, rather
1478 than -v as in 2.5.2. Output from plain -v is more similar to
1479 what was historically used so as not to break scripts that try
1480 to parse the output.
1481
1482 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
1483
1484 * Made the --write-batch and --read-batch options actually work
1485 and added documentation in the man page (Jos Backus)
1486
1487 * If the daemon is unable to fork a child to accept a connection,
1488 print an error message. (Colin Walters)
1489
276877cf
WD
1490\f
1491NEWS for rsync 2.5.2 (26 Jan 2002)
1492Protocol: 26 (changed)
1493Changes since 2.5.1:
97efa5c3
MP
1494
1495 SECURITY FIXES:
1496
1497 * Signedness security patch from Sebastian Krahmer
1498 <krahmer@suse.de> -- in some cases we were not sufficiently
1499 careful about reading integers from the network.
1500
1501 BUG FIXES:
1502
1503 * Fix possible string mangling in log files.
1504
1505 * Fix for setting local address of outgoing sockets.
1506
1507 * Better handling of hardlinks and devices on platforms with
1508 64-bit dev_t or ino_t.
1509
1510 * Name resolution on machines supporting IPv6 is improved.
1511
1512 * Fix for device nodes. (dann frazier) (Debian #129135)
1513
1514 ENHANCEMENTS:
1515
1516 * With -v, rsync now shows the command used to initiate an ssh/rsh
1517 connection.
1518
1519 * --statistics now shows memory heap usage on platforms that
276877cf 1520 support mallinfo().
97efa5c3
MP
1521
1522 * "The Ted T'so school of program optimization": make progress
1523 visible and people will think it's faster. (With --progress,
1524 rsync will show you how many files it has seen as it builds the
1525 file_list, giving some indication that it has not hung.)
1526
1527 * Improvements to batch mode support. This is still experimental
1528 but testing would be welcome. (Jos Backus)
276877cf 1529
97efa5c3
MP
1530 * New --ignore-existing option, patch previously distributed with
1531 Vipul's Razor. (Debian #124286)
1532
276877cf
WD
1533\f
1534NEWS for rsync 2.5.1 (3 Jan 2002)
1535Protocol: 25 (unchanged)
1536Changes since 2.5.0:
1537
1538 BUG FIXES:
499957d9 1539
499957d9
MP
1540 * Fix for segfault in --daemon mode configuration parser. (Paul
1541 Mackerras)
1542
1543 * Correct string<->address parsing for both IPv4 and 6.
1544 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
1545 Hagino)
1546
1547 * Various fixes for IPv6 support. (Dave Dykstra)
1548
1549 * rsync.1 typo fix. (Matt Kraai)
1550
1551 * Test suite typo fixes. (Tom Schmidt)
1552
1553 * rsync.1 grammar and clarity improvements. (Edward
1554 Welbourne)
1555
1556 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
1557
1558 ENHANCEMENTS:
1559
1560 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
1561 multiple of bytes/s) and estimated time to completion. (Rik
1562 Faith)
1563
499957d9 1564 * --no-detach option, required to run as a W32 service and also
276877cf
WD
1565 useful when running on Unix under daemontools, AIX's SRC, or a
1566 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
1567
1568 * Clearer error messages for some conditions.
1569
c9a66d41 1570\f
276877cf
WD
1571NEWS for rsync 2.5.0 (30 Nov 2001)
1572Protocol: 25 (changed)
1573Changes since 2.4.6:
d313ae7d
MP
1574
1575 ANNOUNCEMENTS
1576
1577 * Martin Pool <mbp@samba.org> is now a co-maintainer.
1578
1579 NEW FEATURES
1580
1581 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
1582
1583 * Shell wildcards are allowed in "auth users" lines.
1584
1585 * Merged UNC rsync+ patch to support creation of standalone patch
1586 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
1587 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
1588
1589 * IPv6 support based on a patch from KAME.net, on systems
1590 including modern versions of Linux, Solaris, and HP-UX. Also
1591 includes IPv6 compatibility functions for old OSs by the
1592 Internet Software Consortium, Paul Vixie, the OpenSSH
1593 portability project, and OpenBSD.
1594
1595 ENHANCEMENTS
1596
1597 * Include/exclude cluestick: with -vv, print out whether files are
1598 included or excluded and why.
1599
1600 * Many error messages have more friendly explanations and more
1601 details.
1602
1603 * Manual page improvements plus scanty protocol documentation.
1604
1605 * When running as --daemon in the background and using a "log
1606 file" rsyncd.conf directive, close the log file every time it is
1607 open when going to sleep on the socket. This allows the log
1608 file to get cleaned out by another process.
1609
1610 * Change to using libpopt rather than getopt for processing
1611 options. This makes the code cleaner and the behaviour more
1612 consistent across platforms. popt is included and built if not
1613 installed on the platform.
1614
1615 * More details in --version, including note about whether 64-bit
1616 files, symlinks and hardlinks are supported.
1617
1618 * MD4 code may use less CPU cycles.
1619
1620 * Use mkstemp on systems where it is secure. If we use mktemp,
1621 explain that we do it in a secure way.
1622
1623 * --whole-file is the default when source and target are on the
1624 local machine.
1625
1626 BUG FIXES:
1627
1628 * Fix for various bugs causing rsync to hang.
1629
1630 * Attempt to fix Large File Summit support on AIX.
1631
1632 * Attempt to fix error handling lockup bug.
1633
1634 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 1635 to transfer fail to transfer.
d313ae7d
MP
1636
1637 * For log messages containing ridiculously long strings that might
1638 overflow a buffer rsync no longer aborts, but rather prints an
1639 ellipsis at the end of the string. (Patch from Ed Santiago.)
1640
1641 PLATFORMS:
1642
1643 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
1644
1645 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 1646 scripts. It is not required to simply build rsync.
d313ae7d
MP
1647
1648 * Platforms thought to work in this release:
1649
1650 Cray SV1 UNICOS 10.0.0.8 cc
1651 Debian Linux 2.2 UltraSparc gcc
1652 Debian Linux testing/unstable ARM gcc
1653 FreeBSD 3.3-RELEASE i386 cc
1654 FreeBSD 4.1.1-RELEASE i386 cc
1655 FreeBSD 4.3-STABLE i386 cc
1656 HP PA-RISC HP-UX 10.20 gcc
1657 HP PA-RISC HP-UX 11.11 cc
1658 IRIX 6.5 MIPS cc
1659 IRIX 6.5 MIPS gcc
1660 Mac OS X PPC (--disable-ipv6) cc
1661 NetBSD 1.5 i386 gcc
1662 NetBSD Current i386 cc
1663 OpenBSD 2.5 Sparc gcc
1664 OpenBSD 2.9 i386 cc
1665 OpenBSD Current i386 cc
1666 RedHat 6.2 i386 gcc
1667 RedHat 6.2 i386 insure++
1668 RedHat 7.0 i386 gcc
1669 RedHat 7.1 i386 (Kernel 2.4.10) gcc
1670 Slackware 8.0 i686 (Kernel 2.4.10)
1671 Solaris 8 UltraSparc cc
1672 Solaris 8 UltraSparc gcc
1673 Solaris 8 i386 gcc
1674 SuSE 7.1 i386 gcc2.95.2
1675 SuSE 7.1 ppc gcc2.95.2
1676 i386-pc-sco3.2v5.0.5 cc
1677 i386-pc-sco3.2v5.0.5 gcc
1678 powerpc-ibm-aix4.3.3.0 cc
1679 i686-unknown-sysv5UnixWare7.1.0 gcc
1680 i686-unknown-sysv5UnixWare7.1.0 cc
1681
1682 TESTING:
1683
1684 * The existing test.sh script by Phil Hands has been merged into a
1685 test framework that works from both "make check" and the Samba
1686 build farm.
3742bf3a
S
1687\f
1688Partial Protocol History
f7e48a5c 1689 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
a058cbc4 1690 11 Mar 2006 2.6.7 29
cbc63b9b 1691 28 Jul 2005 2.6.6 29
2dfe1c37 1692 01 Jun 2005 2.6.5 29
f7e48a5c 1693 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 1694 30 Sep 2004 2.6.3 28
c7be6dec
WD
1695 30 Apr 2004 2.6.2 28
1696 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
1697 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
1698 04 Dec 2003 2.5.7 26
1699 26 Jan 2003 2.5.6 26
1700 02 Apr 2002 2.5.5 26
1701 13 Mar 2002 2.5.4 26
1702 11 Mar 2002 2.5.3 26
1703 26 Jan 2002 2.5.2 11 Jan 2002 26
1704 03 Jan 2002 2.5.1 25
1705 30 Nov 2001 2.5.0 23 Aug 2001 25
1706 06 Sep 2000 2.4.6 24
1707 19 Aug 2000 2.4.5 24
1708 29 Jul 2000 2.4.4 24
1709 09 Apr 2000 2.4.3 24
1710 30 Mar 2000 2.4.2 24
1711 30 Jan 2000 2.4.1 29 Jan 2000 24
1712 29 Jan 2000 2.4.0 28 Jan 2000 23
1713 25 Jan 2000 2.3.3 23 Jan 2000 22
1714 08 Nov 1999 2.3.2 26 Jun 1999 21
1715 06 Apr 1999 2.3.1 20
1716 15 Mar 1999 2.3.0 15 Mar 1999 20
1717 25 Nov 1998 2.2.1 19
1718 03 Nov 1998 2.2.0 19
1719 09 Sep 1998 2.1.1 19
1720 20 Jul 1998 2.1.0 19
1721 17 Jul 1998 2.0.19 19
1722 18 Jun 1998 2.0.17 19
1723 01 Jun 1998 2.0.16 19
1724 27 May 1998 2.0.13 27 May 1998 19
1725 26 May 1998 2.0.12 18
1726 22 May 1998 2.0.11 18
1727 18 May 1998 2.0.9 18 May 1998 18
1728 17 May 1998 2.0.8 17
1729 15 May 1998 2.0.1 17
1730 14 May 1998 2.0.0 17
1731 17 Apr 1998 1.7.4 17
1732 13 Apr 1998 1.7.3 17
1733 05 Apr 1998 1.7.2 17
1734 26 Mar 1998 1.7.1 17
1735 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
1736 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
1737
1738* DATE OF COMMIT is the date the protocol change was committed to CVS.