Updated nightly-rsync and release-rsync to handle the new
[rsync/rsync.git] / OLDNEWS
CommitLineData
3cbe640d
WD
1NEWS for rsync 3.0.0 (1 Mar 2008)
2Protocol: 30 (changed)
3Changes since 2.6.9:
4
5 NOTABLE CHANGES IN BEHAVIOR:
6
7 - The handling of implied directories when using --relative has changed to
8 send them as directories (e.g. no implied dir is ever sent as a symlink).
9 This avoids unexpected behavior and should not adversely affect most
10 people. If you're one of those rare individuals who relied upon having
11 an implied dir be duplicated as a symlink, you should specify the
12 transfer of the symlink and the transfer of the referent directory as
13 separate args. (See also --keep-dirlinks and --no-implied-dirs.)
14 Also, exclude rules no longer have a partial effect on implied dirs.
15
16 - Requesting a remote file-listing without specifying -r (--recursive) now
17 sends the -d (--dirs) option to the remote rsync rather than sending -r
18 along with an extra exclude of /*/*. If the remote rsync does not
19 understand the -d option (i.e. it is 2.6.3 or older), you will need to
20 either turn off -d (--no-d), or specify -r --exclude='/*/*' manually.
21
22 - In --dry-run mode, the last line of the verbose summary text is output
23 with a "(DRY RUN)" suffix to help remind you that no updates were made.
24 Similarly, --only-write-batch outputs "(BATCH ONLY)".
25
26 - A writable rsync daemon with "use chroot" disabled now defaults to a
27 symlink-munging behavior designed to make symlinks safer while also
28 allowing absolute symlinks to be stored and retrieved. This also has
29 the effect of making symlinks unusable while they're in the daemon's
30 hierarchy. See the daemon's "munge symlinks" parameter for details.
31
32 - Starting up an extra copy of an rsync daemon will not clobber the pidfile
33 for the running daemon -- if the pidfile exists, the new daemon will exit
34 with an error. This means that your wrapper script that starts the rsync
35 daemon should be made to handle lock-breaking (if you want any automatic
36 breaking of locks to be done).
37
38 BUG FIXES:
39
40 - A daemon with "use chroot = no" and excluded items listed in the daemon
41 config file now properly checks an absolute-path arg specified for these
42 options: --compare-dest, --link-dest, --copy-dest, --partial-dir,
43 --backup-dir, --temp-dir, and --files-from.
44
45 - A daemon can now be told to disable all user- and group-name translation
46 on a per-module basis. This avoids a potential problem with a writable
47 daemon module that has "use chroot" enabled -- if precautions weren't
48 taken, a user could try to add a missing library and get rsync to use
49 it. This makes rsync safer by default, and more configurable when id-
50 translation is not desired. See the daemon's "numeric ids" parameter
51 for full details.
52
53 - A chroot daemon can now indicate which part of its path should affect the
54 chroot call, and which part should become an inside-chroot path for the
55 module. This allows you to have outside-the-transfer paths (such as for
56 libraries) even when you enable chroot protection. The idiom used in the
57 rsyncd.conf file is: path = /chroot/dirs/./dirs/inside
58
59 - If a file's data arrived successfully on the receiving side but the
60 rename of the temporary file to the destination file failed AND the
61 --remove-source-files (or the deprecated --remove-sent-files) option
62 was specified, rsync no longer erroneously removes the associated
63 source file.
64
65 - Fixed the output of -ii when combined with one of the --*-dest options:
66 it now itemizes all the items, not just the changed ones.
67
68 - Made the output of all file types consistent when using a --*-dest
69 option. Prior versions would output too many creation events for
70 matching items.
71
72 - The code that waits for a child pid now handles being interrupted by a
73 signal. This fixes a problem with the pre-xfer exec function not being
74 able to get the exit status from the script.
75
76 - A negated filter rule (i.e. with a '!' modifier) no longer loses the
77 negation when sending the filter rules to the remote rsync.
78
79 - Fixed a problem with the --out-format (aka --log-format) option %f: it
80 no longer outputs superfluous directory info for a non-daemon rsync.
81
82 - Fixed a problem with -vv (double --verbose) and --stats when "pushing"
83 files (which includes local copies). Version 2.6.9 would complete the
84 copy, but exit with an error when the receiver output its memory stats.
85
86 - If --password-file is used on a non-daemon transfer, rsync now complains
87 and exits. This should help users figure out that they can't use this
88 option to control a remote shell's password prompt.
89
90 - Make sure that directory permissions of a newly-created destination
91 directory are handled right when --perms is left off.
92
93 - The itemized output of a newly-created destination directory is now
94 output as a creation event, not a change event.
95
96 - Improved --hard-link so that more corner cases are handled correctly
97 when combined with options such as --link-dest and/or --ignore-existing.
98
99 - The --append option no longer updates a file that has the same size.
100
101 - Fixed a bug when combining --backup and --backup-dir with --inplace:
102 any missing backup directories are now created.
103
104 - Fixed a bug when using --backup and --inplace with --whole-file or
105 --read-batch: backup files are actually created now.
106
107 - The daemon pidfile is checked and created sooner in the startup sequence.
108
109 - If a daemon module's "path" value is not an absolute pathname, the code
110 now makes it absolute internally (making it work properly).
111
112 - Ensure that a temporary file always has owner-write permission while we
113 are writing to it. This avoids problems with some network filesystems
114 when transfering read-only files.
115
116 - Any errors output about password-file reading no longer cause an error at
117 the end of the run about a partial transfer.
118
119 - The --read-batch option for protocol 30 now ensures that several more
120 options are set correctly for the current batch file: --iconv, --acls,
121 --xattrs, --inplace, --append, and --append-verify.
122
123 - Using --only-write-batch to a daemon receiver now works properly (older
124 versions would update some files while writing the batch).
125
126 - Avoid outputting a "file has vanished" message when the file is a broken
127 symlink and --copy-unsafe-links or --copy-dirlinks is used (the code
128 already handled this for --copy-links).
129
130 - Fixed the combination of --only-write-batch and --dry-run.
131
132 - Fixed rsync's ability to remove files that are not writable by the file's
133 owner when rsync is running as the same user.
134
135 ENHANCEMENTS:
136
137 - A new incremental-recursion algorithm is now used when rsync is talking
138 to another 3.x version. This starts the transfer going more quickly
139 (before all the files have been found), and requires much less memory.
140 See the --recursive option in the manpage for some restrictions.
141
142 - Lowered memory use in the non-incremental-recursion algorithm for typical
143 option values (usually saving from 21-29 bytes per file).
144
145 - The default --delete algorithm is now --delete-during when talking to a
146 3.x rsync. This is a faster scan than using --delete-before (which is
147 the default when talking to older rsync versions), and is compatible with
148 the new incremental recursion mode.
149
150 - Rsync now allows multiple remote-source args to be specified rather than
151 having to rely on a special space-splitting side-effect of the remote-
152 shell. Additional remote args must specify the same host or an empty one
153 (e.g. empty: :file1 or ::module/file2). For example, this means that
154 local use of brace expansion now works: rsync -av host:dir/{f1,f2} .
155
156 - Added the --protect-args (-s) option, that tells rsync to send most of
157 the command-line args at the start of the transfer rather than as args
158 to the remote-shell command. This protects them from space-splitting,
159 and only interprets basic wildcard special shell characters (*?[).
160
161 - Added the --delete-delay option, which is a more efficient way to delete
162 files at the end of the transfer without needing a separate delete pass.
163
164 - Added the --acls (-A) option to preserve Access Control Lists. This is
165 an improved version of the prior patch that was available, and it even
166 supports OS X ACLs. If you need to have backward compatibility with old,
167 ACL-patched versions of rsync, apply the acls.diff file from the patches
168 dir.
169
170 - Added the --xattrs (-X) option to preserve extended attributes. This is
171 an improved version of the prior patch that was available, and it even
172 supports OS X xattrs (which includes their resource fork data). If you
173 need to have backward compatibility with old, xattr-patched versions of
174 rsync, apply the xattrs.diff file from the patches dir.
175
176 - Added the --fake-super option that allows a non-super user to preserve
177 all attributes of a file by using a special extended-attribute idiom.
178 It even supports the storing of foreign ACL data on your backup server.
179 There is also an analogous "fake super" parameter for an rsync daemon.
180
181 - Added the --iconv option, which allows rsync to convert filenames from
182 one character-set to another during the transfer. The default is to
183 make this feature available as long as your system has iconv_open().
184 If compilation fails, specify --disable-iconv to configure, and then
185 rebuild. If you want rsync to perform character-set conversions by
186 default, you can specify --enable-iconv=CONVERT_STRING with the default
187 value for the --iconv option that you wish to use. For example,
188 "--enable-iconv=." is a good choice. See the rsync manpage for an
189 explanation of the --iconv option's settings.
190
191 - A new daemon config parameter, "charset", lets you control the character-
192 set that is used during an --iconv transfer to/from a daemon module. You
193 can also set your daemon to refuse "no-iconv" if you want to force the
194 client to use an --iconv transfer (requiring an rsync 3.x client).
195
196 - Added the --skip-compress=LIST option to override the default list of
197 file suffixes that will not be compressed when using --compress (-z).
198
199 - The daemon's default for "dont compress" was extended to include:
200 *.7z *.mp[34] *.mov *.avi *.ogg *.jpg *.jpeg
201 The name-matching routine was also optimized to run more quickly.
202
203 - The --max-delete option now outputs a warning if it skipped any file
204 deletions, including a count of how many deletions were skipped. (Older
205 versions just silently stopped deleting things.)
206
207 - You may specify --max-delete=0 to a 3.0.0 client to request that it warn
208 about extraneous files without deleting anything. If you're not sure
209 what version the client is, you can use the less-obvious --max-delete=-1,
210 as both old and new versions will treat that as the same request (though
211 older versions don't warn).
212
213 - The --hard-link option now uses less memory on both the sending and
214 receiving side for all protocol versions. For protocol 30, the use of a
215 hashtable on the sending side allows us to more efficiently convey to the
216 receiver what files are linked together. This reduces the amount of data
217 sent over the socket by a considerable margin (rather than adding more
218 data), and limits the in-memory storage of the device+inode information
219 to just the sending side for the new protocol 30, or to the receiving
220 side when speaking an older protocol (note that older rsync versions kept
221 the device+inode information on both sides).
222
223 - The filter rules now support a perishable ("p") modifier that marks rules
224 that should not have an effect in a directory that is being deleted. e.g.
225 -f '-p .svn/' would only affect "live" .svn directories.
226
227 - Rsync checks all the alternate-destination args for validity (e.g.
228 --link-dest). This lets the user know when they specified a directory
229 that does not exist.
230
231 - If we get an error setting the time on a symlink, we don't complain about
232 it anymore (since some operating systems don't support that, and it's not
233 that important).
234
235 - Protocol 30 now uses MD5 checksums instead of MD4.
236
237 - Changed the --append option to not checksum the existing data in the
238 destination file, which speeds up file appending.
239
240 - Added the --append-verify option, which works like the older --append
241 option (verifying the existing data in the destination file). For
242 compatibility with older rsync versions, any use of --append that is
243 talking protocol 29 or older will revert to the --append-verify method.
244
245 - Added the --contimeout=SECONDS option that lets the user specify a
246 connection timeout for rsync daemon access.
247
248 - Documented and extended the support for the RSYNC_CONNECT_PROG variable
249 that can be used to enhance the client side of a daemon connection.
250
251 - Improved the dashes and double-quotes in the nroff manpage output.
252
253 - Rsync now supports a lot more --no-OPTION override options.
254
255 INTERNAL:
256
257 - The file-list sorting algorithm now uses a sort that keeps any same-
258 named items in the same order as they were specified. This allows
259 rsync to always ensure that the first of the duplicates is the one
260 that will be included in the copy. The new sort is also faster
261 than the glibc version of qsort() and mergesort().
262
263 - Rsync now supports the transfer of 64-bit timestamps (time_t values).
264
265 - Made the file-deletion code use a little less stack when recursing
266 through a directory hierarchy of extraneous files.
267
268 - Fixed a build problem with older (2.x) versions of gcc.
269
270 - Added some isType() functions that make dealing with signed characters
271 easier without forcing variables via casts.
272
273 - Changed strcat/strcpy/sprintf function calls to use safer versions.
274
275 - Upgraded the included popt version to 1.10.2 and improved its use of
276 string-handling functions.
277
278 - Added missing prototypes for compatibility functions from the lib dir.
279
280 - Configure determines if iconv() has a const arg, allowing us to avoid a
281 compiler warning.
282
283 - Made the sending of some numbers more efficient for protocol 30.
284
285 - Make sure that a daemon process doesn't mind if the client was weird and
286 omitted the --server option.
287
288 - There are more internal logging categories available in protocol 30 than
289 the age-old FINFO and FERROR, including FERROR_XFER and FWARN. These new
290 categories allow some errors and warnings to go to stderr without causing
291 an erroneous end-of-run warning about some files not being able to be
292 transferred.
293
294 - Improved the use of "const" on pointers.
295
296 - Improved J.W.'s pool_alloc routines to add a way of incrementally freeing
297 older sections of a pool's memory.
298
299 - The getaddrinfo.c compatibility code in the "lib" dir was replaced with
300 some new code (derived from samba, derived from PostgreSQL) that has a
301 better license than the old code.
302
303 DEVELOPER RELATED:
304
305 - Rsync is now licensed under the GPLv3 or later.
306
307 - Rsync is now being maintained in a "git" repository instead of CVS
308 (though the old CVS repository still exists for historical access).
309 Several maintenance scripts were updated to work with git.
310
311 - Generated files are no longer committed into the source repository. The
312 autoconf and autoheader commands are now automatically run during the
313 normal use of "configure" and "make". The latest dev versions of all
314 generated files can also be copied from the samba.org web site (see the
315 prepare-source script's fetch option).
316
317 - The "patches" directory of diff files is now built from branches in the
318 rsync git repository (branch patch/FOO creates file patches/FOO.diff).
319 This directory is now distributed in a separate separate tar file named
320 rsync-patches-VERSION.tar.gz instead of the main rsync-VERSION.tar.gz.
321
322 - The proto.h file is now built using a simple perl script rather than a
323 complex awk script, which proved to be more widely compatible.
324
325 - When running the tests, we now put our per-test temp dirs into a sub-
326 directory named testtmp (which is created, if missing). This allows
327 someone to symlink the testtmp directory to another filesystem (which is
328 useful if the build dir's filesystem does not support ACLs and xattrs,
329 but another filesystem does).
330
331 - Rsync now has a way of handling protocol-version changes during the
332 development of a new protocol version. This causes any out-of-sync
333 versions to speak an older protocol rather than fail in a cryptic manner.
334 This addition makes it safer to deploy a pre-release version that may
335 interact with the public. This new exchange of sub-version info does not
336 interfere with the {MIN,MAX}_PROTOCOL_VERSION checking algorithm (which
337 does not have enough range to allow the main protocol number to be
338 incremented for every minor tweak in that happens during development).
339
340 - The csprotocol.txt file was updated to mention the daemon protocol change
341 in the 3.0.0 release.
342
343\f
2955529b
WD
344NEWS for rsync 2.6.9 (6 Nov 2006)
345Protocol: 29 (unchanged)
346Changes since 2.6.8:
347
348 BUG FIXES:
349
350 - If rsync is interrupted via a handled signal (such as SIGINT), it will
351 once again clean-up its temp file from the destination dir.
352
353 - Fixed an overzealous sanitizing bug in the handling of the --link-dest,
354 --copy-dest, and --compare-dest options to a daemon without chroot: if
355 the copy's destination dir is deeper than the top of the module's path,
356 these options now accept a safe number of parent-dir (../) references
357 (since these options are relative to the destination dir). The old code
358 incorrectly chopped off all "../" prefixes for these options, no matter
359 how deep the destination directory was in the module's hierarchy.
360
361 - Fixed a bug where a deferred info/error/log message could get sent
362 directly to the sender instead of being handled by rwrite() in the
363 generator. This fixes an "unexpected tag 3" fatal error, and should
364 also fix a potential problem where a deferred info/error message from
365 the receiver might bypass the log file and get sent only to the client
366 process. (These problems could only affect an rsync daemon that was
367 receiving files.)
368
369 - Fixed a bug when --inplace was combined with a --*-dest option and we
370 update a file's data using an alternate basis file. The code now
371 notices that it needs to copy the matching data from the basis file
372 instead of (wrongly) assuming that it was already present in the file.
373
374 - Fixed a bug where using --dry-run with a --*-dest option with a path
375 relative to a directory that does not yet exist: the affected option
376 gets its proper path value so that the output of the dry-run is right.
377
378 - Fixed a bug in the %f logfile escape when receiving files: the
379 destination path is now included in the output (e.g. you can now tell
380 when a user specifies a subdir inside a module).
381
382 - If the receiving side fails to create a directory, it will now skip
383 trying to update everything that is inside that directory.
384
385 - If --link-dest is specified with --checksum but without --times, rsync
386 will now allow a hard-link to be created to a matching link-dest file
387 even when the file's modify-time doesn't match the server's file.
388
389 - The daemon now calls more timezone-using functions prior to doing a
390 chroot. This should help some C libraries to generate proper timestamps
391 from inside a chrooted daemon (and to not try to access /etc/timezone
392 over and over again).
393
394 - Fixed a bug in the handling of an absolute --partial-dir=ABS_PATH option:
395 it now deletes an alternate basis file from the partial-dir that was used
396 to successfully update a destination file.
397
398 - Fixed a bug in the handling of --delete-excluded when using a per-dir
399 merge file: the merge file is now honored on the receiving side, and
400 only its unqualified include/exclude commands are ignored (just as is
401 done for global include/excludes).
402
403 - Fixed a recent bug where --delete was not working when transferring from
404 the root (/) of the filesystem with --relative enabled.
405
406 - Fixed a recent bug where an --exclude='*' could affect the root (/) of
407 the filesystem with --relative enabled.
408
409 - When --inplace creates a file, it is now created with owner read/write
410 permissions (0600) instead of no permissions at all. This avoids a
411 problem continuing a transfer that was interrupted (since --inplace
412 will not update a file that has no write permissions).
413
414 - If either --remove-source-files or --remove-sent-files is enabled and we
415 are unable to remove the source file, rsync now outputs an error.
416
417 - Fixed a bug in the daemon's "incoming chmod" rule: newly-created
418 directories no longer get the 'F' (file) rules applied to them.
419
420 - Fixed an infinite loop bug when a filter rule was rejected due to being
421 overly long.
422
423 - When the server receives a --partial-dir option from the client, it no
424 longer runs the client-side code that adds an assumed filter rule (since
425 the client will be sending us the rules in the usual manner, and they
426 may have chosen to override the auto-added rule).
427
428 ENHANCEMENTS:
429
430 - Added the --log-file=FILE and --log-file-format=FORMAT options. These
431 can be used to tell any rsync to output what it is doing to a log file.
432 They work with a client rsync, a non-daemon server rsync (see the man
433 page for instructions), and also allows the overriding of rsyncd.conf
434 settings when starting a daemon.
435
436 - The --log-format option was renamed to be --out-format to avoid confusing
437 it with affecting the log-file output. (The old option remains as an
438 alias for the new to preserve backward compatibility.)
439
440 - Made "log file" and "syslog facility" settable on a per-module basis in
441 the daemon's config file.
442
443 - Added the --remove-source-files option as a replacement for the (now
444 deprecated) --remove-sent-files option. This new option removes all
445 non-dirs from the source directories, even if the file was already
446 up-to-date. This fixes a problem where interrupting an rsync that
447 was using --remove-sent-files and restarting it could leave behind
448 a file that the earlier rsync synchronized, but didn't get to remove.
449 (The deprecated --remove-sent-files is still understood for now, and
450 still behaves in the same way as before.)
451
452 - Added the option --no-motd to suppress the message-of-the-day output
453 from a daemon when doing a copy. (See the manpage for a caveat.)
454
455 - Added a new environment variable to the pre-/post-xfer exec commands (in
456 the daemon's config file): RSYNC_PID. This value will be the same in
4eeaa162
WD
457 both the pre- and post-xfer commands, so it can be used as a unique ID
458 if the pre-xfer command wants to cache some arg/request info for the
459 post-xfer command.
2955529b
WD
460
461 INTERNAL:
462
463 - Did a code audit using IBM's code-checker program and made several
464 changes, including: replacing most of the strcpy() and sprintf()
465 calls with strlcpy(), snprintf(), and memcpy(), adding a 0-value to
466 an enum that had been intermingling a literal 0 with the defined enum
467 values, silencing some uninitialized memory checks, marking some
468 functions with a "noreturn" attribute, and changing an "if" that
469 could never succeed on some platforms into a pre-processor directive
470 that conditionally compiles the code.
471
472 - Fixed a potential bug in f_name_cmp() when both the args are a
473 top-level "." dir (which doesn't happen in normal operations).
474
475 - Changed exit_cleanup() so that it can never return instead of exit.
476 The old code might return if it found the exit_cleanup() function
477 was being called recursively. The new code is segmented so that
478 any recursive calls move on to the next step of the exit-processing.
479
480 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
481 define it.
482
483 DEVELOPER RELATED:
484
485 - The acls.diff and xattrs.diff patches have received a bunch of work to
486 make them much closer to being acceptable in the main distribution.
487 The xattrs patch also has some preliminary Mac OS X and FreeBSD
488 compatibility code that various system types to exchange extended
489 file-attributes.
490
491 - A new diff in the patches dir, fake-root.diff, allows rsync to
492 maintain a backup hierarchy with full owner, group, and device info
493 without actually running as root. It does this using a special
494 extended attribute, so it depends on xattrs.diff (which depends on
495 acls.diff).
496
497 - The rsync.yo and rsyncd.conf.yo files have been updated to work
498 better with the latest yodl 2.x releases.
499
500 - Updated config.guess and config.sub to their 2006-07-02 versions.
501
502 - Updated various files to include the latest FSF address and to have
503 consistent opening comments.
504
505\f
60ef8ed1
WD
506NEWS for rsync 2.6.8 (22 Apr 2006)
507Protocol: 29 (unchanged)
508Changes since 2.6.7:
509
510 BUG FIXES:
511
512 - Fixed a bug in the exclude code where an anchored exclude without any
513 wildcards fails to match an absolute source arg, but only when --relative
514 is in effect.
515
516 - Improved the I/O code for the generator to fix a potential hang when the
517 receiver gets an EOF on the socket but the generator's select() call
518 never indicates that the socket is writable for it to be notified about
519 the EOF. (This can happen when using stunnel).
520
521 - Fixed a problem with the file-reading code where a failed read (such as
522 that caused by a bad sector) would not advance the file's read-position
523 beyond the failed read's data.
524
525 - Fixed a logging bug where the "log file" directive was not being honored
526 in a single-use daemon (one spawned by a remote-shell connection or by
527 init).
528
529 - If rsync cannot honor the --delete option, we output an error and exit
530 instead of silently ignoring the option.
531
532 - Fixed a bug in the --link-dest code that prevented special files (such as
533 fifos) from being linked.
534
535 - The ability to hard-link symlinks and special files is now determined at
536 configure time instead of at runtime. This fixes a bug with --link-dest
537 creating a hard-link to a symlink's referent on a BSD system.
538
539 ENHANCEMENTS:
540
541 - In daemon mode, if rsync fails to bind to the requested port, the
542 error(s) returned by socket() and/or bind() are now logged.
543
544 - When we output a fatal error, we now output the version of rsync in the
545 message.
546
547 - Improved the documentation for the --owner and --group options.
548
549 - The rsyncstats script in "support" has an improved line-parsing regex
550 that is easier to read and also makes it to parse syslog-generated lines.
551
552 - A new script in "support": file-attr-restore, can be used to restore the
553 attributes of a file-set (the permissions, ownership, and group info)
554 taken from the cached output of a "find ARG... -ls" command.
555
556 DEVELOPER RELATED:
557
558 - Removed the unused function write_int_named(), the unused variable
559 io_read_phase, and the rarely used variable io_write_phase. This also
560 elides the confusing 'phase "unknown"' part of one error message.
561
562 - Removed two unused configure checks and two related (also unused)
563 compatibility functions.
564
565 - The xattrs.diff patch received a security fix that prevents a potential
566 buffer overflow in the receive_xattr() code.
567
568 - The acls.diff patch has been improved quite a bit, with more to come.
569
570 - A new patch was added: log-file.diff. This contains an early version of
571 a future option, --log-file=FILE, that will allow any rsync to log its
572 actions to a file (something that only a daemon supports at present).
573
574\f
f171bf5b
WD
575NEWS for rsync 2.6.7 (11 Mar 2006)
576Protocol: 29 (unchanged)
577Changes since 2.6.6:
578
579 OUTPUT CHANGES:
580
581 - The letter 'D' in the itemized output was being used for both devices
582 (character or block) as well as other special files (such as fifos and
583 named sockets). This has changed to separate non-device special files
584 under the 'S' designation (e.g. "cS+++++++ path/fifo"). See also the
585 "--specials" option, below.
586
587 - The way rsync escapes unreadable characters has changed. First, rsync
588 now has support for recognizing valid multibyte character sequences in
589 your current locale, allowing it to escape fewer characters than before
590 for a locale such as UTF-8. Second, it now uses an escape idiom of
591 "\#123", which is the literal string "\#" followed by exactly 3 octal
592 digits. Rsync no longer doubles a backslash character in a filename
593 (e.g. it used to output "foo\\bar" when copying "foo\bar") -- now it only
594 escapes a backslash that is followed by a hash-sign and 3 digits (0-9)
595 (e.g. it will output "foo\#134#789" when copying "foo\#789"). See also
596 the --8-bit-output (-8) option, mentioned below.
597
598 Script writers: the local rsync is the one that outputs escaped names,
599 so if you need to support unescaping of filenames for older rsyncs, I'd
600 suggest that you parse the output of "rsync --version" and only use the
601 old unescaping rules for 2.6.5 and 2.6.6.
602
603 BUG FIXES:
604
605 - Fixed a really old bug that caused --checksum (-c) to checksum all the
606 files encountered during the delete scan (ouch).
607
608 - Fixed a potential hang in a remote generator: when the receiver gets a
609 read-error on the socket, it now signals the generator about this so that
610 the generator does not try to send any of the terminating error messages
611 to the client (avoiding a potential hang in some setups).
612
613 - Made hard-links work with symlinks and devices again.
614
615 - If the sender gets an early EOF reading a source file, we propagate this
616 error to the receiver so that it can discard the file and try requesting
617 it again (which is the existing behavior for other kinds of read errors).
618
619 - If a device-file/special-file changes permissions, rsync now updates the
620 permissions without recreating the file.
621
622 - If the user specifies a remote-host for both the source and destination,
623 we now output a syntax error rather than trying to open the destination
624 hostspec as a filename.
625
626 - When --inplace creates a new destination file, rsync now creates it with
627 permissions 0600 instead of 0000 -- this makes restarting possible when
628 the transfer gets interrupted in the middle of sending a new file.
629
630 - Reject the combination of --inplace and --sparse since the sparse-output
631 algorithm doesn't work when overwriting existing data.
632
633 - Fixed the directory name in the error that is output when pop_dir()
634 fails.
635
636 - Really fixed the parsing of a "!" entry in .cvsignore files this time.
637
638 - If the generator gets a stat() error on a file, output it (this used to
639 require at least -vv for the error to be seen).
640
641 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle
642 the exit status properly and generate a better error.
643
644 - Fixed some glitches in the double-verbose output when using --copy-dest,
645 --link-dest, or --compare-dest. Also improved how the verbose output
646 handles hard-links (within the transfer) that had an up-to-date alternate
647 "dest" file, and copied files (via --copy-dest).
648
649 - Fixed the matching of the dont-compress items (e.g. *.gz) against files
650 that have a path component containing a slash.
651
549a3efb
WD
652 - If the code reading a filter/exclude file gets an EINTR error, rsync now
653 clears the error flag on the file handle so it can keep on reading.
f171bf5b
WD
654
655 - If --relative is active, the sending side cleans up trailing "/" or "/."
656 suffixes to avoid triggering a bug in older rsync versions. Also, we now
657 reject a ".." dir if it would be sent as a relative dir.
658
659 - If a non-directory is in the way of a directory and rsync is run with
660 --dry-run and --delete, rsync no longer complains about not being able
661 to opendir() the not-yet present directory.
662
663 - When --list-only is used and a non-existent local destination dir was
664 also specified as a destination, rsync no longer generates a warning
665 about being unable to create the missing directory.
666
667 - Fixed some problems with --relative --no-implied-dirs when the
668 destination directory did not yet exist: we can now create a symlink or
669 device when it is the first thing in the missing dir, and --fuzzy no
670 longer complains about being unable to open the missing dir.
671
672 - Fixed a bug where the --copy-links option would not affect implied
673 directories without --copy-unsafe-links (see --relative).
674
675 - Got rid of the need for --force to be used in some circumstances with
676 --delete-after (making it consistent with --delete-before/-during).
677
678 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this
679 when a file is too large (rsync handles the write error).
680
681 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it
682 was not properly padded with trailing '=' chars. This only affects a
683 user that need to use a password-authenticated proxy for an outgoing
684 daemon-rsync connection.
685
686 - If we're transferring an empty directory to a new name, rsync no longer
687 forces S_IWUSR if it wasn't already set, nor does it accidentally leave
688 it set.
689
690 - Fixed a bug in the debug output (-vvvvv) that could mention the wrong
691 checksum for the current file offset.
692
693 - Rsync no longer allows a single directory to be copied over a non-
694 directory destination arg.
695
696 ENHANCEMENTS:
697
698 - Added the --append option that makes rsync append data onto files that
699 are longer on the source than the destination (this includes new files).
700
701 - Added the --min-size=SIZE option to exclude small files from the
702 transfer.
703
704 - Added the --compress-level option to allow you to set how aggressive
705 rsync's compression should be (this option implies --compress).
706
707 - Enhanced the parsing of the SIZE value for --min-size and --max-size to
708 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
709 and off-by-one values too (e.g. --max-size=8mb-1).
710
711 - Added the --8-bit-output (-8) option, which tells rsync to avoid escaping
712 high-bit characters that it thinks are unreadable in the current locale.
713
714 - The new option --human-readable (-h) changes the output of --progress,
715 --stats, and the end-of-run summary to be easier to read. If repeated,
716 the units become powers of 1024 instead of powers of 1000. (The old
717 meaning of -h, as a shorthand for --help, still works as long as you
718 just use it on its own, as in "rsync -h".)
719
720 - If lutimes() and/or lchmod() are around, use them to allow the
721 preservation of attributes on symlinks.
722
723 - The --link-dest option now affects symlinks and devices (when possible).
724
725 - Added two config items to the rsyncd.conf parsing: "pre-xfer exec" and
726 "post-xfer exec". These allow a command to be specified on a per-module
727 basis that will be run before and/or after a daemon-mode transfer. (See
728 the man page for a list of the environment variables that are set with
729 information about the transfer.)
730
731 - When using the --relative option, you can now insert a dot dir in
732 the source path to indicate where the replication of the source dirs
733 should start. For example, if you specify a source path of
734 rsync://host/module/foo/bar/./baz/dir with -R, rsync will now only
735 replicate the "baz/dir" part of the source path (note: a trailing
736 dot dir is unaffected unless it also has a trailing slash).
737
738 - Added some new --no-FOO options that make it easier to override unwanted
739 implied or default options. For example, "-a --no-o" (aka "--archive
740 --no-owner") can be used to turn off the preservation of file ownership
741 that is implied by -a.
742
743 - Added the --chmod=MODE option that allows the destination permissions to
744 be changed from the source permissions. E.g. --chmod=g+w,o-rwx
745
746 - Added the "incoming chmod" and "outgoing chmod" daemon options that allow
747 a module to specify what permissions changes should be applied to all
748 files copied to and from the daemon.
749
750 - Allow the --temp-dir option to be specified when starting a daemon, which
751 sets the default temporary directory for incoming files.
752
753 - If --delete is combined with --dirs without --recursive, rsync will now
754 delete in any directory whose content is being synchronized.
755
756 - If --backup is combined with --delete without --backup-dir (and without
757 --delete-excluded), we add a "protect" filter-rule to ensure that files
758 with the backup suffix are not deleted.
759
760 - The file-count stats that are output by --progress were improved to
761 better indicate what the numbers mean. For instance, the output:
762 "(xfer#5, to-check=8383/9999)" indicates that this was the fifth file
763 to be transferred, and we still need to check 8383 more files out of
764 a total of 9999.
765
766 - The include/exclude code now allows a dir/*** directive (with 3 trailing
767 stars) to match both the dir itself as well as all the content below the
768 dir (dir/** would not match the dir).
769
770 - Added the --prune-empty-dirs (-m) option that makes the receiving rsync
771 discard empty chains of directories from the file-list. This makes it
772 easier to selectively copy files from a source hierarchy and end up with
773 just the directories needed to hold the resulting files.
774
775 - If the --itemize-changes (-i) option is repeated, rsync now includes
776 unchanged files in the itemized output (similar to -vv, but without all
777 the other verbose messages that can get in the way). Of course, the
778 client must be version 2.6.7 for this to work, but the remote rsync only
779 needs to be 2.6.7 if you're pushing files.
780
781 - Added the --specials option to tell rsync to copy non-device special
782 files (which rsync now attempts even as a normal user). The --devices
783 option now requests the copying of just devices (character and block).
784 The -D option still requests both (e.g. --devices and --specials), -a
785 still implies -D, and non-root users still get a silent downgrade that
786 omits device copying.
787
788 - Added the --super option to make the receiver always attempt super-user
789 activities. This is useful for systems that allow things such as devices
790 to be created or ownership to be set without being UID 0, and is also
791 useful for someone who wants to ensure that errors will be output if the
792 receiving rsync isn't being run as root.
793
794 - Added the --sockopts option for those few who want to customize the TCP
795 options used to contact a daemon rsync.
796
797 - Added a way for the --temp-dir option to be combined with a partial-dir
798 setting that lets rsync avoid non-atomic updates (for those times when
799 --temp-dir is not being used because space is tight).
800
801 - A new support script, files-to-excludes, will transform a list of files
802 into a set of include/exclude directives that will copy those files.
803
804 - A new option, --executability (-E) can be used to preserve just the
805 execute bit on files, for those times when using the --perms option is
806 not desired.
807
808 - The daemon now logs each connection and also each module-list request
809 that it receives.
810
811 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B
812 (permission bits, e.g. "rwxr-xrwt").
813
814 - The --dry-run option no longer forces the enabling of --verbose.
815
816 - The --remove-sent-files option now does a better job of incrementally
817 removing the sent files on the sending side (older versions tended to
818 clump up all the removals at the end).
819
820 - A daemon now supersedes its minimal SIGCHLD handler with the standard
821 PID-remembering version after forking. This ensures that the generator
822 can get the child-exit status from the receiver.
823
824 - Use of the --bwlimit option no longer interferes with the remote rsync
825 sending error messages about invalid/refused options.
826
827 - Rsync no longer returns a usage error when used with one local source arg
828 and no destination: this now implies the --list-only option, just like
829 the comparable situation with a remote source arg.
830
831 - Added the --copy-dirlinks option, a more limited version of --copy-links.
832
833 - Various documentation improvements, including: a better synopsis, some
834 improved examples, a better discussion of the presence and absence of
835 --perms (including how it interacts with the new --executability and
836 --chmod options), an extended discussion of --temp-dir, an improved
837 discussion of --partial-dir, a better description of rsync's pattern
838 matching characters, an improved --no-implied-dirs section, and the
839 documenting of what the --stats option outputs.
840
841 - Various new and updated diffs in the patches dir, including: acls.diff,
842 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
843
844 INTERNAL:
845
846 - We now use sigaction() and sigprocmask() if possible, and fall back on
847 signal() if not. Using sigprocmask() ensures that rsync enables all the
848 signals that it needs, just in case it was started in a masked state.
849
850 - Some buffer sizes were expanded a bit, particularly on systems where
851 MAXPATHLEN is overly small (e.g. cygwin).
852
853 - If io_printf() tries to format more data than fits in the buffer, exit
854 with an error instead of transmitting a truncated buffer.
855
856 - If a va_copy macro is defined, lib/snprintf.c will use it when defining
857 the VA_COPY macro.
858
859 - Reduced the amount of stack memory needed for each level of directory
860 recursion by nearly MAXPATHLEN bytes.
861
862 - The wildmatch function was extended to allow an array of strings to be
863 supplied as the string to match. This allows the exclude code to do less
864 string copying.
865
866 - Got rid of the safe_fname() function (and all the myriad calls) and
867 replaced it with a new function in the log.c code that filters all the
868 output going to the terminal.
869
870 - Unified the f_name() and the f_name_to() functions.
871
872 - Improved the hash-table code the sender uses to handle checksums to make
873 it use slightly less memory and run just a little faster.
874
875 DEVELOPER RELATED:
876
877 - The diffs in the patches dir now require "patch -p1 <DIFF" instead of
878 the previous -p0. Also, the version included in the release tar now
879 affect generated files (e.g. configure, rsync.1, proto.h, etc.), so
880 it is no longer necessary to run autoconf and/or yodl unless you're
881 applying a patch that was checked out from CVS.
882
883 - Several diffs in the patches dir now use the proper --enable-FOO
884 configure option instead of --with-FOO to turn on the inclusion of
885 the newly patched feature.
886
887 - There is a new script, "prepare-source" than can be used to update the
888 various generated files (proto.h, configure, etc.) even before configure
889 has created the Makefile (this is mainly useful when patching the source
890 with a patch that doesn't affect generated files).
891
892 - The testsuite now sets HOME so that it won't be affected by a file such
893 as ~/.popt.
894
895\f
f90f7149
WD
896NEWS for rsync 2.6.6 (28 Jul 2005)
897Protocol: 29 (unchanged)
898Changes since 2.6.5:
899
900 SECURITY FIXES:
901
902 - The zlib code was upgraded to version 1.2.3 in order to make it more
903 secure. While the widely-publicized security problem in zlib 1.2.2 did
904 not affect rsync, another security problem surfaced that affects rsync's
905 zlib 1.1.4.
906
907 BUG FIXES:
908
909 - The setting of flist->high in clean_flist() was wrong for an empty list.
910 This could cause flist_find() to crash in certain rare circumstances
911 (e.g. if just the right directory setup was around when --fuzzy was
912 combined with --link-dest).
913
914 - The outputting of hard-linked files when verbosity was > 1 was not right:
1578919c
WD
915 (1) Without -i it would output the name of each hard-linked file as
916 though it had been changed; it now outputs a "is hard linked" message for
917 the file. (2) With -i it would output all dots for the unchanged
918 attributes of a hard-link; it now changes those dots to spaces, as is
919 done for other totally unchanged items.
f90f7149
WD
920
921 - When backing up a changed symlink or device, get rid of any old backup
922 item so that we don't get an "already exists" error.
923
924 - A couple places that were comparing a local and a remote modification-
925 time were not honoring the --modify-window option.
926
927 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get
928 set too often (if some non-significant mode bits differed).
929
930 - Fixed a really old, minor bug that could cause rsync to warn about being
931 unable to mkdir() a path that ends in "/." because it just created the
932 directory (required --relative, --no-implied-dirs, a source path that
933 ended in either a trailing slash or a trailing "/.", and a non-existing
934 destination dir to tickle the bug in a recent version).
935
936 ENHANCEMENTS:
937
938 - Made the "max verbosity" setting in the rsyncd.conf file settable on a
939 per-module basis (which now matches the documentation).
940
941 - The support/rrsync script has been upgraded to verify the args of options
942 that take args (instead of rejecting any such options). The script was
943 also changed to try to be more secure and to fix a problem in the parsing
944 of a pull operation that has multiple sources.
945
946 - Improved the documentation that explains the difference between a
947 normal daemon transfer and a daemon-over remote-shell transfer.
948
949 - Some of the diffs supplied in the patches dir were fixed and/or
950 improved.
951
952 BUILD CHANGES:
953
954 - Made configure define NOBODY_USER (currently hard-wired to "nobody") and
955 NOBODY_GROUP (set to either "nobody" or "nogroup" depending on what we
956 find in the /etc/group file).
957
958 - Added a test to the test suite, itemized.test, that tests the output of
959 -i (log-format w/%i) and some double-verbose messages.
960
961\f
a1c75ed0
WD
962NEWS for rsync 2.6.5 (1 Jun 2005)
963Protocol: 29 (unchanged)
964Changes since 2.6.4:
965
966 OUTPUT CHANGES:
967
968 - Non-printable chars in filenames are now output using backslash-
969 escaped characters rather than '?'s. Any non-printable character is
970 output using 3 digits of octal (e.g. "\n" -> "\012"), and a backslash
971 is now output as "\\". Rsync also uses your locale setting, which
972 can make it treat fewer high-bit characters as non-printable.
973
974 - If rsync received an empty file-list when pulling files, it would
975 output a "nothing to do" message and exit with a 0 (success) exit
976 status, even if the remote rsync returned an error (it did not do
977 this under the same conditions when pushing files). This was changed
978 to make the pulling behavior the same as the pushing behavior: we
979 now do the normal end-of-run outputting (depending on options) and
980 exit with the appropriate exit status.
981
982 BUG FIXES:
983
984 - A crash bug was fixed when a daemon had its "path" set to "/", did
985 not have chroot enabled, and used some anchored excludes in the
986 rsyncd.conf file.
987
988 - Fixed a bug in the transfer of a single file when -H is specified
989 (rsync would either infinite loop or perhaps crash).
990
991 - Fixed a case where the generator might try (and fail) to tweak the
992 write-permissions of a read-only directory in list-only mode (this
993 only caused an annoying warning message).
994
995 - If --compare-dest or --link-dest uses a locally-copied file as the
996 basis for an updated version, log this better when --verbose or -i
997 is in effect.
998
999 - Fixed the accidental disabling of --backup during the --delete-after
1000 processing.
1001
1002 - Restored the ability to use the --address option in client mode (in
1003 addition to its use in daemon mode).
1004
1005 - Make sure that some temporary progress information from the delete
1006 processing does not get left on the screen when it is followed by a
1007 newline.
1008
1009 - When --existing skips a directory with extra verbosity, refer to it
1010 as a "directory", not a "file".
1011
1012 - When transferring a single file to a different-named file, any
1013 generator messages that are source-file related no longer refer to
1014 the file by the destination filename.
1015
1016 - Fixed a bug where hard-linking a group of files might fail if the
1017 generator hasn't created a needed destination directory yet.
1018
1019 - Fixed a bug where a hard-linked group of files that is newly-linked
1020 to a file in a --link-dest dir doesn't link the files from the rest
1021 of the cluster.
1022
1023 - When deleting files with the --one-file-system (-x) option set, rsync
1024 no longer tries to remove files from inside a mount-point on the
1025 receiving side. Also, we don't complain about being unable to remove
1026 the mount-point dir.
1027
1028 - Fixed a compatibility problem when using --cvs-ignore (-C) and
1029 sending files to an older rsync without using --delete.
1030
1031 - Make sure that a "- !" or "+ !" include/exclude pattern does not
1032 trigger the list-clearing action that is reserved for "!".
1033
1034 - Avoid a timeout in the generator when the sender/receiver aren't
1035 handling the generator's checksum output quickly enough.
1036
1037 - Fixed the omission of some directories in the delete processing when
1038 --relative (-R) was combined with a source path that had a trailing
1039 slash.
1040
1041 - Fixed a case where rsync would erroneously delete some files and then
1042 re-transfer them when the options --relative (-R) and --recursive
1043 (-r) were both enabled (along with --delete) and a source path had a
1044 trailing slash.
1045
1046 - Make sure that --max-size doesn't affect a device or a symlink.
1047
1048 - Make sure that a system with a really small MAXPATHLEN does not cause
1049 the buffers in readfd_unbuffered() to be too small to receive normal
1050 messages. (This mainly affected Cygwin.)
1051
1052 - If a source pathname ends with a filename of "..", treat it as if
1053 "../" had been specified (so that we don't copy files to the parent
1054 dir of the destination).
1055
1056 - If --delete is combined with a file-listing rsync command (i.e. no
1057 transfer is happening), avoid outputting a warning that we couldn't
1058 delete anything.
1059
1060 - If --stats is specified with --delete-after, ensure that all the
1061 "deleting" messages are output before the statistics.
1062
1063 - Improved one "if" in the deletion code that was only checking errno
1064 for ENOTEMPTY when it should have also been checking for EEXIST (for
1065 compatibility with OS variations).
1066
1067 ENHANCEMENTS:
1068
1069 - Added the --only-write-batch=FILE option that may be used (instead
1070 of --write-batch=FILE) to create a batch file without doing any
1071 actual updating of the destination. This allows you to divert all
1072 the file-updating data away from a slow data link (as long as you
1073 are pushing the data to the remote server when creating the batch).
1074
1075 - When the generator is taking a long time to fill up its output buffer
1076 (e.g. if the transferred files are few, small, or missing), it now
1077 periodically flushes the output buffer so that the sender/receiver
1078 can get started on the files sooner rather than later.
1079
1080 - Improved the keep-alive code to handle a long silence between the
1081 sender and the receiver that can occur when the sender is receiving
1082 the checksum data for a large file.
1083
1084 - Improved the auth-errors that are logged by the daemon to include
1085 some information on why the authorization failed: wrong user,
1086 password mismatch, etc. (The client-visible message is unchanged!)
1087
1088 - Improved the client's handling of an "@ERROR" from a daemon so that
1089 it does not complain about an unexpectedly closed socket (since we
1090 really did expect the socket to close).
1091
1092 - If the daemon can't open the log-file specified in rsyncd.conf, fall
1093 back to using syslog and log an appropriate warning. This is better
1094 than what was typically a totally silent (and fatal) failure (since a
1095 daemon is not usually run with the --no-detach option that was
1096 necessary to see the error on stderr).
1097
1098 - The man pages now consistently refer to an rsync daemon as a "daemon"
1099 instead of a "server" (to distinguish it from the server process in a
1100 non-daemon transfer).
1101
1102 - Made a small change to the rrsync script (restricted rsync -- in the
1103 support dir) to make a read-only server reject all --remove-* options
1104 when sending files (to future-proof it against the possibility of
1105 other similar options being added at some point).
1106
1107 INTERNAL:
1108
1109 - Rsync now calls setlocale(LC_CTYPE, ""). This enables isprint() to
1110 better discern which filename characters need to be escaped in
1111 messages (which should result in fewer escaped characters in some
1112 locales).
1113
1114 - Improved the naming of the log-file open/reopen/close functions.
1115
1116 - Removed some protocol-compatibility code that was only needed to help
1117 someone running a pre-release of 2.6.4.
1118
1119 BUILD CHANGES:
1120
1121 - Added configure option "--disable-locale" to disable any use of
1122 setlocale() in the binary.
1123
1124 - Fixed a bug in the SUPPORT{,_HARD}_LINKS #defines which prevented
1125 rsync from being built without symlink or hard-link support.
1126
1127 - Only #define HAVE_REMSH if it is going to be set to 1.
1128
1129 - Configure now disables the use of mkstemp() under HP-UX (since they
1130 refuse to fix its broken handling of large files).
1131
1132 - Configure now explicitly checks for the lseek64() function so that
1133 the code can use HAVE_LSEEK64 instead of inferring lseek64()'s
1134 presence based on the presence of the off64_t type.
1135
1136 - Configure no longer mentions the change in the default remote-shell
1137 (from rsh to ssh) that occurred for the 2.6.0 release.
1138
1139 - Some minor enhancements to the test scripts.
1140
1141 - Added a few new *.diff files to the patches dir, including a patch
1142 that enables the optional copying of extended attributes.
1143
1144\f
1ad6a7f6
WD
1145NEWS for rsync 2.6.4 (30 March 2005)
1146Protocol: 29 (changed)
1147Changes since 2.6.3:
1148
1149 OUTPUT CHANGES:
1150
1151 - When rsync deletes a directory and outputs a verbose message about
1152 it, it now appends a trailing slash to the name instead of (only
1153 sometimes) outputting a preceding "directory " string.
1154
1155 - The --stats output will contain file-list time-statistics if both
1156 sides are 2.6.4, or if the local side is 2.6.4 and the files are
1157 being pushed (since the stats come from the sending side).
1158 (Requires protocol 29 for a pull.)
1159
1160 - The "%o" (operation) log-format escape now has a third value (besides
1161 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
1162 This changes the way deletions are logged in the daemon's log file.
1163
1164 - When the --log-format option is combined with --verbose, rsync now
1165 avoids outputting the name of the file twice in most circumstances.
1166 As long as the --log-format item does not refer to any post-transfer
1167 items (such as %b or %c), the --log-format message is output prior to
1168 the transfer, so --verbose is now the equivalent of a --log-format of
1169 '%n%L' (which outputs the name and any link info). If the log output
1170 must occur after the transfer to be complete, the only time the name
1171 is also output prior to the transfer is when --progress was specified
1172 (so that the name will precede the progress stats, and the full
1173 --log-format output will come after).
97e3c50c 1174
7c2a83c6
WD
1175 - Non-printable characters in filenames are replaced with a '?' to
1176 avoid corrupting the screen or generating empty lines in the output.
1ad6a7f6
WD
1177
1178 BUG FIXES:
1179
1180 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
1181 was only treating it as a special token in an rsync include/exclude
1182 file).
1183
1184 - The combination of --verbose and --dry-run now mentions the full list
1185 of changes that would be output without --dry-run.
1186
1187 - Avoid a mkdir warning when removing a directory in the destination
1188 that already exists in the --backup-dir.
1189
1190 - An OS that has a binary mode for its files (such as cygwin) needed
1191 setmode(fd, O_BINARY) called on the temp-file we opened with
10a1a3f5 1192 mkstemp(). (Fix derived from cygwin's 2.6.3 rsync package.)
1ad6a7f6
WD
1193
1194 - Fixed a potential hang when verbosity is high, the client side is
1195 the sender, and the file-list is large.
1196
1197 - Fixed a potential protocol-corrupting bug where the generator could
1198 merge a message from the receiver into the middle of a multiplexed
1199 packet of data if only part of that data had been written out to the
1200 socket when the message from the generator arrived.
1201
1202 - We now check if the OS doesn't support using mknod() for creating
1203 FIFOs and sockets, and compile-in some compatibility code using
1204 mkfifo() and socket() when necessary.
1205
1206 - Fixed an off-by-one error in the handling of --max-delete=N. Also,
1207 if the --max-delete limit is exceeded during a run, we now output a
1208 warning about this at the end of the run and exit with a new error
1209 code (25).
1210
1211 - One place in the code wasn't checking if fork() failed.
1212
1213 - The "ignore nonreadable" daemon parameter used to erroneously affect
1214 readable symlinks that pointed to a non-existent file.
1215
1216 - If the OS does not have lchown() and a chown() of a symlink will
1217 affect the referent of a symlink (as it should), we no longer try
1218 to set the user and group of a symlink.
1219
1220 - The generator now properly runs the hard-link loop and the dir-time
1221 rewriting loop after we're sure that the redo phase is complete.
1222
1223 - When --backup was specified with --partial-dir=DIR, where DIR is a
1224 relative path, the backup code was erroneously trying to backup a
1225 file that was put into the partial-dir.
1226
1227 - If a file gets resent in a single transfer and the --backup option is
1228 enabled along with --inplace, rsync no longer performs a duplicate
1229 backup (it used to overwrite the first backup with the failed file).
1230
1231 - One call to flush_write_file() was not being checked for an error.
1232
1233 - The --no-relative option was not being sent from the client to a
1234 server sender.
1235
1236 - If an rsync daemon specified "dont compress = ..." for a file and the
1237 client tried to specify --compress, the libz code was not handling a
1238 compression level of 0 properly. This could cause a transfer failure
1239 if the block-size for a file was large enough (e.g. rsync might have
1240 exited with an error for large files).
1241
1242 - Fixed a bug that would sometimes surface when using --compress and
1243 sending a file with a block-size larger than 64K (either manually
1244 specified, or computed due to the file being really large). Prior
1245 versions of rsync would sometimes fail to decompress the data
1246 properly, and thus the transferred file would fail its verification.
1247
1248 - If a daemon can't open the specified log file (i.e. syslog is not
1249 being used), die without crashing. We also output an error about
1250 the failure on stderr (which will only be seen if --no-detach was
1251 specified) and exit with a new error code (6).
1252
1253 - A local transfer no longer duplicates all its include/exclude options
1254 (since the forked process already has a copy of the exclude list,
1255 there's no need to send them a set of duplicates).
1256
7eb2ecda
WD
1257 - The output of the items that are being updated by the generator (dirs,
1258 symlinks, devices) is now intermingled in the proper order with the
1259 output from the items that the receiver is updating (regular files)
1260 when pulling. This misordering was particularly bad when --progress
1261 was specified. (Requires protocol 29.)
1ad6a7f6
WD
1262
1263 - When --timeout is specified, lulls that occur in the transfer while
1264 the generator is doing work that does not generate socket traffic
1265 (looking for changed files, deleting files, doing directory-time
1266 touch-ups, etc.) will cause a new keep-alive packet to be sent that
1267 should keep the transfer going as long as the generator continues to
1268 make progress. (Requires protocol 29.)
1269
1270 - The stat size of a device is not added to the total file size of the
1271 items in the transfer (the size might be undefined on some OSes).
1272
1273 - Fixed a problem with refused-option messages sometimes not making it
1274 back to the client side when a remote --files-from was in effect and
1275 the daemon was the receiver.
1276
0f9941dc 1277 - The --compare-dest option was not updating a file that differed in
1ad6a7f6
WD
1278 (the preserved) attributes from the version in the compare-dest DIR.
1279
1280 - When rsync is copying files into a write-protected directory, fixed
1281 the change-report output for the directory so that we don't report
1282 an identical directory as changed.
1283
1284 ENHANCEMENTS:
1285
1286 - Rsync now supports popt's option aliases, which means that you can
1287 use /etc/popt and/or ~/.popt to create your own option aliases.
1288
1289 - Added the --delete-during (--del) option which will delete files
1290 from the receiving side incrementally as each directory in the
1291 transfer is being processed. This makes it more efficient than the
1292 default, before-the-transfer behavior, which is now also available as
1293 --delete-before (and is still the default --delete-WHEN option that
1294 will be chosen if --delete or --delete-excluded is specified without
1295 a --delete-WHEN choice). All the --del* options infer --delete, so
1296 an rsync daemon that refuses "delete" will still refuse to allow any
1297 file-deleting options (including the new --remove-sent-files option).
1298
1299 - All the --delete-WHEN options are now more memory efficient:
1300 Previously an duplicate set of file-list objects was created on the
1301 receiving side for the entire destination hierarchy. The new
1302 algorithm only creates one directory of objects at a time (for files
1303 inside the transfer).
1304
1305 - Added the --copy-dest option, which works like --link-dest except
1306 that it locally copies identical files instead of hard-linking them.
1307
1308 - Added support for specifying multiple --compare-dest, --copy-dest, or
1309 --link-dest options, but only of a single type. (Promoted from the
1310 patches dir and enhanced.) (Requires protocol 29.)
1311
1312 - Added the --max-size option. (Promoted from the patches dir.)
1313
1314 - The daemon-mode options are now separated from the normal rsync
1315 options so that they can't be mixed together. This makes it
1316 impossible to start a daemon that has improper default option values
1317 (which could cause problems when a client connects, such as hanging
1318 or crashing).
1319
1320 - The --bwlimit option may now be used in combination with --daemon
1321 to specify both a default value for the daemon side and a value
1322 that cannot be exceeded by a user-specified --bwlimit option.
1323
1324 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
1325 the patches dir.) Also added "address". The command-line options
1326 take precedence over a config-file option, as expected.
1327
1328 - In _exit_cleanup(): when we are exiting with a partially-received
1329 file, we now flush any data in the write-cache before closing the
1330 partial file.
1331
1332 - The --inplace support was enhanced to work with --compare-dest,
1333 --link-dest, and (the new) --copy-dest options. (Requires protocol
1334 29.)
1335
1336 - Added the --dirs (-d) option for an easier way to copy directories
af6155bb
WD
1337 without recursion. Any directories that are encountered are created
1338 on the destination. Specifying a directory with a trailing slash
1339 copies its immediate contents to the destination.
1340
1341 - The --files-from option now implies --dirs (-d).
1ad6a7f6
WD
1342
1343 - Added the --list-only option, which is mainly a way for the client to
1344 put the server into listing mode without needing to resort to any
1345 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
1346 for a non-recursive listing). This option is used automatically
1347 (behind the scenes) when a modern rsync speaks to a modern daemon,
1348 but may also be specified manually if you want to force the use of
1349 the --list-only option over a remote-shell connection.
1350
1351 - Added the --omit-dir-times (-O) option, which will avoid updating
1352 the modified time for directories when --times was specified. This
1353 option will avoid an extra pass through the file-list at the end of
1354 the transfer (to tweak all the directory times), which may provide
1355 an appreciable speedup for a really large transfer. (Promoted from
1356 the patches dir.)
1357
1358 - Added the --filter (-f) option and its helper option, -F. Filter
1359 rules are an extension to the existing include/exclude handling
1360 that also supports nested filter files as well as per-directory
1361 filter files (like .cvsignore, but with full filter-rule parsing).
1362 This new option was chosen in order to ensure that all existing
1363 include/exclude processing remained 100% compatible with older
1364 versions. Protocol 29 is needed for full filter-rule support, but
1365 backward-compatible rules work with earlier protocol versions.
1366 (Promoted from the patches dir and enhanced.)
1367
1368 - Added the --delay-updates option that puts all updated files into
1369 a temporary directory (by default ".~tmp~", but settable via the
1370 --partial-dir=DIR option) until the end of the transfer. This
1371 makes the updates a little more atomic for a large transfer.
1372
1373 - If rsync is put into the background, any output from --progress is
1374 reduced.
1375
1376 - Documented the "max verbosity" setting for rsyncd.conf. (This
1377 setting was added a couple releases ago, but left undocumented.)
1378
1379 - The sender and the generator now double-check the file-list index
1380 they are given, and refuse to try to do a file transfer on a
1381 non-file index (since that would indicate that something had gone
1382 very wrong).
1383
1384 - Added the --itemize-changes (-i) option, which is a way to output a
1385 more detailed list of what files changed and in what way. The effect
1386 is the same as specifying a --log-format of "%i %n%L" (see both the
1387 rsync and rsyncd.conf manpages). Works with --dry-run too.
1388
1389 - Added the --fuzzy (-y) option, which attempts to find a basis file
1390 for a file that is being created from scratch. The current algorithm
1391 only looks in the destination directory for the created file, but it
1392 does attempt to find a match based on size/mod-time (in case the file
1393 was renamed with no other changes) as well as based on a fuzzy
1394 name-matching algorithm. This option requires protocol 29 because it
1395 needs the new file-sorting order. (Promoted from patches dir and
1396 enhanced.) (Requires protocol 29.)
1397
1398 - Added the --remove-sent-files option, which lets you move files
1399 between systems.
1400
1401 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
1402 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
1403 literals in the rsync://HOST:PORT/PATH format.)
1404
1405 - When rsync recurses to build the file list, it no longer keeps open
1406 one or more directory handles from the dir's parent dirs.
1407
1408 - When building under windows, the default for --daemon is now to
1409 avoid detaching, requiring the new --detach option to force rsync
1410 to detach.
1411
1412 - The --dry-run option can now be combined with either --write-batch or
1413 --read-batch, allowing you to run a do-nothing test command to see
1414 what would happen without --dry-run.
1415
1416 - The daemon's "read only" config item now sets an internal read_only
1417 variable that makes extra sure that no write/delete calls on the
1418 read-only side can succeed.
1419
1420 - The log-format % escapes can now have a numeric field width in
1421 between the % and the escape letter (e.g. "%-40n %08p").
1422
1423 - Improved the option descriptions in the --help text.
1424
1425 SUPPORT FILES:
1426
1427 - Added atomic-rsync to the support dir: a perl script that will
1428 transfer some files using rsync, and then move the updated files into
1429 place all at once at the end of the transfer. Only works when
1430 pulling, and uses --link-dest and a parallel hierarchy of files to
1431 effect its update.
1432
1433 - Added mnt-excl to the support dir: a perl script that takes the
1434 /proc/mounts file and translates it into a set of excludes that will
1435 exclude all mount points (even mapped mounts to the same disk). The
1436 excludes are made relative to the specified source dir and properly
1437 anchored.
1438
1439 - Added savetransfer.c to the support dir: a C program that can make
1440 a copy of all the data that flows over the wire. This lets you test
1441 for data corruption (by saving the data on both the sending side and
1442 the receiving side) and provides one way to debug a protocol error.
1443
1444 - Added rrsync to the support dir: this is an updated version of Joe
1445 Smith's restricted rsync perl script. This helps to ensure that only
1446 certain rsync commands can be run by an ssh invocation.
1447
1448 INTERNAL:
1449
1450 - Added better checking of the checksum-header values that come over
1451 the socket.
1452
1453 - Merged a variety of file-deleting functions into a single function so
1454 that it is easier to maintain.
1455
1456 - Improved the type of some variables (particularly blocksize vars) for
1457 consistency and proper size.
1458
1459 - Got rid of the uint64 type (which we didn't need).
1460
1461 - Use a slightly more compatible set of core #include directives.
1462
1463 - Defined int32 in a way that ensures that the build dies if we can't
1464 find a variable with at least 32 bits.
1465
1466 PROTOCOL DIFFERENCES FOR VERSION 29:
1467
1468 - A 16-bit flag-word is transmitted after every file-list index. This
1469 indicates what is changing between the sender and the receiver. The
1470 generator now transmits an index and a flag-word to indicate when
1471 dirs and symlinks have changed (instead of producing a message),
1472 which makes the outputting of the information more consistent and
1473 less prone to screen corruption (because the local receiver/sender is
1474 now outputting all the file-change info messages).
1475
1476 - If a file is being hard-linked, the ITEM_XNAME_FOLLOWS bit is enabled
1477 in the flag-word and the name of the file that was linked immediately
1478 follows in vstring format (see below).
1479
1480 - If a file is being transferred with an alternate-basis file, the
1481 ITEM_BASIS_TYPE_FOLLOWS bit is enabled in the flag-word and a single
1482 byte follows, indicating what type of basis file was chosen. If that
1483 indicates that a fuzzy-match was selected, the ITEM_XNAME_FOLLOWS bit
1484 is set in the flag-word and the name of the match in vstring format
1485 follows the basis byte. A vstring is a variable length string that
1486 has its size written prior to the string, and no terminating null.
1487 If the string is from 1-127 bytes, the length is a single byte. If
1488 it is from 128-32767 bytes, the length is written as ((len >> 8) |
1489 0x80) followed by (len % 0x100).
1490
1491 - The sending of exclude names is done using filter-rule syntax. This
1492 means that all names have a prefixed rule indicator, even excludes
1493 (which used to be sent as a bare pattern, when possible). The -C
1494 option will include the per-dir .cvsignore merge file in the list of
1495 filter rules so it is positioned correctly (unlike in some older
1496 transfer scenarios).
1497
1498 - Rsync sorts the filename list in a different way: it sorts the subdir
1499 names after the non-subdir names for each dir's contents, and it
1500 always puts a dir's contents immediately after the dir's name in the
1501 list. (Previously an item named "foo.txt" would sort in between
1502 directory "foo/" and "foo/bar".)
1503
1504 - When talking to a protocol 29 rsync daemon, a list-only request
1505 is able to note this before the options are sent over the wire and
1506 the new --list-only option is included in the options.
1507
1508 - When the --stats bytes are sent over the wire (or stored in a batch),
1509 they now include two elapsed-time values: one for how long it took to
1510 build the file-list, and one for how long it took to send it over the
1511 wire (each expressed in thousandths of a second).
1512
1513 - When --delete-excluded is specified with some filter rules (AKA
1514 excludes), a client sender will now initiate a send of the rules to
1515 the receiver (older protocols used to omit the sending of excludes in
1516 this situation since there were no receiver-specific rules that
1517 survived --delete-excluded back then). Note that, as with all the
1518 filter-list sending, only items that are significant to the other
1519 side will actually be sent over the wire, so the filter-rule list
1520 that is sent in this scenario is often empty.
1521
1522 - An index equal to the file-list count is sent as a keep-alive packet
1523 from the generator to the sender, which then forwards it on to the
1524 receiver. This normally invalid index is only a valid keep-alive
1525 packet if the 16-bit flag-word that follows it contains a single bit
1526 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
1527
1528 - A protocol-29 batch file includes a bit for the setting of the --dirs
1529 option and for the setting of the --compress option. Also, the shell
1530 script created by --write-batch will use the --filter option instead
1531 of --exclude-from to capture any filter rules.
1532
1533 BUILD CHANGES:
1534
1535 - Handle an operating system that use mkdev() in place of makedev().
1536
1537 - Improved configure to better handle cross-compiling.
a1c75ed0
WD
1538
1539\f
ca39ebf9
WD
1540NEWS for rsync 2.6.3 (30 Sep 2004)
1541Protocol: 28 (unchanged)
1542Changes since 2.6.2:
1543
1544 SECURITY FIXES:
1545
1546 - A bug in the sanitize_path routine (which affects a non-chrooted
1547 rsync daemon) could allow a user to craft a pathname that would get
1548 transformed into an absolute path for certain options (but not for
1549 file-transfer names). If you're running an rsync daemon with chroot
1550 disabled, *please upgrade*, ESPECIALLY if the user privs you run
1551 rsync under is anything above "nobody".
1552
1553 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
1554
1555 - Please note that the 2-line footer (output when verbose) now uses the
1556 term "sent" instead of "wrote" and "received" instead of "read". If
1557 you are not parsing the numeric values out of this footer, a script
1558 would be better off using the empty line prior to the footer as the
1559 indicator that the verbose output is over.
1560
1561 - The output from the --stats option was similarly affected to change
1562 "written" to "sent" and "read" to "received".
1563
1564 - Rsync ensures that a filename that contains a newline gets mentioned
1565 with each newline transformed into a question mark (which prevents a
1566 filename from causing an empty line to be output).
1567
1568 - The "backed up ..." message that is output when at least 2 --verbose
1569 options are specified is now the same both with and without the
1570 --backup-dir option.
1571
1572 BUG FIXES:
1573
1574 - Fixed a crash bug that might appear when --delete was used and
1575 multiple source directories were specified.
1576
1577 - Fixed a 32-bit truncation of the file length when generating the
1578 checksums.
1579
1580 - The --backup code no longer attempts to create some directories
1581 over and over again (generating warnings along the way).
1582
1583 - Fixed a bug in the reading of the secrets file (by the daemon) and
1584 the password file (by the client): the files no longer need to be
1585 terminated by a newline for their content to be read in.
1586
1587 - If a file has a read error on the sending side or the reconstructed
1588 data doesn't match the expected checksum (perhaps due to the basis
1589 file changing during the transfer), the receiver will no longer
1590 retain the resulting file unless the --partial option was specified.
1591 (Note: for the read-error detection to work, neither side can be
1592 older than 2.6.3 -- older receivers will always retain the file, and
1593 older senders don't tell the receiver that the file had a read
1594 error.)
1595
1596 - If a file gets resent in a single transfer and the --backup option
1597 is enabled, rsync no longer performs a duplicate backup (it used to
1598 overwrite the original file in the backup area).
1599
1600 - Files specified in the daemon's "exclude" or "exclude from" config
1601 items are now excluded from being uploaded (assuming that the module
1602 allows uploading at all) in addition to the old download exclusion.
1603
1604 - Got rid of a potential hang in the receiver when near the end of a
1605 phase.
1606
1607 - When using --backup without a --backup-dir, rsync no longer preserves
1608 the modify time on directories. This avoids confusing NFS.
1609
1610 - When --copy-links (-L) is specified, we now output a separate error
1611 for a symlink that has no referent instead of claiming that a file
1612 "vanished".
1613
1614 - The --copy-links (-L) option no longer has the side-effect of telling
1615 the receiving side to follow symlinks. See the --keep-dirlinks
1616 option (mentioned below) for a way to specify that behavior.
1617
1618 - Error messages from the daemon server's option-parsing (such as
1619 refused options) are now successfully transferred back to the client
1620 (the server used to fail to send the message because the socket
1621 wasn't in the right state for the message to get through).
1622
1623 - Most transfer errors that occur during a daemon transfer are now
1624 returned to the user in addition to being logged (some messages are
1625 intended to be daemon-only and are not affected by this).
1626
1627 - Fixed a bug in the daemon authentication code when using one of the
1628 batch-processing options.
1629
1630 - We try to work around some buggy IPv6 implementations that fail to
1631 implement IPV6_V6ONLY. This should fix the "address in use" error
1632 that some daemons get when running on an OS with a buggy IPv6
1633 implementation. Also, if the new code gets this error, we might
1634 suggest that the user specify --ipv4 or --ipv6 (if we think it will
1635 help).
1636
1637 - When the remote rsync dies, make a better effort to recover any error
1638 messages it may have sent before dying (the local rsync used to just
1639 die with a socket-write error).
1640
1641 - When using --delete and a --backup-dir that contains files that are
1642 hard-linked to their destination equivalents, rsync now makes sure
1643 that removed files really get removed (avoids a really weird rename()
1644 behavior).
1645
1646 - Avoid a bogus run-time complaint about a lack of 64-bit integers when
1647 the int64 type is defined as an off_t and it actually has 64-bits.
1648
1649 - Added a configure check for open64() without mkstemp64() so that we
1650 can avoid using mkstemp() when such a combination is encountered.
1651 This bypasses a problem writing out large temp files on OSes such as
1652 AIX and HP-UX.
1653
1654 - Fixed an age-old crash problem with --read-batch on a local copy
1655 (rsync was improperly assuming --whole-file for the local copy).
1656
1657 - When --dry-run (-n) is used and the destination directory does not
1658 exist, rsync now produces a correct report of files that would be
1659 sent instead of dying with a chdir() error.
1660
1661 - Fixed a bug that could cause a slow-to-connect rsync daemon to die
1662 with an error instead of waiting for the connection to finish.
1663
1664 - Fixed an ssh interaction that could cause output to be lost when the
1665 user chose to combine the output of rsync's stdout and stderr (e.g.
1666 using the "2>&1").
1667
920240a6
WD
1668 - Fixed an option-parsing bug when --files-from got passed to a daemon.
1669
ca39ebf9
WD
1670 ENHANCEMENTS:
1671
1672 - Added the --partial-dir=DIR option that lets you specify where to
1673 (temporarily) put a partially transferred file (instead of over-
1674 writing the destination file). E.g. --partial-dir=.rsync-partial
1675 Also added support for the RSYNC_PARTIAL_DIR environment variable
1676 that, when found, transforms a regular --partial option (such as
1677 the convenient -P option) into one that also specifies a directory.
1678
1679 - Added --keep-dirlinks (-K), which allows you to symlink a directory
1680 onto another partition on the receiving side and have rsync treat it
1681 as matching a normal directory from the sender.
1682
1683 - Added the --inplace option that tells rsync to write each destination
1684 file without using a temporary file. The matching of existing data
1685 in the destination file can be severely limited by this, but there
1686 are also cases where this is more efficient (such as appending data).
1687 Use only when needed (see the man page for more details).
1688
1689 - Added the "write only" option for the daemon's config file.
1690
1691 - Added long-option names for -4 and -6 (namely --ipv4 and --ipv6)
1692 and documented all these options in the man page.
1693
1694 - Improved the handling of the --bwlimit option so that it's less
1695 bursty, more accurate, and works properly over a larger range of
1696 values.
1697
1698 - The rsync daemon-over-ssh code now looks for SSH_CONNECTION and
1699 SSH2_CLIENT in addition to SSH_CLIENT to figure out the IP address.
1700
1701 - Added the --checksum-seed=N option for advanced users.
1702
1703 - Batch writing/reading has a brand-new implementation that is simpler,
1704 fixes a few weird problems with the old code (such as no longer
1705 sprinkling the batch files into different dirs or even onto different
1706 systems), and is much less intrusive into the code (making it easier
1707 to maintain for the future). The new code generates just one data
1708 file instead of three, which makes it possible to read the batch on
1709 stdin via a remote shell. Also, the old requirement of forcing the
1710 same fixed checksum-seed for all batch processing has been removed.
1711
1712 - If an rsync daemon has a module set with "list = no" (which hides its
1713 presence in the list of available modules), a user that fails to
1714 authenticate gets the same "unknown module" error that they would get
1715 if the module were actually unknown (while still logging the real
1716 error to the daemon's log file). This prevents fishing for module
1717 names.
1718
1719 - The daemon's "refuse options" config item now allows you to match
1720 option names using wildcards and/or the single-letter option names.
1721
1722 - Each transferred file now gets its permissions and modified-time
1723 updated before the temp-file gets moved into place. Previously, the
1724 finished file would have a very brief window where its permissions
1725 disallowed all group and world access.
1726
1727 - Added the ability to parse a literal IPv6 address in an "rsync:" URL
1728 (e.g. rsync://[2001:638:500:101::21]:873/module/dir).
1729
1730 - The daemon's wildcard expanding code can now handle more than 1000
1731 filenames (it's now limited by memory instead of having a hard-wired
1732 limit).
1733
1734 INTERNAL:
1735
1736 - Some cleanup in the exclude code has saved some per-exclude memory
1737 and made the code easier to maintain.
1738
1739 - Improved the argv-overflow checking for a remote command that has a
1740 lot of args.
1741
1742 - Use rsyserr() in the various places that were still calling rprintf()
1743 with strerror() as an arg.
1744
1745 - If an rsync daemon is listening on multiple sockets (to handle both
1746 IPv4 and IPv6 to a single port), we now close all the unneeded file
1747 handles after we accept a connection (we used to close just one of
1748 them).
1749
1750 - Optimized the handling of larger block sizes (rsync used to slow to a
1751 crawl if the block size got too large).
1752
1753 - Optimized away a loop in hash_search().
1754
1755 - Some improvements to the sanitize_path() and clean_fname() functions
1756 makes them more efficient and produce better results (while still
1757 being compatible with the file-name cleaning that gets done on both
1758 sides when sending the file-list).
1759
1760 - Got rid of alloc_sanitize_path() after adding a destination-buffer
1761 arg to sanitize_path() made it possible to put all the former's
1762 functionality into the latter.
1763
1764 - The file-list that is output when at least 4 verbose options are
1765 specified reports the uid value on the sender even when rsync is
1766 not running as root (since we might be sending to a root receiver).
1767
1768 BUILD CHANGES:
1769
1770 - Added a "gen" target to rebuild most of the generated files,
1771 including configure, config.h.in, the man pages, and proto.h.
1772
1773 - If "make proto" doesn't find some changes in the prototypes, the
1774 proto.h file is left untouched (its time-stamp used to always be
1775 updated).
1776
1777 - The variable $STRIP (that is optionally set by the install-strip
1778 target's rule) was changed to $INSTALL_STRIP because some systems
1779 have $STRIP already set in the environment.
1780
1781 - Fixed a build problem when SUPPORT_HARD_LINKS isn't defined.
1782
1783 - When cross-compiling, the gettimeofday() function is now assumed to
1784 be a modern version that takes two-args (since we can't test it).
1785
1786 DEVELOPER RELATED:
1787
1788 - The scripts in the testsuite dir were cleaned up a bit and a few
1789 new tests added.
1790
1791 - Some new diffs were added to the patches dir, and some accepted
1792 ones were removed.
1793
1794\f
c7be6dec
WD
1795NEWS for rsync 2.6.2 (30 Apr 2004)
1796Protocol: 28 (unchanged)
1797Changes since 2.6.1:
1798
1799 BUG FIXES:
1800
1801 - Fixed a major bug in the sorting of the filenames when --relative
1802 is used for some sources (just sources such as "/" and "/*" were
1803 affected). This fix ensures that we ask for the right file-list
1804 item when requesting changes from the sender.
1805
1806 - Rsync now checks the return value of the close() function to
1807 better report disk-full problems on an NFS file system.
1808
1809 - Restored the old daemon-server behavior of logging error messages
1810 rather than returning them to the user. (A better long-term fix
1811 will be sought in the future.)
1812
1813 - An obscure uninitialized-variable bug was fixed in the uid/gid
1814 code. (This bug probably had no ill effects.)
1815
1816 BUILD CHANGES:
1817
1818 - Got rid of the configure check for sys/sysctl.h (it wasn't used
1819 and was causing a problem on some systems). Also improved the
1820 broken-largefile-locking test to try to avoid failure due to an
1821 NFS build-dir.
1822
1823 - Fixed a compile problem on systems that don't define
1824 AI_NUMERICHOST.
1825
1826 - Fixed a compile problem in the popt source for compilers that
1827 don't support __attribute__.
1828
1829 DEVELOPER RELATED:
1830
1831 - Improved the testsuite's "merge" test to work on OSF1.
1832
1833 - Two new diffs were added to the patches dir.
1834
1835\f
1836NEWS for rsync 2.6.1 (26 Apr 2004)
1837Protocol: 28 (changed)
1838Changes since 2.6.0:
1839
1840 SECURITY FIXES:
1841
1842 - Paths sent to an rsync daemon are more thoroughly sanitized when
1843 chroot is not used. If you're running a non-read-only rsync
1844 daemon with chroot disabled, *please upgrade*, ESPECIALLY if the
1845 user privs you run rsync under is anything above "nobody".
1846
1847 ENHANCEMENTS:
1848
1849 - Lower memory use, more optimal transfer of data over the socket,
1850 and lower CPU usage (see the INTERNAL section for details).
1851
1852 - The RSYNC_PROXY environment variable can now contain a
1853 "USER:PASS@" prefix before the "HOST:PORT" information.
1854 (Bardur Arantsson)
1855
1856 - The --progress output now mentions how far along in the transfer
1857 we are, including both a count of files transferred and a
1858 percentage of the total file-count that we've processed. It also
1859 shows better current-rate-of-transfer and remaining-transfer-time
1860 values.
1861
1862 - Documentation changes now attempt to describe some often mis-
1863 understood features more clearly.
1864
1865 BUG FIXES:
1866
1867 - When -x (--one-file-system) is combined with -L (--copy-links) or
1868 --copy-unsafe-links, no symlinked files are skipped, even if the
1869 referent file is on a different filesystem.
1870
1871 - The --link-dest code now works properly for a non-root user when
1872 (1) the UIDs of the source and destination differ and -o was
1873 specified, or (2) when the group of the source can't be used on
1874 the destination and -g was specified.
1875
1876 - Fixed a bug in the handling of -H (hard-links) that might cause
1877 the expanded PATH/NAME value of the current item to get
1878 overwritten (due to an expanded-name caching bug).
1879
1880 - We now reset the "new data has been sent" flag at the start of
1881 each file we send. This makes sure that an interrupted transfer
1882 with the --partial option set doesn't keep a shorter temp file
10a1a3f5 1883 than the current basis file when no new data has been transferred
c7be6dec
WD
1884 over the wire for that file.
1885
1886 - Fixed a byte-order problem in --batch-mode on big-endian machines.
1887 (Jay Fenlason)
1888
1889 - When using --cvs-exclude, the exclude items we get from a
1890 per-directory's .cvsignore file once again only affect that one
1891 directory (not all following directories too). The items are also
1892 now properly word-split and parsed without any +/- prefix parsing.
1893
1894 - When specifying the USER@HOST: prefix for a file, the USER part
1895 can now contain an '@', if needed (i.e. the last '@' is used to
1896 find the HOST, not the first).
1897
1898 - Fixed some bugs in the handling of group IDs for non-root users:
1899 (1) It properly handles a group that the sender didn't have a name
1900 for (it would previously skip changing the group on any files in
1901 that group). (2) If --numeric-ids is used, rsync no longer
1902 attempts to set groups that the user doesn't have the permission
1903 to set.
1904
1905 - Fixed the "refuse options" setting in the rsyncd.conf file.
1906
1907 - Improved the -x (--one-file-system) flag's handling of any mount-
1908 point directories we encounter. It is both more optimal (in that
1909 it no longer does a useless scan of the contents of the mount-
1910 point dirs) and also fixes a bug where a remapped mount of the
1911 original filesystem could get discovered in a subdir we should be
1912 ignoring.
1913
1914 - Rsync no longer discards a double-slash at the start of a filename
1915 when trying to open the file. It also no longer constructs names
1916 that start with a double slash (unless the user supplied them).
1917
1918 - Path-specifying options to a daemon should now work the same with
1919 or without chroot turned on. Previously, such a option (such as
1920 --link-dest) would get its absolute path munged into a relative
1921 one if chroot was not on, making that setting fairly useless.
1922 Rsync now transforms the path into one that is based on the
1923 module's base dir when chroot is not enabled.
1924
1925 - Fixed a compatibility problem interacting with older rsync
1926 versions that might send us an empty --suffix value without
1927 telling us that --backup-dir was specified.
1928
1929 - The "hosts allow" option for a daemon-over-remote-shell process
1930 now has improved support for IPv6 addresses and a fix for systems
1931 that have a length field in their socket structs.
1932
1933 - Fixed the ability to request an empty backup --suffix when sending
1934 files to an rsync daemon.
1935
920240a6
WD
1936 - Fixed an option-parsing bug when --files-from was sent to a server
1937 sender.
1938
c7be6dec
WD
1939 INTERNAL:
1940
1941 - Most of the I/O is now buffered, which results in a pretty large
1942 speedup when running under MS Windows. (Craig Barratt)
1943
1944 - Optimizations to the name-handling/comparing code have made some
1945 significant reductions in user-CPU time for large file sets.
1946
1947 - Some cleanup of the variable types make the code more consistent.
1948
1949 - Reduced memory requirements of hard link preservation.
1950 (J.W. Schultz)
1951
1952 - Implemented a new algorithm for hard-link handling that speeds up
1953 the code significantly. (J.W. Schultz and Wayne Davison)
1954
1955 - The --hard-link option now uses the first existing file in the
1956 group of linked files as the basis for the transfer. This
1957 prevents the sub-optimal transfer of a file's data when a new
1958 hardlink is added on the sending side and it sorts alphabetically
1959 earlier in the list than the files that are already present on the
1960 receiving side.
1961
1962 - Dropped support for protocol versions less than 20 (2.3.0 released
1963 15 Mar 1999) and activated warnings for protocols less than 25
1964 (2.5.0 released 23 Aug 2001). (Wayne Davison and J.W. Schultz,
1965 severally)
1966
1967 - More optimal data transmission for --hard-links (protocol 28).
1968
1969 - More optimal data transmission for --checksum (protocol 28).
1970
1971 - Less memory is used when --checksum is specified.
1972
1973 - Less memory is used in the file list (a per-file savings).
1974
1975 - The generator is now better about not modifying the file list
1976 during the transfer in order to avoid a copy-on-write memory
1977 bifurcation (on systems where fork() uses shared memory).
1978 Previously, rsync's shared memory would slowly become unshared,
1979 resulting in real memory usage nearly doubling on the receiving
1980 side by the end of the transfer. Now, as long as permissions
1981 are being preserved, the shared memory should remain that way
1982 for the entire transfer.
1983
1984 - Changed hardlink info and file_struct + strings to use allocation
1985 pools. This reduces memory use for large file-sets and permits
1986 freeing memory to the OS. (J.W. Schultz)
1987
1988 - The 2 pipes used between the receiver and generator processes
1989 (which are forked on the same machine) were reduced to 1 pipe and
1990 the protocol improved so that (1) it is now impossible to have the
1991 "redo" pipe fill up and hang rsync, and (2) trailing messages from
1992 the receiver don't get lost on their way through the generator
1993 over to the sender (which mainly affected hard-link messages and
1994 verbose --stats output).
1995
1996 - Improved the internal uid/gid code to be more portable and a
1997 little more optimized.
1998
1999 - The device numbers sent when using --devices are now sent as
2000 separate major/minor values with 32-bit accuracy (protocol 28).
2001 Previously, the copied devices were sent as a single 32-bit
2002 number. This will make inter-operation of 64-bit binaries more
2003 compatible with their 32-bit brethren (with both ends of the
2004 connection are using protocol 28). Note that optimizations in the
2005 binary protocol for sending the device numbers often results in
2006 fewer bytes being used than before, even though more precision is
2007 now available.
2008
2009 - Some cleanup of the exclude/include structures and its code made
2010 things clearer (internally), simpler, and more efficient.
2011
2012 - The reading & writing of the file-list in batch-mode is now
2013 handled by the same code that sends & receives the list over the
2014 wire. This makes it much easier to maintain. (Note that the
2015 batch code is still considered to be experimental.)
2016
2017 BUILD CHANGES:
2018
2019 - The configure script now accepts --with-rsyncd-conf=PATH to
2020 override the default value of the /etc/rsyncd.conf file.
2021
2022 - Fixed configure bug when running "./configure --disable-ipv6".
2023
2024 - Fixed compilation problem on Tru64 Unix (having to do with
2025 sockaddr.sa_len and sockaddr.sin_len).
2026
2027 DEVELOPER RELATED:
2028
2029 - Fixed "make test" bug when build dir is not the source dir.
2030
2031 - Added a couple extra diffs in the "patches" dir, removed the ones
2032 that got applied, and rebuilt the rest.
2033
2034\f
0f1aa0d3
WD
2035NEWS for rsync 2.6.0 (1 Jan 2004)
2036Protocol: 27 (changed)
2037Changes since 2.5.7:
2038
2039 ENHANCEMENTS:
2040
2041 * "ssh" is now the default remote shell for rsync. If you want to
2042 change this, configure like this: "./configure --with-rsh=rsh".
2043
2044 * Added --files-from, --no-relative, --no-implied-dirs, and --from0.
2045 Note that --from0 affects the line-ending character for all the
2046 files read by the --*-from options. (Wayne Davison)
2047
2048 * Length of csum2 is now per-file starting with protocol version
2049 27. (J.W. Schultz)
2050
2051 * Per-file dynamic block size is now sqrt(file length). The
2052 per-file checksum size is determined according to an algorithm
2053 provided by Donovan Baarda which reduces the probability of rsync
2054 algorithm corrupting data and falling back using the whole md4
2055 checksums. (J.W. Schultz, Donovan Baarda)
2056
2057 * The --stats option no longer includes the (debug) malloc summary
2058 unless the verbose option was specified at least twice.
2059
2060 * Added a new error/warning code for when files vanish from the
2061 sending side. Made vanished source files not interfere with the
2062 file-deletion pass when --delete-after was specified.
2063
2064 * Various trailing-info sections are now preceded by a newline.
2065
2066 BUG FIXES:
2067
2068 * Fixed several exclude/include matching bugs when using wild-cards.
2069 This has a several user-visible effects, all of which make the
2070 matching more consistent and intuitive. This should hopefully not
2071 cause anyone problems since it makes the matching work more like
2072 what people are expecting. (Wayne Davison)
2073
2074 - A pattern with a "**" no longer causes a "*" to match slashes.
2075 For example, with "/*/foo/**", "foo" must be 2 levels deep.
2076 [If your string has BOTH "*" and "**" wildcards, changing the
2077 "*" wildcards to "**" will provide the old behavior in all
2078 versions.]
2079
2080 - "**/foo" now matches at the base of the transfer (like /foo
2081 does). [Use "/**/foo" to get the old behavior in all versions.]
2082
2083 - A non-anchored wildcard term floats to match beyond the base of
2084 the transfer. E.g. "CVS/R*" matches at the end of the path,
2085 just like the non-wildcard term "CVS/Root" does. [Use "/CVS/R*"
2086 to get the old behavior in all versions.]
2087
2088 - Including a "**" in the match term causes it to be matched
2089 against the entire path, not just the name portion, even if
2090 there aren't any interior slashes in the term. E.g. "foo**bar"
2091 would exclude "/path/foo-bar" (just like before) as well as
2092 "/foo-path/baz-bar" (unlike before). [Use "foo*bar" to get the
2093 old behavior in all versions.]
2094
2095 * The exclude list specified in the daemon's config file is now
2096 properly applied to the pulled items no matter how deep the
2097 user's file-args are in the source tree. (Wayne Davison)
2098
2099 * For protocol version >= 27, mdfour_tail() is called when the
2100 block size (including checksum_seed) is a multiple of 64.
2101 Previously it was not called, giving the wrong MD4 checksum.
2102 (Craig Barratt)
2103
2104 * For protocol version >= 27, a 64 bit bit counter is used in
2105 mdfour.c as required by the RFC. Previously only a 32 bit bit
2106 counter was used, causing incorrect MD4 file checksums for
2107 file sizes >= 512MB - 4. (Craig Barratt)
2108
2109 * Fixed a crash bug when interacting with older rsync versions and
2110 multiple files of the same name are destined for the same dir.
2111 (Wayne Davison)
2112
2113 * Keep tmp names from overflowing MAXPATHLEN.
2114
2115 * Make --link-dest honor the absence of -p, -o, and -g.
2116
2117 * Made rsync treat a trailing slash in the destination in a more
2118 consistent manner.
2119
2120 * Fixed file I/O error detection. (John Van Essen)
2121
2122 * Fixed bogus "malformed address {hostname}" message in rsyncd log
2123 when checking IP address against hostnames from "hosts allow"
2124 and "hosts deny" parameters in config file.
2125
2126 * Print heap statistics when verbose >= 2 instead of when >= 1.
2127
2128 * Fixed a compression (-z) bug when syncing a mostly-matching file
2129 that contains already-compressed data. (Yasuoka Masahiko and
2130 Wayne Davison)
2131
2132 * Fixed a bug in the --backup code that could cause deleted files
2133 to not get backed up.
2134
2135 * When the backup code makes new directories, create them with mode
2136 0700 instead of 0755 (since the directory permissions in the
2137 backup tree are not yet copied from the main tree).
2138
2139 * Call setgroups() in a more portable manner.
2140
2141 * Improved file-related error messages to better indicate exactly
2142 what pathname failed. (Wayne Davison)
2143
2144 * Fixed some bugs in the handling of --delete and --exclude when
2145 using the --relative (-R) option. (Wayne Davison)
2146
2147 * Fixed bug that prevented regular files from replacing
2148 special files and caused a directory in --link-dest or
2149 --compare-dest to block the creation of a file with the
2150 same path. A directory still cannot be replaced by a
2151 regular file unless --delete specified. (J.W. Schultz)
2152
2153 * Detect and report when open or opendir succeed but read and
2154 readdir fail caused by network filesystem issues and truncated
2155 files. (David Norwood, Michael Brown, J.W. Schultz)
2156
2157 * Added a fix that should give ssh time to restore the tty settings
2158 if the user presses Ctrl-C at an ssh password prompt.
2159
2160 INTERNAL:
2161
2162 * Eliminated vestigial support for old versions that we stopped
2163 supporting. (J.W. Schultz)
2164
2165 * Simplified some of the option-parsing code. (Wayne Davison)
2166
2167 * Some cleanup made to the exclude code, as well as some new
2168 defines added to enhance readability. (Wayne Davison)
2169
2170 * Changed the protocol-version code so that it can interact at a
2171 lower protocol level than the maximum supported by both sides.
2172 Added an undocumented option, --protocol=N, to force the value
2173 we advertise to the other side (primarily for testing purposes).
2174 (Wayne Davison)
2175
2176\f
276877cf
WD
2177NEWS for rsync 2.5.7 (4 Dec 2003)
2178Protocol: 26 (unchanged)
2179Changes since 2.5.6:
2180
2181 SECURITY FIXES:
2182
2183 * Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul
2184 Russell, Andrea Barisani)
2185
2186\f
2187NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
2188Protocol: 26 (unchanged)
2189Changes since 2.5.5:
2190
2191 ENHANCEMENTS:
2192
2193 * The --delete-after option now implies --delete. (Wayne Davison)
2194
2195 * The --suffix option can now be used with --backup-dir. (Michael
2196 Zimmerman)
2197
a923437b 2198 * Combining "::" syntax with the --rsh/-e option now uses the
276877cf
WD
2199 specified remote-shell as a transport to talk to a (newly-spawned)
2200 server-daemon. This allows someone to use daemon features, such
2201 as modules, over a secure protocol, such as ssh. (JD Paul)
2202
2203 * The rsync:// syntax for daemon connections is now accepted in the
2204 destination field.
2205
2206 * If the file name given to --include-from or --exclude-from is "-",
2207 rsync will read from standard input. (J.W. Schultz)
2208
2209 * New option --link-dest which is like --compare-dest except that
2210 unchanged files are hard-linked in to the destination directory.
2211 (J.W. Schultz)
2212
2213 * Don't report an error if an excluded file disappears during an
2214 rsync run. (Eugene Chupriyanov and Bo Kersey)
2215
2216 * Added .svn to --cvs-exclude list to support subversion. (Jon
2217 Middleton)
2218
2219 * Properly support IPv6 addresses in the rsyncd.conf "hosts allow"
2220 and "hosts deny" fields. (Hideaki Yoshifuji)
2221
2222 * Changed exclude file handling to permit DOS or MAC style line
2223 terminations. (J.W. Schultz)
2224
2225 * Ignore errors from chmod when -p/-a/--preserve-perms is not set.
2226 (Dave Dykstra)
2227
2228 BUG FIXES:
2229
2230 * Fix "forward name lookup failed" errors on AIX 4.3.3. (John
2231 L. Allen, Martin Pool)
2232
2233 * Generate each file's rolling-checksum data as we send it, not
2234 in a separate (memory-eating) pass before hand. This prevents
2235 timeout errors on really large files. (Stefan Nehlsen)
2236
2237 * Fix compilation on Tru64. (Albert Chin, Zoong Pham)
2238
2239 * Better handling of some client-server errors. (Martin Pool)
2240
2241 * Fixed a crash that would occur when sending a list of files that
2242 contains a duplicate name (if it sorts to the end of the file
2243 list) and using --delete. (Wayne Davison)
2244
2245 * Fixed the file-name duplicate-removal code when dealing with multiple
2246 dups in a row. (Wayne Davison)
2247
2248 * Fixed a bug that caused rsync to lose the exit status of its child
2249 processes and sometimes return an exit code of 0 instead of showing
2250 an error. (David R. Staples, Dave Dykstra)
2251
2252 * Fixed bug in --copy-unsafe-links that caused it to be completely
2253 broken. (Dave Dykstra)
2254
2255 * Prevent infinite recursion in cleanup code under certain circumstances.
2256 (Sviatoslav Sviridov and Marc Espie)
2257
2258 * Fixed a bug that prevented rsync from creating intervening directories
2259 when --relative-paths/-R is set. (Craig Barratt)
2260
2261 * Prevent "Connection reset by peer" messages from Cygwin. (Randy O'Meara)
2262
2263 INTERNAL:
2264
2265 * Many code cleanups and improved internal documentation. (Martin
2266 Pool, Nelson Beebe)
2267
2268 * Portability fixes. (Dave Dykstra and Wayne Davison)
2269
2270 * More test cases. (Martin Pool)
2271
2272 * Some test-case fixes. (Brian Poole, Wayne Davison)
2273
2274 * Updated included popt to the latest vendor drop, version 1.6.4.
2275 (Jos Backus)
2276
2277 * Updated config.guess and config.sub to latest versions; this
2278 means rsync should build on more platforms. (Paul Green)
2279
2280\f
2281NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
2282Protocol: 26 (unchanged)
2283Changes since 2.5.4:
54c7298c
MP
2284
2285 ENHANCEMENTS:
2286
2287 * With --progress, when a transfer is complete show the time taken;
2288 otherwise show expected time to complete. (Cameron Simpson)
2289
2290 * Make "make install-strip" works properly, and "make install"
2291 accepts a DESTDIR variable for help in building binary packages.
2292 (Peter Breitenlohner, Greg Louis)
2293
2294 * If configured with --enable-maintainer-mode, then on receipt of
2295 a fatal signal rsync will try to open an xterm running gdb,
2296 similarly to Samba's "panic action" or GNOME's bug-buddy.
2297 (Martin Pool)
2298
2299
2300 BUG FIXES:
2301
2302 * Fix situation where failure to fork (e.g. because out of process
2303 slots) would cause rsync to kill all processes owned by the
2304 current user. Yes, really! (Paul Haas, Martin Pool)
2305
2306 * Fix test suite on Solaris. (Jos Backus, Martin Pool)
2307
2308 * Fix minor memory leak in socket code. (Dave Dykstra, Martin
2309 Pool.)
2310
2311 * Fix --whole-file problem that caused it to be the default even
2312 for remote connections. (Martin Pool, Frank Schulz)
2313
2314 * Work around bug in Mac OS X mkdir(2), which cannot handle
2315 trailing slashes.
2316 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html>
2317 (Martin Pool)
2318
2319 * Improved network error handling. (Greg A. Woods)
2320
2321\f
276877cf
WD
2322NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
2323Protocol: 26 (unchanged)
2324Changes since 2.5.3:
c9a66d41
MP
2325
2326 BUG FIXES:
2327
2328 * Additional fix for zlib double-free bug. (Martin Pool, Andrew
2329 Tridgell) (CVE CAN-2002-0059)
276877cf 2330
c9a66d41
MP
2331 ENHANCEMENTS:
2332
2333 * Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus)
2334 (Note that rsync still uses a custom version of zlib; you can
2335 not just link against a system library. See zlib/README.rsync)
2336
2337 * Additional test cases for --compress. (Martin Pool)
2338
2339\f
276877cf
WD
2340NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
2341Protocol: 26 (unchanged)
2342Changes since 2.5.2:
d40fb723
MP
2343
2344 SECURITY FIXES:
2345
2346 * Make sure that supplementary groups are removed from a server
2347 process after changing uid and gid. (Ethan Benson) (Debian bug
2348 #132272, CVE CAN-2002-0080)
2349
2350 BUG FIXES:
2351
2352 * Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE
2353 CAN-2002-0059)
2354
276877cf 2355 * Fixed problem that in many cases caused the error message
d40fb723
MP
2356 unexpected read size of 0 in map_ptr
2357 and resulted in the wrong data being copied.
2358
2359 * Fixed compilation errors on some systems caused by the use of
2360 "unsigned int64" in rsync.h.
2361
2362 * Fixed problem on systems such as Sunos4 that do not support realloc
2363 on a NULL pointer; error was "out of memory in flist_expand".
2364
2365 * Fix for rsync server processes hanging around after the client
2366 unexpectedly disconnects. (Colin Walters) (Debian bug #128632)
2367
2368 * Cope with BSD systems on which mkdir() will not accept a trailing
2369 slash.
2370
2371 ENHANCEMENTS:
2372
2373 * Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that
2374 rsync still uses a custom version of zlib; you can not just link
2375 against a system library. See zlib/README.rsync)
276877cf 2376
d40fb723
MP
2377 * Command to initiate connections is only shown with -vv, rather
2378 than -v as in 2.5.2. Output from plain -v is more similar to
2379 what was historically used so as not to break scripts that try
2380 to parse the output.
2381
2382 * Added --no-whole-file and --no-blocking-io options (Dave Dykstra)
2383
2384 * Made the --write-batch and --read-batch options actually work
2385 and added documentation in the man page (Jos Backus)
2386
2387 * If the daemon is unable to fork a child to accept a connection,
2388 print an error message. (Colin Walters)
2389
276877cf
WD
2390\f
2391NEWS for rsync 2.5.2 (26 Jan 2002)
2392Protocol: 26 (changed)
2393Changes since 2.5.1:
97efa5c3
MP
2394
2395 SECURITY FIXES:
2396
2397 * Signedness security patch from Sebastian Krahmer
2398 <krahmer@suse.de> -- in some cases we were not sufficiently
2399 careful about reading integers from the network.
2400
2401 BUG FIXES:
2402
2403 * Fix possible string mangling in log files.
2404
2405 * Fix for setting local address of outgoing sockets.
2406
2407 * Better handling of hardlinks and devices on platforms with
2408 64-bit dev_t or ino_t.
2409
2410 * Name resolution on machines supporting IPv6 is improved.
2411
2412 * Fix for device nodes. (dann frazier) (Debian #129135)
2413
2414 ENHANCEMENTS:
2415
2416 * With -v, rsync now shows the command used to initiate an ssh/rsh
2417 connection.
2418
2419 * --statistics now shows memory heap usage on platforms that
276877cf 2420 support mallinfo().
97efa5c3
MP
2421
2422 * "The Ted T'so school of program optimization": make progress
2423 visible and people will think it's faster. (With --progress,
2424 rsync will show you how many files it has seen as it builds the
2425 file_list, giving some indication that it has not hung.)
2426
2427 * Improvements to batch mode support. This is still experimental
2428 but testing would be welcome. (Jos Backus)
276877cf 2429
97efa5c3
MP
2430 * New --ignore-existing option, patch previously distributed with
2431 Vipul's Razor. (Debian #124286)
2432
276877cf
WD
2433\f
2434NEWS for rsync 2.5.1 (3 Jan 2002)
2435Protocol: 25 (unchanged)
2436Changes since 2.5.0:
2437
2438 BUG FIXES:
499957d9 2439
499957d9
MP
2440 * Fix for segfault in --daemon mode configuration parser. (Paul
2441 Mackerras)
2442
2443 * Correct string<->address parsing for both IPv4 and 6.
2444 (YOSHIFUJI Hideaki, SUMIKAWA Munechika and Jun-ichiro "itojun"
2445 Hagino)
2446
2447 * Various fixes for IPv6 support. (Dave Dykstra)
2448
2449 * rsync.1 typo fix. (Matt Kraai)
2450
2451 * Test suite typo fixes. (Tom Schmidt)
2452
2453 * rsync.1 grammar and clarity improvements. (Edward
2454 Welbourne)
2455
2456 * Correction to ./configure tests for inet_ntop. (Jeff Garzik)
2457
2458 ENHANCEMENTS:
2459
2460 * --progress and -P now show estimated data transfer rate (in a
276877cf
WD
2461 multiple of bytes/s) and estimated time to completion. (Rik
2462 Faith)
2463
499957d9 2464 * --no-detach option, required to run as a W32 service and also
276877cf
WD
2465 useful when running on Unix under daemontools, AIX's SRC, or a
2466 debugger. (Max Bowsher, Jos Backus)
499957d9
MP
2467
2468 * Clearer error messages for some conditions.
2469
c9a66d41 2470\f
276877cf
WD
2471NEWS for rsync 2.5.0 (30 Nov 2001)
2472Protocol: 25 (changed)
2473Changes since 2.4.6:
d313ae7d
MP
2474
2475 ANNOUNCEMENTS
2476
2477 * Martin Pool <mbp@samba.org> is now a co-maintainer.
2478
2479 NEW FEATURES
2480
2481 * Support for LSB-compliant packaging <http://www.linuxbase.org/>
2482
2483 * Shell wildcards are allowed in "auth users" lines.
2484
2485 * Merged UNC rsync+ patch to support creation of standalone patch
2486 sets. By Bert J. Dempsey and Debra Weiss, updated by Jos
2487 Backus. <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
2488
2489 * IPv6 support based on a patch from KAME.net, on systems
2490 including modern versions of Linux, Solaris, and HP-UX. Also
2491 includes IPv6 compatibility functions for old OSs by the
2492 Internet Software Consortium, Paul Vixie, the OpenSSH
2493 portability project, and OpenBSD.
2494
2495 ENHANCEMENTS
2496
2497 * Include/exclude cluestick: with -vv, print out whether files are
2498 included or excluded and why.
2499
2500 * Many error messages have more friendly explanations and more
2501 details.
2502
2503 * Manual page improvements plus scanty protocol documentation.
2504
2505 * When running as --daemon in the background and using a "log
2506 file" rsyncd.conf directive, close the log file every time it is
2507 open when going to sleep on the socket. This allows the log
2508 file to get cleaned out by another process.
2509
2510 * Change to using libpopt rather than getopt for processing
2511 options. This makes the code cleaner and the behaviour more
2512 consistent across platforms. popt is included and built if not
2513 installed on the platform.
2514
2515 * More details in --version, including note about whether 64-bit
2516 files, symlinks and hardlinks are supported.
2517
2518 * MD4 code may use less CPU cycles.
2519
2520 * Use mkstemp on systems where it is secure. If we use mktemp,
2521 explain that we do it in a secure way.
2522
2523 * --whole-file is the default when source and target are on the
2524 local machine.
2525
2526 BUG FIXES:
2527
2528 * Fix for various bugs causing rsync to hang.
2529
2530 * Attempt to fix Large File Summit support on AIX.
2531
2532 * Attempt to fix error handling lockup bug.
2533
2534 * Give a non-0 exit code if *any* of the files we have been asked
276877cf 2535 to transfer fail to transfer.
d313ae7d
MP
2536
2537 * For log messages containing ridiculously long strings that might
2538 overflow a buffer rsync no longer aborts, but rather prints an
2539 ellipsis at the end of the string. (Patch from Ed Santiago.)
2540
2541 PLATFORMS:
2542
2543 * Improved support for UNICOS (tested on Cray T3E and Cray SV1)
2544
2545 * autoconf2.52 (or later) is now required to rebuild the autoconf
276877cf 2546 scripts. It is not required to simply build rsync.
d313ae7d
MP
2547
2548 * Platforms thought to work in this release:
2549
2550 Cray SV1 UNICOS 10.0.0.8 cc
2551 Debian Linux 2.2 UltraSparc gcc
2552 Debian Linux testing/unstable ARM gcc
2553 FreeBSD 3.3-RELEASE i386 cc
2554 FreeBSD 4.1.1-RELEASE i386 cc
2555 FreeBSD 4.3-STABLE i386 cc
2556 HP PA-RISC HP-UX 10.20 gcc
2557 HP PA-RISC HP-UX 11.11 cc
2558 IRIX 6.5 MIPS cc
2559 IRIX 6.5 MIPS gcc
2560 Mac OS X PPC (--disable-ipv6) cc
2561 NetBSD 1.5 i386 gcc
2562 NetBSD Current i386 cc
2563 OpenBSD 2.5 Sparc gcc
2564 OpenBSD 2.9 i386 cc
2565 OpenBSD Current i386 cc
2566 RedHat 6.2 i386 gcc
2567 RedHat 6.2 i386 insure++
2568 RedHat 7.0 i386 gcc
2569 RedHat 7.1 i386 (Kernel 2.4.10) gcc
2570 Slackware 8.0 i686 (Kernel 2.4.10)
2571 Solaris 8 UltraSparc cc
2572 Solaris 8 UltraSparc gcc
2573 Solaris 8 i386 gcc
2574 SuSE 7.1 i386 gcc2.95.2
2575 SuSE 7.1 ppc gcc2.95.2
2576 i386-pc-sco3.2v5.0.5 cc
2577 i386-pc-sco3.2v5.0.5 gcc
2578 powerpc-ibm-aix4.3.3.0 cc
2579 i686-unknown-sysv5UnixWare7.1.0 gcc
2580 i686-unknown-sysv5UnixWare7.1.0 cc
2581
2582 TESTING:
2583
2584 * The existing test.sh script by Phil Hands has been merged into a
2585 test framework that works from both "make check" and the Samba
2586 build farm.
3742bf3a
S
2587\f
2588Partial Protocol History
f7e48a5c 2589 RELEASE DATE VER. DATE OF COMMIT* PROTOCOL
3cbe640d 2590 ?? ??? 2008 3.0.1 30
4cb6197b 2591 01 Mar 2008 3.0.0 11 Nov 2006 30
0c6d7952 2592 06 Nov 2006 2.6.9 29
4177f09b 2593 22 Apr 2006 2.6.8 29
a058cbc4 2594 11 Mar 2006 2.6.7 29
cbc63b9b 2595 28 Jul 2005 2.6.6 29
2dfe1c37 2596 01 Jun 2005 2.6.5 29
f7e48a5c 2597 30 Mar 2005 2.6.4 17 Jan 2005 29
6fcedb7d 2598 30 Sep 2004 2.6.3 28
c7be6dec
WD
2599 30 Apr 2004 2.6.2 28
2600 26 Apr 2004 2.6.1 08 Jan 2004 28
276877cf
WD
2601 01 Jan 2004 2.6.0 10 Apr 2003 27 (MAX=40)
2602 04 Dec 2003 2.5.7 26
2603 26 Jan 2003 2.5.6 26
2604 02 Apr 2002 2.5.5 26
2605 13 Mar 2002 2.5.4 26
2606 11 Mar 2002 2.5.3 26
2607 26 Jan 2002 2.5.2 11 Jan 2002 26
2608 03 Jan 2002 2.5.1 25
2609 30 Nov 2001 2.5.0 23 Aug 2001 25
2610 06 Sep 2000 2.4.6 24
2611 19 Aug 2000 2.4.5 24
2612 29 Jul 2000 2.4.4 24
2613 09 Apr 2000 2.4.3 24
2614 30 Mar 2000 2.4.2 24
2615 30 Jan 2000 2.4.1 29 Jan 2000 24
2616 29 Jan 2000 2.4.0 28 Jan 2000 23
2617 25 Jan 2000 2.3.3 23 Jan 2000 22
2618 08 Nov 1999 2.3.2 26 Jun 1999 21
2619 06 Apr 1999 2.3.1 20
2620 15 Mar 1999 2.3.0 15 Mar 1999 20
2621 25 Nov 1998 2.2.1 19
2622 03 Nov 1998 2.2.0 19
2623 09 Sep 1998 2.1.1 19
2624 20 Jul 1998 2.1.0 19
2625 17 Jul 1998 2.0.19 19
2626 18 Jun 1998 2.0.17 19
2627 01 Jun 1998 2.0.16 19
2628 27 May 1998 2.0.13 27 May 1998 19
2629 26 May 1998 2.0.12 18
2630 22 May 1998 2.0.11 18
2631 18 May 1998 2.0.9 18 May 1998 18
2632 17 May 1998 2.0.8 17
2633 15 May 1998 2.0.1 17
2634 14 May 1998 2.0.0 17
2635 17 Apr 1998 1.7.4 17
2636 13 Apr 1998 1.7.3 17
2637 05 Apr 1998 1.7.2 17
2638 26 Mar 1998 1.7.1 17
2639 26 Mar 1998 1.7.0 26 Mar 1998 17 (MAX=30)
2640 13 Jan 1998 1.6.9 13 Jan 1998 15 (MAX=20)
2641
2642* DATE OF COMMIT is the date the protocol change was committed to CVS.