1 NEWS for rsync 2.6.4 (UNRELEASED)
7 - When rsync deletes a directory and outputs a verbose message about
8 it, it now appends a trailing slash to the name instead of (only
9 sometimes) outputting a preceding "directory " string.
11 - The --stats output will contain file-list time-statistics if both
12 sides are 2.6.4, or if the local side is 2.6.4 and the files are
13 being pushed (since the stats come from the sending side).
14 (Requires protocol 29 for a pull.)
16 - The "%o" (operation) log-format escape now has a third value (besides
17 "send" and "recv"): "del." (with trailing dot to make it 4 chars).
18 This changes the way deletions are logged in the daemon's log file.
20 - When the --log-format option is combined with --verbose, rsync now
21 avoids outputting the name of the file twice in most circumstances.
22 As long as the --log-format item does not refer to any post-transfer
23 items (such as %b or %c), the --log-format message is output prior to
24 the transfer with --verbose being the equivalent of a --log-format of
25 '%n%L' (which outputs the name and any symlink info). If the log
26 output must occur after the transfer to be complete, the only time
27 the name is also output prior to the transfer is when --progress was
28 specified (so that the name will precede the progress stats, and the
29 full --log-format output will come after).
33 - Restore the list-clearing behavior of "!" in a .cvsignore file (2.6.3
34 was only treating it as a special token in an rsync include/exclude
37 - The combination of --verbose and --dry-run now mentions the full list
38 of changes that would be output without --dry-run.
40 - Avoid a mkdir warning when removing a directory in the destination
41 that already exists in the --backup-dir.
43 - An OS that has a binary mode for its files (such as cygwin) needed
44 setmode(fd, O_BINARY) called on the temp-file we opened with
45 mkstemp(). (Fix derived from the cygwin's 2.6.3 rsync package.)
47 - Fixed a potential hang when verbosity is high, the client side is
48 the sender, and the file-list is large.
50 - Fixed a potential protocol-corrupting bug where the generator could
51 merge a message from the receiver into the middle of a multiplexed
52 packet of data if only part of that data was written out to the
53 socket when we got the message from the generator.
55 - We now check if the OS doesn't support using mknod() for creating
56 FIFOs and sockets, and compile-in using mkfifo() and socket() when
59 - Fixed an off-by-one error in the handling of --max-delete=N.
61 - One place in the code wasn't checking if fork() failed.
63 - The "ignore nonreadable" daemon parameter used to erroneously affect
64 symlinks that pointed to a non-existent file. This has been fixed.
66 - If the OS does not have lchown() and a chown() of a symlink will
67 affect the referent of a symlink (as it should), we no longer try
68 to set the user and group of a symlink.
70 - The generator now properly runs the hard-link loop and the dir-time
71 rewriting loop after we're sure that the redo phase is complete.
73 - When --backup was specified with --partial-dir=DIR (where DIR is a
74 relative path), the backup code was erroneously trying to backup a
75 file that was put into the partial-dir.
77 - If a file gets resent in a single transfer and the --backup option is
78 enabled along with --inplace, rsync no longer performs a duplicate
79 backup (it used to overwrite the first backup with the failed file).
81 - One call to flush_write_file() was not being checked for an error.
83 - The --no-relative option was not being sent from the client to a
86 - If an rsync daemon specified "dont compress = ..." for a file and the
87 client tried to specify --compress, the libz code was not handling a
88 compression level of 0 properly. This could cause a transfer failure
89 if the block-size for a file was large enough (e.g. rsync might have
90 exited with an error for large files).
92 - Fixed a bug that would sometimes surface when using --compress and
93 sending a file with a block-size larger than 64K (either manually
94 specified, or computed due to the file being really large). Prior
95 versions of rsync would sometimes fail to decompress the data
96 properly, and thus the transferred file would fail its verification.
98 - If a daemon can't open the specified log file (i.e. syslog is not
99 being used), die without crashing. We also output an error about
100 the failure on stderr (which will only be seen if --no-detach was
103 - A local transfer no longer duplicates all its include/exclude options
104 (since the forked process already has a copy of the exclude list,
105 there's no need to send them a set of duplicates).
107 - When --progress is specified, the output of items that the generator
108 is creating (e.g. dirs, symlinks) is now integrated into the progress
109 output without overlapping it. (Requires protocol 29.)
111 - When --timeout is specified, lulls that occur in the transfer while
112 the generator is doing work that does not generate socket traffic
113 (looking for changed files, deleting files, doing directory-time
114 touch-ups, etc.) will cause a new keep-alive packet to be sent that
115 should keep the transfer going as long as the generator continues to
116 make progress. (Requires protocol 29.)
118 - The stat size of a device is not added to the total file size of the
119 items in the transfer since the size might be undefined on some OSes.
121 - Fixed a problem with refused-option messages sometimes not making it
122 back to the client side when a remote --files-from was in effect and
123 the daemon was the receiver.
125 - The --compare-dest option was not updating a file that differred in
126 (the preserved) attributes from the version in the compare-dest DIR.
128 - When rsync is copying files into a write-protected directory, fixed
129 the change-report output for the directory so that we don't report
130 an identical directory as changed.
134 - Rsync now supports popt's option aliases, which means that you can
135 use /etc/popt and/or ~/.popt to create your own option aliases.
137 - Added the --delete-during (--del) option which will delete files
138 from the receiving side incrementally as each directory in the
139 transfer is being processed. This makes it more efficient than the
140 default, before-the-transfer behavior, which is now available as
141 --delete-before (and is still the default --delete-WHEN option that
142 will be chosen if --delete or --delete-excluded is specified without
143 a --delete-WHEN choice). All the --del* options infer --delete, so
144 an rsync daemon that refuses "delete" will still refuse to allow any
145 file-deleting options.
147 - All the --delete-WHEN options are now more memory efficient:
148 Previously an entire duplicate set of file-list objects was created
149 on the receiving side for the entire destination hierarchy. The new
150 algorithm only creates one directory of objects at a time (for files
151 inside the transfer).
153 - Added the --copy-dest option, which works like --link-dest except
154 that it copies identical files instead of hard-linking them.
156 - Added support for specifying multiple --compare-dest, --copy-dest, or
157 --link-dest options, but only of a single type. (Promoted from the
158 patches dir and enhanced.) (Requires protocol 29.)
160 - Added the --max-size option. (Promoted from the patches dir.)
162 - The daemon-mode options were separated from the normal rsync options
163 so that they can't be mixed together. This makes it impossible to
164 start a daemon that had improper default option values that could
165 cause problems when a client connects (e.g. a hang or an abort).
167 - The --bwlimit option may now be used in combination with --daemon
168 to specify both a default value for the daemon side and a value
169 that cannot be exceeded by a user-specified --bwlimit option.
171 - Added the "port" parameter to the rsyncd.conf file. (Promoted from
172 the patches dir.) Also added "address". A command-line option
173 will take precedence over a config-file option, as expected.
175 - In _exit_cleanup(): when we are exiting with a partially-received
176 file, we now flush any data in the write-cache before closing the
179 - The --inplace support was enhanced to work with --compare-dest,
180 --link-dest, and (the new) --copy-dest options. (Requires protocol
183 - Added the --dirs (-d) option for an easier way to copy directories
186 - Added the --list-only option, which is mainly a way for the client to
187 put the server into listing mode without needing to resort to any
188 internal option kluges (e.g. the age-old use of "-r --exclude="/*/*"
189 for a non-recursive listing). This option is used automatically
190 (behind the scenes) when a modern rsync speaks to a modern daemon,
191 but may also be specified manually if you want to force the use of
192 the --list-only option over a remote-shell connection.
194 - Added the --omit-dir-times (-O) option, which will avoid updating
195 the modified time for directories when --times was specified. This
196 option will avoid an extra pass through the file-list at the end of
197 the transfer (to tweak all the directory times), which can result in
198 an appreciable speedup for a really large transfer. (Promoted from
201 - Added the --filter (-f) option and its helper option, -F. Filter
202 rules are an extension to the existing include/exclude handling
203 that also supports nested filter files as well as per-directory
204 filter files (like .cvsignore, but with full filter-rule parsing).
205 This new option was chosen in order to ensure that all existing
206 include/exclude processing remained 100% compatible with older
207 versions. Protocol 29 is needed for full filter-rule support, but
208 backward-compatible rules work with earlier protocol versions.
209 (Promoted from the patches dir and enhanced.)
211 - Added the --delay-updates option that puts all updated files into
212 a temporary directory (by default ".~tmp~", but settable via the
213 --partial-dir=DIR option) until the end of the transfer. This
214 makes the updates a little more atomic for a large transfer.
216 - If rsync is put into the background, any output from --progress is
219 - Documented the "max verbosity" setting for rsyncd.conf. (This
220 setting was added a couple releases ago, but left undocumented.)
222 - The sender and the generator now double-check the file-list index
223 they are given, and refuse to try to do a file transfer on a
224 non-file index (since that would indicate that something had gone
227 - Added the --itemize-changes (-i) option, which is a way to output a
228 more detailed list of what files changed in any way and how they
229 changed. The effect is the same as specifying a --log-format of
230 "%i %n%L" (see the rsyncd.conf manpage). Works with --dry-run too.
232 - Added the --fuzzy option, which attempts to find a basis file for a
233 file that is being created from scratch. The current algorithm
234 only looks in the destination directory for the created file, but
235 it does attempt to find a match based on size/mod-time (in case the
236 file was renamed with no other changes) as well as based on a fuzzy
237 name-matching algorithm. This option requires protocol 29 because
238 it needs the new file-sorting order. (Promoted from patches dir
239 and enhanced.) (Requires protocol 29.)
241 - Added the --remove-sent-files option, which lets you move files
244 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal
245 enclosed in '[' and ']' (e.g. "[::1]"). (We already allowed IPv6
246 literals in the rsync://HOST:PORT/PATH format.)
248 - When rsync recurses to build the file list, it no longer keeps open
249 the directory handles of all the parent dirs inside the transfer.
251 - When building under windows, the default for --daemon is now to
252 avoid detaching, requiring the new --detach option to force rsync
255 - Improved the option descriptions in the --help text.
259 - Added atomic-rsync to the support dir: a perl script that will
260 transfer some files using rsync, and then move the updated files into
261 place all at once at the end of the transfer. Only works when
262 pulling, and uses --link-dest and a parallel hierarchy of files to
265 - Added mnt-excl to the support dir: a perl script that takes the
266 /proc/mounts file and translates it into a set of excludes that will
267 exclude all mount points (even mapped mounts to the same disk). The
268 excludes are made relative to the specified source dir and properly
271 - Added savetransfer.c to the support dir: a C program that can make
272 a copy of all the data that flows over the wire. This lets you test
273 for data corruption (by saving the data on both the sending side and
274 the receiving side) or provides a way to help debug a protocol error.
276 - Added rrsync to the support dir: this is my version of Joe Smith's
277 restricted rsync perl script. This helps to ensure that only certain
278 rsync commands can be run by an ssh invocation.
282 - Added better checking of the checksum-header values that come over
285 - Merged a variety of file-deleting functions into a single function so
286 that it is easier to maintain.
288 - Improved the type of some variables (particularly blocksize vars) for
289 consistency and proper size.
291 - Got rid of the uint64 type (which we didn't need).
293 - Use a slightly more compatible set of core #include directives.
295 - Defined int32 in a way that ensures that the build dies if we can't
296 find a variable with at least 32 bits.
298 - The daemon's "read only" config item now sets an internal read_only
299 variable that makes extra sure that no write/delete calls on the
300 read-only side can succeed.
302 PROTOCOL DIFFERENCES FOR VERSION 29:
304 - A 16-bit flag-word is transmitted after every file-list index. This
305 indicates what is changing between the sender and the receiver. The
306 generator now transmits an index and a flag-word to indicate when
307 dirs and symlinks have changed (instead of producing a message),
308 which makes the outputting of the information more consistent and
309 less prone to screen corruption (because either the receiver or the
310 sender is now outputting all the file-change info).
312 - If a file is being hard-linked, the appropriate bit is enabled in
313 the flag-word and the name of the file that was linked immediately
314 follows in vstring format (see below).
316 - If a file is being transferred with an alternate-basis file, the
317 appropriate bit is enabled in the flag-word and a single-byte
318 follows, indicating what type of basis file was chosen. If that
319 indicates that a fuzzy-match was selected, the name of the match
320 immediately follows in vstring format. A vstring is a variable
321 length string that has its size written prior to the string, and
322 no terminating null. If the string is from 1-127 bytes, the length
323 is a single byte. If it is from 128-32767 bytes, the length is
324 written as ((len >> 8) | 0x80) followed by (len % 0x100).
326 - The sending of exclude names is done using filter-rule syntax. This
327 means that all names have a prefixed rule indicator, even excludes
328 (which used to be sent as a bare pattern, when possible). The -C
329 option will include the per-dir .cvsignore merge file in the list of
330 filter rules so it is positioned correctly (unlike in some older
333 - Rsync sorts the filename list in a different way: it sorts the subdir
334 names after the non-subdir names for each dir's contents, and it
335 always puts a dir's contents immediately after the dir's name in the
336 list. (Previously an item named "foo.txt" would sort in between
337 directory "foo/" and "foo/bar".)
339 - When talking to a protocol 29 rsync daemon, a list-only request
340 is able to note this before the options are sent over the wire and
341 the new --list-only option is included in the options.
343 - When the --stats bytes are sent over the wire (or stored in a batch),
344 they now include two elapsed-time values: one for how long it took to
345 build the file-list, and one for how long it took to send it over the
346 wire (each expressed in thousandths of a second).
348 - When --delete-excluded is specified with some filter excludes, a
349 client sender will now initiate a send of the filter rules to the
350 receiver (older protocols used to omit the sending of excludes in
351 this situation since there were no receiver-specific rules that
352 survived --delete-excluded back then). Note that, as with all the
353 filter-list sending, only items that are significant to the other
354 side will actually be sent over the wire, so the filter-rule list
355 is often empty in this scenario.
357 - A protocol-29 batch file includes a bit for the setting of the --dirs
358 option. Also, the shell script created by --write-batch will use the
359 --filter option instead of --exclude-from to capture any filter rules.
361 - An index equal to the file-list count is sent as a keep-alive packet
362 from the generator to the sender, which then forwards it on to the
363 receiver. This normally invalid index is only a valid keep-alive
364 packet if the 16-bit flag-word that follows it contains a single bit
365 (ITEM_IS_NEW, which is normally an illegal flag to appear alone).
369 - Handle an operating system that use mkdev() in place of makedev().
371 - Improved configure to better handle cross-compiling.
Matt McCutchen's Web Site / rsync / rsync.git / blob