Tweaked the calculation that goes into sum->count so that it cannot
[rsync/rsync.git] / rsync.yo
CommitLineData
9e3c856a 1mailto(rsync-bugs@samba.org)
9ec8bd87 2manpage(rsync)(1)(28 Jul 2005)()()
41059f75
AT
3manpagename(rsync)(faster, flexible replacement for rcp)
4manpagesynopsis()
5
9ef53907 6rsync [OPTION]... SRC [SRC]... [USER@]HOST:DEST
41059f75 7
d0e94abb 8rsync [OPTION]... [USER@]HOST:SRC [DEST]
41059f75 9
9ef53907 10rsync [OPTION]... SRC [SRC]... DEST
41059f75 11
9ef53907 12rsync [OPTION]... [USER@]HOST::SRC [DEST]
41059f75 13
9ef53907 14rsync [OPTION]... SRC [SRC]... [USER@]HOST::DEST
41059f75 15
9ef53907 16rsync [OPTION]... rsync://[USER@]HOST[:PORT]/SRC [DEST]
039faa86 17
8d69d571
WD
18rsync [OPTION]... SRC [SRC]... rsync://[USER@]HOST[:PORT]/DEST
19
41059f75
AT
20manpagedescription()
21
22rsync is a program that behaves in much the same way that rcp does,
23but has many more options and uses the rsync remote-update protocol to
675ef1aa
WD
24greatly speed up file transfers when the destination file is being
25updated.
41059f75
AT
26
27The rsync remote-update protocol allows rsync to transfer just the
f39281ae 28differences between two sets of files across the network connection, using
41059f75
AT
29an efficient checksum-search algorithm described in the technical
30report that accompanies this package.
31
32Some of the additional features of rsync are:
33
34itemize(
b9f592fb 35 it() support for copying links, devices, owners, groups, and permissions
41059f75
AT
36 it() exclude and exclude-from options similar to GNU tar
37 it() a CVS exclude mode for ignoring the same files that CVS would ignore
43cd760f 38 it() can use any transparent remote shell, including ssh or rsh
41059f75
AT
39 it() does not require root privileges
40 it() pipelining of file transfers to minimize latency costs
5a727522 41 it() support for anonymous or authenticated rsync daemons (ideal for
41059f75
AT
42 mirroring)
43)
44
45manpagesection(GENERAL)
46
15997547
WD
47Rsync copies files either to or from a remote host, or locally on the
48current host (it does not support copying files between two remote hosts).
49
50There are two different ways for rsync to contact a remote system: using a
51remote-shell program as the transport (such as ssh or rsh) or contacting an
52rsync daemon directly via TCP. The remote-shell transport is used whenever
53the source or destination path contains a single colon (:) separator after
54a host specification. Contacting an rsync daemon directly happens when the
55source or destination path contains a double colon (::) separator after a
ba3542cf 56host specification, OR when an rsync:// URL is specified (see also the
754a080f 57"USING RSYNC-DAEMON FEATURES VIA A REMOTE-SHELL CONNECTION" section for
ba3542cf 58an exception to this latter rule).
15997547
WD
59
60As a special case, if a remote source is specified without a destination,
61the remote files are listed in an output format similar to "ls -l".
62
63As expected, if neither the source or destination path specify a remote
64host, the copy occurs locally (see also the bf(--list-only) option).
65
41059f75
AT
66manpagesection(SETUP)
67
68See the file README for installation instructions.
69
1bbf83c0
WD
70Once installed, you can use rsync to any machine that you can access via
71a remote shell (as well as some that you can access using the rsync
43cd760f 72daemon-mode protocol). For remote transfers, a modern rsync uses ssh
1bbf83c0 73for its communications, but it may have been configured to use a
43cd760f 74different remote shell by default, such as rsh or remsh.
41059f75 75
faa82484 76You can also specify any remote shell you like, either by using the bf(-e)
41059f75
AT
77command line option, or by setting the RSYNC_RSH environment variable.
78
79One common substitute is to use ssh, which offers a high degree of
80security.
81
8e987130 82Note that rsync must be installed on both the source and destination
faa82484 83machines.
8e987130 84
41059f75
AT
85manpagesection(USAGE)
86
87You use rsync in the same way you use rcp. You must specify a source
88and a destination, one of which may be remote.
89
4d888108 90Perhaps the best way to explain the syntax is with some examples:
41059f75 91
faa82484 92quote(tt(rsync -t *.c foo:src/))
41059f75 93
8a97fc2e 94This would transfer all files matching the pattern *.c from the
41059f75
AT
95current directory to the directory src on the machine foo. If any of
96the files already exist on the remote system then the rsync
97remote-update protocol is used to update the file by sending only the
98differences. See the tech report for details.
99
faa82484 100quote(tt(rsync -avz foo:src/bar /data/tmp))
41059f75 101
8a97fc2e 102This would recursively transfer all files from the directory src/bar on the
41059f75
AT
103machine foo into the /data/tmp/bar directory on the local machine. The
104files are transferred in "archive" mode, which ensures that symbolic
b5accaba 105links, devices, attributes, permissions, ownerships, etc. are preserved
14d43f1f 106in the transfer. Additionally, compression will be used to reduce the
41059f75
AT
107size of data portions of the transfer.
108
faa82484 109quote(tt(rsync -avz foo:src/bar/ /data/tmp))
41059f75 110
8a97fc2e
WD
111A trailing slash on the source changes this behavior to avoid creating an
112additional directory level at the destination. You can think of a trailing
113/ on a source as meaning "copy the contents of this directory" as opposed
114to "copy the directory by name", but in both cases the attributes of the
115containing directory are transferred to the containing directory on the
116destination. In other words, each of the following commands copies the
117files in the same way, including their setting of the attributes of
118/dest/foo:
119
faa82484
WD
120quote(
121tt(rsync -av /src/foo /dest)nl()
122tt(rsync -av /src/foo/ /dest/foo)nl()
123)
41059f75 124
c4833b02
WD
125Note also that host and module references don't require a trailing slash to
126copy the contents of the default directory. For example, both of these
127copy the remote directory's contents into "/dest":
128
129quote(
130tt(rsync -av host: /dest)nl()
131tt(rsync -av host::module /dest)nl()
132)
133
41059f75
AT
134You can also use rsync in local-only mode, where both the source and
135destination don't have a ':' in the name. In this case it behaves like
136an improved copy command.
137
bb9bdba4
WD
138Finally, you can list all the (listable) modules available from a
139particular rsync daemon by leaving off the module name:
140
faa82484 141quote(tt(rsync somehost.mydomain.com::))
14d43f1f 142
bb9bdba4 143See the following section for more details.
14d43f1f 144
675ef1aa
WD
145manpagesection(ADVANCED USAGE)
146
147The syntax for requesting multiple files from a remote host involves using
148quoted spaces in the SRC. Some examples:
149
faa82484 150quote(tt(rsync host::'modname/dir1/file1 modname/dir2/file2' /dest))
675ef1aa
WD
151
152This would copy file1 and file2 into /dest from an rsync daemon. Each
153additional arg must include the same "modname/" prefix as the first one,
154and must be preceded by a single space. All other spaces are assumed
155to be a part of the filenames.
156
faa82484 157quote(tt(rsync -av host:'dir1/file1 dir2/file2' /dest))
675ef1aa
WD
158
159This would copy file1 and file2 into /dest using a remote shell. This
160word-splitting is done by the remote shell, so if it doesn't work it means
161that the remote shell isn't configured to split its args based on
162whitespace (a very rare setting, but not unknown). If you need to transfer
163a filename that contains whitespace, you'll need to either escape the
164whitespace in a way that the remote shell will understand, or use wildcards
165in place of the spaces. Two examples of this are:
166
faa82484
WD
167quote(
168tt(rsync -av host:'file\ name\ with\ spaces' /dest)nl()
169tt(rsync -av host:file?name?with?spaces /dest)nl()
170)
675ef1aa
WD
171
172This latter example assumes that your shell passes through unmatched
173wildcards. If it complains about "no match", put the name in quotes.
174
5a727522 175manpagesection(CONNECTING TO AN RSYNC DAEMON)
41059f75 176
754a080f
WD
177It is also possible to use rsync without a remote shell as the transport.
178In this case you will directly connect to a remote rsync daemon, typically
179using TCP port 873. (This obviously requires the daemon to be running on
180the remote system, so refer to the STARTING AN RSYNC DAEMON TO ACCEPT
181CONNECTIONS section below for information on that.)
4c3b4b25 182
1bbf83c0 183Using rsync in this way is the same as using it with a remote shell except
41059f75
AT
184that:
185
186itemize(
62f27e3c
WD
187 it() you either use a double colon :: instead of a single colon to
188 separate the hostname from the path, or you use an rsync:// URL.
2c64b258 189 it() the first word of the "path" is actually a module name.
5a727522 190 it() the remote daemon may print a message of the day when you
14d43f1f 191 connect.
5a727522
WD
192 it() if you specify no path name on the remote daemon then the
193 list of accessible paths on the daemon will be shown.
f7632fc6 194 it() if you specify no local destination then a listing of the
5a727522 195 specified files on the remote daemon is provided.
2c64b258 196 it() you must not specify the bf(--rsh) (bf(-e)) option.
41059f75
AT
197)
198
754a080f
WD
199An example that copies all the files in a remote module named "src":
200
201verb( rsync -av host::src /dest)
202
203Some modules on the remote daemon may require authentication. If so,
4c3d16be
AT
204you will receive a password prompt when you connect. You can avoid the
205password prompt by setting the environment variable RSYNC_PASSWORD to
faa82484 206the password you want to use or using the bf(--password-file) option. This
65575e96 207may be useful when scripting rsync.
4c3d16be 208
3bc67f0c 209WARNING: On some systems environment variables are visible to all
faa82484 210users. On those systems using bf(--password-file) is recommended.
3bc67f0c 211
754a080f
WD
212You may establish the connection via a web proxy by setting the
213environment variable RSYNC_PROXY to a hostname:port pair pointing to
214your web proxy. Note that your web proxy's configuration must support
215proxy connections to port 873.
bef49340 216
754a080f
WD
217manpagesection(USING RSYNC-DAEMON FEATURES VIA A REMOTE-SHELL CONNECTION)
218
219It is sometimes useful to use various features of an rsync daemon (such as
220named modules) without actually allowing any new socket connections into a
221system (other than what is already required to allow remote-shell access).
222Rsync supports connecting to a host using a remote shell and then spawning
223a single-use "daemon" server that expects to read its config file in the
224home dir of the remote user. This can be useful if you want to encrypt a
225daemon-style transfer's data, but since the daemon is started up fresh by
226the remote user, you may not be able to use features such as chroot or
227change the uid used by the daemon. (For another way to encrypt a daemon
228transfer, consider using ssh to tunnel a local port to a remote machine and
229configure a normal rsync daemon on that remote host to only allow
230connections from "localhost".)
231
232From the user's perspective, a daemon transfer via a remote-shell
233connection uses nearly the same command-line syntax as a normal
234rsync-daemon transfer, with the only exception being that you must
235explicitly set the remote shell program on the command-line with the
236bf(--rsh=COMMAND) option. (Setting the RSYNC_RSH in the environment
237will not turn on this functionality.) For example:
238
239verb( rsync -av --rsh=ssh host::module /dest)
240
241If you need to specify a different remote-shell user, keep in mind that the
242user@ prefix in front of the host is specifying the rsync-user value (for a
243module that requires user-based authentication). This means that you must
244give the '-l user' option to ssh when specifying the remote-shell:
245
246verb( rsync -av -e "ssh -l ssh-user" rsync-user@host::module /dest)
bef49340
WD
247
248The "ssh-user" will be used at the ssh level; the "rsync-user" will be
754a080f 249used to log-in to the "module".
bef49340 250
754a080f 251manpagesection(STARTING AN RSYNC DAEMON TO ACCEPT CONNECTIONS)
bef49340 252
754a080f
WD
253In order to connect to an rsync daemon, the remote system needs to have a
254daemon already running (or it needs to have configured something like inetd
255to spawn an rsync daemon for incoming connections on a particular port).
256For full information on how to start a daemon that will handling incoming
257socket connections, see the rsyncd.conf(5) man page -- that is the config
258file for the daemon, and it contains the full details for how to run the
259daemon (including stand-alone and inetd configurations).
bef49340 260
754a080f
WD
261If you're using one of the remote-shell transports for the transfer, there is
262no need to manually start an rsync daemon.
bef49340 263
41059f75
AT
264manpagesection(EXAMPLES)
265
266Here are some examples of how I use rsync.
267
14d43f1f
DD
268To backup my wife's home directory, which consists of large MS Word
269files and mail folders, I use a cron job that runs
41059f75 270
faa82484 271quote(tt(rsync -Cavz . arvidsjaur:backup))
41059f75 272
f39281ae 273each night over a PPP connection to a duplicate directory on my machine
41059f75
AT
274"arvidsjaur".
275
276To synchronize my samba source trees I use the following Makefile
277targets:
278
faa82484
WD
279verb( get:
280 rsync -avuzb --exclude '*~' samba:samba/ .
281 put:
282 rsync -Cavuzb . samba:samba/
283 sync: get put)
41059f75
AT
284
285this allows me to sync with a CVS directory at the other end of the
ae283632
WD
286connection. I then do CVS operations on the remote machine, which saves a
287lot of time as the remote CVS protocol isn't very efficient.
41059f75
AT
288
289I mirror a directory between my "old" and "new" ftp sites with the
faa82484 290command:
41059f75 291
faa82484 292tt(rsync -az -e ssh --delete ~ftp/pub/samba nimbus:"~ftp/pub/tridge")
41059f75 293
faa82484 294This is launched from cron every few hours.
41059f75 295
c95da96a
AT
296manpagesection(OPTIONS SUMMARY)
297
14d43f1f 298Here is a short summary of the options available in rsync. Please refer
faa82484 299to the detailed description below for a complete description. verb(
c95da96a 300 -v, --verbose increase verbosity
44d98d61 301 -q, --quiet suppress non-error messages
44d98d61
WD
302 -c, --checksum skip based on checksum, not mod-time & size
303 -a, --archive archive mode; same as -rlptgoD (no -H)
f40aa6fb 304 --no-OPTION turn off an implied OPTION (e.g. --no-D)
c95da96a
AT
305 -r, --recursive recurse into directories
306 -R, --relative use relative path names
f40aa6fb 307 --no-implied-dirs don't send implied dirs with --relative
915dd207 308 -b, --backup make backups (see --suffix & --backup-dir)
44d98d61 309 --backup-dir=DIR make backups into hierarchy based in DIR
915dd207 310 --suffix=SUFFIX backup suffix (default ~ w/o --backup-dir)
44d98d61
WD
311 -u, --update skip files that are newer on the receiver
312 --inplace update destination files in-place
94f20a9f 313 --append append data onto shorter files
09ed3099 314 -d, --dirs transfer directories without recursing
eb06fa95 315 -l, --links copy symlinks as symlinks
44d98d61
WD
316 -L, --copy-links transform symlink into referent file/dir
317 --copy-unsafe-links only "unsafe" symlinks are transformed
318 --safe-links ignore symlinks that point outside the tree
c95da96a 319 -H, --hard-links preserve hard links
09ed3099 320 -K, --keep-dirlinks treat symlinked dir on receiver as dir
c95da96a
AT
321 -p, --perms preserve permissions
322 -o, --owner preserve owner (root only)
323 -g, --group preserve group
324 -D, --devices preserve devices (root only)
325 -t, --times preserve times
54e66f1d 326 -O, --omit-dir-times omit directories when preserving times
c95da96a
AT
327 -S, --sparse handle sparse files efficiently
328 -n, --dry-run show what would have been transferred
98bf61c8 329 -W, --whole-file copy files whole (without rsync algorithm)
c95da96a 330 -x, --one-file-system don't cross filesystem boundaries
3ed8eb3f 331 -B, --block-size=SIZE force a fixed checksum block-size
44d98d61 332 -e, --rsh=COMMAND specify the remote shell to use
68e169ab 333 --rsync-path=PROGRAM specify the rsync to run on remote machine
1347d512 334 --existing only update files that already exist
915dd207 335 --ignore-existing ignore files that already exist on receiver
96110304 336 --remove-sent-files sent files/symlinks are removed from sender
ae76a740 337 --del an alias for --delete-during
915dd207 338 --delete delete files that don't exist on sender
598c409e 339 --delete-before receiver deletes before transfer (default)
ae76a740
WD
340 --delete-during receiver deletes during xfer, not before
341 --delete-after receiver deletes after transfer, not before
866925bf 342 --delete-excluded also delete excluded files on receiver
b5accaba 343 --ignore-errors delete even if there are I/O errors
866925bf 344 --force force deletion of dirs even if not empty
0b73ca12 345 --max-delete=NUM don't delete more than NUM files
3610c458 346 --max-size=SIZE don't transfer any file larger than SIZE
c95da96a 347 --partial keep partially transferred files
44cad59f 348 --partial-dir=DIR put a partially transferred file into DIR
44d98d61 349 --delay-updates put all updated files into place at end
c95da96a 350 --numeric-ids don't map uid/gid values by user/group name
b5accaba 351 --timeout=TIME set I/O timeout in seconds
44d98d61
WD
352 -I, --ignore-times don't skip files that match size and time
353 --size-only skip files that match in size
354 --modify-window=NUM compare mod-times with reduced accuracy
abce74bb 355 -T, --temp-dir=DIR create temporary files in directory DIR
5b483755 356 -y, --fuzzy find similar file for basis if no dest file
915dd207 357 --compare-dest=DIR also compare received files relative to DIR
2f03ce67 358 --copy-dest=DIR ... and include copies of unchanged files
b127c1dc 359 --link-dest=DIR hardlink to files in DIR when unchanged
32a5edf4 360 -z, --compress compress file data during the transfer
44d98d61 361 -C, --cvs-exclude auto-ignore files in the same way CVS does
16e5de84 362 -f, --filter=RULE add a file-filtering RULE
8a6f3fea 363 -F same as --filter='dir-merge /.rsync-filter'
16e5de84 364 repeated: --filter='- .rsync-filter'
2acf81eb 365 --exclude=PATTERN exclude files matching PATTERN
44d98d61 366 --exclude-from=FILE read exclude patterns from FILE
2acf81eb 367 --include=PATTERN don't exclude files matching PATTERN
44d98d61
WD
368 --include-from=FILE read include patterns from FILE
369 --files-from=FILE read list of source-file names from FILE
fa92818a 370 -0, --from0 all *from/filter files are delimited by 0s
3ae5367f 371 --address=ADDRESS bind address for outgoing socket to daemon
c259892c 372 --port=PORT specify double-colon alternate port number
b5accaba 373 --blocking-io use blocking I/O for the remote shell
44d98d61 374 --stats give some file-transfer stats
eb86d661 375 --progress show progress during transfer
44d98d61 376 -P same as --partial --progress
b78296cb 377 -i, --itemize-changes output a change-summary for all updates
81c453b1 378 --log-format=FORMAT output filenames using the specified format
44d98d61 379 --password-file=FILE read password from FILE
09ed3099 380 --list-only list the files instead of copying them
44d98d61 381 --bwlimit=KBPS limit I/O bandwidth; KBytes per second
faa82484 382 --write-batch=FILE write a batched update to FILE
326bb56e 383 --only-write-batch=FILE like --write-batch but w/o updating dest
44d98d61 384 --read-batch=FILE read a batched update from FILE
0b941479 385 --protocol=NUM force an older protocol version to be used
44d98d61 386 --checksum-seed=NUM set block/file checksum seed (advanced)
abce74bb
WD
387 -4, --ipv4 prefer IPv4
388 -6, --ipv6 prefer IPv6
81c453b1 389 --version print version number
faa82484 390 -h, --help show this help screen)
6902ed17 391
faa82484
WD
392Rsync can also be run as a daemon, in which case the following options are
393accepted: verb(
bdf278f7
WD
394 --daemon run as an rsync daemon
395 --address=ADDRESS bind to the specified address
44d98d61 396 --bwlimit=KBPS limit I/O bandwidth; KBytes per second
bdf278f7
WD
397 --config=FILE specify alternate rsyncd.conf file
398 --no-detach do not detach from the parent
c259892c 399 --port=PORT listen on alternate port number
24b0922b 400 -v, --verbose increase verbosity
abce74bb
WD
401 -4, --ipv4 prefer IPv4
402 -6, --ipv6 prefer IPv6
faa82484 403 -h, --help show this help screen)
c95da96a 404
41059f75
AT
405manpageoptions()
406
407rsync uses the GNU long options package. Many of the command line
408options have two variants, one short and one long. These are shown
14d43f1f 409below, separated by commas. Some options only have a long variant.
b5679335
DD
410The '=' for options that take a parameter is optional; whitespace
411can be used instead.
41059f75
AT
412
413startdit()
414dit(bf(-h, --help)) Print a short help page describing the options
bdf278f7 415available in rsync.
41059f75 416
bdf278f7 417dit(bf(--version)) print the rsync version number and exit.
41059f75
AT
418
419dit(bf(-v, --verbose)) This option increases the amount of information you
14d43f1f 420are given during the transfer. By default, rsync works silently. A
faa82484
WD
421single bf(-v) will give you information about what files are being
422transferred and a brief summary at the end. Two bf(-v) flags will give you
41059f75 423information on what files are being skipped and slightly more
faa82484 424information at the end. More than two bf(-v) flags should only be used if
14d43f1f 425you are debugging rsync.
41059f75 426
4f90eb43
WD
427Note that the names of the transferred files that are output are done using
428a default bf(--log-format) of "%n%L", which tells you just the name of the
81c453b1 429file and, if the item is a link, where it points. At the single bf(-v)
4f90eb43
WD
430level of verbosity, this does not mention when a file gets its attributes
431changed. If you ask for an itemized list of changed attributes (either
432bf(--itemize-changes) or adding "%i" to the bf(--log-format) setting), the
433output (on the client) increases to mention all items that are changed in
434any way. See the bf(--log-format) option for more details.
435
b86f0cef
DD
436dit(bf(-q, --quiet)) This option decreases the amount of information you
437are given during the transfer, notably suppressing information messages
438from the remote server. This flag is useful when invoking rsync from
439cron.
440
41059f75 441dit(bf(-I, --ignore-times)) Normally rsync will skip any files that are
915dd207
WD
442already the same size and have the same modification time-stamp.
443This option turns off this "quick check" behavior.
41059f75 444
a03a9f4e 445dit(bf(--size-only)) Normally rsync will not transfer any files that are
915dd207 446already the same size and have the same modification time-stamp. With the
faa82484 447bf(--size-only) option, files will not be transferred if they have the same size,
f83f0548
AT
448regardless of timestamp. This is useful when starting to use rsync
449after using another mirroring system which may not preserve timestamps
450exactly.
451
4f1f94d1
WD
452dit(bf(--modify-window)) When comparing two timestamps, rsync treats the
453timestamps as being equal if they differ by no more than the modify-window
454value. This is normally 0 (for an exact match), but you may find it useful
455to set this to a larger value in some situations. In particular, when
456transferring to or from an MS Windows FAT filesystem (which represents
457times with a 2-second resolution), bf(--modify-window=1) is useful
458(allowing times to differ by up to 1 second).
5b56cc19 459
41059f75
AT
460dit(bf(-c, --checksum)) This forces the sender to checksum all files using
461a 128-bit MD4 checksum before transfer. The checksum is then
462explicitly checked on the receiver and any files of the same name
463which already exist and have the same checksum and size on the
a03a9f4e 464receiver are not transferred. This option can be quite slow.
41059f75 465
faa82484 466dit(bf(-a, --archive)) This is equivalent to bf(-rlptgoD). It is a quick
e7bf3e5e 467way of saying you want recursion and want to preserve almost
f40aa6fb
WD
468everything (with -H being a notable omission).
469The only exception to the above equivalence is when bf(--files-from) is
5dd97ab9 470specified, in which case bf(-r) is not implied.
e7bf3e5e 471
faa82484 472Note that bf(-a) bf(does not preserve hardlinks), because
e7bf3e5e
MP
473finding multiply-linked files is expensive. You must separately
474specify bf(-H).
41059f75 475
f40aa6fb
WD
476dit(--no-OPTION) You may turn off one or more implied options by prefixing
477the option name with "no-". Not all options may be prefixed with a "no-":
478only options that are implied by other options (e.g. bf(--no-D),
479bf(--no-perms)) or have different defaults in various circumstances
480(e.g. bf(--no-whole-file), bf(--no-blocking-io), bf(--no-dirs)). You may
481specify either the short or the long option name after the "no-" prefix
482(e.g. bf(--no-R) is the same as bf(--no-relative)).
483
484For example: if you want to use bf(-a) (bf(--archive)) but don't want
485bf(-o) (bf(--owner)), instead of converting bf(-a) into bf(-rlptgD), you
486could specify bf(-a --no-o) (or bf(-a --no-owner)).
487
488The order of the options is important: if you specify bf(--no-r -a), the
489bf(-r) option would end up being turned on, the opposite of bf(-a --no-r).
490Note also that the side-effects of the bf(--files-from) option are NOT
491positional, as it affects the default state of several options and sligntly
492changes the meaning of bf(-a) (see the bf(--files-from) option for more
493details).
494
24986abd 495dit(bf(-r, --recursive)) This tells rsync to copy directories
faa82484 496recursively. See also bf(--dirs) (bf(-d)).
41059f75
AT
497
498dit(bf(-R, --relative)) Use relative paths. This means that the full path
499names specified on the command line are sent to the server rather than
500just the last parts of the filenames. This is particularly useful when
14d43f1f 501you want to send several different directories at the same time. For
1dc42d12 502example, if you used this command:
41059f75 503
1dc42d12 504quote(tt( rsync -av /foo/bar/baz.c remote:/tmp/))
41059f75 505
1dc42d12 506... this would create a file called baz.c in /tmp/ on the remote
41059f75
AT
507machine. If instead you used
508
1dc42d12 509quote(tt( rsync -avR /foo/bar/baz.c remote:/tmp/))
41059f75 510
1dc42d12 511then a file called /tmp/foo/bar/baz.c would be created on the remote
9bef934c 512machine -- the full path name is preserved. To limit the amount of
1dc42d12
WD
513path information that is sent, you have a couple options: (1) With
514a modern rsync on the sending side (beginning with 2.6.7), you can
515insert a dot dir into the source path, like this:
516
517quote(tt( rsync -avR /foo/./bar/baz.c remote:/tmp/))
518
519That would create /tmp/bar/baz.c on the remote machine. (Note that the
520dot dir must followed by a slash, so "/foo/." would not be abbreviated.)
521(2) For older rsync versions, you would need to use a chdir to limit the
522source path. For example, when pushing files:
523
53cf0b8b 524quote(tt( (cd /foo; rsync -avR bar/baz.c remote:/tmp/) ))
1dc42d12 525
53cf0b8b
WD
526(Note that the parens put the two commands into a sub-shell, so that the
527"cd" command doesn't remain in effect for future commands.)
528If you're pulling files, use this idiom (which doesn't work with an
529rsync daemon):
9bef934c 530
faa82484 531quote(
1dc42d12
WD
532tt( rsync -avR --rsync-path="cd /foo; rsync" \ )nl()
533tt( remote:bar/baz.c /tmp/)
faa82484 534)
9bef934c 535
faa82484 536dit(bf(--no-implied-dirs)) When combined with the bf(--relative) option, the
f177b7cc
WD
537implied directories in each path are not explicitly duplicated as part
538of the transfer. This makes the transfer more optimal and also allows
539the two sides to have non-matching symlinks in the implied part of the
faa82484 540path. For instance, if you transfer the file "/path/foo/file" with bf(-R),
f177b7cc
WD
541the default is for rsync to ensure that "/path" and "/path/foo" on the
542destination exactly match the directories/symlinks of the source. Using
faa82484 543the bf(--no-implied-dirs) option would omit both of these implied dirs,
f177b7cc
WD
544which means that if "/path" was a real directory on one machine and a
545symlink of the other machine, rsync would not try to change this.
41059f75 546
b19fd07c
WD
547dit(bf(-b, --backup)) With this option, preexisting destination files are
548renamed as each file is transferred or deleted. You can control where the
549backup file goes and what (if any) suffix gets appended using the
faa82484 550bf(--backup-dir) and bf(--suffix) options.
fbe5eeb8
WD
551Note that if you don't specify bf(--backup-dir), the bf(--omit-dir-times)
552option will be enabled.
41059f75 553
faa82484 554dit(bf(--backup-dir=DIR)) In combination with the bf(--backup) option, this
66203a98 555tells rsync to store all backups in the specified directory. This is
759ac870 556very useful for incremental backups. You can additionally
faa82484 557specify a backup suffix using the bf(--suffix) option
759ac870
DD
558(otherwise the files backed up in the specified directory
559will keep their original filenames).
66203a98 560
b5679335 561dit(bf(--suffix=SUFFIX)) This option allows you to override the default
faa82484
WD
562backup suffix used with the bf(--backup) (bf(-b)) option. The default suffix is a ~
563if no -bf(-backup-dir) was specified, otherwise it is an empty string.
9ef53907 564
4539c0d7
WD
565dit(bf(-u, --update)) This forces rsync to skip any files which exist on
566the destination and have a modified time that is newer than the source
567file. (If an existing destination file has a modify time equal to the
568source file's, it will be updated if the sizes are different.)
41059f75 569
faa82484 570In the current implementation of bf(--update), a difference of file format
4539c0d7 571between the sender and receiver is always
adddd075
WD
572considered to be important enough for an update, no matter what date
573is on the objects. In other words, if the source has a directory or a
574symlink where the destination has a file, the transfer would occur
575regardless of the timestamps. This might change in the future (feel
576free to comment on this on the mailing list if you have an opinion).
577
a3221d2a
WD
578dit(bf(--inplace)) This causes rsync not to create a new copy of the file
579and then move it into place. Instead rsync will overwrite the existing
eb162f3b
WD
580file, meaning that the rsync algorithm can't accomplish the full amount of
581network reduction it might be able to otherwise (since it does not yet try
582to sort data matches). One exception to this is if you combine the option
faa82484 583with bf(--backup), since rsync is smart enough to use the backup file as the
eb162f3b 584basis file for the transfer.
a3221d2a 585
183150b7
WD
586This option is useful for transfer of large files with block-based changes
587or appended data, and also on systems that are disk bound, not network
588bound.
589
faa82484
WD
590The option implies bf(--partial) (since an interrupted transfer does not delete
591the file), but conflicts with bf(--partial-dir) and bf(--delay-updates).
b7c24819
WD
592Prior to rsync 2.6.4 bf(--inplace) was also incompatible with bf(--compare-dest)
593and bf(--link-dest).
a3221d2a 594
399371e7 595WARNING: The file's data will be in an inconsistent state during the
98f51bfb 596transfer (and possibly afterward if the transfer gets interrupted), so you
399371e7 597should not use this option to update files that are in use. Also note that
eb162f3b 598rsync will be unable to update a file in-place that is not writable by the
75b243a5 599receiving user.
a3221d2a 600
94f20a9f
WD
601dit(bf(--append)) This causes rsync to update a file by appending data onto
602the end of the file, which presumes that the data that already exists on
603the receiving side is identical with the start of the file on the sending
604side. If that is not true, the file will fail the checksum test, and the
d37d1c44
WD
605resend will do a normal bf(--inplace) update to correct the mismatched data.
606Only files on the receiving side that are shorter than the corresponding
607file on the sending side (as well as new files) are sent.
a8cbb57c
WD
608Implies bf(--inplace), but does not conflict with bf(--sparse) (though the
609bf(--sparse) option will be auto-disabled if a resend of the already-existing
610data is required).
94f20a9f 611
09ed3099 612dit(bf(-d, --dirs)) Tell the sending side to include any directories that
faa82484 613are encountered. Unlike bf(--recursive), a directory's contents are not copied
09ed3099
WD
614unless the directory was specified on the command-line as either "." or a
615name with a trailing slash (e.g. "foo/"). Without this option or the
faa82484 616bf(--recursive) option, rsync will skip all directories it encounters (and
f40aa6fb
WD
617output a message to that effect for each one). If you specify both
618bf(--dirs) and bf(--recursive), the latter takes precedence.
09ed3099 619
eb06fa95
MP
620dit(bf(-l, --links)) When symlinks are encountered, recreate the
621symlink on the destination.
41059f75 622
eb06fa95 623dit(bf(-L, --copy-links)) When symlinks are encountered, the file that
ef855d19
WD
624they point to (the referent) is copied, rather than the symlink. In older
625versions of rsync, this option also had the side-effect of telling the
626receiving side to follow symlinks, such as symlinks to directories. In a
faa82484 627modern rsync such as this one, you'll need to specify bf(--keep-dirlinks) (bf(-K))
ef855d19 628to get this extra behavior. The only exception is when sending files to
faa82484
WD
629an rsync that is too old to understand bf(-K) -- in that case, the bf(-L) option
630will still have the side-effect of bf(-K) on that older receiving rsync.
b5313607 631
eb06fa95 632dit(bf(--copy-unsafe-links)) This tells rsync to copy the referent of
7af4227a 633symbolic links that point outside the copied tree. Absolute symlinks
eb06fa95 634are also treated like ordinary files, and so are any symlinks in the
faa82484 635source path itself when bf(--relative) is used.
41059f75 636
d310a212 637dit(bf(--safe-links)) This tells rsync to ignore any symbolic links
7af4227a 638which point outside the copied tree. All absolute symlinks are
faa82484
WD
639also ignored. Using this option in conjunction with bf(--relative) may
640give unexpected results.
d310a212 641
41059f75
AT
642dit(bf(-H, --hard-links)) This tells rsync to recreate hard links on
643the remote system to be the same as the local system. Without this
644option hard links are treated like regular files.
645
646Note that rsync can only detect hard links if both parts of the link
647are in the list of files being sent.
648
649This option can be quite slow, so only use it if you need it.
650
09ed3099
WD
651dit(bf(-K, --keep-dirlinks)) On the receiving side, if a symlink is
652pointing to a directory, it will be treated as matching a directory
653from the sender.
654
41059f75 655dit(bf(-W, --whole-file)) With this option the incremental rsync algorithm
a1a440c2
DD
656is not used and the whole file is sent as-is instead. The transfer may be
657faster if this option is used when the bandwidth between the source and
6eb770bb 658destination machines is higher than the bandwidth to disk (especially when the
4d888108 659"disk" is actually a networked filesystem). This is the default when both
6eb770bb 660the source and destination are specified as local paths.
41059f75 661
8dc74608
WD
662dit(bf(-p, --perms)) This option causes rsync to set the destination
663permissions to be the same as the source permissions.
664
79db59d1
WD
665Without this option, all existing files (including updated files) retain
666their existing permissions, while each new file gets its permissions set
667based on the source file's permissions, but masked by the receiving end's
668umask setting
8dc74608 669(which is the same behavior as other file-copy utilities, such as cp).
41059f75 670
eb06fa95
MP
671dit(bf(-o, --owner)) This option causes rsync to set the owner of the
672destination file to be the same as the source file. On most systems,
a2b0471f
WD
673only the super-user can set file ownership. By default, the preservation
674is done by name, but may fall back to using the ID number in some
faa82484 675circumstances. See the bf(--numeric-ids) option for a full discussion.
41059f75 676
eb06fa95
MP
677dit(bf(-g, --group)) This option causes rsync to set the group of the
678destination file to be the same as the source file. If the receiving
679program is not running as the super-user, only groups that the
a2b0471f
WD
680receiver is a member of will be preserved. By default, the preservation
681is done by name, but may fall back to using the ID number in some
faa82484 682circumstances. See the bf(--numeric-ids) option for a full discussion.
41059f75
AT
683
684dit(bf(-D, --devices)) This option causes rsync to transfer character and
685block device information to the remote system to recreate these
686devices. This option is only available to the super-user.
687
688dit(bf(-t, --times)) This tells rsync to transfer modification times along
baf3e504
DD
689with the files and update them on the remote system. Note that if this
690option is not used, the optimization that excludes files that have not been
faa82484
WD
691modified cannot be effective; in other words, a missing bf(-t) or bf(-a) will
692cause the next transfer to behave as if it used bf(-I), causing all files to be
d0bc3520 693updated (though the rsync algorithm will make the update fairly efficient
faa82484 694if the files haven't actually changed, you're much better off using bf(-t)).
41059f75 695
54e66f1d 696dit(bf(-O, --omit-dir-times)) This tells rsync to omit directories when
faa82484
WD
697it is preserving modification times (see bf(--times)). If NFS is sharing
698the directories on the receiving side, it is a good idea to use bf(-O).
fbe5eeb8 699This option is inferred if you use bf(--backup) without bf(--backup-dir).
54e66f1d 700
41059f75
AT
701dit(bf(-n, --dry-run)) This tells rsync to not do any file transfers,
702instead it will just report the actions it would have taken.
703
704dit(bf(-S, --sparse)) Try to handle sparse files efficiently so they take
a8cbb57c
WD
705up less space on the destination. Conflicts with bf(--inplace) because it's
706not possible to overwrite data in a sparse fashion.
41059f75 707
d310a212
AT
708NOTE: Don't use this option when the destination is a Solaris "tmpfs"
709filesystem. It doesn't seem to handle seeks over null regions
710correctly and ends up corrupting the files.
711
41059f75
AT
712dit(bf(-x, --one-file-system)) This tells rsync not to cross filesystem
713boundaries when recursing. This is useful for transferring the
714contents of only one filesystem.
715
faa82484 716dit(bf(--existing)) This tells rsync not to create any new files --
1347d512
AT
717only update files that already exist on the destination.
718
3d6feada 719dit(bf(--ignore-existing))
faa82484
WD
720This tells rsync not to update files that already exist on
721the destination.
3d6feada 722
96110304
WD
723dit(bf(--remove-sent-files)) This tells rsync to remove from the sending
724side the files and/or symlinks that are newly created or whose content is
725updated on the receiving side. Directories and devices are not removed,
726nor are files/symlinks whose attributes are merely changed.
727
2c0fa6c5 728dit(bf(--delete)) This tells rsync to delete extraneous files from the
e8b155a3
WD
729receiving side (ones that aren't on the sending side), but only for the
730directories that are being synchronized. You must have asked rsync to
731send the whole directory (e.g. "dir" or "dir/") without using a wildcard
732for the directory's contents (e.g. "dir/*") since the wildcard is expanded
ae76a740 733by the shell and rsync thus gets a request to transfer individual files, not
e8b155a3 734the files' parent directory. Files that are excluded from transfer are
0dfffb88
WD
735also excluded from being deleted unless you use the bf(--delete-excluded)
736option or mark the rules as only matching on the sending side (see the
737include/exclude modifiers in the FILTER RULES section).
41059f75 738
866925bf 739This option has no effect unless directory recursion is enabled.
24986abd 740
b33b791e 741This option can be dangerous if used incorrectly! It is a very good idea
faa82484 742to run first using the bf(--dry-run) option (bf(-n)) to see what files would be
b33b791e 743deleted to make sure important files aren't listed.
41059f75 744
e8b155a3 745If the sending side detects any I/O errors, then the deletion of any
3e578a19
AT
746files at the destination will be automatically disabled. This is to
747prevent temporary filesystem failures (such as NFS errors) on the
748sending side causing a massive deletion of files on the
faa82484 749destination. You can override this with the bf(--ignore-errors) option.
41059f75 750
faa82484
WD
751The bf(--delete) option may be combined with one of the --delete-WHEN options
752without conflict, as well as bf(--delete-excluded). However, if none of the
2c0fa6c5 753--delete-WHEN options are specified, rsync will currently choose the
faa82484
WD
754bf(--delete-before) algorithm. A future version may change this to choose the
755bf(--delete-during) algorithm. See also bf(--delete-after).
2c0fa6c5
WD
756
757dit(bf(--delete-before)) Request that the file-deletions on the receiving
faa82484
WD
758side be done before the transfer starts. This is the default if bf(--delete)
759or bf(--delete-excluded) is specified without one of the --delete-WHEN options.
760See bf(--delete) (which is implied) for more details on file-deletion.
2c0fa6c5
WD
761
762Deleting before the transfer is helpful if the filesystem is tight for space
aaca3daa 763and removing extraneous files would help to make the transfer possible.
ae76a740 764However, it does introduce a delay before the start of the transfer,
faa82484 765and this delay might cause the transfer to timeout (if bf(--timeout) was
ae76a740
WD
766specified).
767
2c0fa6c5
WD
768dit(bf(--delete-during, --del)) Request that the file-deletions on the
769receiving side be done incrementally as the transfer happens. This is
ae283632 770a faster method than choosing the before- or after-transfer algorithm,
ae76a740 771but it is only supported beginning with rsync version 2.6.4.
faa82484 772See bf(--delete) (which is implied) for more details on file-deletion.
aaca3daa 773
2c0fa6c5 774dit(bf(--delete-after)) Request that the file-deletions on the receiving
ae76a740
WD
775side be done after the transfer has completed. This is useful if you
776are sending new per-directory merge files as a part of the transfer and
777you want their exclusions to take effect for the delete phase of the
778current transfer.
faa82484 779See bf(--delete) (which is implied) for more details on file-deletion.
e8b155a3 780
866925bf
WD
781dit(bf(--delete-excluded)) In addition to deleting the files on the
782receiving side that are not on the sending side, this tells rsync to also
faa82484 783delete any files on the receiving side that are excluded (see bf(--exclude)).
0dfffb88
WD
784See the FILTER RULES section for a way to make individual exclusions behave
785this way on the receiver, and for a way to protect files from
786bf(--delete-excluded).
faa82484 787See bf(--delete) (which is implied) for more details on file-deletion.
866925bf 788
faa82484 789dit(bf(--ignore-errors)) Tells bf(--delete) to go ahead and delete files
b5accaba 790even when there are I/O errors.
2c5548d2 791
b695d088
DD
792dit(bf(--force)) This options tells rsync to delete directories even if
793they are not empty when they are to be replaced by non-directories. This
faa82484
WD
794is only relevant without bf(--delete) because deletions are now done depth-first.
795Requires the bf(--recursive) option (which is implied by bf(-a)) to have any effect.
41059f75 796
e2124620 797dit(bf(--max-delete=NUM)) This tells rsync not to delete more than NUM
3b2ef5b1
WD
798files or directories (NUM must be non-zero).
799This is useful when mirroring very large trees to prevent disasters.
e2124620
WD
800
801dit(bf(--max-size=SIZE)) This tells rsync to avoid transferring any
802file that is larger than the specified SIZE. The SIZE value can be
803suffixed with a letter to indicate a size multiplier (K, M, or G) and
804may be a fractional value (e.g. "bf(--max-size=1.5m)").
805
3ed8eb3f
WD
806dit(bf(-B, --block-size=BLOCKSIZE)) This forces the block size used in
807the rsync algorithm to a fixed value. It is normally selected based on
808the size of each file being updated. See the technical report for details.
41059f75 809
b5679335 810dit(bf(-e, --rsh=COMMAND)) This option allows you to choose an alternative
41059f75 811remote shell program to use for communication between the local and
43cd760f
WD
812remote copies of rsync. Typically, rsync is configured to use ssh by
813default, but you may prefer to use rsh on a local network.
41059f75 814
bef49340 815If this option is used with bf([user@]host::module/path), then the
5a727522 816remote shell em(COMMAND) will be used to run an rsync daemon on the
bef49340
WD
817remote host, and all data will be transmitted through that remote
818shell connection, rather than through a direct socket connection to a
754a080f
WD
819running rsync daemon on the remote host. See the section "USING
820RSYNC-DAEMON FEATURES VIA A REMOTE-SHELL CONNECTION" above.
bef49340 821
ea7f8108
WD
822Command-line arguments are permitted in COMMAND provided that COMMAND is
823presented to rsync as a single argument. For example:
98393ae2 824
faa82484 825quote(tt( -e "ssh -p 2234"))
98393ae2
WD
826
827(Note that ssh users can alternately customize site-specific connect
828options in their .ssh/config file.)
829
41059f75 830You can also choose the remote shell program using the RSYNC_RSH
faa82484 831environment variable, which accepts the same range of values as bf(-e).
41059f75 832
faa82484 833See also the bf(--blocking-io) option which is affected by this option.
735a816e 834
68e169ab
WD
835dit(bf(--rsync-path=PROGRAM)) Use this to specify what program is to be run
836on the remote machine to start-up rsync. Often used when rsync is not in
837the default remote-shell's path (e.g. --rsync-path=/usr/local/bin/rsync).
838Note that PROGRAM is run with the help of a shell, so it can be any
839program, script, or command sequence you'd care to run, so long as it does
840not corrupt the standard-in & standard-out that rsync is using to
841communicate.
842
843One tricky example is to set a different default directory on the remote
844machine for use with the bf(--relative) option. For instance:
845
846quote(tt( rsync -avR --rsync-path="cd /a/b && rsync" hst:c/d /e/))
41059f75 847
f177b7cc
WD
848dit(bf(-C, --cvs-exclude)) This is a useful shorthand for excluding a
849broad range of files that you often don't want to transfer between
850systems. It uses the same algorithm that CVS uses to determine if
851a file should be ignored.
852
853The exclude list is initialized to:
854
faa82484 855quote(quote(tt(RCS SCCS CVS CVS.adm RCSLOG cvslog.* tags TAGS .make.state
2a383be0 856.nse_depinfo *~ #* .#* ,* _$* *$ *.old *.bak *.BAK *.orig *.rej
faa82484 857.del-* *.a *.olb *.o *.obj *.so *.exe *.Z *.elc *.ln core .svn/)))
f177b7cc
WD
858
859then files listed in a $HOME/.cvsignore are added to the list and any
2a383be0
WD
860files listed in the CVSIGNORE environment variable (all cvsignore names
861are delimited by whitespace).
862
f177b7cc 863Finally, any file is ignored if it is in the same directory as a
bafa4875
WD
864.cvsignore file and matches one of the patterns listed therein. Unlike
865rsync's filter/exclude files, these patterns are split on whitespace.
2a383be0 866See the bf(cvs(1)) manual for more information.
f177b7cc 867
bafa4875
WD
868If you're combining bf(-C) with your own bf(--filter) rules, you should
869note that these CVS excludes are appended at the end of your own rules,
3753975f 870regardless of where the bf(-C) was placed on the command-line. This makes them
bafa4875
WD
871a lower priority than any rules you specified explicitly. If you want to
872control where these CVS excludes get inserted into your filter rules, you
873should omit the bf(-C) as a command-line option and use a combination of
874bf(--filter=:C) and bf(--filter=-C) (either on your command-line or by
875putting the ":C" and "-C" rules into a filter file with your other rules).
876The first option turns on the per-directory scanning for the .cvsignore
877file. The second option does a one-time import of the CVS excludes
878mentioned above.
879
16e5de84
WD
880dit(bf(-f, --filter=RULE)) This option allows you to add rules to selectively
881exclude certain files from the list of files to be transferred. This is
882most useful in combination with a recursive transfer.
41059f75 883
faa82484 884You may use as many bf(--filter) options on the command line as you like
41059f75
AT
885to build up the list of files to exclude.
886
16e5de84
WD
887See the FILTER RULES section for detailed information on this option.
888
faa82484 889dit(bf(-F)) The bf(-F) option is a shorthand for adding two bf(--filter) rules to
16e5de84
WD
890your command. The first time it is used is a shorthand for this rule:
891
faa82484 892quote(tt( --filter=': /.rsync-filter'))
16e5de84
WD
893
894This tells rsync to look for per-directory .rsync-filter files that have
895been sprinkled through the hierarchy and use their rules to filter the
faa82484 896files in the transfer. If bf(-F) is repeated, it is a shorthand for this
16e5de84
WD
897rule:
898
faa82484 899quote(tt( --filter='- .rsync-filter'))
16e5de84
WD
900
901This filters out the .rsync-filter files themselves from the transfer.
902
903See the FILTER RULES section for detailed information on how these options
904work.
905
906dit(bf(--exclude=PATTERN)) This option is a simplified form of the
faa82484 907bf(--filter) option that defaults to an exclude rule and does not allow
16e5de84
WD
908the full rule-parsing syntax of normal filter rules.
909
910See the FILTER RULES section for detailed information on this option.
41059f75 911
faa82484 912dit(bf(--exclude-from=FILE)) This option is similar to the bf(--exclude)
c48b22c8
AT
913option, but instead it adds all exclude patterns listed in the file
914FILE to the exclude list. Blank lines in FILE and lines starting with
915';' or '#' are ignored.
f8a94f0d
DD
916If em(FILE) is bf(-) the list will be read from standard input.
917
16e5de84 918dit(bf(--include=PATTERN)) This option is a simplified form of the
faa82484 919bf(--filter) option that defaults to an include rule and does not allow
16e5de84 920the full rule-parsing syntax of normal filter rules.
43bd68e5 921
16e5de84 922See the FILTER RULES section for detailed information on this option.
43bd68e5 923
b5679335 924dit(bf(--include-from=FILE)) This specifies a list of include patterns
43bd68e5 925from a file.
c769702f 926If em(FILE) is "-" the list will be read from standard input.
f8a94f0d 927
f177b7cc
WD
928dit(bf(--files-from=FILE)) Using this option allows you to specify the
929exact list of files to transfer (as read from the specified FILE or "-"
c769702f 930for standard input). It also tweaks the default behavior of rsync to make
faa82484
WD
931transferring just the specified files and directories easier:
932
933quote(itemize(
934 it() The bf(--relative) (bf(-R)) option is implied, which preserves the path
935 information that is specified for each item in the file (use
f40aa6fb 936 bf(--no-relative) or bf(--no-R) if you want to turn that off).
faa82484
WD
937 it() The bf(--dirs) (bf(-d)) option is implied, which will create directories
938 specified in the list on the destination rather than noisily skipping
f40aa6fb 939 them (use bf(--no-dirs) or bf(--no-d) if you want to turn that off).
faa82484
WD
940 it() The bf(--archive) (bf(-a)) option's behavior does not imply bf(--recursive)
941 (bf(-r)), so specify it explicitly, if you want it.
f40aa6fb
WD
942 it() These side-effects change the default state of rsync, so the position
943 of the bf(--files-from) option on the command-line has no bearing on how
944 other options are parsed (e.g. bf(-a) works the same before or after
945 bf(--files-from), as does bf(--no-R) and all other options).
faa82484 946))
f177b7cc
WD
947
948The file names that are read from the FILE are all relative to the
949source dir -- any leading slashes are removed and no ".." references are
950allowed to go higher than the source dir. For example, take this
951command:
952
faa82484 953quote(tt( rsync -a --files-from=/tmp/foo /usr remote:/backup))
f177b7cc
WD
954
955If /tmp/foo contains the string "bin" (or even "/bin"), the /usr/bin
51cc96e4
WD
956directory will be created as /backup/bin on the remote host. If it
957contains "bin/" (note the trailing slash), the immediate contents of
958the directory would also be sent (without needing to be explicitly
959mentioned in the file -- this began in version 2.6.4). In both cases,
960if the bf(-r) option was enabled, that dir's entire hierarchy would
961also be transferred (keep in mind that bf(-r) needs to be specified
962explicitly with bf(--files-from), since it is not implied by bf(-a)).
963Also note
faa82484 964that the effect of the (enabled by default) bf(--relative) option is to
f177b7cc
WD
965duplicate only the path info that is read from the file -- it does not
966force the duplication of the source-spec path (/usr in this case).
967
faa82484 968In addition, the bf(--files-from) file can be read from the remote host
f177b7cc
WD
969instead of the local host if you specify a "host:" in front of the file
970(the host must match one end of the transfer). As a short-cut, you can
971specify just a prefix of ":" to mean "use the remote end of the
972transfer". For example:
973
faa82484 974quote(tt( rsync -a --files-from=:/path/file-list src:/ /tmp/copy))
f177b7cc
WD
975
976This would copy all the files specified in the /path/file-list file that
977was located on the remote "src" host.
978
fa92818a 979dit(bf(-0, --from0)) This tells rsync that the rules/filenames it reads from a
f177b7cc 980file are terminated by a null ('\0') character, not a NL, CR, or CR+LF.
faa82484
WD
981This affects bf(--exclude-from), bf(--include-from), bf(--files-from), and any
982merged files specified in a bf(--filter) rule.
983It does not affect bf(--cvs-exclude) (since all names read from a .cvsignore
f01b6368 984file are split on whitespace).
41059f75 985
b5679335 986dit(bf(-T, --temp-dir=DIR)) This option instructs rsync to use DIR as a
375a4556 987scratch directory when creating temporary copies of the files
41059f75
AT
988transferred on the receiving side. The default behavior is to create
989the temporary files in the receiving directory.
990
5b483755
WD
991dit(bf(-y, --fuzzy)) This option tells rsync that it should look for a
992basis file for any destination file that is missing. The current algorithm
993looks in the same directory as the destination file for either a file that
994has an identical size and modified-time, or a similarly-named file. If
995found, rsync uses the fuzzy basis file to try to speed up the transfer.
996
997Note that the use of the bf(--delete) option might get rid of any potential
998fuzzy-match files, so either use bf(--delete-after) or specify some
999filename exclusions if you need to prevent this.
1000
b127c1dc 1001dit(bf(--compare-dest=DIR)) This option instructs rsync to use em(DIR) on
e49f61f5
WD
1002the destination machine as an additional hierarchy to compare destination
1003files against doing transfers (if the files are missing in the destination
1004directory). If a file is found in em(DIR) that is identical to the
1005sender's file, the file will NOT be transferred to the destination
1006directory. This is useful for creating a sparse backup of just files that
1007have changed from an earlier backup.
1008
faa82484 1009Beginning in version 2.6.4, multiple bf(--compare-dest) directories may be
99eb41b2
WD
1010provided, which will cause rsync to search the list in the order specified
1011for an exact match.
2f03ce67
WD
1012If a match is found that differs only in attributes, a local copy is made
1013and the attributes updated.
99eb41b2
WD
1014If a match is not found, a basis file from one of the em(DIR)s will be
1015selected to try to speed up the transfer.
e49f61f5
WD
1016
1017If em(DIR) is a relative path, it is relative to the destination directory.
2f03ce67 1018See also bf(--copy-dest) and bf(--link-dest).
b127c1dc 1019
2f03ce67
WD
1020dit(bf(--copy-dest=DIR)) This option behaves like bf(--compare-dest), but
1021rsync will also copy unchanged files found in em(DIR) to the destination
1022directory using a local copy.
1023This is useful for doing transfers to a new destination while leaving
1024existing files intact, and then doing a flash-cutover when all files have
1025been successfully transferred.
1026
1027Multiple bf(--copy-dest) directories may be provided, which will cause
1028rsync to search the list in the order specified for an unchanged file.
1029If a match is not found, a basis file from one of the em(DIR)s will be
1030selected to try to speed up the transfer.
1031
1032If em(DIR) is a relative path, it is relative to the destination directory.
1033See also bf(--compare-dest) and bf(--link-dest).
1034
1035dit(bf(--link-dest=DIR)) This option behaves like bf(--copy-dest), but
e49f61f5
WD
1036unchanged files are hard linked from em(DIR) to the destination directory.
1037The files must be identical in all preserved attributes (e.g. permissions,
1038possibly ownership) in order for the files to be linked together.
8429aa9e
WD
1039An example:
1040
faa82484 1041quote(tt( rsync -av --link-dest=$PWD/prior_dir host:src_dir/ new_dir/))
59c95e42 1042
99eb41b2
WD
1043Beginning in version 2.6.4, multiple bf(--link-dest) directories may be
1044provided, which will cause rsync to search the list in the order specified
1045for an exact match.
2f03ce67
WD
1046If a match is found that differs only in attributes, a local copy is made
1047and the attributes updated.
99eb41b2
WD
1048If a match is not found, a basis file from one of the em(DIR)s will be
1049selected to try to speed up the transfer.
e49f61f5
WD
1050
1051If em(DIR) is a relative path, it is relative to the destination directory.
2f03ce67 1052See also bf(--compare-dest) and bf(--copy-dest).
b127c1dc 1053
e0204f56 1054Note that rsync versions prior to 2.6.1 had a bug that could prevent
faa82484
WD
1055bf(--link-dest) from working properly for a non-root user when bf(-o) was specified
1056(or implied by bf(-a)). You can work-around this bug by avoiding the bf(-o) option
eb162f3b 1057when sending to an old rsync.
e0204f56 1058
32a5edf4
WD
1059dit(bf(-z, --compress)) With this option, rsync compresses the file data
1060as it is sent to the destination machine, which reduces the amount of data
1061being transmitted -- something that is useful over a slow connection.
41059f75 1062
32a5edf4
WD
1063Note this this option typically achieves better compression ratios that can
1064be achieved by using a compressing remote shell or a compressing transport
1065because it takes advantage of the implicit information in the matching data
1066blocks that are not explicitly sent over the connection.
41059f75
AT
1067
1068dit(bf(--numeric-ids)) With this option rsync will transfer numeric group
4d888108 1069and user IDs rather than using user and group names and mapping them
41059f75
AT
1070at both ends.
1071
4d888108 1072By default rsync will use the username and groupname to determine
41059f75 1073what ownership to give files. The special uid 0 and the special group
faa82484 10740 are never mapped via user/group names even if the bf(--numeric-ids)
41059f75
AT
1075option is not specified.
1076
ec40899b
WD
1077If a user or group has no name on the source system or it has no match
1078on the destination system, then the numeric ID
1079from the source system is used instead. See also the comments on the
a2b0471f
WD
1080"use chroot" setting in the rsyncd.conf manpage for information on how
1081the chroot setting affects rsync's ability to look up the names of the
1082users and groups and what you can do about it.
41059f75 1083
b5accaba 1084dit(bf(--timeout=TIMEOUT)) This option allows you to set a maximum I/O
de2fd20e
AT
1085timeout in seconds. If no data is transferred for the specified time
1086then rsync will exit. The default is 0, which means no timeout.
41059f75 1087
3ae5367f
WD
1088dit(bf(--address)) By default rsync will bind to the wildcard address when
1089connecting to an rsync daemon. The bf(--address) option allows you to
1090specify a specific IP address (or hostname) to bind to. See also this
1091option in the bf(--daemon) mode section.
1092
c259892c
WD
1093dit(bf(--port=PORT)) This specifies an alternate TCP port number to use
1094rather than the default of 873. This is only needed if you are using the
1095double-colon (::) syntax to connect with an rsync daemon (since the URL
1096syntax has a way to specify the port as a part of the URL). See also this
faa82484 1097option in the bf(--daemon) mode section.
c259892c 1098
b5accaba 1099dit(bf(--blocking-io)) This tells rsync to use blocking I/O when launching
314a74d7
WD
1100a remote shell transport. If the remote shell is either rsh or remsh,
1101rsync defaults to using
b5accaba
WD
1102blocking I/O, otherwise it defaults to using non-blocking I/O. (Note that
1103ssh prefers non-blocking I/O.)
64c704f0 1104
0cfdf226 1105dit(bf(-i, --itemize-changes)) Requests a simple itemized list of the
4f90eb43 1106changes that are being made to each file, including attribute changes.
ea67c715
WD
1107This is exactly the same as specifying bf(--log-format='%i %n%L').
1108
a314f7c1
WD
1109The "%i" escape has a cryptic output that is 9 letters long. The general
1110format is like the string bf(UXcstpoga)), where bf(U) is replaced by the
1111kind of update being done, bf(X) is replaced by the file-type, and the
1112other letters represent attributes that may be output if they are being
ee171c6d 1113modified.
ea67c715 1114
a314f7c1 1115The update types that replace the bf(U) are as follows:
ea67c715 1116
a314f7c1 1117quote(itemize(
cc3e0770 1118 it() A bf(<) means that a file is being transferred to the remote host
a314f7c1 1119 (sent).
cc3e0770
WD
1120 it() A bf(>) means that a file is being transferred to the local host
1121 (received).
c48cff9f 1122 it() A bf(c) means that a local change/creation is occurring for the item
ee171c6d 1123 (such as the creation of a directory or the changing of a symlink, etc.).
b4875de4
WD
1124 it() A bf(h) means that the item is a hard-link to another item (requires
1125 bf(--hard-links)).
ee171c6d
WD
1126 it() A bf(.) means that the item is not being updated (though it might
1127 have attributes that are being modified).
a314f7c1 1128))
ea67c715 1129
a314f7c1 1130The file-types that replace the bf(X) are: bf(f) for a file, a bf(d) for a
b9f0ca72 1131directory, an bf(L) for a symlink, and a bf(D) for a device.
ea67c715 1132
a314f7c1 1133The other letters in the string above are the actual letters that
ea67c715
WD
1134will be output if the associated attribute for the item is being updated or
1135a "." for no change. Three exceptions to this are: (1) a newly created
b9f0ca72
WD
1136item replaces each letter with a "+", (2) an identical item replaces the
1137dots with spaces, and (3) an unknown attribute replaces each letter with
81c453b1 1138a "?" (this can happen when talking to an older rsync).
ea67c715
WD
1139
1140The attribute that is associated with each letter is as follows:
1141
1142quote(itemize(
1143 it() A bf(c) means the checksum of the file is different and will be
c48cff9f 1144 updated by the file transfer (requires bf(--checksum)).
ea67c715
WD
1145 it() A bf(s) means the size of the file is different and will be updated
1146 by the file transfer.
1147 it() A bf(t) means the modification time is different and is being updated
5a727522 1148 to the sender's value (requires bf(--times)). An alternate value of bf(T)
ea67c715
WD
1149 means that the time will be set to the transfer time, which happens
1150 anytime a symlink is transferred, or when a file or device is transferred
1151 without bf(--times).
1152 it() A bf(p) means the permissions are different and are being updated to
5a727522 1153 the sender's value (requires bf(--perms)).
4dc67d5e 1154 it() An bf(o) means the owner is different and is being updated to the
5a727522 1155 sender's value (requires bf(--owner) and root privileges).
4dc67d5e 1156 it() A bf(g) means the group is different and is being updated to the
5a727522 1157 sender's value (requires bf(--group) and the authority to set the group).
a314f7c1
WD
1158 it() The bf(a) is reserved for a future enhanced version that supports
1159 extended file attributes, such as ACLs.
ea67c715
WD
1160))
1161
1162One other output is possible: when deleting files, the "%i" will output
ee171c6d 1163the string "*deleting" for each item that is being removed (assuming that
ea67c715
WD
1164you are talking to a recent enough rsync that it logs deletions instead of
1165outputting them as a verbose message).
dc0f2497 1166
3a64ad1f 1167dit(bf(--log-format=FORMAT)) This allows you to specify exactly what the
ea67c715
WD
1168rsync client outputs to the user on a per-file basis. The format is a text
1169string containing embedded single-character escape sequences prefixed with
1170a percent (%) character. For a list of the possible escape characters, see
1171the "log format" setting in the rsyncd.conf manpage. (Note that this
1172option does not affect what a daemon logs to its logfile.)
1173
1174Specifying this option will mention each file, dir, etc. that gets updated
1175in a significant way (a transferred file, a recreated symlink/device, or a
1176touched directory) unless the itemized-changes escape (%i) is included in
1177the string, in which case the logging of names increases to mention any
81c453b1 1178item that is changed in any way (as long as the receiving side is at least
ea67c715
WD
11792.6.4). See the bf(--itemized-changes) option for a description of the
1180output of "%i".
1181
1182The bf(--verbose) option implies a format of "%n%L", but you can use
1183bf(--log-format) without bv(--verbose) if you like, or you can override
1184the format of its per-file output using this option.
1185
1186Rsync will output the log-format string prior to a file's transfer unless
1187one of the transfer-statistic escapes is requested, in which case the
1188logging is done at the end of the file's transfer. When this late logging
1189is in effect and bf(--progress) is also specified, rsync will also output
1190the name of the file being transferred prior to its progress information
1191(followed, of course, by the log-format output).
b6062654 1192
b72f24c7
AT
1193dit(bf(--stats)) This tells rsync to print a verbose set of statistics
1194on the file transfer, allowing you to tell how effective the rsync
e19452a9 1195algorithm is for your data.
b72f24c7 1196
d9fcc198
AT
1197dit(bf(--partial)) By default, rsync will delete any partially
1198transferred file if the transfer is interrupted. In some circumstances
1199it is more desirable to keep partially transferred files. Using the
faa82484 1200bf(--partial) option tells rsync to keep the partial file which should
d9fcc198
AT
1201make a subsequent transfer of the rest of the file much faster.
1202
c2582307
WD
1203dit(bf(--partial-dir=DIR)) A better way to keep partial files than the
1204bf(--partial) option is to specify a em(DIR) that will be used to hold the
1205partial data (instead of writing it out to the destination file).
1206On the next transfer, rsync will use a file found in this
1207dir as data to speed up the resumption of the transfer and then deletes it
1208after it has served its purpose.
1209Note that if bf(--whole-file) is specified (or implied), any partial-dir
1210file that is found for a file that is being updated will simply be removed
1211(since
b90a6d9f 1212rsync is sending files without using the incremental rsync algorithm).
44cad59f 1213
c2582307
WD
1214Rsync will create the em(DIR) if it is missing (just the last dir -- not
1215the whole path). This makes it easy to use a relative path (such as
1216"bf(--partial-dir=.rsync-partial)") to have rsync create the
1217partial-directory in the destination file's directory when needed, and then
1218remove it again when the partial file is deleted.
44cad59f 1219
c2582307 1220If the partial-dir value is not an absolute path, rsync will also add a directory
faa82484 1221bf(--exclude) of this value at the end of all your existing excludes. This
a33857da
WD
1222will prevent partial-dir files from being transferred and also prevent the
1223untimely deletion of partial-dir items on the receiving side. An example:
faa82484 1224the above bf(--partial-dir) option would add an "bf(--exclude=.rsync-partial/)"
16e5de84
WD
1225rule at the end of any other filter rules. Note that if you are
1226supplying your own filter rules, you may need to manually insert a
a33857da
WD
1227rule for this directory exclusion somewhere higher up in the list so that
1228it has a high enough priority to be effective (e.g., if your rules specify
c2582307
WD
1229a trailing bf(--exclude='*') rule, the auto-added rule would never be
1230reached).
44cad59f 1231
faa82484 1232IMPORTANT: the bf(--partial-dir) should not be writable by other users or it
b4d1e854
WD
1233is a security risk. E.g. AVOID "/tmp".
1234
1235You can also set the partial-dir value the RSYNC_PARTIAL_DIR environment
faa82484
WD
1236variable. Setting this in the environment does not force bf(--partial) to be
1237enabled, but rather it effects where partial files go when bf(--partial) is
1238specified. For instance, instead of using bf(--partial-dir=.rsync-tmp)
1239along with bf(--progress), you could set RSYNC_PARTIAL_DIR=.rsync-tmp in your
1240environment and then just use the bf(-P) option to turn on the use of the
1241.rsync-tmp dir for partial transfers. The only time that the bf(--partial)
1242option does not look for this environment value is (1) when bf(--inplace) was
1243specified (since bf(--inplace) conflicts with bf(--partial-dir)), or (2) when
1244bf(--delay-updates) was specified (see below).
01b835c2 1245
5a727522 1246For the purposes of the daemon-config's "refuse options" setting,
c2582307
WD
1247bf(--partial-dir) does em(not) imply bf(--partial). This is so that a
1248refusal of the bf(--partial) option can be used to disallow the overwriting
1249of destination files with a partial transfer, while still allowing the
1250safer idiom provided by bf(--partial-dir).
1251
01b835c2 1252dit(bf(--delay-updates)) This option puts the temporary file from each
c2582307 1253updated file into a holding directory until the end of the
01b835c2
WD
1254transfer, at which time all the files are renamed into place in rapid
1255succession. This attempts to make the updating of the files a little more
c2582307
WD
1256atomic. By default the files are placed into a directory named ".~tmp~" in
1257each file's destination directory, but you can override this by specifying
1258the bf(--partial-dir) option. (Note that RSYNC_PARTIAL_DIR has no effect
1259on this value, nor is bf(--partial-dir) considered to be implied for the
5a727522 1260purposes of the daemon-config's "refuse options" setting.)
c2582307 1261Conflicts with bf(--inplace).
01b835c2
WD
1262
1263This option uses more memory on the receiving side (one bit per file
1264transferred) and also requires enough free disk space on the receiving
1265side to hold an additional copy of all the updated files. Note also that
faa82484 1266you should not use an absolute path to bf(--partial-dir) unless there is no
01b835c2
WD
1267chance of any of the files in the transfer having the same name (since all
1268the updated files will be put into a single directory if the path is
1269absolute).
1270
1271See also the "atomic-rsync" perl script in the "support" subdir for an
faa82484 1272update algorithm that is even more atomic (it uses bf(--link-dest) and a
01b835c2 1273parallel hierarchy of files).
44cad59f 1274
eb86d661
AT
1275dit(bf(--progress)) This option tells rsync to print information
1276showing the progress of the transfer. This gives a bored user
1277something to watch.
c2582307 1278Implies bf(--verbose) if it wasn't already specified.
7b10f91d 1279
68f9910d
WD
1280When the file is transferring, the data looks like this:
1281
faa82484 1282verb( 782448 63% 110.64kB/s 0:00:04)
68f9910d
WD
1283
1284This tells you the current file size, the percentage of the transfer that
1285is complete, the current calculated file-completion rate (including both
1286data over the wire and data being matched locally), and the estimated time
1287remaining in this transfer.
1288
c2c14fa2 1289After a file is complete, the data looks like this:
68f9910d 1290
faa82484 1291verb( 1238099 100% 146.38kB/s 0:00:08 (5, 57.1% of 396))
68f9910d
WD
1292
1293This tells you the final file size, that it's 100% complete, the final
1294transfer rate for the file, the amount of elapsed time it took to transfer
1295the file, and the addition of a total-transfer summary in parentheses.
1296These additional numbers tell you how many files have been updated, and
1297what percent of the total number of files has been scanned.
1298
faa82484 1299dit(bf(-P)) The bf(-P) option is equivalent to bf(--partial) bf(--progress). Its
183150b7
WD
1300purpose is to make it much easier to specify these two options for a long
1301transfer that may be interrupted.
d9fcc198 1302
65575e96 1303dit(bf(--password-file)) This option allows you to provide a password
5a727522
WD
1304in a file for accessing a remote rsync daemon. Note that this option
1305is only useful when accessing an rsync daemon using the built in
65575e96 1306transport, not when using a remote shell as the transport. The file
fc7952e7
AT
1307must not be world readable. It should contain just the password as a
1308single line.
65575e96 1309
09ed3099
WD
1310dit(bf(--list-only)) This option will cause the source files to be listed
1311instead of transferred. This option is inferred if there is no destination
1312specified, so you don't usually need to use it explicitly. However, it can
15997547 1313come in handy for a user that wants to avoid the "bf(-r --exclude='/*/*')"
09ed3099 1314options that rsync might use as a compatibility kluge when generating a
15997547
WD
1315non-recursive listing, or to list the files that are involved in a local
1316copy (since the destination path is not optional for a local copy, you
1317must specify this option explicitly and still include a destination).
09ed3099 1318
ef5d23eb
DD
1319dit(bf(--bwlimit=KBPS)) This option allows you to specify a maximum
1320transfer rate in kilobytes per second. This option is most effective when
1321using rsync with large files (several megabytes and up). Due to the nature
1322of rsync transfers, blocks of data are sent, then if rsync determines the
1323transfer was too fast, it will wait before sending the next data block. The
4d888108 1324result is an average transfer rate equaling the specified limit. A value
ef5d23eb
DD
1325of zero specifies no limit.
1326
b9f592fb 1327dit(bf(--write-batch=FILE)) Record a file that can later be applied to
faa82484 1328another identical destination with bf(--read-batch). See the "BATCH MODE"
32c7f91a 1329section for details, and also the bf(--only-write-batch) option.
6902ed17 1330
326bb56e
WD
1331dit(bf(--only-write-batch=FILE)) Works like bf(--write-batch), except that
1332no updates are made on the destination system when creating the batch.
1333This lets you transport the changes to the destination system via some
32c7f91a
WD
1334other means and then apply the changes via bf(--read-batch).
1335
1336Note that you can feel free to write the batch directly to some portable
1337media: if this media fills to capacity before the end of the transfer, you
1338can just apply that partial transfer to the destination and repeat the
1339whole process to get the rest of the changes (as long as you don't mind a
1340partially updated destination system while the multi-update cycle is
1341happening).
1342
1343Also note that you only save bandwidth when pushing changes to a remote
1344system because this allows the batched data to be diverted from the sender
1345into the batch file without having to flow over the wire to the receiver
1346(when pulling, the sender is remote, and thus can't write the batch).
326bb56e 1347
b9f592fb 1348dit(bf(--read-batch=FILE)) Apply all of the changes stored in FILE, a
faa82484 1349file previously generated by bf(--write-batch).
399371e7 1350If em(FILE) is "-" the batch data will be read from standard input.
c769702f 1351See the "BATCH MODE" section for details.
6902ed17 1352
0b941479
WD
1353dit(bf(--protocol=NUM)) Force an older protocol version to be used. This
1354is useful for creating a batch file that is compatible with an older
1355version of rsync. For instance, if rsync 2.6.4 is being used with the
1356bf(--write-batch) option, but rsync 2.6.3 is what will be used to run the
81c453b1
WD
1357bf(--read-batch) option, you should use "--protocol=28" when creating the
1358batch file to force the older protocol version to be used in the batch
1359file (assuming you can't upgrade the rsync on the reading system).
0b941479 1360
e40a46de
WD
1361dit(bf(-4, --ipv4) or bf(-6, --ipv6)) Tells rsync to prefer IPv4/IPv6
1362when creating sockets. This only affects sockets that rsync has direct
1363control over, such as the outgoing socket when directly contacting an
faa82484 1364rsync daemon. See also these options in the bf(--daemon) mode section.
e40a46de 1365
c8d895de
WD
1366dit(bf(--checksum-seed=NUM)) Set the MD4 checksum seed to the integer
1367NUM. This 4 byte checksum seed is included in each block and file
1368MD4 checksum calculation. By default the checksum seed is generated
b9f592fb 1369by the server and defaults to the current time(). This option
c8d895de
WD
1370is used to set a specific checksum seed, which is useful for
1371applications that want repeatable block and file checksums, or
1372in the case where the user wants a more random checksum seed.
1373Note that setting NUM to 0 causes rsync to use the default of time()
b9f592fb 1374for checksum seed.
41059f75
AT
1375enddit()
1376
faa82484
WD
1377manpagesection(DAEMON OPTIONS)
1378
bdf278f7
WD
1379The options allowed when starting an rsync daemon are as follows:
1380
1381startdit()
bdf278f7 1382dit(bf(--daemon)) This tells rsync that it is to run as a daemon. The
62f27e3c
WD
1383daemon you start running may be accessed using an rsync client using
1384the bf(host::module) or bf(rsync://host/module/) syntax.
bdf278f7
WD
1385
1386If standard input is a socket then rsync will assume that it is being
1387run via inetd, otherwise it will detach from the current terminal and
1388become a background daemon. The daemon will read the config file
1389(rsyncd.conf) on each connect made by a client and respond to
1390requests accordingly. See the rsyncd.conf(5) man page for more
1391details.
1392
3ae5367f
WD
1393dit(bf(--address)) By default rsync will bind to the wildcard address when
1394run as a daemon with the bf(--daemon) option. The bf(--address) option
1395allows you to specify a specific IP address (or hostname) to bind to. This
1396makes virtual hosting possible in conjunction with the bf(--config) option.
1397See also the "address" global option in the rsyncd.conf manpage.
bdf278f7 1398
1f69bec4
WD
1399dit(bf(--bwlimit=KBPS)) This option allows you to specify a maximum
1400transfer rate in kilobytes per second for the data the daemon sends.
faa82484 1401The client can still specify a smaller bf(--bwlimit) value, but their
1f69bec4
WD
1402requested value will be rounded down if they try to exceed it. See the
1403client version of this option (above) for some extra details.
1404
bdf278f7 1405dit(bf(--config=FILE)) This specifies an alternate config file than
faa82484 1406the default. This is only relevant when bf(--daemon) is specified.
bdf278f7
WD
1407The default is /etc/rsyncd.conf unless the daemon is running over
1408a remote shell program and the remote user is not root; in that case
1409the default is rsyncd.conf in the current directory (typically $HOME).
1410
1411dit(bf(--no-detach)) When running as a daemon, this option instructs
1412rsync to not detach itself and become a background process. This
1413option is required when running as a service on Cygwin, and may also
1414be useful when rsync is supervised by a program such as
1415bf(daemontools) or AIX's bf(System Resource Controller).
1416bf(--no-detach) is also recommended when rsync is run under a
1417debugger. This option has no effect if rsync is run from inetd or
1418sshd.
1419
c259892c
WD
1420dit(bf(--port=PORT)) This specifies an alternate TCP port number for the
1421daemon to listen on rather than the default of 873. See also the "port"
1422global option in the rsyncd.conf manpage.
bdf278f7 1423
24b0922b
WD
1424dit(bf(-v, --verbose)) This option increases the amount of information the
1425daemon logs during its startup phase. After the client connects, the
1426daemon's verbosity level will be controlled by the options that the client
1427used and the "max verbosity" setting in the module's config section.
1428
bdf278f7
WD
1429dit(bf(-4, --ipv4) or bf(-6, --ipv6)) Tells rsync to prefer IPv4/IPv6
1430when creating the incoming sockets that the rsync daemon will use to
1431listen for connections. One of these options may be required in older
1432versions of Linux to work around an IPv6 bug in the kernel (if you see
1433an "address already in use" error when nothing else is using the port,
faa82484 1434try specifying bf(--ipv6) or bf(--ipv4) when starting the daemon).
bdf278f7 1435
faa82484 1436dit(bf(-h, --help)) When specified after bf(--daemon), print a short help
bdf278f7 1437page describing the options available for starting an rsync daemon.
bdf278f7
WD
1438enddit()
1439
16e5de84 1440manpagesection(FILTER RULES)
43bd68e5 1441
16e5de84
WD
1442The filter rules allow for flexible selection of which files to transfer
1443(include) and which files to skip (exclude). The rules either directly
1444specify include/exclude patterns or they specify a way to acquire more
1445include/exclude patterns (e.g. to read them from a file).
43bd68e5 1446
16e5de84
WD
1447As the list of files/directories to transfer is built, rsync checks each
1448name to be transferred against the list of include/exclude patterns in
1449turn, and the first matching pattern is acted on: if it is an exclude
1450pattern, then that file is skipped; if it is an include pattern then that
1451filename is not skipped; if no matching pattern is found, then the
43bd68e5
AT
1452filename is not skipped.
1453
16e5de84
WD
1454Rsync builds an ordered list of filter rules as specified on the
1455command-line. Filter rules have the following syntax:
1456
faa82484 1457quote(
d91de046
WD
1458tt(RULE [PATTERN_OR_FILENAME])nl()
1459tt(RULE,MODIFIERS [PATTERN_OR_FILENAME])nl()
16e5de84
WD
1460)
1461
d91de046
WD
1462You have your choice of using either short or long RULE names, as described
1463below. If you use a short-named rule, the ',' separating the RULE from the
1464MODIFIERS is optional. The PATTERN or FILENAME that follows (when present)
1465must come after either a single space or an underscore (_).
1466Here are the available rule prefixes:
16e5de84 1467
faa82484 1468quote(
d91de046
WD
1469bf(exclude, -) specifies an exclude pattern. nl()
1470bf(include, +) specifies an include pattern. nl()
1471bf(merge, .) specifies a merge-file to read for more rules. nl()
1472bf(dir-merge, :) specifies a per-directory merge-file. nl()
0dfffb88
WD
1473bf(hide, H) specifies a pattern for hiding files from the transfer. nl()
1474bf(show, S) files that match the pattern are not hidden. nl()
1475bf(protect, P) specifies a pattern for protecting files from deletion. nl()
1476bf(risk, R) files that match the pattern are not protected. nl()
d91de046 1477bf(clear, !) clears the current include/exclude list (takes no arg) nl()
16e5de84
WD
1478)
1479
d91de046
WD
1480When rules are being read from a file, empty lines are ignored, as are
1481comment lines that start with a "#".
1482
faa82484 1483Note that the bf(--include)/bf(--exclude) command-line options do not allow the
16e5de84 1484full range of rule parsing as described above -- they only allow the
d91de046
WD
1485specification of include/exclude patterns plus a "!" token to clear the
1486list (and the normal comment parsing when rules are read from a file).
1487If a pattern
16e5de84
WD
1488does not begin with "- " (dash, space) or "+ " (plus, space), then the
1489rule will be interpreted as if "+ " (for an include option) or "- " (for
faa82484 1490an exclude option) were prefixed to the string. A bf(--filter) option, on
d91de046
WD
1491the other hand, must always contain either a short or long rule name at the
1492start of the rule.
16e5de84 1493
faa82484 1494Note also that the bf(--filter), bf(--include), and bf(--exclude) options take one
16e5de84 1495rule/pattern each. To add multiple ones, you can repeat the options on
faa82484
WD
1496the command-line, use the merge-file syntax of the bf(--filter) option, or
1497the bf(--include-from)/bf(--exclude-from) options.
16e5de84 1498
16e5de84
WD
1499manpagesection(INCLUDE/EXCLUDE PATTERN RULES)
1500
0dfffb88
WD
1501You can include and exclude files by specifying patterns using the "+",
1502"-", etc. filter rules (as introduced in the FILTER RULES section above).
bb5f4e72
WD
1503The include/exclude rules each specify a pattern that is matched against
1504the names of the files that are going to be transferred. These patterns
1505can take several forms:
16e5de84
WD
1506
1507itemize(
16e5de84
WD
1508 it() if the pattern starts with a / then it is anchored to a
1509 particular spot in the hierarchy of files, otherwise it is matched
1510 against the end of the pathname. This is similar to a leading ^ in
1511 regular expressions.
1512 Thus "/foo" would match a file called "foo" at either the "root of the
1513 transfer" (for a global rule) or in the merge-file's directory (for a
1514 per-directory rule).
1515 An unqualified "foo" would match any file or directory named "foo"
1516 anywhere in the tree because the algorithm is applied recursively from
1517 the
1518 top down; it behaves as if each path component gets a turn at being the
1519 end of the file name. Even the unanchored "sub/foo" would match at
1520 any point in the hierarchy where a "foo" was found within a directory
1521 named "sub". See the section on ANCHORING INCLUDE/EXCLUDE PATTERNS for
1522 a full discussion of how to specify a pattern that matches at the root
1523 of the transfer.
16e5de84
WD
1524 it() if the pattern ends with a / then it will only match a
1525 directory, not a file, link, or device.
16e5de84
WD
1526 it() if the pattern contains a wildcard character from the set
1527 *?[ then expression matching is applied using the shell filename
1528 matching rules. Otherwise a simple string match is used.
16e5de84
WD
1529 it() the double asterisk pattern "**" will match slashes while a
1530 single asterisk pattern "*" will stop at slashes.
16e5de84
WD
1531 it() if the pattern contains a / (not counting a trailing /) or a "**"
1532 then it is matched against the full pathname, including any leading
1533 directories. If the pattern doesn't contain a / or a "**", then it is
1534 matched only against the final component of the filename.
1535 (Remember that the algorithm is applied recursively so "full filename"
ae283632 1536 can actually be any portion of a path from the starting directory on
16e5de84 1537 down.)
16e5de84
WD
1538)
1539
faa82484
WD
1540Note that, when using the bf(--recursive) (bf(-r)) option (which is implied by
1541bf(-a)), every subcomponent of every path is visited from the top down, so
16e5de84
WD
1542include/exclude patterns get applied recursively to each subcomponent's
1543full name (e.g. to include "/foo/bar/baz" the subcomponents "/foo" and
1544"/foo/bar" must not be excluded).
1545The exclude patterns actually short-circuit the directory traversal stage
1546when rsync finds the files to send. If a pattern excludes a particular
1547parent directory, it can render a deeper include pattern ineffectual
1548because rsync did not descend through that excluded section of the
1549hierarchy. This is particularly important when using a trailing '*' rule.
1550For instance, this won't work:
1551
faa82484
WD
1552quote(
1553tt(+ /some/path/this-file-will-not-be-found)nl()
1554tt(+ /file-is-included)nl()
1555tt(- *)nl()
16e5de84
WD
1556)
1557
1558This fails because the parent directory "some" is excluded by the '*'
1559rule, so rsync never visits any of the files in the "some" or "some/path"
1560directories. One solution is to ask for all directories in the hierarchy
a5a26484
WD
1561to be included by using a single rule: "+ */" (put it somewhere before the
1562"- *" rule). Another solution is to add specific include rules for all
16e5de84
WD
1563the parent dirs that need to be visited. For instance, this set of rules
1564works fine:
1565
faa82484
WD
1566quote(
1567tt(+ /some/)nl()
1568tt(+ /some/path/)nl()
1569tt(+ /some/path/this-file-is-found)nl()
1570tt(+ /file-also-included)nl()
1571tt(- *)nl()
16e5de84
WD
1572)
1573
1574Here are some examples of exclude/include matching:
1575
1576itemize(
1577 it() "- *.o" would exclude all filenames matching *.o
1578 it() "- /foo" would exclude a file called foo in the transfer-root directory
1579 it() "- foo/" would exclude any directory called foo
1580 it() "- /foo/*/bar" would exclude any file called bar two
1581 levels below a directory called foo in the transfer-root directory
1582 it() "- /foo/**/bar" would exclude any file called bar two
1583 or more levels below a directory called foo in the transfer-root directory
faa82484 1584 it() The combination of "+ */", "+ *.c", and "- *" would include all
16e5de84
WD
1585 directories and C source files but nothing else.
1586 it() The combination of "+ foo/", "+ foo/bar.c", and "- *" would include
1587 only the foo directory and foo/bar.c (the foo directory must be
1588 explicitly included or it would be excluded by the "*")
1589)
1590
1591manpagesection(MERGE-FILE FILTER RULES)
1592
1593You can merge whole files into your filter rules by specifying either a
d91de046
WD
1594merge (.) or a dir-merge (:) filter rule (as introduced in the FILTER RULES
1595section above).
16e5de84
WD
1596
1597There are two kinds of merged files -- single-instance ('.') and
1598per-directory (':'). A single-instance merge file is read one time, and
1599its rules are incorporated into the filter list in the place of the "."
1600rule. For per-directory merge files, rsync will scan every directory that
1601it traverses for the named file, merging its contents when the file exists
1602into the current list of inherited rules. These per-directory rule files
1603must be created on the sending side because it is the sending side that is
1604being scanned for the available files to transfer. These rule files may
1605also need to be transferred to the receiving side if you want them to
1606affect what files don't get deleted (see PER-DIRECTORY RULES AND DELETE
1607below).
1608
1609Some examples:
1610
faa82484 1611quote(
d91de046 1612tt(merge /etc/rsync/default.rules)nl()
faa82484 1613tt(. /etc/rsync/default.rules)nl()
d91de046
WD
1614tt(dir-merge .per-dir-filter)nl()
1615tt(dir-merge,n- .non-inherited-per-dir-excludes)nl()
faa82484 1616tt(:n- .non-inherited-per-dir-excludes)nl()
16e5de84
WD
1617)
1618
d91de046 1619The following modifiers are accepted after a merge or dir-merge rule:
16e5de84
WD
1620
1621itemize(
62bf783f 1622 it() A bf(-) specifies that the file should consist of only exclude
d91de046 1623 patterns, with no other rule-parsing except for in-file comments.
62bf783f 1624 it() A bf(+) specifies that the file should consist of only include
d91de046
WD
1625 patterns, with no other rule-parsing except for in-file comments.
1626 it() A bf(C) is a way to specify that the file should be read in a
1627 CVS-compatible manner. This turns on 'n', 'w', and '-', but also
1628 allows the list-clearing token (!) to be specified. If no filename is
1629 provided, ".cvsignore" is assumed.
1630 it() A bf(e) will exclude the merge-file name from the transfer; e.g.
a5a26484 1631 "dir-merge,e .rules" is like "dir-merge .rules" and "- .rules".
62bf783f
WD
1632 it() An bf(n) specifies that the rules are not inherited by subdirectories.
1633 it() A bf(w) specifies that the rules are word-split on whitespace instead
16e5de84
WD
1634 of the normal line-splitting. This also turns off comments. Note: the
1635 space that separates the prefix from the rule is treated specially, so
d91de046
WD
1636 "- foo + bar" is parsed as two rules (assuming that prefix-parsing wasn't
1637 also disabled).
1638 it() You may also specify any of the modifiers for the "+" or "-" rules
1639 (below) in order to have the rules that are read-in from the file
a5a26484 1640 default to having that modifier set. For instance, "merge,-/ .excl" would
0dfffb88
WD
1641 treat the contents of .excl as absolute-path excludes,
1642 while "dir-merge,s .filt" and ":sC" would each make all their
5a727522 1643 per-directory rules apply only on the sending side.
16e5de84
WD
1644)
1645
44d60d5f 1646The following modifiers are accepted after a "+" or "-":
dc1488ae
WD
1647
1648itemize(
1649 it() A "/" specifies that the include/exclude should be treated as an
1650 absolute path, relative to the root of the filesystem. For example,
a5a26484 1651 "-/ /etc/passwd" would exclude the passwd file any time the transfer
dc1488ae 1652 was sending files from the "/etc" directory.
44d60d5f
WD
1653 it() A "!" specifies that the include/exclude should take effect if
1654 the pattern fails to match. For instance, "-! */" would exclude all
1655 non-directories.
397a3443
WD
1656 it() A bf(C) is used to indicate that all the global CVS-exclude rules
1657 should be inserted as excludes in place of the "-C". No arg should
1658 follow.
0dfffb88
WD
1659 it() An bf(s) is used to indicate that the rule applies to the sending
1660 side. When a rule affects the sending side, it prevents files from
1661 being transferred. The default is for a rule to affect both sides
1662 unless bf(--delete-excluded) was specified, in which case default rules
1663 become sender-side only. See also the hide (H) and show (S) rules,
5a727522 1664 which are an alternate way to specify sending-side includes/excludes.
0dfffb88
WD
1665 it() An bf(r) is used to indicate that the rule applies to the receiving
1666 side. When a rule affects the receiving side, it prevents files from
1667 being deleted. See the bf(s) modifier for more info. See also the
1668 protect (P) and risk (R) rules, which are an alternate way to
1669 specify receiver-side includes/excludes.
1670)
dc1488ae 1671
16e5de84
WD
1672Per-directory rules are inherited in all subdirectories of the directory
1673where the merge-file was found unless the 'n' modifier was used. Each
1674subdirectory's rules are prefixed to the inherited per-directory rules
1675from its parents, which gives the newest rules a higher priority than the
d91de046 1676inherited rules. The entire set of dir-merge rules are grouped together in
16e5de84 1677the spot where the merge-file was specified, so it is possible to override
d91de046 1678dir-merge rules via a rule that got specified earlier in the list of global
16e5de84
WD
1679rules. When the list-clearing rule ("!") is read from a per-directory
1680file, it only clears the inherited rules for the current merge file.
1681
d91de046 1682Another way to prevent a single rule from a dir-merge file from being inherited is to
16e5de84
WD
1683anchor it with a leading slash. Anchored rules in a per-directory
1684merge-file are relative to the merge-file's directory, so a pattern "/foo"
d91de046 1685would only match the file "foo" in the directory where the dir-merge filter
16e5de84
WD
1686file was found.
1687
faa82484 1688Here's an example filter file which you'd specify via bf(--filter=". file":)
16e5de84 1689
faa82484 1690quote(
d91de046 1691tt(merge /home/user/.global-filter)nl()
faa82484 1692tt(- *.gz)nl()
d91de046 1693tt(dir-merge .rules)nl()
faa82484
WD
1694tt(+ *.[ch])nl()
1695tt(- *.o)nl()
16e5de84
WD
1696)
1697
1698This will merge the contents of the /home/user/.global-filter file at the
1699start of the list and also turns the ".rules" filename into a per-directory
1700filter file. All rules read-in prior to the start of the directory scan
1701follow the global anchoring rules (i.e. a leading slash matches at the root
1702of the transfer).
1703
1704If a per-directory merge-file is specified with a path that is a parent
1705directory of the first transfer directory, rsync will scan all the parent
1706dirs from that starting point to the transfer directory for the indicated
faa82484 1707per-directory file. For instance, here is a common filter (see bf(-F)):
16e5de84 1708
faa82484 1709quote(tt(--filter=': /.rsync-filter'))
16e5de84
WD
1710
1711That rule tells rsync to scan for the file .rsync-filter in all
1712directories from the root down through the parent directory of the
1713transfer prior to the start of the normal directory scan of the file in
1714the directories that are sent as a part of the transfer. (Note: for an
1715rsync daemon, the root is always the same as the module's "path".)
1716
1717Some examples of this pre-scanning for per-directory files:
1718
faa82484
WD
1719quote(
1720tt(rsync -avF /src/path/ /dest/dir)nl()
1721tt(rsync -av --filter=': ../../.rsync-filter' /src/path/ /dest/dir)nl()
1722tt(rsync -av --filter=': .rsync-filter' /src/path/ /dest/dir)nl()
16e5de84
WD
1723)
1724
1725The first two commands above will look for ".rsync-filter" in "/" and
1726"/src" before the normal scan begins looking for the file in "/src/path"
1727and its subdirectories. The last command avoids the parent-dir scan
1728and only looks for the ".rsync-filter" files in each directory that is
1729a part of the transfer.
1730
1731If you want to include the contents of a ".cvsignore" in your patterns,
d91de046
WD
1732you should use the rule ":C", which creates a dir-merge of the .cvsignore
1733file, but parsed in a CVS-compatible manner. You can
faa82484 1734use this to affect where the bf(--cvs-exclude) (bf(-C)) option's inclusion of the
d91de046 1735per-directory .cvsignore file gets placed into your rules by putting the
16e5de84 1736":C" wherever you like in your filter rules. Without this, rsync would
d91de046 1737add the dir-merge rule for the .cvsignore file at the end of all your other
16e5de84
WD
1738rules (giving it a lower priority than your command-line rules). For
1739example:
1740
faa82484
WD
1741quote(
1742tt(cat <<EOT | rsync -avC --filter='. -' a/ b)nl()
1743tt(+ foo.o)nl()
1744tt(:C)nl()
1745tt(- *.old)nl()
1746tt(EOT)nl()
1747tt(rsync -avC --include=foo.o -f :C --exclude='*.old' a/ b)nl()
16e5de84
WD
1748)
1749
1750Both of the above rsync commands are identical. Each one will merge all
1751the per-directory .cvsignore rules in the middle of the list rather than
1752at the end. This allows their dir-specific rules to supersede the rules
bafa4875
WD
1753that follow the :C instead of being subservient to all your rules. To
1754affect the other CVS exclude rules (i.e. the default list of exclusions,
1755the contents of $HOME/.cvsignore, and the value of $CVSIGNORE) you should
1756omit the bf(-C) command-line option and instead insert a "-C" rule into
1757your filter rules; e.g. "--filter=-C".
16e5de84
WD
1758
1759manpagesection(LIST-CLEARING FILTER RULE)
1760
1761You can clear the current include/exclude list by using the "!" filter
1762rule (as introduced in the FILTER RULES section above). The "current"
1763list is either the global list of rules (if the rule is encountered while
1764parsing the filter options) or a set of per-directory rules (which are
1765inherited in their own sub-list, so a subdirectory can use this to clear
1766out the parent's rules).
1767
1768manpagesection(ANCHORING INCLUDE/EXCLUDE PATTERNS)
1769
1770As mentioned earlier, global include/exclude patterns are anchored at the
1771"root of the transfer" (as opposed to per-directory patterns, which are
1772anchored at the merge-file's directory). If you think of the transfer as
1773a subtree of names that are being sent from sender to receiver, the
1774transfer-root is where the tree starts to be duplicated in the destination
1775directory. This root governs where patterns that start with a / match.
a4b6f305
WD
1776
1777Because the matching is relative to the transfer-root, changing the
faa82484 1778trailing slash on a source path or changing your use of the bf(--relative)
a4b6f305
WD
1779option affects the path you need to use in your matching (in addition to
1780changing how much of the file tree is duplicated on the destination
16e5de84 1781host). The following examples demonstrate this.
a4b6f305 1782
b5ebe6d9
WD
1783Let's say that we want to match two source files, one with an absolute
1784path of "/home/me/foo/bar", and one with a path of "/home/you/bar/baz".
1785Here is how the various command choices differ for a 2-source transfer:
a4b6f305 1786
faa82484
WD
1787quote(
1788 Example cmd: rsync -a /home/me /home/you /dest nl()
1789 +/- pattern: /me/foo/bar nl()
1790 +/- pattern: /you/bar/baz nl()
1791 Target file: /dest/me/foo/bar nl()
1792 Target file: /dest/you/bar/baz nl()
1793)
1794
1795quote(
1796 Example cmd: rsync -a /home/me/ /home/you/ /dest nl()
1797 +/- pattern: /foo/bar (note missing "me") nl()
1798 +/- pattern: /bar/baz (note missing "you") nl()
1799 Target file: /dest/foo/bar nl()
1800 Target file: /dest/bar/baz nl()
1801)
1802
1803quote(
1804 Example cmd: rsync -a --relative /home/me/ /home/you /dest nl()
1805 +/- pattern: /home/me/foo/bar (note full path) nl()
1806 +/- pattern: /home/you/bar/baz (ditto) nl()
1807 Target file: /dest/home/me/foo/bar nl()
1808 Target file: /dest/home/you/bar/baz nl()
1809)
1810
1811quote(
1812 Example cmd: cd /home; rsync -a --relative me/foo you/ /dest nl()
1813 +/- pattern: /me/foo/bar (starts at specified path) nl()
1814 +/- pattern: /you/bar/baz (ditto) nl()
1815 Target file: /dest/me/foo/bar nl()
1816 Target file: /dest/you/bar/baz nl()
a4b6f305
WD
1817)
1818
16e5de84 1819The easiest way to see what name you should filter is to just
faa82484
WD
1820look at the output when using bf(--verbose) and put a / in front of the name
1821(use the bf(--dry-run) option if you're not yet ready to copy any files).
d1cce1dd 1822
16e5de84 1823manpagesection(PER-DIRECTORY RULES AND DELETE)
43bd68e5 1824
16e5de84
WD
1825Without a delete option, per-directory rules are only relevant on the
1826sending side, so you can feel free to exclude the merge files themselves
1827without affecting the transfer. To make this easy, the 'e' modifier adds
1828this exclude for you, as seen in these two equivalent commands:
27b9a19b 1829
faa82484
WD
1830quote(
1831tt(rsync -av --filter=': .excl' --exclude=.excl host:src/dir /dest)nl()
1832tt(rsync -av --filter=':e .excl' host:src/dir /dest)nl()
43bd68e5
AT
1833)
1834
16e5de84
WD
1835However, if you want to do a delete on the receiving side AND you want some
1836files to be excluded from being deleted, you'll need to be sure that the
1837receiving side knows what files to exclude. The easiest way is to include
faa82484 1838the per-directory merge files in the transfer and use bf(--delete-after),
16e5de84
WD
1839because this ensures that the receiving side gets all the same exclude
1840rules as the sending side before it tries to delete anything:
43bd68e5 1841
faa82484 1842quote(tt(rsync -avF --delete-after host:src/dir /dest))
20af605e 1843
16e5de84
WD
1844However, if the merge files are not a part of the transfer, you'll need to
1845either specify some global exclude rules (i.e. specified on the command
1846line), or you'll need to maintain your own per-directory merge files on
1847the receiving side. An example of the first is this (assume that the
1848remote .rules files exclude themselves):
20af605e 1849
faa82484
WD
1850verb(rsync -av --filter=': .rules' --filter='. /my/extra.rules'
1851 --delete host:src/dir /dest)
20af605e 1852
16e5de84
WD
1853In the above example the extra.rules file can affect both sides of the
1854transfer, but (on the sending side) the rules are subservient to the rules
1855merged from the .rules files because they were specified after the
1856per-directory merge rule.
43bd68e5 1857
16e5de84
WD
1858In one final example, the remote side is excluding the .rsync-filter
1859files from the transfer, but we want to use our own .rsync-filter files
1860to control what gets deleted on the receiving side. To do this we must
1861specifically exclude the per-directory merge files (so that they don't get
1862deleted) and then put rules into the local files to control what else
1863should not get deleted. Like one of these commands:
1864
faa82484
WD
1865verb( rsync -av --filter=':e /.rsync-filter' --delete \
1866 host:src/dir /dest
1867 rsync -avFF --delete host:src/dir /dest)
43bd68e5 1868
6902ed17
MP
1869manpagesection(BATCH MODE)
1870
088aac85
DD
1871Batch mode can be used to apply the same set of updates to many
1872identical systems. Suppose one has a tree which is replicated on a
1873number of hosts. Now suppose some changes have been made to this
1874source tree and those changes need to be propagated to the other
1875hosts. In order to do this using batch mode, rsync is run with the
1876write-batch option to apply the changes made to the source tree to one
1877of the destination trees. The write-batch option causes the rsync
b9f592fb
WD
1878client to store in a "batch file" all the information needed to repeat
1879this operation against other, identical destination trees.
1880
1881To apply the recorded changes to another destination tree, run rsync
1882with the read-batch option, specifying the name of the same batch
1883file, and the destination tree. Rsync updates the destination tree
1884using the information stored in the batch file.
1885
1886For convenience, one additional file is creating when the write-batch
1887option is used. This file's name is created by appending
73e01568 1888".sh" to the batch filename. The .sh file contains
b9f592fb
WD
1889a command-line suitable for updating a destination tree using that
1890batch file. It can be executed using a Bourne(-like) shell, optionally
1891passing in an alternate destination tree pathname which is then used
1892instead of the original path. This is useful when the destination tree
1893path differs from the original destination tree path.
1894
1895Generating the batch file once saves having to perform the file
1896status, checksum, and data block generation more than once when
088aac85 1897updating multiple destination trees. Multicast transport protocols can
b9f592fb
WD
1898be used to transfer the batch update files in parallel to many hosts
1899at once, instead of sending the same data to every host individually.
088aac85 1900
4602eafa 1901Examples:
088aac85 1902
faa82484
WD
1903quote(
1904tt($ rsync --write-batch=foo -a host:/source/dir/ /adest/dir/)nl()
1905tt($ scp foo* remote:)nl()
1906tt($ ssh remote ./foo.sh /bdest/dir/)nl()
4602eafa
WD
1907)
1908
faa82484
WD
1909quote(
1910tt($ rsync --write-batch=foo -a /source/dir/ /adest/dir/)nl()
1911tt($ ssh remote rsync --read-batch=- -a /bdest/dir/ <foo)nl()
4602eafa
WD
1912)
1913
98f51bfb
WD
1914In these examples, rsync is used to update /adest/dir/ from /source/dir/
1915and the information to repeat this operation is stored in "foo" and
1916"foo.sh". The host "remote" is then updated with the batched data going
1917into the directory /bdest/dir. The differences between the two examples
1918reveals some of the flexibility you have in how you deal with batches:
1919
1920itemize(
98f51bfb
WD
1921 it() The first example shows that the initial copy doesn't have to be
1922 local -- you can push or pull data to/from a remote host using either the
1923 remote-shell syntax or rsync daemon syntax, as desired.
98f51bfb
WD
1924 it() The first example uses the created "foo.sh" file to get the right
1925 rsync options when running the read-batch command on the remote host.
98f51bfb
WD
1926 it() The second example reads the batch data via standard input so that
1927 the batch file doesn't need to be copied to the remote machine first.
1928 This example avoids the foo.sh script because it needed to use a modified
faa82484 1929 bf(--read-batch) option, but you could edit the script file if you wished to
98f51bfb 1930 make use of it (just be sure that no other option is trying to use
faa82484 1931 standard input, such as the "bf(--exclude-from=-)" option).
98f51bfb 1932)
088aac85
DD
1933
1934Caveats:
1935
98f51bfb 1936The read-batch option expects the destination tree that it is updating
088aac85
DD
1937to be identical to the destination tree that was used to create the
1938batch update fileset. When a difference between the destination trees
0b941479 1939is encountered the update might be discarded with a warning (if the file
7432ccf4
WD
1940appears to be up-to-date already) or the file-update may be attempted
1941and then, if the file fails to verify, the update discarded with an
1942error. This means that it should be safe to re-run a read-batch operation
59d73bf3 1943if the command got interrupted. If you wish to force the batched-update to
faa82484 1944always be attempted regardless of the file's size and date, use the bf(-I)
59d73bf3
WD
1945option (when reading the batch).
1946If an error occurs, the destination tree will probably be in a
7432ccf4 1947partially updated state. In that case, rsync can
088aac85
DD
1948be used in its regular (non-batch) mode of operation to fix up the
1949destination tree.
1950
b9f592fb 1951The rsync version used on all destinations must be at least as new as the
59d73bf3
WD
1952one used to generate the batch file. Rsync will die with an error if the
1953protocol version in the batch file is too new for the batch-reading rsync
0b941479
WD
1954to handle. See also the bf(--protocol) option for a way to have the
1955creating rsync generate a batch file that an older rsync can understand.
1956(Note that batch files changed format in version 2.6.3, so mixing versions
1957older than that with newer versions will not work.)
088aac85 1958
7432ccf4
WD
1959When reading a batch file, rsync will force the value of certain options
1960to match the data in the batch file if you didn't set them to the same
1961as the batch-writing command. Other options can (and should) be changed.
bb5f4e72
WD
1962For instance bf(--write-batch) changes to bf(--read-batch),
1963bf(--files-from) is dropped, and the
1964bf(--filter)/bf(--include)/bf(--exclude) options are not needed unless
1965one of the bf(--delete) options is specified.
b9f592fb 1966
faa82484 1967The code that creates the BATCH.sh file transforms any filter/include/exclude
98f51bfb
WD
1968options into a single list that is appended as a "here" document to the
1969shell script file. An advanced user can use this to modify the exclude
faa82484 1970list if a change in what gets deleted by bf(--delete) is desired. A normal
98f51bfb 1971user can ignore this detail and just use the shell script as an easy way
faa82484 1972to run the appropriate bf(--read-batch) command for the batched data.
98f51bfb 1973
59d73bf3
WD
1974The original batch mode in rsync was based on "rsync+", but the latest
1975version uses a new implementation.
6902ed17 1976
eb06fa95
MP
1977manpagesection(SYMBOLIC LINKS)
1978
f28bd833 1979Three basic behaviors are possible when rsync encounters a symbolic
eb06fa95
MP
1980link in the source directory.
1981
1982By default, symbolic links are not transferred at all. A message
1983"skipping non-regular" file is emitted for any symlinks that exist.
1984
1985If bf(--links) is specified, then symlinks are recreated with the same
1986target on the destination. Note that bf(--archive) implies
1987bf(--links).
1988
1989If bf(--copy-links) is specified, then symlinks are "collapsed" by
1990copying their referent, rather than the symlink.
1991
1992rsync also distinguishes "safe" and "unsafe" symbolic links. An
1993example where this might be used is a web site mirror that wishes
1994ensure the rsync module they copy does not include symbolic links to
1995bf(/etc/passwd) in the public section of the site. Using
1996bf(--copy-unsafe-links) will cause any links to be copied as the file
1997they point to on the destination. Using bf(--safe-links) will cause
6efe9416
WD
1998unsafe links to be omitted altogether. (Note that you must specify
1999bf(--links) for bf(--safe-links) to have any effect.)
eb06fa95 2000
7bd0cf5b
MP
2001Symbolic links are considered unsafe if they are absolute symlinks
2002(start with bf(/)), empty, or if they contain enough bf("..")
2003components to ascend from the directory being copied.
2004
6efe9416
WD
2005Here's a summary of how the symlink options are interpreted. The list is
2006in order of precedence, so if your combination of options isn't mentioned,
2007use the first line that is a complete subset of your options:
2008
2009dit(bf(--copy-links)) Turn all symlinks into normal files (leaving no
2010symlinks for any other options to affect).
2011
2012dit(bf(--links --copy-unsafe-links)) Turn all unsafe symlinks into files
2013and duplicate all safe symlinks.
2014
2015dit(bf(--copy-unsafe-links)) Turn all unsafe symlinks into files, noisily
2016skip all safe symlinks.
2017
2018dit(bf(--links --safe-links)) Duplicate safe symlinks and skip unsafe
2019ones.
2020
2021dit(bf(--links)) Duplicate all symlinks.
2022
faa82484 2023manpagediagnostics()
d310a212 2024
14d43f1f 2025rsync occasionally produces error messages that may seem a little
d310a212 2026cryptic. The one that seems to cause the most confusion is "protocol
faa82484 2027version mismatch -- is your shell clean?".
d310a212
AT
2028
2029This message is usually caused by your startup scripts or remote shell
2030facility producing unwanted garbage on the stream that rsync is using
14d43f1f 2031for its transport. The way to diagnose this problem is to run your
d310a212
AT
2032remote shell like this:
2033
faa82484
WD
2034quote(tt(ssh remotehost /bin/true > out.dat))
2035
d310a212 2036then look at out.dat. If everything is working correctly then out.dat
2cfeab21 2037should be a zero length file. If you are getting the above error from
d310a212
AT
2038rsync then you will probably find that out.dat contains some text or
2039data. Look at the contents and try to work out what is producing
14d43f1f 2040it. The most common cause is incorrectly configured shell startup
d310a212
AT
2041scripts (such as .cshrc or .profile) that contain output statements
2042for non-interactive logins.
2043
16e5de84 2044If you are having trouble debugging filter patterns, then
faa82484 2045try specifying the bf(-vv) option. At this level of verbosity rsync will
e6c64e79
MP
2046show why each individual file is included or excluded.
2047
55b64e4b
MP
2048manpagesection(EXIT VALUES)
2049
2050startdit()
a73de5f3 2051dit(bf(0)) Success
faa82484
WD
2052dit(bf(1)) Syntax or usage error
2053dit(bf(2)) Protocol incompatibility
a73de5f3
WD
2054dit(bf(3)) Errors selecting input/output files, dirs
2055dit(bf(4)) Requested action not supported: an attempt
8212336a 2056was made to manipulate 64-bit files on a platform that cannot support
f28bd833 2057them; or an option was specified that is supported by the client and
8212336a 2058not by the server.
a73de5f3 2059dit(bf(5)) Error starting client-server protocol
124f349e 2060dit(bf(6)) Daemon unable to append to log-file
faa82484
WD
2061dit(bf(10)) Error in socket I/O
2062dit(bf(11)) Error in file I/O
2063dit(bf(12)) Error in rsync protocol data stream
2064dit(bf(13)) Errors with program diagnostics
2065dit(bf(14)) Error in IPC code
2066dit(bf(20)) Received SIGUSR1 or SIGINT
2067dit(bf(21)) Some error returned by waitpid()
2068dit(bf(22)) Error allocating core memory buffers
3c1e2ad9
WD
2069dit(bf(23)) Partial transfer due to error
2070dit(bf(24)) Partial transfer due to vanished source files
124f349e 2071dit(bf(25)) The --max-delete limit stopped deletions
faa82484 2072dit(bf(30)) Timeout in data send/receive
55b64e4b
MP
2073enddit()
2074
de2fd20e
AT
2075manpagesection(ENVIRONMENT VARIABLES)
2076
2077startdit()
de2fd20e 2078dit(bf(CVSIGNORE)) The CVSIGNORE environment variable supplements any
faa82484 2079ignore patterns in .cvsignore files. See the bf(--cvs-exclude) option for
de2fd20e 2080more details.
de2fd20e 2081dit(bf(RSYNC_RSH)) The RSYNC_RSH environment variable allows you to
ea7f8108 2082override the default shell used as the transport for rsync. Command line
faa82484 2083options are permitted after the command name, just as in the bf(-e) option.
4c3b4b25
AT
2084dit(bf(RSYNC_PROXY)) The RSYNC_PROXY environment variable allows you to
2085redirect your rsync client to use a web proxy when connecting to a
2086rsync daemon. You should set RSYNC_PROXY to a hostname:port pair.
de2fd20e 2087dit(bf(RSYNC_PASSWORD)) Setting RSYNC_PASSWORD to the required
bb18e755 2088password allows you to run authenticated rsync connections to an rsync
de2fd20e
AT
2089daemon without user intervention. Note that this does not supply a
2090password to a shell transport such as ssh.
de2fd20e 2091dit(bf(USER) or bf(LOGNAME)) The USER or LOGNAME environment variables
5a727522 2092are used to determine the default username sent to an rsync daemon.
4b2f6a7c 2093If neither is set, the username defaults to "nobody".
14d43f1f 2094dit(bf(HOME)) The HOME environment variable is used to find the user's
de2fd20e 2095default .cvsignore file.
de2fd20e
AT
2096enddit()
2097
41059f75
AT
2098manpagefiles()
2099
30e8c8e1 2100/etc/rsyncd.conf or rsyncd.conf
41059f75
AT
2101
2102manpageseealso()
2103
2104rsyncd.conf(5)
2105
41059f75
AT
2106manpagebugs()
2107
2108times are transferred as unix time_t values
2109
f28bd833 2110When transferring to FAT filesystems rsync may re-sync
38843171 2111unmodified files.
faa82484 2112See the comments on the bf(--modify-window) option.
38843171 2113
b5accaba 2114file permissions, devices, etc. are transferred as native numerical
41059f75
AT
2115values
2116
faa82484 2117see also the comments on the bf(--delete) option
41059f75 2118
38843171
DD
2119Please report bugs! See the website at
2120url(http://rsync.samba.org/)(http://rsync.samba.org/)
41059f75 2121
15997547
WD
2122manpagesection(VERSION)
2123
9ec8bd87 2124This man page is current for version 2.6.6 of rsync.
15997547 2125
41059f75
AT
2126manpagesection(CREDITS)
2127
2128rsync is distributed under the GNU public license. See the file
2129COPYING for details.
2130
41059f75 2131A WEB site is available at
3cd5eb3b
MP
2132url(http://rsync.samba.org/)(http://rsync.samba.org/). The site
2133includes an FAQ-O-Matic which may cover questions unanswered by this
2134manual page.
9e3c856a
AT
2135
2136The primary ftp site for rsync is
2137url(ftp://rsync.samba.org/pub/rsync)(ftp://rsync.samba.org/pub/rsync).
41059f75
AT
2138
2139We would be delighted to hear from you if you like this program.
2140
9e3c856a
AT
2141This program uses the excellent zlib compression library written by
2142Jean-loup Gailly and Mark Adler.
41059f75
AT
2143
2144manpagesection(THANKS)
2145
2146Thanks to Richard Brent, Brendan Mackay, Bill Waite, Stephen Rothwell
7ff701e8
MP
2147and David Bell for helpful suggestions, patches and testing of rsync.
2148I've probably missed some people, my apologies if I have.
2149
ce5f2732 2150Especial thanks also to: David Dykstra, Jos Backus, Sebastian Krahmer,
98f51bfb 2151Martin Pool, Wayne Davison, J.W. Schultz.
41059f75
AT
2152
2153manpageauthor()
2154
ce5f2732
MP
2155rsync was originally written by Andrew Tridgell and Paul Mackerras.
2156Many people have later contributed to it.
3cd5eb3b 2157
a5d74a18 2158Mailing lists for support and development are available at
faa82484 2159url(http://lists.samba.org)(lists.samba.org)