Added back support for the --delete-before option so that future
[rsync/rsync.git] / rsync.yo
CommitLineData
9e3c856a 1mailto(rsync-bugs@samba.org)
618c8a73 2manpage(rsync)(1)(30 Sep 2004)()()
41059f75
AT
3manpagename(rsync)(faster, flexible replacement for rcp)
4manpagesynopsis()
5
9ef53907 6rsync [OPTION]... SRC [SRC]... [USER@]HOST:DEST
41059f75 7
9ef53907 8rsync [OPTION]... [USER@]HOST:SRC DEST
41059f75 9
9ef53907 10rsync [OPTION]... SRC [SRC]... DEST
41059f75 11
9ef53907 12rsync [OPTION]... [USER@]HOST::SRC [DEST]
41059f75 13
9ef53907 14rsync [OPTION]... SRC [SRC]... [USER@]HOST::DEST
41059f75 15
9ef53907 16rsync [OPTION]... rsync://[USER@]HOST[:PORT]/SRC [DEST]
039faa86 17
8d69d571
WD
18rsync [OPTION]... SRC [SRC]... rsync://[USER@]HOST[:PORT]/DEST
19
41059f75
AT
20manpagedescription()
21
22rsync is a program that behaves in much the same way that rcp does,
23but has many more options and uses the rsync remote-update protocol to
675ef1aa
WD
24greatly speed up file transfers when the destination file is being
25updated.
41059f75
AT
26
27The rsync remote-update protocol allows rsync to transfer just the
f39281ae 28differences between two sets of files across the network connection, using
41059f75
AT
29an efficient checksum-search algorithm described in the technical
30report that accompanies this package.
31
32Some of the additional features of rsync are:
33
34itemize(
b9f592fb 35 it() support for copying links, devices, owners, groups, and permissions
41059f75
AT
36 it() exclude and exclude-from options similar to GNU tar
37 it() a CVS exclude mode for ignoring the same files that CVS would ignore
43cd760f 38 it() can use any transparent remote shell, including ssh or rsh
41059f75
AT
39 it() does not require root privileges
40 it() pipelining of file transfers to minimize latency costs
41 it() support for anonymous or authenticated rsync servers (ideal for
42 mirroring)
43)
44
45manpagesection(GENERAL)
46
bef49340 47There are eight different ways of using rsync. They are:
41059f75
AT
48
49itemize(
50 it() for copying local files. This is invoked when neither
51 source nor destination path contains a : separator
52
53 it() for copying from the local machine to a remote machine using
43cd760f
WD
54 a remote shell program as the transport (such as ssh or
55 rsh). This is invoked when the destination path contains a
41059f75
AT
56 single : separator.
57
58 it() for copying from a remote machine to the local machine
6c7c2ef3 59 using a remote shell program. This is invoked when the source
41059f75
AT
60 contains a : separator.
61
62 it() for copying from a remote rsync server to the local
63 machine. This is invoked when the source path contains a ::
bb18e755 64 separator or an rsync:// URL.
41059f75
AT
65
66 it() for copying from the local machine to a remote rsync
67 server. This is invoked when the destination path contains a ::
bb18e755 68 separator or an rsync:// URL.
039faa86 69
bef49340
WD
70 it() for copying from a remote machine using a remote shell
71 program as the transport, using rsync server on the remote
72 machine. This is invoked when the source path contains a ::
73 separator and the --rsh=COMMAND (aka "-e COMMAND") option is
74 also provided.
75
76 it() for copying from the local machine to a remote machine
77 using a remote shell program as the transport, using rsync
78 server on the remote machine. This is invoked when the
79 destination path contains a :: separator and the
4d888108 80 --rsh=COMMAND option is also provided.
bef49340 81
039faa86
AT
82 it() for listing files on a remote machine. This is done the
83 same way as rsync transfers except that you leave off the
84 local destination.
41059f75
AT
85)
86
14d43f1f
DD
87Note that in all cases (other than listing) at least one of the source
88and destination paths must be local.
41059f75
AT
89
90manpagesection(SETUP)
91
92See the file README for installation instructions.
93
1bbf83c0
WD
94Once installed, you can use rsync to any machine that you can access via
95a remote shell (as well as some that you can access using the rsync
43cd760f 96daemon-mode protocol). For remote transfers, a modern rsync uses ssh
1bbf83c0 97for its communications, but it may have been configured to use a
43cd760f 98different remote shell by default, such as rsh or remsh.
41059f75 99
1bbf83c0 100You can also specify any remote shell you like, either by using the -e
41059f75
AT
101command line option, or by setting the RSYNC_RSH environment variable.
102
103One common substitute is to use ssh, which offers a high degree of
104security.
105
8e987130
AT
106Note that rsync must be installed on both the source and destination
107machines.
108
41059f75
AT
109manpagesection(USAGE)
110
111You use rsync in the same way you use rcp. You must specify a source
112and a destination, one of which may be remote.
113
4d888108 114Perhaps the best way to explain the syntax is with some examples:
41059f75 115
675ef1aa 116quote(rsync -t *.c foo:src/)
41059f75 117
8a97fc2e 118This would transfer all files matching the pattern *.c from the
41059f75
AT
119current directory to the directory src on the machine foo. If any of
120the files already exist on the remote system then the rsync
121remote-update protocol is used to update the file by sending only the
122differences. See the tech report for details.
123
124quote(rsync -avz foo:src/bar /data/tmp)
125
8a97fc2e 126This would recursively transfer all files from the directory src/bar on the
41059f75
AT
127machine foo into the /data/tmp/bar directory on the local machine. The
128files are transferred in "archive" mode, which ensures that symbolic
b5accaba 129links, devices, attributes, permissions, ownerships, etc. are preserved
14d43f1f 130in the transfer. Additionally, compression will be used to reduce the
41059f75
AT
131size of data portions of the transfer.
132
133quote(rsync -avz foo:src/bar/ /data/tmp)
134
8a97fc2e
WD
135A trailing slash on the source changes this behavior to avoid creating an
136additional directory level at the destination. You can think of a trailing
137/ on a source as meaning "copy the contents of this directory" as opposed
138to "copy the directory by name", but in both cases the attributes of the
139containing directory are transferred to the containing directory on the
140destination. In other words, each of the following commands copies the
141files in the same way, including their setting of the attributes of
142/dest/foo:
143
675ef1aa
WD
144quote(rsync -av /src/foo /dest)
145quote(rsync -av /src/foo/ /dest/foo)
41059f75
AT
146
147You can also use rsync in local-only mode, where both the source and
148destination don't have a ':' in the name. In this case it behaves like
149an improved copy command.
150
14d43f1f
DD
151quote(rsync somehost.mydomain.com::)
152
8a97fc2e 153This would list all the anonymous rsync modules available on the host
14d43f1f
DD
154somehost.mydomain.com. (See the following section for more details.)
155
41059f75 156
675ef1aa
WD
157manpagesection(ADVANCED USAGE)
158
159The syntax for requesting multiple files from a remote host involves using
160quoted spaces in the SRC. Some examples:
161
162quote(rsync host::'modname/dir1/file1 modname/dir2/file2' /dest)
163
164This would copy file1 and file2 into /dest from an rsync daemon. Each
165additional arg must include the same "modname/" prefix as the first one,
166and must be preceded by a single space. All other spaces are assumed
167to be a part of the filenames.
168
169quote(rsync -av host:'dir1/file1 dir2/file2' /dest)
170
171This would copy file1 and file2 into /dest using a remote shell. This
172word-splitting is done by the remote shell, so if it doesn't work it means
173that the remote shell isn't configured to split its args based on
174whitespace (a very rare setting, but not unknown). If you need to transfer
175a filename that contains whitespace, you'll need to either escape the
176whitespace in a way that the remote shell will understand, or use wildcards
177in place of the spaces. Two examples of this are:
178
179quote(rsync -av host:'file\ name\ with\ spaces' /dest)
180quote(rsync -av host:file?name?with?spaces /dest)
181
182This latter example assumes that your shell passes through unmatched
183wildcards. If it complains about "no match", put the name in quotes.
184
185
41059f75
AT
186manpagesection(CONNECTING TO AN RSYNC SERVER)
187
1bbf83c0 188It is also possible to use rsync without a remote shell as the
41059f75
AT
189transport. In this case you will connect to a remote rsync server
190running on TCP port 873.
191
eb06fa95 192You may establish the connection via a web proxy by setting the
4c3b4b25 193environment variable RSYNC_PROXY to a hostname:port pair pointing to
4d888108
WD
194your web proxy. Note that your web proxy's configuration must support
195proxy connections to port 873.
4c3b4b25 196
1bbf83c0 197Using rsync in this way is the same as using it with a remote shell except
41059f75
AT
198that:
199
200itemize(
201 it() you use a double colon :: instead of a single colon to
bb18e755 202 separate the hostname from the path or an rsync:// URL.
41059f75
AT
203
204 it() the remote server may print a message of the day when you
14d43f1f 205 connect.
41059f75
AT
206
207 it() if you specify no path name on the remote server then the
208 list of accessible paths on the server will be shown.
14d43f1f 209
f7632fc6 210 it() if you specify no local destination then a listing of the
14d43f1f 211 specified files on the remote server is provided.
41059f75
AT
212)
213
4c3d16be
AT
214Some paths on the remote server may require authentication. If so then
215you will receive a password prompt when you connect. You can avoid the
216password prompt by setting the environment variable RSYNC_PASSWORD to
65575e96
AT
217the password you want to use or using the --password-file option. This
218may be useful when scripting rsync.
4c3d16be 219
3bc67f0c 220WARNING: On some systems environment variables are visible to all
65575e96 221users. On those systems using --password-file is recommended.
3bc67f0c 222
bef49340
WD
223manpagesection(CONNECTING TO AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM)
224
225It is sometimes useful to be able to set up file transfers using rsync
43cd760f
WD
226server capabilities on the remote machine, while still using ssh or
227rsh for transport. This is especially useful when you want to connect
bef49340
WD
228to a remote machine via ssh (for encryption or to get through a
229firewall), but you still want to have access to the rsync server
230features (see RUNNING AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM,
231below).
232
233From the user's perspective, using rsync in this way is the same as
234using it to connect to an rsync server, except that you must
235explicitly set the remote shell program on the command line with
236--rsh=COMMAND. (Setting RSYNC_RSH in the environment will not turn on
237this functionality.)
238
239In order to distinguish between the remote-shell user and the rsync
240server user, you can use '-l user' on your remote-shell command:
241
242quote(rsync -av --rsh="ssh -l ssh-user" rsync-user@host::module[/path] local-path)
243
244The "ssh-user" will be used at the ssh level; the "rsync-user" will be
245used to check against the rsyncd.conf on the remote host.
246
41059f75
AT
247manpagesection(RUNNING AN RSYNC SERVER)
248
4d888108 249An rsync server is configured using a configuration file. Please see the
30e8c8e1
DD
250rsyncd.conf(5) man page for more information. By default the configuration
251file is called /etc/rsyncd.conf, unless rsync is running over a remote
252shell program and is not running as root; in that case, the default name
253is rsyncd.conf in the current directory on the remote computer
254(typically $HOME).
41059f75 255
bef49340
WD
256manpagesection(RUNNING AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM)
257
258See the rsyncd.conf(5) man page for full information on the rsync
259server configuration file.
260
261Several configuration options will not be available unless the remote
262user is root (e.g. chroot, setuid/setgid, etc.). There is no need to
263configure inetd or the services map to include the rsync server port
264if you run an rsync server only via a remote shell program.
265
e6f9e388
WD
266To run an rsync server out of a single-use ssh key, see this section
267in the rsyncd.conf(5) man page.
bef49340 268
41059f75
AT
269manpagesection(EXAMPLES)
270
271Here are some examples of how I use rsync.
272
14d43f1f
DD
273To backup my wife's home directory, which consists of large MS Word
274files and mail folders, I use a cron job that runs
41059f75
AT
275
276quote(rsync -Cavz . arvidsjaur:backup)
277
f39281ae 278each night over a PPP connection to a duplicate directory on my machine
41059f75
AT
279"arvidsjaur".
280
281To synchronize my samba source trees I use the following Makefile
282targets:
283
284quote( get:nl()
285 rsync -avuzb --exclude '*~' samba:samba/ .
286
287 put:nl()
288 rsync -Cavuzb . samba:samba/
289
290 sync: get put)
291
292this allows me to sync with a CVS directory at the other end of the
f39281ae 293connection. I then do cvs operations on the remote machine, which saves a
41059f75
AT
294lot of time as the remote cvs protocol isn't very efficient.
295
296I mirror a directory between my "old" and "new" ftp sites with the
297command
298
299quote(rsync -az -e ssh --delete ~ftp/pub/samba/ nimbus:"~ftp/pub/tridge/samba")
300
301this is launched from cron every few hours.
302
c95da96a
AT
303manpagesection(OPTIONS SUMMARY)
304
14d43f1f 305Here is a short summary of the options available in rsync. Please refer
c95da96a
AT
306to the detailed description below for a complete description.
307
308verb(
309 -v, --verbose increase verbosity
b86f0cef 310 -q, --quiet decrease verbosity
c95da96a 311 -c, --checksum always checksum
06891710 312 -a, --archive archive mode, equivalent to -rlptgoD
c95da96a
AT
313 -r, --recursive recurse into directories
314 -R, --relative use relative path names
f177b7cc
WD
315 --no-relative turn off --relative
316 --no-implied-dirs don't send implied dirs with -R
915dd207 317 -b, --backup make backups (see --suffix & --backup-dir)
5b56cc19 318 --backup-dir make backups into this directory
915dd207 319 --suffix=SUFFIX backup suffix (default ~ w/o --backup-dir)
c95da96a 320 -u, --update update only (don't overwrite newer files)
eb162f3b 321 --inplace update the destination files in-place
09ed3099 322 -d, --dirs transfer directories without recursing
eb06fa95 323 -l, --links copy symlinks as symlinks
7af4227a
WD
324 -L, --copy-links copy the referent of all symlinks
325 --copy-unsafe-links copy the referent of "unsafe" symlinks
326 --safe-links ignore "unsafe" symlinks
c95da96a 327 -H, --hard-links preserve hard links
09ed3099 328 -K, --keep-dirlinks treat symlinked dir on receiver as dir
c95da96a
AT
329 -p, --perms preserve permissions
330 -o, --owner preserve owner (root only)
331 -g, --group preserve group
332 -D, --devices preserve devices (root only)
333 -t, --times preserve times
54e66f1d 334 -O, --omit-dir-times omit directories when preserving times
c95da96a
AT
335 -S, --sparse handle sparse files efficiently
336 -n, --dry-run show what would have been transferred
337 -W, --whole-file copy whole files, no incremental checks
93689aa5 338 --no-whole-file turn off --whole-file
c95da96a 339 -x, --one-file-system don't cross filesystem boundaries
3ed8eb3f 340 -B, --block-size=SIZE force a fixed checksum block-size
915dd207 341 -e, --rsh=COMMAND specify the remote shell
d9fcc198 342 --rsync-path=PATH specify path to rsync on the remote machine
1347d512 343 --existing only update files that already exist
915dd207 344 --ignore-existing ignore files that already exist on receiver
ae76a740 345 --del an alias for --delete-during
915dd207 346 --delete delete files that don't exist on sender
ae76a740
WD
347 --delete-during receiver deletes during xfer, not before
348 --delete-after receiver deletes after transfer, not before
866925bf 349 --delete-excluded also delete excluded files on receiver
b5accaba 350 --ignore-errors delete even if there are I/O errors
866925bf 351 --force force deletion of dirs even if not empty
0b73ca12 352 --max-delete=NUM don't delete more than NUM files
3610c458 353 --max-size=SIZE don't transfer any file larger than SIZE
c95da96a 354 --partial keep partially transferred files
44cad59f 355 --partial-dir=DIR put a partially transferred file into DIR
01b835c2 356 --delay-updates update transferred files into place at end
c95da96a 357 --numeric-ids don't map uid/gid values by user/group name
b5accaba 358 --timeout=TIME set I/O timeout in seconds
915dd207
WD
359 -I, --ignore-times turn off mod time & file size quick check
360 --size-only ignore mod time for quick check (use size)
f6aeaa74 361 --modify-window=NUM compare mod times with reduced accuracy
c95da96a 362 -T --temp-dir=DIR create temporary files in directory DIR
915dd207 363 --compare-dest=DIR also compare received files relative to DIR
b127c1dc
WD
364 --copy-dest=DIR ... and include copies of unchanged files
365 --link-dest=DIR hardlink to files in DIR when unchanged
d9fcc198 366 -P equivalent to --partial --progress
c95da96a 367 -z, --compress compress file data
f177b7cc 368 -C, --cvs-exclude auto ignore files in the same way CVS does
16e5de84
WD
369 -f, --filter=RULE add a file-filtering RULE
370 -F same as --filter=': /.rsync-filter'
371 repeated: --filter='- .rsync-filter'
2acf81eb 372 --exclude=PATTERN exclude files matching PATTERN
9ef53907 373 --exclude-from=FILE exclude patterns listed in FILE
2acf81eb 374 --include=PATTERN don't exclude files matching PATTERN
9ef53907 375 --include-from=FILE don't exclude patterns listed in FILE
f177b7cc 376 --files-from=FILE read FILE for list of source-file names
915dd207 377 -0 --from0 all file lists are delimited by nulls
c95da96a 378 --version print version number
c259892c 379 --port=PORT specify double-colon alternate port number
b5accaba 380 --blocking-io use blocking I/O for the remote shell
93689aa5 381 --no-blocking-io turn off --blocking-io
c95da96a 382 --stats give some file transfer stats
eb86d661 383 --progress show progress during transfer
b6062654 384 --log-format=FORMAT log file transfers using specified format
9ef53907 385 --password-file=FILE get password from FILE
09ed3099 386 --list-only list the files instead of copying them
ef5d23eb 387 --bwlimit=KBPS limit I/O bandwidth, KBytes per second
b9f592fb
WD
388 --write-batch=FILE write a batch to FILE
389 --read-batch=FILE read a batch from FILE
c8d895de 390 --checksum-seed=NUM set block/file checksum seed
e40a46de
WD
391 -4 --ipv4 prefer IPv4
392 -6 --ipv6 prefer IPv6
c95da96a 393 -h, --help show this help screen
bdf278f7 394)
6902ed17 395
bdf278f7 396Rsync can also be run as a daemon, in which case the following options are accepted:
6902ed17 397
bdf278f7
WD
398verb(
399 --daemon run as an rsync daemon
400 --address=ADDRESS bind to the specified address
1f69bec4 401 --bwlimit=KBPS limit I/O bandwidth, KBytes per second
bdf278f7
WD
402 --config=FILE specify alternate rsyncd.conf file
403 --no-detach do not detach from the parent
c259892c 404 --port=PORT listen on alternate port number
bdf278f7
WD
405 -4 --ipv4 prefer IPv4
406 -6 --ipv6 prefer IPv6
407 -h, --help show this help screen
c95da96a
AT
408)
409
41059f75
AT
410manpageoptions()
411
412rsync uses the GNU long options package. Many of the command line
413options have two variants, one short and one long. These are shown
14d43f1f 414below, separated by commas. Some options only have a long variant.
b5679335
DD
415The '=' for options that take a parameter is optional; whitespace
416can be used instead.
41059f75
AT
417
418startdit()
419dit(bf(-h, --help)) Print a short help page describing the options
bdf278f7 420available in rsync.
41059f75 421
bdf278f7 422dit(bf(--version)) print the rsync version number and exit.
41059f75
AT
423
424dit(bf(-v, --verbose)) This option increases the amount of information you
14d43f1f 425are given during the transfer. By default, rsync works silently. A
41059f75
AT
426single -v will give you information about what files are being
427transferred and a brief summary at the end. Two -v flags will give you
428information on what files are being skipped and slightly more
429information at the end. More than two -v flags should only be used if
14d43f1f 430you are debugging rsync.
41059f75 431
b86f0cef
DD
432dit(bf(-q, --quiet)) This option decreases the amount of information you
433are given during the transfer, notably suppressing information messages
434from the remote server. This flag is useful when invoking rsync from
435cron.
436
41059f75 437dit(bf(-I, --ignore-times)) Normally rsync will skip any files that are
915dd207
WD
438already the same size and have the same modification time-stamp.
439This option turns off this "quick check" behavior.
41059f75 440
a03a9f4e 441dit(bf(--size-only)) Normally rsync will not transfer any files that are
915dd207 442already the same size and have the same modification time-stamp. With the
a03a9f4e 443--size-only option, files will not be transferred if they have the same size,
f83f0548
AT
444regardless of timestamp. This is useful when starting to use rsync
445after using another mirroring system which may not preserve timestamps
446exactly.
447
5b56cc19
AT
448dit(bf(--modify-window)) When comparing two timestamps rsync treats
449the timestamps as being equal if they are within the value of
450modify_window. This is normally zero, but you may find it useful to
451set this to a larger value in some situations. In particular, when
38843171
DD
452transferring to Windows FAT filesystems which cannot represent times
453with a 1 second resolution --modify-window=1 is useful.
5b56cc19 454
41059f75
AT
455dit(bf(-c, --checksum)) This forces the sender to checksum all files using
456a 128-bit MD4 checksum before transfer. The checksum is then
457explicitly checked on the receiver and any files of the same name
458which already exist and have the same checksum and size on the
a03a9f4e 459receiver are not transferred. This option can be quite slow.
41059f75 460
e7bf3e5e
MP
461dit(bf(-a, --archive)) This is equivalent to -rlptgoD. It is a quick
462way of saying you want recursion and want to preserve almost
463everything.
464
465Note however that bf(-a) bf(does not preserve hardlinks), because
466finding multiply-linked files is expensive. You must separately
467specify bf(-H).
41059f75 468
24986abd 469dit(bf(-r, --recursive)) This tells rsync to copy directories
09ed3099 470recursively. See also --dirs (-d).
41059f75
AT
471
472dit(bf(-R, --relative)) Use relative paths. This means that the full path
473names specified on the command line are sent to the server rather than
474just the last parts of the filenames. This is particularly useful when
14d43f1f
DD
475you want to send several different directories at the same time. For
476example, if you used the command
41059f75 477
9bef934c 478verb(rsync /foo/bar/foo.c remote:/tmp/)
41059f75
AT
479
480then this would create a file called foo.c in /tmp/ on the remote
481machine. If instead you used
482
9bef934c 483verb(rsync -R /foo/bar/foo.c remote:/tmp/)
41059f75
AT
484
485then a file called /tmp/foo/bar/foo.c would be created on the remote
9bef934c
WD
486machine -- the full path name is preserved. To limit the amount of
487path information that is sent, do something like this:
488
489verb(cd /foo
490rsync -R bar/foo.c remote:/tmp/)
491
492That would create /tmp/bar/foo.c on the remote machine.
f177b7cc
WD
493
494dit(bf(--no-relative)) Turn off the --relative option. This is only
495needed if you want to use --files-from without its implied --relative
496file processing.
497
498dit(bf(--no-implied-dirs)) When combined with the --relative option, the
499implied directories in each path are not explicitly duplicated as part
500of the transfer. This makes the transfer more optimal and also allows
501the two sides to have non-matching symlinks in the implied part of the
502path. For instance, if you transfer the file "/path/foo/file" with -R,
503the default is for rsync to ensure that "/path" and "/path/foo" on the
504destination exactly match the directories/symlinks of the source. Using
505the --no-implied-dirs option would omit both of these implied dirs,
506which means that if "/path" was a real directory on one machine and a
507symlink of the other machine, rsync would not try to change this.
41059f75 508
b19fd07c
WD
509dit(bf(-b, --backup)) With this option, preexisting destination files are
510renamed as each file is transferred or deleted. You can control where the
511backup file goes and what (if any) suffix gets appended using the
512--backup-dir and --suffix options.
41059f75 513
66203a98
AT
514dit(bf(--backup-dir=DIR)) In combination with the --backup option, this
515tells rsync to store all backups in the specified directory. This is
759ac870
DD
516very useful for incremental backups. You can additionally
517specify a backup suffix using the --suffix option
518(otherwise the files backed up in the specified directory
519will keep their original filenames).
0b79c324
WD
520If DIR is a relative path, it is relative to the destination directory
521(which changes in a recursive transfer).
66203a98 522
b5679335 523dit(bf(--suffix=SUFFIX)) This option allows you to override the default
b19fd07c
WD
524backup suffix used with the --backup (-b) option. The default suffix is a ~
525if no --backup-dir was specified, otherwise it is an empty string.
9ef53907 526
4539c0d7
WD
527dit(bf(-u, --update)) This forces rsync to skip any files which exist on
528the destination and have a modified time that is newer than the source
529file. (If an existing destination file has a modify time equal to the
530source file's, it will be updated if the sizes are different.)
41059f75 531
4539c0d7
WD
532In the current implementation of --update, a difference of file format
533between the sender and receiver is always
adddd075
WD
534considered to be important enough for an update, no matter what date
535is on the objects. In other words, if the source has a directory or a
536symlink where the destination has a file, the transfer would occur
537regardless of the timestamps. This might change in the future (feel
538free to comment on this on the mailing list if you have an opinion).
539
a3221d2a
WD
540dit(bf(--inplace)) This causes rsync not to create a new copy of the file
541and then move it into place. Instead rsync will overwrite the existing
eb162f3b
WD
542file, meaning that the rsync algorithm can't accomplish the full amount of
543network reduction it might be able to otherwise (since it does not yet try
544to sort data matches). One exception to this is if you combine the option
545with --backup, since rsync is smart enough to use the backup file as the
546basis file for the transfer.
a3221d2a 547
183150b7
WD
548This option is useful for transfer of large files with block-based changes
549or appended data, and also on systems that are disk bound, not network
550bound.
551
552The option implies --partial (since an interrupted transfer does not delete
01b835c2
WD
553the file), but conflicts with --partial-dir and --delay-updates.
554Prior to rsync 2.6.4 --inplace was also incompatible with --compare-dest,
555--copy-dest, and --link-dest.
a3221d2a 556
399371e7 557WARNING: The file's data will be in an inconsistent state during the
98f51bfb 558transfer (and possibly afterward if the transfer gets interrupted), so you
399371e7 559should not use this option to update files that are in use. Also note that
eb162f3b 560rsync will be unable to update a file in-place that is not writable by the
75b243a5 561receiving user.
a3221d2a 562
09ed3099
WD
563dit(bf(-d, --dirs)) Tell the sending side to include any directories that
564are encountered. Unlike --recursive, a directory's contents are not copied
565unless the directory was specified on the command-line as either "." or a
566name with a trailing slash (e.g. "foo/"). Without this option or the
567--recursive option, rsync will skip all directories it encounters (and
568output a message to that effect for each one).
569
eb06fa95
MP
570dit(bf(-l, --links)) When symlinks are encountered, recreate the
571symlink on the destination.
41059f75 572
eb06fa95 573dit(bf(-L, --copy-links)) When symlinks are encountered, the file that
ef855d19
WD
574they point to (the referent) is copied, rather than the symlink. In older
575versions of rsync, this option also had the side-effect of telling the
576receiving side to follow symlinks, such as symlinks to directories. In a
577modern rsync such as this one, you'll need to specify --keep-dirlinks (-K)
578to get this extra behavior. The only exception is when sending files to
579an rsync that is too old to understand -K -- in that case, the -L option
580will still have the side-effect of -K on that older receiving rsync.
b5313607 581
eb06fa95 582dit(bf(--copy-unsafe-links)) This tells rsync to copy the referent of
7af4227a 583symbolic links that point outside the copied tree. Absolute symlinks
eb06fa95
MP
584are also treated like ordinary files, and so are any symlinks in the
585source path itself when --relative is used.
41059f75 586
d310a212 587dit(bf(--safe-links)) This tells rsync to ignore any symbolic links
7af4227a 588which point outside the copied tree. All absolute symlinks are
d310a212 589also ignored. Using this option in conjunction with --relative may
14d43f1f 590give unexpected results.
d310a212 591
41059f75
AT
592dit(bf(-H, --hard-links)) This tells rsync to recreate hard links on
593the remote system to be the same as the local system. Without this
594option hard links are treated like regular files.
595
596Note that rsync can only detect hard links if both parts of the link
597are in the list of files being sent.
598
599This option can be quite slow, so only use it if you need it.
600
09ed3099
WD
601dit(bf(-K, --keep-dirlinks)) On the receiving side, if a symlink is
602pointing to a directory, it will be treated as matching a directory
603from the sender.
604
41059f75 605dit(bf(-W, --whole-file)) With this option the incremental rsync algorithm
a1a440c2
DD
606is not used and the whole file is sent as-is instead. The transfer may be
607faster if this option is used when the bandwidth between the source and
6eb770bb 608destination machines is higher than the bandwidth to disk (especially when the
4d888108 609"disk" is actually a networked filesystem). This is the default when both
6eb770bb 610the source and destination are specified as local paths.
41059f75 611
93689aa5
DD
612dit(bf(--no-whole-file)) Turn off --whole-file, for use when it is the
613default.
614
8dc74608
WD
615dit(bf(-p, --perms)) This option causes rsync to set the destination
616permissions to be the same as the source permissions.
617
618Without this option, each new file gets its permissions set based on the
619source file's permissions and the umask at the receiving end, while all
620other files (including updated files) retain their existing permissions
621(which is the same behavior as other file-copy utilities, such as cp).
41059f75 622
eb06fa95
MP
623dit(bf(-o, --owner)) This option causes rsync to set the owner of the
624destination file to be the same as the source file. On most systems,
a2b0471f
WD
625only the super-user can set file ownership. By default, the preservation
626is done by name, but may fall back to using the ID number in some
627circumstances. See the --numeric-ids option for a full discussion.
41059f75 628
eb06fa95
MP
629dit(bf(-g, --group)) This option causes rsync to set the group of the
630destination file to be the same as the source file. If the receiving
631program is not running as the super-user, only groups that the
a2b0471f
WD
632receiver is a member of will be preserved. By default, the preservation
633is done by name, but may fall back to using the ID number in some
634circumstances. See the --numeric-ids option for a full discussion.
41059f75
AT
635
636dit(bf(-D, --devices)) This option causes rsync to transfer character and
637block device information to the remote system to recreate these
638devices. This option is only available to the super-user.
639
640dit(bf(-t, --times)) This tells rsync to transfer modification times along
baf3e504
DD
641with the files and update them on the remote system. Note that if this
642option is not used, the optimization that excludes files that have not been
643modified cannot be effective; in other words, a missing -t or -a will
d0bc3520
WD
644cause the next transfer to behave as if it used -I, causing all files to be
645updated (though the rsync algorithm will make the update fairly efficient
646if the files haven't actually changed, you're much better off using -t).
41059f75 647
54e66f1d 648dit(bf(-O, --omit-dir-times)) This tells rsync to omit directories when
f5a7b9e7
WD
649it is preserving modification times (see --times). If NFS is sharing
650the directories on the receiving side, it is a good idea to use -O.
54e66f1d 651
41059f75
AT
652dit(bf(-n, --dry-run)) This tells rsync to not do any file transfers,
653instead it will just report the actions it would have taken.
654
655dit(bf(-S, --sparse)) Try to handle sparse files efficiently so they take
656up less space on the destination.
657
d310a212
AT
658NOTE: Don't use this option when the destination is a Solaris "tmpfs"
659filesystem. It doesn't seem to handle seeks over null regions
660correctly and ends up corrupting the files.
661
41059f75
AT
662dit(bf(-x, --one-file-system)) This tells rsync not to cross filesystem
663boundaries when recursing. This is useful for transferring the
664contents of only one filesystem.
665
1347d512
AT
666dit(bf(--existing)) This tells rsync not to create any new files -
667only update files that already exist on the destination.
668
3d6feada
MP
669dit(bf(--ignore-existing))
670This tells rsync not to update files that already exist on
671the destination.
672
0b73ca12
AT
673dit(bf(--max-delete=NUM)) This tells rsync not to delete more than NUM
674files or directories. This is useful when mirroring very large trees
675to prevent disasters.
676
3610c458
WD
677dit(bf(--max-size=SIZE)) This tells rsync to avoid transferring any
678file that is larger than the specified SIZE. The SIZE value can be
679suffixed with a letter to indicate a size multiplier (K, M, or G) and
680may be a fractional value (e.g. "--max-size=1.5m").
681
e8b155a3
WD
682dit(bf(--delete)) This tells rsync to delete extraneous files from the
683receiving side (ones that aren't on the sending side), but only for the
684directories that are being synchronized. You must have asked rsync to
685send the whole directory (e.g. "dir" or "dir/") without using a wildcard
686for the directory's contents (e.g. "dir/*") since the wildcard is expanded
ae76a740 687by the shell and rsync thus gets a request to transfer individual files, not
e8b155a3
WD
688the files' parent directory. Files that are excluded from transfer are
689excluded from being deleted unless you use --delete-excluded.
41059f75 690
866925bf 691This option has no effect unless directory recursion is enabled.
24986abd 692
b33b791e 693This option can be dangerous if used incorrectly! It is a very good idea
e8b155a3 694to run first using the --dry-run option (-n) to see what files would be
b33b791e 695deleted to make sure important files aren't listed.
41059f75 696
e8b155a3 697If the sending side detects any I/O errors, then the deletion of any
3e578a19
AT
698files at the destination will be automatically disabled. This is to
699prevent temporary filesystem failures (such as NFS errors) on the
700sending side causing a massive deletion of files on the
2c5548d2 701destination. You can override this with the --ignore-errors option.
41059f75 702
ae76a740
WD
703If you don't specify --delete-during (--del) or --delete-after, the
704file deletions will be done before the first file is transferred.
705This is helpful if the filesystem is tight for space
aaca3daa 706and removing extraneous files would help to make the transfer possible.
ae76a740
WD
707However, it does introduce a delay before the start of the transfer,
708and this delay might cause the transfer to timeout (if --timeout was
709specified).
710
711dit(bf(--del, --delete-during)) Request that the file-deletions on the
712receving side be done incrementally as the transfer happens. This is
713a faster method than chosing the before- or after-transfer processing,
714but it is only supported beginning with rsync version 2.6.4.
715See --delete (which is implied) for more details on file-deletion.
aaca3daa
WD
716
717dit(bf(--delete-after)) Request that the file-deletions on the receving
ae76a740
WD
718side be done after the transfer has completed. This is useful if you
719are sending new per-directory merge files as a part of the transfer and
720you want their exclusions to take effect for the delete phase of the
721current transfer.
722See --delete (which is implied) for more details on file-deletion.
e8b155a3 723
866925bf
WD
724dit(bf(--delete-excluded)) In addition to deleting the files on the
725receiving side that are not on the sending side, this tells rsync to also
726delete any files on the receiving side that are excluded (see --exclude).
ae76a740 727See --delete (which is implied) for more details on file-deletion.
866925bf 728
2c5548d2 729dit(bf(--ignore-errors)) Tells --delete to go ahead and delete files
b5accaba 730even when there are I/O errors.
2c5548d2 731
b695d088
DD
732dit(bf(--force)) This options tells rsync to delete directories even if
733they are not empty when they are to be replaced by non-directories. This
734is only relevant without --delete because deletions are now done depth-first.
735Requires the --recursive option (which is implied by -a) to have any effect.
41059f75 736
3ed8eb3f
WD
737dit(bf(-B, --block-size=BLOCKSIZE)) This forces the block size used in
738the rsync algorithm to a fixed value. It is normally selected based on
739the size of each file being updated. See the technical report for details.
41059f75 740
b5679335 741dit(bf(-e, --rsh=COMMAND)) This option allows you to choose an alternative
41059f75 742remote shell program to use for communication between the local and
43cd760f
WD
743remote copies of rsync. Typically, rsync is configured to use ssh by
744default, but you may prefer to use rsh on a local network.
41059f75 745
bef49340 746If this option is used with bf([user@]host::module/path), then the
4d888108 747remote shell em(COMMAND) will be used to run an rsync server on the
bef49340
WD
748remote host, and all data will be transmitted through that remote
749shell connection, rather than through a direct socket connection to a
2d4ca358
DD
750running rsync server on the remote host. See the section "CONNECTING
751TO AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM" above.
bef49340 752
ea7f8108
WD
753Command-line arguments are permitted in COMMAND provided that COMMAND is
754presented to rsync as a single argument. For example:
98393ae2 755
ea7f8108 756quote(-e "ssh -p 2234")
98393ae2
WD
757
758(Note that ssh users can alternately customize site-specific connect
759options in their .ssh/config file.)
760
41059f75 761You can also choose the remote shell program using the RSYNC_RSH
ea7f8108 762environment variable, which accepts the same range of values as -e.
41059f75 763
735a816e
DD
764See also the --blocking-io option which is affected by this option.
765
b5679335 766dit(bf(--rsync-path=PATH)) Use this to specify the path to the copy of
d73ee7b7
AT
767rsync on the remote machine. Useful when it's not in your path. Note
768that this is the full path to the binary, not just the directory that
769the binary is in.
41059f75 770
f177b7cc
WD
771dit(bf(-C, --cvs-exclude)) This is a useful shorthand for excluding a
772broad range of files that you often don't want to transfer between
773systems. It uses the same algorithm that CVS uses to determine if
774a file should be ignored.
775
776The exclude list is initialized to:
777
2a383be0
WD
778quote(RCS SCCS CVS CVS.adm RCSLOG cvslog.* tags TAGS .make.state
779.nse_depinfo *~ #* .#* ,* _$* *$ *.old *.bak *.BAK *.orig *.rej
780.del-* *.a *.olb *.o *.obj *.so *.exe *.Z *.elc *.ln core .svn/)
f177b7cc
WD
781
782then files listed in a $HOME/.cvsignore are added to the list and any
2a383be0
WD
783files listed in the CVSIGNORE environment variable (all cvsignore names
784are delimited by whitespace).
785
f177b7cc 786Finally, any file is ignored if it is in the same directory as a
2a383be0 787.cvsignore file and matches one of the patterns listed therein.
2a383be0 788See the bf(cvs(1)) manual for more information.
f177b7cc 789
16e5de84
WD
790dit(bf(-f, --filter=RULE)) This option allows you to add rules to selectively
791exclude certain files from the list of files to be transferred. This is
792most useful in combination with a recursive transfer.
41059f75 793
16e5de84 794You may use as many --filter options on the command line as you like
41059f75
AT
795to build up the list of files to exclude.
796
16e5de84
WD
797See the FILTER RULES section for detailed information on this option.
798
799dit(bf(-F)) The -F option is a shorthand for adding two --filter rules to
800your command. The first time it is used is a shorthand for this rule:
801
802verb(
803 --filter=': /.rsync-filter'
804)
805
806This tells rsync to look for per-directory .rsync-filter files that have
807been sprinkled through the hierarchy and use their rules to filter the
808files in the transfer. If -F is repeated, it is a shorthand for this
809rule:
810
811verb(
812 --filter='- .rsync-filter'
813)
814
815This filters out the .rsync-filter files themselves from the transfer.
816
817See the FILTER RULES section for detailed information on how these options
818work.
819
820dit(bf(--exclude=PATTERN)) This option is a simplified form of the
821--filter option that defaults to an exclude rule and does not allow
822the full rule-parsing syntax of normal filter rules.
823
824See the FILTER RULES section for detailed information on this option.
41059f75 825
b5679335 826dit(bf(--exclude-from=FILE)) This option is similar to the --exclude
c48b22c8
AT
827option, but instead it adds all exclude patterns listed in the file
828FILE to the exclude list. Blank lines in FILE and lines starting with
829';' or '#' are ignored.
f8a94f0d
DD
830If em(FILE) is bf(-) the list will be read from standard input.
831
16e5de84
WD
832dit(bf(--include=PATTERN)) This option is a simplified form of the
833--filter option that defaults to an include rule and does not allow
834the full rule-parsing syntax of normal filter rules.
43bd68e5 835
16e5de84 836See the FILTER RULES section for detailed information on this option.
43bd68e5 837
b5679335 838dit(bf(--include-from=FILE)) This specifies a list of include patterns
43bd68e5 839from a file.
c769702f 840If em(FILE) is "-" the list will be read from standard input.
f8a94f0d 841
f177b7cc
WD
842dit(bf(--files-from=FILE)) Using this option allows you to specify the
843exact list of files to transfer (as read from the specified FILE or "-"
c769702f 844for standard input). It also tweaks the default behavior of rsync to make
f177b7cc
WD
845transferring just the specified files and directories easier. For
846instance, the --relative option is enabled by default when this option
847is used (use --no-relative if you want to turn that off), all
848directories specified in the list are created on the destination (rather
849than being noisily skipped without -r), and the -a (--archive) option's
850behavior does not imply -r (--recursive) -- specify it explicitly, if
851you want it.
852
853The file names that are read from the FILE are all relative to the
854source dir -- any leading slashes are removed and no ".." references are
855allowed to go higher than the source dir. For example, take this
856command:
857
858quote(rsync -a --files-from=/tmp/foo /usr remote:/backup)
859
860If /tmp/foo contains the string "bin" (or even "/bin"), the /usr/bin
861directory will be created as /backup/bin on the remote host (but the
862contents of the /usr/bin dir would not be sent unless you specified -r
863or the names were explicitly listed in /tmp/foo). Also keep in mind
864that the effect of the (enabled by default) --relative option is to
865duplicate only the path info that is read from the file -- it does not
866force the duplication of the source-spec path (/usr in this case).
867
868In addition, the --files-from file can be read from the remote host
869instead of the local host if you specify a "host:" in front of the file
870(the host must match one end of the transfer). As a short-cut, you can
871specify just a prefix of ":" to mean "use the remote end of the
872transfer". For example:
873
874quote(rsync -a --files-from=:/path/file-list src:/ /tmp/copy)
875
876This would copy all the files specified in the /path/file-list file that
877was located on the remote "src" host.
878
879dit(bf(-0, --from0)) This tells rsync that the filenames it reads from a
880file are terminated by a null ('\0') character, not a NL, CR, or CR+LF.
16e5de84
WD
881This affects --exclude-from, --include-from, --files-from, and any
882merged files specified in a --filter rule.
f01b6368
WD
883It does not affect --cvs-exclude (since all names read from a .cvsignore
884file are split on whitespace).
41059f75 885
b5679335 886dit(bf(-T, --temp-dir=DIR)) This option instructs rsync to use DIR as a
375a4556 887scratch directory when creating temporary copies of the files
41059f75
AT
888transferred on the receiving side. The default behavior is to create
889the temporary files in the receiving directory.
890
b127c1dc 891dit(bf(--compare-dest=DIR)) This option instructs rsync to use em(DIR) on
e49f61f5
WD
892the destination machine as an additional hierarchy to compare destination
893files against doing transfers (if the files are missing in the destination
894directory). If a file is found in em(DIR) that is identical to the
895sender's file, the file will NOT be transferred to the destination
896directory. This is useful for creating a sparse backup of just files that
897have changed from an earlier backup.
898
899Beginning in version 2.6.4, multiple --compare-dest directories may be
900provided and rsync will search the list in the order specified until it
901finds an existing file. That first discovery is used as the basis file,
902and also determines if the transfer needs to happen.
903
904If em(DIR) is a relative path, it is relative to the destination directory.
905See also --copy-dest and --link-dest.
b127c1dc
WD
906
907dit(bf(--copy-dest=DIR)) This option behaves like bf(--compare-dest), but
908rsync will also copy unchanged files found in em(DIR) to the destination
909directory (using the data in the em(DIR) for an efficient copy). This is
910useful for doing transfers to a new destination while leaving existing
911files intact, and then doing a flash-cutover when all files have been
e49f61f5
WD
912successfully transferred.
913
914If em(DIR) is a relative path, it is relative to the destination directory.
915See also --compare-dest and --link-dest.
b127c1dc
WD
916
917dit(bf(--link-dest=DIR)) This option behaves like bf(--copy-dest), but
e49f61f5
WD
918unchanged files are hard linked from em(DIR) to the destination directory.
919The files must be identical in all preserved attributes (e.g. permissions,
920possibly ownership) in order for the files to be linked together.
8429aa9e
WD
921An example:
922
923verb(
924 rsync -av --link-dest=$PWD/prior_dir host:src_dir/ new_dir/
925)
59c95e42 926
e49f61f5
WD
927Beginning with version 2.6.4, if more than one --link-dest option is
928specified, rsync will try to find an exact match to link with (searching
929the list in the order specified), and if not found, a basis file from one
930of the em(DIR)s will be selected to try to speed up the transfer.
931
932If em(DIR) is a relative path, it is relative to the destination directory.
933See also --compare-dest and --copy-dest.
b127c1dc 934
e0204f56
WD
935Note that rsync versions prior to 2.6.1 had a bug that could prevent
936--link-dest from working properly for a non-root user when -o was specified
eb162f3b
WD
937(or implied by -a). You can work-around this bug by avoiding the -o option
938when sending to an old rsync.
e0204f56 939
41059f75 940dit(bf(-z, --compress)) With this option, rsync compresses any data from
089e73f8 941the files that it sends to the destination machine. This
f39281ae 942option is useful on slow connections. The compression method used is the
41059f75
AT
943same method that gzip uses.
944
945Note this this option typically achieves better compression ratios
946that can be achieved by using a compressing remote shell, or a
947compressing transport, as it takes advantage of the implicit
948information sent for matching data blocks.
949
950dit(bf(--numeric-ids)) With this option rsync will transfer numeric group
4d888108 951and user IDs rather than using user and group names and mapping them
41059f75
AT
952at both ends.
953
4d888108 954By default rsync will use the username and groupname to determine
41059f75 955what ownership to give files. The special uid 0 and the special group
14d43f1f 9560 are never mapped via user/group names even if the --numeric-ids
41059f75
AT
957option is not specified.
958
ec40899b
WD
959If a user or group has no name on the source system or it has no match
960on the destination system, then the numeric ID
961from the source system is used instead. See also the comments on the
a2b0471f
WD
962"use chroot" setting in the rsyncd.conf manpage for information on how
963the chroot setting affects rsync's ability to look up the names of the
964users and groups and what you can do about it.
41059f75 965
b5accaba 966dit(bf(--timeout=TIMEOUT)) This option allows you to set a maximum I/O
de2fd20e
AT
967timeout in seconds. If no data is transferred for the specified time
968then rsync will exit. The default is 0, which means no timeout.
41059f75 969
c259892c
WD
970dit(bf(--port=PORT)) This specifies an alternate TCP port number to use
971rather than the default of 873. This is only needed if you are using the
972double-colon (::) syntax to connect with an rsync daemon (since the URL
973syntax has a way to specify the port as a part of the URL). See also this
974option in the --daemon mode section.
975
b5accaba 976dit(bf(--blocking-io)) This tells rsync to use blocking I/O when launching
314a74d7
WD
977a remote shell transport. If the remote shell is either rsh or remsh,
978rsync defaults to using
b5accaba
WD
979blocking I/O, otherwise it defaults to using non-blocking I/O. (Note that
980ssh prefers non-blocking I/O.)
64c704f0 981
93689aa5
DD
982dit(bf(--no-blocking-io)) Turn off --blocking-io, for use when it is the
983default.
984
3a64ad1f 985dit(bf(--log-format=FORMAT)) This allows you to specify exactly what the
14d43f1f 986rsync client logs to stdout on a per-file basis. The log format is
3a64ad1f
DD
987specified using the same format conventions as the log format option in
988rsyncd.conf.
b6062654 989
b72f24c7
AT
990dit(bf(--stats)) This tells rsync to print a verbose set of statistics
991on the file transfer, allowing you to tell how effective the rsync
e19452a9 992algorithm is for your data.
b72f24c7 993
d9fcc198
AT
994dit(bf(--partial)) By default, rsync will delete any partially
995transferred file if the transfer is interrupted. In some circumstances
996it is more desirable to keep partially transferred files. Using the
997--partial option tells rsync to keep the partial file which should
998make a subsequent transfer of the rest of the file much faster.
999
44cad59f 1000dit(bf(--partial-dir=DIR)) Turns on --partial mode, but tells rsync to
b127c1dc 1001put a partially transferred file into em(DIR) instead of writing out the
44cad59f
WD
1002file to the destination dir. Rsync will also use a file found in this
1003dir as data to speed up the transfer (i.e. when you redo the send after
1004rsync creates a partial file) and delete such a file after it has served
b90a6d9f
WD
1005its purpose. Note that if --whole-file is specified (or implied) that an
1006existing partial-dir file will not be used to speedup the transfer (since
1007rsync is sending files without using the incremental rsync algorithm).
44cad59f
WD
1008
1009Rsync will create the dir if it is missing (just the last dir -- not the
1010whole path). This makes it easy to use a relative path (such as
1011"--partial-dir=.rsync-partial") to have rsync create the partial-directory
b127c1dc 1012in the destination file's directory (rsync will also try to remove the em(DIR)
44cad59f
WD
1013if a partial file was found to exist at the start of the transfer and the
1014DIR was specified as a relative path).
1015
a33857da
WD
1016If the partial-dir value is not an absolute path, rsync will also add an
1017--exclude of this value at the end of all your existing excludes. This
1018will prevent partial-dir files from being transferred and also prevent the
1019untimely deletion of partial-dir items on the receiving side. An example:
1020the above --partial-dir option would add an "--exclude=.rsync-partial/"
16e5de84
WD
1021rule at the end of any other filter rules. Note that if you are
1022supplying your own filter rules, you may need to manually insert a
a33857da
WD
1023rule for this directory exclusion somewhere higher up in the list so that
1024it has a high enough priority to be effective (e.g., if your rules specify
1025a trailing --exclude=* rule, the auto-added rule will be ineffective).
44cad59f 1026
b4d1e854
WD
1027IMPORTANT: the --partial-dir should not be writable by other users or it
1028is a security risk. E.g. AVOID "/tmp".
1029
1030You can also set the partial-dir value the RSYNC_PARTIAL_DIR environment
1031variable. Setting this in the environment does not force --partial to be
01b835c2
WD
1032enabled, but rather it effects where partial files go when --partial is
1033specified. For instance, instead of using --partial-dir=.rsync-tmp
b4d1e854
WD
1034along with --progress, you could set RSYNC_PARTIAL_DIR=.rsync-tmp in your
1035environment and then just use the -P option to turn on the use of the
01b835c2
WD
1036.rsync-tmp dir for partial transfers. The only time that the --partial
1037option does not look for this environment value is (1) when --inplace was
1038specified (since --inplace conflicts with --partial-dir), or (2) when
1039--delay-updates was specified (see below).
1040
1041dit(bf(--delay-updates)) This option puts the temporary file from each
1042updated file into the file's partial-dir (see above) until the end of the
1043transfer, at which time all the files are renamed into place in rapid
1044succession. This attempts to make the updating of the files a little more
1045atomic. If you don't specify the --partial-dir option, this option will
1046cause it to default to ".~tmp~" (RSYNC_PARTIAL_DIR is not consulted for
1047this value). Conflicts with --inplace.
1048
1049This option uses more memory on the receiving side (one bit per file
1050transferred) and also requires enough free disk space on the receiving
1051side to hold an additional copy of all the updated files. Note also that
1052you should not use an absolute path to --partial-dir unless there is no
1053chance of any of the files in the transfer having the same name (since all
1054the updated files will be put into a single directory if the path is
1055absolute).
1056
1057See also the "atomic-rsync" perl script in the "support" subdir for an
1058update algorithm that is even more atomic (it uses --link-dest and a
1059parallel hierarchy of files).
44cad59f 1060
eb86d661
AT
1061dit(bf(--progress)) This option tells rsync to print information
1062showing the progress of the transfer. This gives a bored user
1063something to watch.
e2559dbe 1064Implies --verbose without incrementing verbosity.
7b10f91d 1065
68f9910d
WD
1066When the file is transferring, the data looks like this:
1067
1068verb(
1069 782448 63% 110.64kB/s 0:00:04
1070)
1071
1072This tells you the current file size, the percentage of the transfer that
1073is complete, the current calculated file-completion rate (including both
1074data over the wire and data being matched locally), and the estimated time
1075remaining in this transfer.
1076
c2c14fa2 1077After a file is complete, the data looks like this:
68f9910d
WD
1078
1079verb(
1080 1238099 100% 146.38kB/s 0:00:08 (5, 57.1% of 396)
1081)
1082
1083This tells you the final file size, that it's 100% complete, the final
1084transfer rate for the file, the amount of elapsed time it took to transfer
1085the file, and the addition of a total-transfer summary in parentheses.
1086These additional numbers tell you how many files have been updated, and
1087what percent of the total number of files has been scanned.
1088
183150b7
WD
1089dit(bf(-P)) The -P option is equivalent to --partial --progress. Its
1090purpose is to make it much easier to specify these two options for a long
1091transfer that may be interrupted.
d9fcc198 1092
65575e96
AT
1093dit(bf(--password-file)) This option allows you to provide a password
1094in a file for accessing a remote rsync server. Note that this option
bb18e755 1095is only useful when accessing an rsync server using the built in
65575e96 1096transport, not when using a remote shell as the transport. The file
fc7952e7
AT
1097must not be world readable. It should contain just the password as a
1098single line.
65575e96 1099
09ed3099
WD
1100dit(bf(--list-only)) This option will cause the source files to be listed
1101instead of transferred. This option is inferred if there is no destination
1102specified, so you don't usually need to use it explicitly. However, it can
1103come in handy for a power user that wants to avoid the "-r --exclude="/*/*"
1104options that rsync might use as a compatibility kluge when generating a
1105non-recursive listing.
1106
ef5d23eb
DD
1107dit(bf(--bwlimit=KBPS)) This option allows you to specify a maximum
1108transfer rate in kilobytes per second. This option is most effective when
1109using rsync with large files (several megabytes and up). Due to the nature
1110of rsync transfers, blocks of data are sent, then if rsync determines the
1111transfer was too fast, it will wait before sending the next data block. The
4d888108 1112result is an average transfer rate equaling the specified limit. A value
ef5d23eb
DD
1113of zero specifies no limit.
1114
b9f592fb 1115dit(bf(--write-batch=FILE)) Record a file that can later be applied to
98f51bfb 1116another identical destination with --read-batch. See the "BATCH MODE"
b9f592fb 1117section for details.
6902ed17 1118
b9f592fb 1119dit(bf(--read-batch=FILE)) Apply all of the changes stored in FILE, a
c769702f 1120file previously generated by --write-batch.
399371e7 1121If em(FILE) is "-" the batch data will be read from standard input.
c769702f 1122See the "BATCH MODE" section for details.
6902ed17 1123
e40a46de
WD
1124dit(bf(-4, --ipv4) or bf(-6, --ipv6)) Tells rsync to prefer IPv4/IPv6
1125when creating sockets. This only affects sockets that rsync has direct
1126control over, such as the outgoing socket when directly contacting an
c259892c 1127rsync daemon. See also these options in the --daemon mode section.
e40a46de 1128
c8d895de
WD
1129dit(bf(--checksum-seed=NUM)) Set the MD4 checksum seed to the integer
1130NUM. This 4 byte checksum seed is included in each block and file
1131MD4 checksum calculation. By default the checksum seed is generated
b9f592fb 1132by the server and defaults to the current time(). This option
c8d895de
WD
1133is used to set a specific checksum seed, which is useful for
1134applications that want repeatable block and file checksums, or
1135in the case where the user wants a more random checksum seed.
1136Note that setting NUM to 0 causes rsync to use the default of time()
b9f592fb 1137for checksum seed.
c8d895de 1138
41059f75
AT
1139enddit()
1140
bdf278f7
WD
1141The options allowed when starting an rsync daemon are as follows:
1142
1143startdit()
1144
1145dit(bf(--daemon)) This tells rsync that it is to run as a daemon. The
1146daemon may be accessed using the bf(host::module) or
1147bf(rsync://host/module/) syntax.
1148
1149If standard input is a socket then rsync will assume that it is being
1150run via inetd, otherwise it will detach from the current terminal and
1151become a background daemon. The daemon will read the config file
1152(rsyncd.conf) on each connect made by a client and respond to
1153requests accordingly. See the rsyncd.conf(5) man page for more
1154details.
1155
1156dit(bf(--address)) By default rsync will bind to the wildcard address
1157when run as a daemon with the --daemon option or when connecting to a
1158rsync server. The --address option allows you to specify a specific IP
1159address (or hostname) to bind to. This makes virtual hosting possible
01f8a115
WD
1160in conjunction with the --config option. See also the "address" global
1161option in the rsyncd.conf manpage.
bdf278f7 1162
1f69bec4
WD
1163dit(bf(--bwlimit=KBPS)) This option allows you to specify a maximum
1164transfer rate in kilobytes per second for the data the daemon sends.
1165The client can still specify a smaller --bwlimit value, but their
1166requested value will be rounded down if they try to exceed it. See the
1167client version of this option (above) for some extra details.
1168
bdf278f7
WD
1169dit(bf(--config=FILE)) This specifies an alternate config file than
1170the default. This is only relevant when --daemon is specified.
1171The default is /etc/rsyncd.conf unless the daemon is running over
1172a remote shell program and the remote user is not root; in that case
1173the default is rsyncd.conf in the current directory (typically $HOME).
1174
1175dit(bf(--no-detach)) When running as a daemon, this option instructs
1176rsync to not detach itself and become a background process. This
1177option is required when running as a service on Cygwin, and may also
1178be useful when rsync is supervised by a program such as
1179bf(daemontools) or AIX's bf(System Resource Controller).
1180bf(--no-detach) is also recommended when rsync is run under a
1181debugger. This option has no effect if rsync is run from inetd or
1182sshd.
1183
c259892c
WD
1184dit(bf(--port=PORT)) This specifies an alternate TCP port number for the
1185daemon to listen on rather than the default of 873. See also the "port"
1186global option in the rsyncd.conf manpage.
bdf278f7
WD
1187
1188dit(bf(-4, --ipv4) or bf(-6, --ipv6)) Tells rsync to prefer IPv4/IPv6
1189when creating the incoming sockets that the rsync daemon will use to
1190listen for connections. One of these options may be required in older
1191versions of Linux to work around an IPv6 bug in the kernel (if you see
1192an "address already in use" error when nothing else is using the port,
1193try specifying --ipv6 or --ipv4 when starting the daemon).
1194
1195dit(bf(-h, --help)) When specified after --daemon, print a short help
1196page describing the options available for starting an rsync daemon.
1197
1198enddit()
1199
16e5de84 1200manpagesection(FILTER RULES)
43bd68e5 1201
16e5de84
WD
1202The filter rules allow for flexible selection of which files to transfer
1203(include) and which files to skip (exclude). The rules either directly
1204specify include/exclude patterns or they specify a way to acquire more
1205include/exclude patterns (e.g. to read them from a file).
43bd68e5 1206
16e5de84
WD
1207As the list of files/directories to transfer is built, rsync checks each
1208name to be transferred against the list of include/exclude patterns in
1209turn, and the first matching pattern is acted on: if it is an exclude
1210pattern, then that file is skipped; if it is an include pattern then that
1211filename is not skipped; if no matching pattern is found, then the
43bd68e5
AT
1212filename is not skipped.
1213
16e5de84
WD
1214Rsync builds an ordered list of filter rules as specified on the
1215command-line. Filter rules have the following syntax:
1216
1217itemize(
1218 it() x RULE
1219 it() xMODIFIERS RULE
1220 it() !
1221)
1222
1223The 'x' is a single-letter that specifies the kind of rule to create. It
1224can have trailing modifiers, and is separated from the RULE by one of the
1225following characters: a single space, an equal-sign (=), or an underscore
1226(_). Here are the available rule prefixes:
1227
1228verb(
1229 - specifies an exclude pattern.
1230 + specifies an include pattern.
1231 . specifies a merge-file to read for more rules.
1232 : specifies a per-directory merge-file.
1233 ! clears the current include/exclude list
1234)
1235
1236Note that the --include/--exclude command-line options do not allow the
1237full range of rule parsing as described above -- they only allow the
1238specification of include/exclude patterns and the "!" token (not to
1239mention the comment lines when reading rules from a file). If a pattern
1240does not begin with "- " (dash, space) or "+ " (plus, space), then the
1241rule will be interpreted as if "+ " (for an include option) or "- " (for
1242an exclude option) were prefixed to the string. A --filter option, on
1243the other hand, must always contain one of the prefixes above.
1244
1245Note also that the --filter, --include, and --exclude options take one
1246rule/pattern each. To add multiple ones, you can repeat the options on
1247the command-line, use the merge-file syntax of the --filter option, or
1248the --include-from/--exclude-from options.
1249
1250When rules are being read from a file, empty lines are ignored, as are
1251comment lines that start with a "#".
1252
1253manpagesection(INCLUDE/EXCLUDE PATTERN RULES)
1254
1255You can include and exclude files by specifing patterns using the "+" and
1256"-" filter rules (as introduced in the FILTER RULES section above). These
1257rules specify a pattern that is matched against the names of the files
1258that are going to be transferred. These patterns can take several forms:
1259
1260itemize(
1261
1262 it() if the pattern starts with a / then it is anchored to a
1263 particular spot in the hierarchy of files, otherwise it is matched
1264 against the end of the pathname. This is similar to a leading ^ in
1265 regular expressions.
1266 Thus "/foo" would match a file called "foo" at either the "root of the
1267 transfer" (for a global rule) or in the merge-file's directory (for a
1268 per-directory rule).
1269 An unqualified "foo" would match any file or directory named "foo"
1270 anywhere in the tree because the algorithm is applied recursively from
1271 the
1272 top down; it behaves as if each path component gets a turn at being the
1273 end of the file name. Even the unanchored "sub/foo" would match at
1274 any point in the hierarchy where a "foo" was found within a directory
1275 named "sub". See the section on ANCHORING INCLUDE/EXCLUDE PATTERNS for
1276 a full discussion of how to specify a pattern that matches at the root
1277 of the transfer.
1278
1279 it() if the pattern ends with a / then it will only match a
1280 directory, not a file, link, or device.
1281
1282 it() if the pattern contains a wildcard character from the set
1283 *?[ then expression matching is applied using the shell filename
1284 matching rules. Otherwise a simple string match is used.
1285
1286 it() the double asterisk pattern "**" will match slashes while a
1287 single asterisk pattern "*" will stop at slashes.
1288
1289 it() if the pattern contains a / (not counting a trailing /) or a "**"
1290 then it is matched against the full pathname, including any leading
1291 directories. If the pattern doesn't contain a / or a "**", then it is
1292 matched only against the final component of the filename.
1293 (Remember that the algorithm is applied recursively so "full filename"
1294 can actually be any portion of a path fomr the starting directory on
1295 down.)
1296
1297)
1298
1299Note that, when using the --recursive (-r) option (which is implied by
1300-a), every subcomponent of every path is visited from the top down, so
1301include/exclude patterns get applied recursively to each subcomponent's
1302full name (e.g. to include "/foo/bar/baz" the subcomponents "/foo" and
1303"/foo/bar" must not be excluded).
1304The exclude patterns actually short-circuit the directory traversal stage
1305when rsync finds the files to send. If a pattern excludes a particular
1306parent directory, it can render a deeper include pattern ineffectual
1307because rsync did not descend through that excluded section of the
1308hierarchy. This is particularly important when using a trailing '*' rule.
1309For instance, this won't work:
1310
1311verb(
1312 + /some/path/this-file-will-not-be-found
1313 + /file-is-included
1314 - *
1315)
1316
1317This fails because the parent directory "some" is excluded by the '*'
1318rule, so rsync never visits any of the files in the "some" or "some/path"
1319directories. One solution is to ask for all directories in the hierarchy
1320to be included by using a single rule: "+_*/" (put it somewhere before the
1321"-_*" rule). Another solution is to add specific include rules for all
1322the parent dirs that need to be visited. For instance, this set of rules
1323works fine:
1324
1325verb(
1326 + /some/
1327 + /some/path/
1328 + /some/path/this-file-is-found
1329 + /file-also-included
1330 - *
1331)
1332
1333Here are some examples of exclude/include matching:
1334
1335itemize(
1336 it() "- *.o" would exclude all filenames matching *.o
1337 it() "- /foo" would exclude a file called foo in the transfer-root directory
1338 it() "- foo/" would exclude any directory called foo
1339 it() "- /foo/*/bar" would exclude any file called bar two
1340 levels below a directory called foo in the transfer-root directory
1341 it() "- /foo/**/bar" would exclude any file called bar two
1342 or more levels below a directory called foo in the transfer-root directory
1343 it() The combination of "+ */", "+ *.c", and "- *" would include all
1344 directories and C source files but nothing else.
1345 it() The combination of "+ foo/", "+ foo/bar.c", and "- *" would include
1346 only the foo directory and foo/bar.c (the foo directory must be
1347 explicitly included or it would be excluded by the "*")
1348)
1349
1350manpagesection(MERGE-FILE FILTER RULES)
1351
1352You can merge whole files into your filter rules by specifying either a
1353"." or a ":" filter rule (as introduced in the FILTER RULES section
1354above).
1355
1356There are two kinds of merged files -- single-instance ('.') and
1357per-directory (':'). A single-instance merge file is read one time, and
1358its rules are incorporated into the filter list in the place of the "."
1359rule. For per-directory merge files, rsync will scan every directory that
1360it traverses for the named file, merging its contents when the file exists
1361into the current list of inherited rules. These per-directory rule files
1362must be created on the sending side because it is the sending side that is
1363being scanned for the available files to transfer. These rule files may
1364also need to be transferred to the receiving side if you want them to
1365affect what files don't get deleted (see PER-DIRECTORY RULES AND DELETE
1366below).
1367
1368Some examples:
1369
1370verb(
1371 . /etc/rsync/default.rules
1372 : .per-dir-filter
1373 :n- .non-inherited-per-dir-excludes
1374)
1375
1376The following modifiers are accepted after the "." or ":":
1377
1378itemize(
1379 it() A "-" specifies that the file should consist of only exclude
1380 patterns, with no other rule-parsing except for the list-clearing
1381 token ("!").
1382
1383 it() A "+" specifies that the file should consist of only include
1384 patterns, with no other rule-parsing except for the list-clearing
1385 token ("!").
1386
1387 it() A "C" is a shorthand for the modifiers "sn-", which makes the
1388 parsing compatible with the way CVS parses their exclude files. If no
1389 filename is specified, ".cvsignore" is assumed.
1390
1391 it() A "e" will exclude the merge-file from the transfer; e.g.
1392 ":e_.rules" is like ":_.rules" and "-_.rules".
1393
1394 it() An "n" specifies that the rules are not inherited by subdirectories.
1395
1396 it() An "s" specifies that the rules are split on all whitespace instead
1397 of the normal line-splitting. This also turns off comments. Note: the
1398 space that separates the prefix from the rule is treated specially, so
1399 "- foo + bar" is parsed as two rules (assuming that "-" or "+" was not
1400 specified to turn off the parsing of prefixes).
1401)
1402
1403Per-directory rules are inherited in all subdirectories of the directory
1404where the merge-file was found unless the 'n' modifier was used. Each
1405subdirectory's rules are prefixed to the inherited per-directory rules
1406from its parents, which gives the newest rules a higher priority than the
1407inherited rules. The entire set of per-dir rules is grouped together in
1408the spot where the merge-file was specified, so it is possible to override
1409per-dir rules via a rule that got specified earlier in the list of global
1410rules. When the list-clearing rule ("!") is read from a per-directory
1411file, it only clears the inherited rules for the current merge file.
1412
1413Another way to prevent a single per-dir rule from being inherited is to
1414anchor it with a leading slash. Anchored rules in a per-directory
1415merge-file are relative to the merge-file's directory, so a pattern "/foo"
1416would only match the file "foo" in the directory where the per-dir filter
1417file was found.
1418
1419Here's an example filter file which you'd specify via --filter=". file":
1420
1421verb(
1422 . /home/user/.global-filter
1423 - *.gz
1424 : .rules
1425 + *.[ch]
1426 - *.o
1427)
1428
1429This will merge the contents of the /home/user/.global-filter file at the
1430start of the list and also turns the ".rules" filename into a per-directory
1431filter file. All rules read-in prior to the start of the directory scan
1432follow the global anchoring rules (i.e. a leading slash matches at the root
1433of the transfer).
1434
1435If a per-directory merge-file is specified with a path that is a parent
1436directory of the first transfer directory, rsync will scan all the parent
1437dirs from that starting point to the transfer directory for the indicated
1438per-directory file. For instance, here is a common filter (see -F):
1439
1440verb(
1441 --filter=': /.rsync-filter'
1442)
1443
1444That rule tells rsync to scan for the file .rsync-filter in all
1445directories from the root down through the parent directory of the
1446transfer prior to the start of the normal directory scan of the file in
1447the directories that are sent as a part of the transfer. (Note: for an
1448rsync daemon, the root is always the same as the module's "path".)
1449
1450Some examples of this pre-scanning for per-directory files:
1451
1452verb(
1453 rsync -avF /src/path/ /dest/dir
1454 rsync -av --filter=': ../../.rsync-filter' /src/path/ /dest/dir
1455 rsync -av --fitler=': .rsync-filter' /src/path/ /dest/dir
1456)
1457
1458The first two commands above will look for ".rsync-filter" in "/" and
1459"/src" before the normal scan begins looking for the file in "/src/path"
1460and its subdirectories. The last command avoids the parent-dir scan
1461and only looks for the ".rsync-filter" files in each directory that is
1462a part of the transfer.
1463
1464If you want to include the contents of a ".cvsignore" in your patterns,
1465you should use the rule ":C" -- this is a short-hand for the rule
1466":sn-_.cvsignore", and ensures that the .cvsignore file's contents are
1467interpreted according to the same parsing rules that CVS uses. You can
1468use this to affect where the --cvs-exclude (-C) option's inclusion of the
1469per-directory .cvsignore file gets placed into your rules by putting a
1470":C" wherever you like in your filter rules. Without this, rsync would
1471add the per-dir rule for the .cvignore file at the end of all your other
1472rules (giving it a lower priority than your command-line rules). For
1473example:
1474
1475verb(
1476 cat <<EOT | rsync -avC --filter='. -' a/ b
1477 + foo.o
1478 :C
1479 - *.old
1480 EOT
1481
1482 rsync -avC --include=foo.o -f :C --exclude='*.old' a/ b
1483)
1484
1485Both of the above rsync commands are identical. Each one will merge all
1486the per-directory .cvsignore rules in the middle of the list rather than
1487at the end. This allows their dir-specific rules to supersede the rules
1488that follow the :C instead of being subservient to all your rules. (The
1489global rules taken from the $HOME/.cvsignore file and from $CVSIGNORE are
1490not repositioned from their spot at the end of your rules, however -- feel
1491free to manually include $HOME/.cvsignore elsewhere in your rules.)
1492
1493manpagesection(LIST-CLEARING FILTER RULE)
1494
1495You can clear the current include/exclude list by using the "!" filter
1496rule (as introduced in the FILTER RULES section above). The "current"
1497list is either the global list of rules (if the rule is encountered while
1498parsing the filter options) or a set of per-directory rules (which are
1499inherited in their own sub-list, so a subdirectory can use this to clear
1500out the parent's rules).
1501
1502manpagesection(ANCHORING INCLUDE/EXCLUDE PATTERNS)
1503
1504As mentioned earlier, global include/exclude patterns are anchored at the
1505"root of the transfer" (as opposed to per-directory patterns, which are
1506anchored at the merge-file's directory). If you think of the transfer as
1507a subtree of names that are being sent from sender to receiver, the
1508transfer-root is where the tree starts to be duplicated in the destination
1509directory. This root governs where patterns that start with a / match.
a4b6f305
WD
1510
1511Because the matching is relative to the transfer-root, changing the
20af605e 1512trailing slash on a source path or changing your use of the --relative
a4b6f305
WD
1513option affects the path you need to use in your matching (in addition to
1514changing how much of the file tree is duplicated on the destination
16e5de84 1515host). The following examples demonstrate this.
a4b6f305 1516
b5ebe6d9
WD
1517Let's say that we want to match two source files, one with an absolute
1518path of "/home/me/foo/bar", and one with a path of "/home/you/bar/baz".
1519Here is how the various command choices differ for a 2-source transfer:
a4b6f305
WD
1520
1521verb(
b5ebe6d9 1522 Example cmd: rsync -a /home/me /home/you /dest
a4b6f305 1523 +/- pattern: /me/foo/bar
b5ebe6d9 1524 +/- pattern: /you/bar/baz
a4b6f305 1525 Target file: /dest/me/foo/bar
b5ebe6d9 1526 Target file: /dest/you/bar/baz
a4b6f305 1527
b5ebe6d9 1528 Example cmd: rsync -a /home/me/ /home/you/ /dest
b5ebe6d9
WD
1529 +/- pattern: /foo/bar (note missing "me")
1530 +/- pattern: /bar/baz (note missing "you")
a4b6f305 1531 Target file: /dest/foo/bar
b5ebe6d9 1532 Target file: /dest/bar/baz
a4b6f305 1533
b5ebe6d9 1534 Example cmd: rsync -a --relative /home/me/ /home/you /dest
b5ebe6d9
WD
1535 +/- pattern: /home/me/foo/bar (note full path)
1536 +/- pattern: /home/you/bar/baz (ditto)
a4b6f305 1537 Target file: /dest/home/me/foo/bar
b5ebe6d9 1538 Target file: /dest/home/you/bar/baz
be92ac6c 1539
b5ebe6d9 1540 Example cmd: cd /home; rsync -a --relative me/foo you/ /dest
b5ebe6d9
WD
1541 +/- pattern: /me/foo/bar (starts at specified path)
1542 +/- pattern: /you/bar/baz (ditto)
be92ac6c 1543 Target file: /dest/me/foo/bar
b5ebe6d9 1544 Target file: /dest/you/bar/baz
a4b6f305
WD
1545)
1546
16e5de84 1547The easiest way to see what name you should filter is to just
a4b6f305
WD
1548look at the output when using --verbose and put a / in front of the name
1549(use the --dry-run option if you're not yet ready to copy any files).
d1cce1dd 1550
16e5de84 1551manpagesection(PER-DIRECTORY RULES AND DELETE)
43bd68e5 1552
16e5de84
WD
1553Without a delete option, per-directory rules are only relevant on the
1554sending side, so you can feel free to exclude the merge files themselves
1555without affecting the transfer. To make this easy, the 'e' modifier adds
1556this exclude for you, as seen in these two equivalent commands:
27b9a19b 1557
16e5de84
WD
1558verb(
1559 rsync -av --filter=': .excl' --exclude=.excl host:src/dir /dest
1560 rsync -av --filter=':e .excl' host:src/dir /dest
43bd68e5
AT
1561)
1562
16e5de84
WD
1563However, if you want to do a delete on the receiving side AND you want some
1564files to be excluded from being deleted, you'll need to be sure that the
1565receiving side knows what files to exclude. The easiest way is to include
1566the per-directory merge files in the transfer and use --delete-after,
1567because this ensures that the receiving side gets all the same exclude
1568rules as the sending side before it tries to delete anything:
43bd68e5 1569
20af605e 1570verb(
16e5de84 1571 rsync -avF --delete-after host:src/dir /dest
20af605e
WD
1572)
1573
16e5de84
WD
1574However, if the merge files are not a part of the transfer, you'll need to
1575either specify some global exclude rules (i.e. specified on the command
1576line), or you'll need to maintain your own per-directory merge files on
1577the receiving side. An example of the first is this (assume that the
1578remote .rules files exclude themselves):
20af605e
WD
1579
1580verb(
16e5de84
WD
1581 rsync -av --filter=': .rules' --filter='. /my/extra.rules'
1582 --delete host:src/dir /dest
20af605e
WD
1583)
1584
16e5de84
WD
1585In the above example the extra.rules file can affect both sides of the
1586transfer, but (on the sending side) the rules are subservient to the rules
1587merged from the .rules files because they were specified after the
1588per-directory merge rule.
43bd68e5 1589
16e5de84
WD
1590In one final example, the remote side is excluding the .rsync-filter
1591files from the transfer, but we want to use our own .rsync-filter files
1592to control what gets deleted on the receiving side. To do this we must
1593specifically exclude the per-directory merge files (so that they don't get
1594deleted) and then put rules into the local files to control what else
1595should not get deleted. Like one of these commands:
1596
1597verb(
1598 rsync -av --filter=':e /.rsync-filter' --delete host:src/dir /dest
1599 rsync -avFF --delete host:src/dir /dest
43bd68e5
AT
1600)
1601
6902ed17
MP
1602manpagesection(BATCH MODE)
1603
2e3c1417 1604bf(Note:) Batch mode should be considered experimental in this version
7432ccf4
WD
1605of rsync. The interface and behavior have now stabilized, though, so
1606feel free to try this out.
088aac85
DD
1607
1608Batch mode can be used to apply the same set of updates to many
1609identical systems. Suppose one has a tree which is replicated on a
1610number of hosts. Now suppose some changes have been made to this
1611source tree and those changes need to be propagated to the other
1612hosts. In order to do this using batch mode, rsync is run with the
1613write-batch option to apply the changes made to the source tree to one
1614of the destination trees. The write-batch option causes the rsync
b9f592fb
WD
1615client to store in a "batch file" all the information needed to repeat
1616this operation against other, identical destination trees.
1617
1618To apply the recorded changes to another destination tree, run rsync
1619with the read-batch option, specifying the name of the same batch
1620file, and the destination tree. Rsync updates the destination tree
1621using the information stored in the batch file.
1622
1623For convenience, one additional file is creating when the write-batch
1624option is used. This file's name is created by appending
73e01568 1625".sh" to the batch filename. The .sh file contains
b9f592fb
WD
1626a command-line suitable for updating a destination tree using that
1627batch file. It can be executed using a Bourne(-like) shell, optionally
1628passing in an alternate destination tree pathname which is then used
1629instead of the original path. This is useful when the destination tree
1630path differs from the original destination tree path.
1631
1632Generating the batch file once saves having to perform the file
1633status, checksum, and data block generation more than once when
088aac85 1634updating multiple destination trees. Multicast transport protocols can
b9f592fb
WD
1635be used to transfer the batch update files in parallel to many hosts
1636at once, instead of sending the same data to every host individually.
088aac85 1637
4602eafa 1638Examples:
088aac85
DD
1639
1640verb(
98f51bfb
WD
1641 $ rsync --write-batch=foo -a host:/source/dir/ /adest/dir/
1642 $ scp foo* remote:
1643 $ ssh remote ./foo.sh /bdest/dir/
4602eafa
WD
1644)
1645
1646verb(
98f51bfb
WD
1647 $ rsync --write-batch=foo -a /source/dir/ /adest/dir/
1648 $ ssh remote rsync --read-batch=- -a /bdest/dir/ <foo
4602eafa
WD
1649)
1650
98f51bfb
WD
1651In these examples, rsync is used to update /adest/dir/ from /source/dir/
1652and the information to repeat this operation is stored in "foo" and
1653"foo.sh". The host "remote" is then updated with the batched data going
1654into the directory /bdest/dir. The differences between the two examples
1655reveals some of the flexibility you have in how you deal with batches:
1656
1657itemize(
1658
1659 it() The first example shows that the initial copy doesn't have to be
1660 local -- you can push or pull data to/from a remote host using either the
1661 remote-shell syntax or rsync daemon syntax, as desired.
6902ed17 1662
98f51bfb
WD
1663 it() The first example uses the created "foo.sh" file to get the right
1664 rsync options when running the read-batch command on the remote host.
1665
1666 it() The second example reads the batch data via standard input so that
1667 the batch file doesn't need to be copied to the remote machine first.
1668 This example avoids the foo.sh script because it needed to use a modified
1669 --read-batch option, but you could edit the script file if you wished to
1670 make use of it (just be sure that no other option is trying to use
1671 standard input, such as the "--exclude-from=-" option).
1672
1673)
088aac85
DD
1674
1675Caveats:
1676
98f51bfb 1677The read-batch option expects the destination tree that it is updating
088aac85
DD
1678to be identical to the destination tree that was used to create the
1679batch update fileset. When a difference between the destination trees
7432ccf4
WD
1680is encountered the update might be discarded with no error (if the file
1681appears to be up-to-date already) or the file-update may be attempted
1682and then, if the file fails to verify, the update discarded with an
1683error. This means that it should be safe to re-run a read-batch operation
59d73bf3 1684if the command got interrupted. If you wish to force the batched-update to
7432ccf4 1685always be attempted regardless of the file's size and date, use the -I
59d73bf3
WD
1686option (when reading the batch).
1687If an error occurs, the destination tree will probably be in a
7432ccf4 1688partially updated state. In that case, rsync can
088aac85
DD
1689be used in its regular (non-batch) mode of operation to fix up the
1690destination tree.
1691
b9f592fb 1692The rsync version used on all destinations must be at least as new as the
59d73bf3
WD
1693one used to generate the batch file. Rsync will die with an error if the
1694protocol version in the batch file is too new for the batch-reading rsync
1695to handle.
088aac85 1696
98f51bfb 1697The --dry-run (-n) option does not work in batch mode and yields a runtime
088aac85
DD
1698error.
1699
7432ccf4
WD
1700When reading a batch file, rsync will force the value of certain options
1701to match the data in the batch file if you didn't set them to the same
1702as the batch-writing command. Other options can (and should) be changed.
1703For instance
b9f592fb
WD
1704--write-batch changes to --read-batch, --files-from is dropped, and the
1705--include/--exclude options are not needed unless --delete is specified
7432ccf4 1706without --delete-excluded.
b9f592fb 1707
98f51bfb
WD
1708The code that creates the BATCH.sh file transforms any include/exclude
1709options into a single list that is appended as a "here" document to the
1710shell script file. An advanced user can use this to modify the exclude
1711list if a change in what gets deleted by --delete is desired. A normal
1712user can ignore this detail and just use the shell script as an easy way
1713to run the appropriate --read-batch command for the batched data.
1714
59d73bf3
WD
1715The original batch mode in rsync was based on "rsync+", but the latest
1716version uses a new implementation.
6902ed17 1717
eb06fa95
MP
1718manpagesection(SYMBOLIC LINKS)
1719
f28bd833 1720Three basic behaviors are possible when rsync encounters a symbolic
eb06fa95
MP
1721link in the source directory.
1722
1723By default, symbolic links are not transferred at all. A message
1724"skipping non-regular" file is emitted for any symlinks that exist.
1725
1726If bf(--links) is specified, then symlinks are recreated with the same
1727target on the destination. Note that bf(--archive) implies
1728bf(--links).
1729
1730If bf(--copy-links) is specified, then symlinks are "collapsed" by
1731copying their referent, rather than the symlink.
1732
1733rsync also distinguishes "safe" and "unsafe" symbolic links. An
1734example where this might be used is a web site mirror that wishes
1735ensure the rsync module they copy does not include symbolic links to
1736bf(/etc/passwd) in the public section of the site. Using
1737bf(--copy-unsafe-links) will cause any links to be copied as the file
1738they point to on the destination. Using bf(--safe-links) will cause
4d888108 1739unsafe links to be omitted altogether.
eb06fa95 1740
7bd0cf5b
MP
1741Symbolic links are considered unsafe if they are absolute symlinks
1742(start with bf(/)), empty, or if they contain enough bf("..")
1743components to ascend from the directory being copied.
1744
d310a212
AT
1745manpagesection(DIAGNOSTICS)
1746
14d43f1f 1747rsync occasionally produces error messages that may seem a little
d310a212
AT
1748cryptic. The one that seems to cause the most confusion is "protocol
1749version mismatch - is your shell clean?".
1750
1751This message is usually caused by your startup scripts or remote shell
1752facility producing unwanted garbage on the stream that rsync is using
14d43f1f 1753for its transport. The way to diagnose this problem is to run your
d310a212
AT
1754remote shell like this:
1755
1756verb(
43cd760f 1757 ssh remotehost /bin/true > out.dat
d310a212
AT
1758)
1759
1760then look at out.dat. If everything is working correctly then out.dat
2cfeab21 1761should be a zero length file. If you are getting the above error from
d310a212
AT
1762rsync then you will probably find that out.dat contains some text or
1763data. Look at the contents and try to work out what is producing
14d43f1f 1764it. The most common cause is incorrectly configured shell startup
d310a212
AT
1765scripts (such as .cshrc or .profile) that contain output statements
1766for non-interactive logins.
1767
16e5de84 1768If you are having trouble debugging filter patterns, then
e6c64e79
MP
1769try specifying the -vv option. At this level of verbosity rsync will
1770show why each individual file is included or excluded.
1771
55b64e4b
MP
1772manpagesection(EXIT VALUES)
1773
1774startdit()
a73de5f3
WD
1775dit(bf(0)) Success
1776dit(bf(1)) Syntax or usage error
1777dit(bf(2)) Protocol incompatibility
1778dit(bf(3)) Errors selecting input/output files, dirs
1779dit(bf(4)) Requested action not supported: an attempt
8212336a 1780was made to manipulate 64-bit files on a platform that cannot support
f28bd833 1781them; or an option was specified that is supported by the client and
8212336a 1782not by the server.
a73de5f3 1783dit(bf(5)) Error starting client-server protocol
b5accaba
WD
1784dit(bf(10)) Error in socket I/O
1785dit(bf(11)) Error in file I/O
a73de5f3
WD
1786dit(bf(12)) Error in rsync protocol data stream
1787dit(bf(13)) Errors with program diagnostics
1788dit(bf(14)) Error in IPC code
1789dit(bf(20)) Received SIGUSR1 or SIGINT
1790dit(bf(21)) Some error returned by waitpid()
1791dit(bf(22)) Error allocating core memory buffers
3c1e2ad9
WD
1792dit(bf(23)) Partial transfer due to error
1793dit(bf(24)) Partial transfer due to vanished source files
a73de5f3 1794dit(bf(30)) Timeout in data send/receive
55b64e4b
MP
1795enddit()
1796
de2fd20e
AT
1797manpagesection(ENVIRONMENT VARIABLES)
1798
1799startdit()
1800
1801dit(bf(CVSIGNORE)) The CVSIGNORE environment variable supplements any
1802ignore patterns in .cvsignore files. See the --cvs-exclude option for
1803more details.
1804
1805dit(bf(RSYNC_RSH)) The RSYNC_RSH environment variable allows you to
ea7f8108
WD
1806override the default shell used as the transport for rsync. Command line
1807options are permitted after the command name, just as in the -e option.
de2fd20e 1808
4c3b4b25
AT
1809dit(bf(RSYNC_PROXY)) The RSYNC_PROXY environment variable allows you to
1810redirect your rsync client to use a web proxy when connecting to a
1811rsync daemon. You should set RSYNC_PROXY to a hostname:port pair.
1812
de2fd20e 1813dit(bf(RSYNC_PASSWORD)) Setting RSYNC_PASSWORD to the required
bb18e755 1814password allows you to run authenticated rsync connections to an rsync
de2fd20e
AT
1815daemon without user intervention. Note that this does not supply a
1816password to a shell transport such as ssh.
1817
1818dit(bf(USER) or bf(LOGNAME)) The USER or LOGNAME environment variables
bb18e755 1819are used to determine the default username sent to an rsync server.
4b2f6a7c 1820If neither is set, the username defaults to "nobody".
de2fd20e 1821
14d43f1f 1822dit(bf(HOME)) The HOME environment variable is used to find the user's
de2fd20e
AT
1823default .cvsignore file.
1824
1825enddit()
1826
41059f75
AT
1827manpagefiles()
1828
30e8c8e1 1829/etc/rsyncd.conf or rsyncd.conf
41059f75
AT
1830
1831manpageseealso()
1832
1833rsyncd.conf(5)
1834
1835manpagediagnostics()
1836
1837manpagebugs()
1838
1839times are transferred as unix time_t values
1840
f28bd833 1841When transferring to FAT filesystems rsync may re-sync
38843171
DD
1842unmodified files.
1843See the comments on the --modify-window option.
1844
b5accaba 1845file permissions, devices, etc. are transferred as native numerical
41059f75
AT
1846values
1847
a87b3b2a 1848see also the comments on the --delete option
41059f75 1849
38843171
DD
1850Please report bugs! See the website at
1851url(http://rsync.samba.org/)(http://rsync.samba.org/)
41059f75
AT
1852
1853manpagesection(CREDITS)
1854
1855rsync is distributed under the GNU public license. See the file
1856COPYING for details.
1857
41059f75 1858A WEB site is available at
3cd5eb3b
MP
1859url(http://rsync.samba.org/)(http://rsync.samba.org/). The site
1860includes an FAQ-O-Matic which may cover questions unanswered by this
1861manual page.
9e3c856a
AT
1862
1863The primary ftp site for rsync is
1864url(ftp://rsync.samba.org/pub/rsync)(ftp://rsync.samba.org/pub/rsync).
41059f75
AT
1865
1866We would be delighted to hear from you if you like this program.
1867
9e3c856a
AT
1868This program uses the excellent zlib compression library written by
1869Jean-loup Gailly and Mark Adler.
41059f75
AT
1870
1871manpagesection(THANKS)
1872
1873Thanks to Richard Brent, Brendan Mackay, Bill Waite, Stephen Rothwell
7ff701e8
MP
1874and David Bell for helpful suggestions, patches and testing of rsync.
1875I've probably missed some people, my apologies if I have.
1876
ce5f2732 1877Especial thanks also to: David Dykstra, Jos Backus, Sebastian Krahmer,
98f51bfb 1878Martin Pool, Wayne Davison, J.W. Schultz.
41059f75
AT
1879
1880manpageauthor()
1881
ce5f2732
MP
1882rsync was originally written by Andrew Tridgell and Paul Mackerras.
1883Many people have later contributed to it.
3cd5eb3b 1884
a5d74a18 1885Mailing lists for support and development are available at
7ff701e8 1886url(http://lists.samba.org)(lists.samba.org)