Use "an" in front of rsync, not "a".
[rsync/rsync.git] / rsync.yo
... / ...
CommitLineData
1mailto(rsync-bugs@samba.org)
2manpage(rsync)(1)(1 Jan 2004)()()
3manpagename(rsync)(faster, flexible replacement for rcp)
4manpagesynopsis()
5
6rsync [OPTION]... SRC [SRC]... [USER@]HOST:DEST
7
8rsync [OPTION]... [USER@]HOST:SRC DEST
9
10rsync [OPTION]... SRC [SRC]... DEST
11
12rsync [OPTION]... [USER@]HOST::SRC [DEST]
13
14rsync [OPTION]... SRC [SRC]... [USER@]HOST::DEST
15
16rsync [OPTION]... rsync://[USER@]HOST[:PORT]/SRC [DEST]
17
18rsync [OPTION]... SRC [SRC]... rsync://[USER@]HOST[:PORT]/DEST
19
20manpagedescription()
21
22rsync is a program that behaves in much the same way that rcp does,
23but has many more options and uses the rsync remote-update protocol to
24greatly speed up file transfers when the destination file already
25exists.
26
27The rsync remote-update protocol allows rsync to transfer just the
28differences between two sets of files across the network connection, using
29an efficient checksum-search algorithm described in the technical
30report that accompanies this package.
31
32Some of the additional features of rsync are:
33
34itemize(
35 it() support for copying links, devices, owners, groups and permissions
36 it() exclude and exclude-from options similar to GNU tar
37 it() a CVS exclude mode for ignoring the same files that CVS would ignore
38 it() can use any transparent remote shell, including ssh or rsh
39 it() does not require root privileges
40 it() pipelining of file transfers to minimize latency costs
41 it() support for anonymous or authenticated rsync servers (ideal for
42 mirroring)
43)
44
45manpagesection(GENERAL)
46
47There are eight different ways of using rsync. They are:
48
49itemize(
50 it() for copying local files. This is invoked when neither
51 source nor destination path contains a : separator
52
53 it() for copying from the local machine to a remote machine using
54 a remote shell program as the transport (such as ssh or
55 rsh). This is invoked when the destination path contains a
56 single : separator.
57
58 it() for copying from a remote machine to the local machine
59 using a remote shell program. This is invoked when the source
60 contains a : separator.
61
62 it() for copying from a remote rsync server to the local
63 machine. This is invoked when the source path contains a ::
64 separator or an rsync:// URL.
65
66 it() for copying from the local machine to a remote rsync
67 server. This is invoked when the destination path contains a ::
68 separator or an rsync:// URL.
69
70 it() for copying from a remote machine using a remote shell
71 program as the transport, using rsync server on the remote
72 machine. This is invoked when the source path contains a ::
73 separator and the --rsh=COMMAND (aka "-e COMMAND") option is
74 also provided.
75
76 it() for copying from the local machine to a remote machine
77 using a remote shell program as the transport, using rsync
78 server on the remote machine. This is invoked when the
79 destination path contains a :: separator and the
80 --rsh=COMMAND option is also provided.
81
82 it() for listing files on a remote machine. This is done the
83 same way as rsync transfers except that you leave off the
84 local destination.
85)
86
87Note that in all cases (other than listing) at least one of the source
88and destination paths must be local.
89
90manpagesection(SETUP)
91
92See the file README for installation instructions.
93
94Once installed, you can use rsync to any machine that you can access via
95a remote shell (as well as some that you can access using the rsync
96daemon-mode protocol). For remote transfers, a modern rsync uses ssh
97for its communications, but it may have been configured to use a
98different remote shell by default, such as rsh or remsh.
99
100You can also specify any remote shell you like, either by using the -e
101command line option, or by setting the RSYNC_RSH environment variable.
102
103One common substitute is to use ssh, which offers a high degree of
104security.
105
106Note that rsync must be installed on both the source and destination
107machines.
108
109manpagesection(USAGE)
110
111You use rsync in the same way you use rcp. You must specify a source
112and a destination, one of which may be remote.
113
114Perhaps the best way to explain the syntax is with some examples:
115
116quote(rsync *.c foo:src/)
117
118This would transfer all files matching the pattern *.c from the
119current directory to the directory src on the machine foo. If any of
120the files already exist on the remote system then the rsync
121remote-update protocol is used to update the file by sending only the
122differences. See the tech report for details.
123
124quote(rsync -avz foo:src/bar /data/tmp)
125
126This would recursively transfer all files from the directory src/bar on the
127machine foo into the /data/tmp/bar directory on the local machine. The
128files are transferred in "archive" mode, which ensures that symbolic
129links, devices, attributes, permissions, ownerships, etc. are preserved
130in the transfer. Additionally, compression will be used to reduce the
131size of data portions of the transfer.
132
133quote(rsync -avz foo:src/bar/ /data/tmp)
134
135A trailing slash on the source changes this behavior to avoid creating an
136additional directory level at the destination. You can think of a trailing
137/ on a source as meaning "copy the contents of this directory" as opposed
138to "copy the directory by name", but in both cases the attributes of the
139containing directory are transferred to the containing directory on the
140destination. In other words, each of the following commands copies the
141files in the same way, including their setting of the attributes of
142/dest/foo:
143
144quote(rsync -avz /src/foo /dest)
145quote(rsync -avz /src/foo/ /dest/foo)
146
147You can also use rsync in local-only mode, where both the source and
148destination don't have a ':' in the name. In this case it behaves like
149an improved copy command.
150
151quote(rsync somehost.mydomain.com::)
152
153This would list all the anonymous rsync modules available on the host
154somehost.mydomain.com. (See the following section for more details.)
155
156
157manpagesection(CONNECTING TO AN RSYNC SERVER)
158
159It is also possible to use rsync without a remote shell as the
160transport. In this case you will connect to a remote rsync server
161running on TCP port 873.
162
163You may establish the connection via a web proxy by setting the
164environment variable RSYNC_PROXY to a hostname:port pair pointing to
165your web proxy. Note that your web proxy's configuration must support
166proxy connections to port 873.
167
168Using rsync in this way is the same as using it with a remote shell except
169that:
170
171itemize(
172 it() you use a double colon :: instead of a single colon to
173 separate the hostname from the path or an rsync:// URL.
174
175 it() the remote server may print a message of the day when you
176 connect.
177
178 it() if you specify no path name on the remote server then the
179 list of accessible paths on the server will be shown.
180
181 it() if you specify no local destination then a listing of the
182 specified files on the remote server is provided.
183)
184
185Some paths on the remote server may require authentication. If so then
186you will receive a password prompt when you connect. You can avoid the
187password prompt by setting the environment variable RSYNC_PASSWORD to
188the password you want to use or using the --password-file option. This
189may be useful when scripting rsync.
190
191WARNING: On some systems environment variables are visible to all
192users. On those systems using --password-file is recommended.
193
194manpagesection(CONNECTING TO AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM)
195
196It is sometimes useful to be able to set up file transfers using rsync
197server capabilities on the remote machine, while still using ssh or
198rsh for transport. This is especially useful when you want to connect
199to a remote machine via ssh (for encryption or to get through a
200firewall), but you still want to have access to the rsync server
201features (see RUNNING AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM,
202below).
203
204From the user's perspective, using rsync in this way is the same as
205using it to connect to an rsync server, except that you must
206explicitly set the remote shell program on the command line with
207--rsh=COMMAND. (Setting RSYNC_RSH in the environment will not turn on
208this functionality.)
209
210In order to distinguish between the remote-shell user and the rsync
211server user, you can use '-l user' on your remote-shell command:
212
213quote(rsync -av --rsh="ssh -l ssh-user" rsync-user@host::module[/path] local-path)
214
215The "ssh-user" will be used at the ssh level; the "rsync-user" will be
216used to check against the rsyncd.conf on the remote host.
217
218manpagesection(RUNNING AN RSYNC SERVER)
219
220An rsync server is configured using a configuration file. Please see the
221rsyncd.conf(5) man page for more information. By default the configuration
222file is called /etc/rsyncd.conf, unless rsync is running over a remote
223shell program and is not running as root; in that case, the default name
224is rsyncd.conf in the current directory on the remote computer
225(typically $HOME).
226
227manpagesection(RUNNING AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM)
228
229See the rsyncd.conf(5) man page for full information on the rsync
230server configuration file.
231
232Several configuration options will not be available unless the remote
233user is root (e.g. chroot, setuid/setgid, etc.). There is no need to
234configure inetd or the services map to include the rsync server port
235if you run an rsync server only via a remote shell program.
236
237To run an rsync server out of a single-use ssh key, see this section
238in the rsyncd.conf(5) man page.
239
240manpagesection(EXAMPLES)
241
242Here are some examples of how I use rsync.
243
244To backup my wife's home directory, which consists of large MS Word
245files and mail folders, I use a cron job that runs
246
247quote(rsync -Cavz . arvidsjaur:backup)
248
249each night over a PPP connection to a duplicate directory on my machine
250"arvidsjaur".
251
252To synchronize my samba source trees I use the following Makefile
253targets:
254
255quote( get:nl()
256 rsync -avuzb --exclude '*~' samba:samba/ .
257
258 put:nl()
259 rsync -Cavuzb . samba:samba/
260
261 sync: get put)
262
263this allows me to sync with a CVS directory at the other end of the
264connection. I then do cvs operations on the remote machine, which saves a
265lot of time as the remote cvs protocol isn't very efficient.
266
267I mirror a directory between my "old" and "new" ftp sites with the
268command
269
270quote(rsync -az -e ssh --delete ~ftp/pub/samba/ nimbus:"~ftp/pub/tridge/samba")
271
272this is launched from cron every few hours.
273
274manpagesection(OPTIONS SUMMARY)
275
276Here is a short summary of the options available in rsync. Please refer
277to the detailed description below for a complete description.
278
279verb(
280 -v, --verbose increase verbosity
281 -q, --quiet decrease verbosity
282 -c, --checksum always checksum
283 -a, --archive archive mode, equivalent to -rlptgoD
284 -r, --recursive recurse into directories
285 -R, --relative use relative path names
286 --no-relative turn off --relative
287 --no-implied-dirs don't send implied dirs with -R
288 -b, --backup make backups (see --suffix & --backup-dir)
289 --backup-dir make backups into this directory
290 --suffix=SUFFIX backup suffix (default ~ w/o --backup-dir)
291 -u, --update update only (don't overwrite newer files)
292 -l, --links copy symlinks as symlinks
293 -L, --copy-links copy the referent of symlinks
294 --copy-unsafe-links copy links outside the source tree
295 --safe-links ignore links outside the destination tree
296 -H, --hard-links preserve hard links
297 -p, --perms preserve permissions
298 -o, --owner preserve owner (root only)
299 -g, --group preserve group
300 -D, --devices preserve devices (root only)
301 -t, --times preserve times
302 -S, --sparse handle sparse files efficiently
303 -n, --dry-run show what would have been transferred
304 -W, --whole-file copy whole files, no incremental checks
305 --no-whole-file turn off --whole-file
306 -x, --one-file-system don't cross filesystem boundaries
307 -B, --block-size=SIZE checksum blocking size (default 700)
308 -e, --rsh=COMMAND specify the remote shell
309 --rsync-path=PATH specify path to rsync on the remote machine
310 --existing only update files that already exist
311 --ignore-existing ignore files that already exist on receiver
312 --delete delete files that don't exist on sender
313 --delete-excluded also delete excluded files on receiver
314 --delete-after receiver deletes after transfer, not before
315 --ignore-errors delete even if there are I/O errors
316 --max-delete=NUM don't delete more than NUM files
317 --partial keep partially transferred files
318 --force force deletion of dirs even if not empty
319 --numeric-ids don't map uid/gid values by user/group name
320 --timeout=TIME set I/O timeout in seconds
321 -I, --ignore-times turn off mod time & file size quick check
322 --size-only ignore mod time for quick check (use size)
323 --modify-window=NUM compare mod times with reduced accuracy
324 -T --temp-dir=DIR create temporary files in directory DIR
325 --compare-dest=DIR also compare received files relative to DIR
326 --link-dest=DIR create hardlinks to DIR for unchanged files
327 -P equivalent to --partial --progress
328 -z, --compress compress file data
329 -C, --cvs-exclude auto ignore files in the same way CVS does
330 --exclude=PATTERN exclude files matching PATTERN
331 --exclude-from=FILE exclude patterns listed in FILE
332 --include=PATTERN don't exclude files matching PATTERN
333 --include-from=FILE don't exclude patterns listed in FILE
334 --files-from=FILE read FILE for list of source-file names
335 -0 --from0 all file lists are delimited by nulls
336 --version print version number
337 --daemon run as an rsync daemon
338 --no-detach do not detach from the parent
339 --address=ADDRESS bind to the specified address
340 --config=FILE specify alternate rsyncd.conf file
341 --port=PORT specify alternate rsyncd port number
342 --blocking-io use blocking I/O for the remote shell
343 --no-blocking-io turn off --blocking-io
344 --stats give some file transfer stats
345 --progress show progress during transfer
346 --log-format=FORMAT log file transfers using specified format
347 --password-file=FILE get password from FILE
348 --bwlimit=KBPS limit I/O bandwidth, KBytes per second
349 --write-batch=PREFIX write batch fileset starting with PREFIX
350 --read-batch=PREFIX read batch fileset starting with PREFIX
351 -h, --help show this help screen
352
353
354)
355
356manpageoptions()
357
358rsync uses the GNU long options package. Many of the command line
359options have two variants, one short and one long. These are shown
360below, separated by commas. Some options only have a long variant.
361The '=' for options that take a parameter is optional; whitespace
362can be used instead.
363
364startdit()
365dit(bf(-h, --help)) Print a short help page describing the options
366available in rsync
367
368dit(bf(--version)) print the rsync version number and exit
369
370dit(bf(-v, --verbose)) This option increases the amount of information you
371are given during the transfer. By default, rsync works silently. A
372single -v will give you information about what files are being
373transferred and a brief summary at the end. Two -v flags will give you
374information on what files are being skipped and slightly more
375information at the end. More than two -v flags should only be used if
376you are debugging rsync.
377
378dit(bf(-q, --quiet)) This option decreases the amount of information you
379are given during the transfer, notably suppressing information messages
380from the remote server. This flag is useful when invoking rsync from
381cron.
382
383dit(bf(-I, --ignore-times)) Normally rsync will skip any files that are
384already the same size and have the same modification time-stamp.
385This option turns off this "quick check" behavior.
386
387dit(bf(--size-only)) Normally rsync will skip any files that are
388already the same size and have the same modification time-stamp. With the
389--size-only option files will be skipped if they have the same size,
390regardless of timestamp. This is useful when starting to use rsync
391after using another mirroring system which may not preserve timestamps
392exactly.
393
394dit(bf(--modify-window)) When comparing two timestamps rsync treats
395the timestamps as being equal if they are within the value of
396modify_window. This is normally zero, but you may find it useful to
397set this to a larger value in some situations. In particular, when
398transferring to Windows FAT filesystems which cannot represent times
399with a 1 second resolution --modify-window=1 is useful.
400
401dit(bf(-c, --checksum)) This forces the sender to checksum all files using
402a 128-bit MD4 checksum before transfer. The checksum is then
403explicitly checked on the receiver and any files of the same name
404which already exist and have the same checksum and size on the
405receiver are skipped. This option can be quite slow.
406
407dit(bf(-a, --archive)) This is equivalent to -rlptgoD. It is a quick
408way of saying you want recursion and want to preserve almost
409everything.
410
411Note however that bf(-a) bf(does not preserve hardlinks), because
412finding multiply-linked files is expensive. You must separately
413specify bf(-H).
414
415dit(bf(-r, --recursive)) This tells rsync to copy directories
416recursively. If you don't specify this then rsync won't copy
417directories at all.
418
419dit(bf(-R, --relative)) Use relative paths. This means that the full path
420names specified on the command line are sent to the server rather than
421just the last parts of the filenames. This is particularly useful when
422you want to send several different directories at the same time. For
423example, if you used the command
424
425verb(rsync foo/bar/foo.c remote:/tmp/)
426
427then this would create a file called foo.c in /tmp/ on the remote
428machine. If instead you used
429
430verb(rsync -R foo/bar/foo.c remote:/tmp/)
431
432then a file called /tmp/foo/bar/foo.c would be created on the remote
433machine -- the full path name is preserved.
434
435dit(bf(--no-relative)) Turn off the --relative option. This is only
436needed if you want to use --files-from without its implied --relative
437file processing.
438
439dit(bf(--no-implied-dirs)) When combined with the --relative option, the
440implied directories in each path are not explicitly duplicated as part
441of the transfer. This makes the transfer more optimal and also allows
442the two sides to have non-matching symlinks in the implied part of the
443path. For instance, if you transfer the file "/path/foo/file" with -R,
444the default is for rsync to ensure that "/path" and "/path/foo" on the
445destination exactly match the directories/symlinks of the source. Using
446the --no-implied-dirs option would omit both of these implied dirs,
447which means that if "/path" was a real directory on one machine and a
448symlink of the other machine, rsync would not try to change this.
449
450dit(bf(-b, --backup)) With this option, preexisting destination files are
451renamed as each file is transferred or deleted. You can control where the
452backup file goes and what (if any) suffix gets appended using the
453--backup-dir and --suffix options.
454
455dit(bf(--backup-dir=DIR)) In combination with the --backup option, this
456tells rsync to store all backups in the specified directory. This is
457very useful for incremental backups. You can additionally
458specify a backup suffix using the --suffix option
459(otherwise the files backed up in the specified directory
460will keep their original filenames).
461
462dit(bf(--suffix=SUFFIX)) This option allows you to override the default
463backup suffix used with the --backup (-b) option. The default suffix is a ~
464if no --backup-dir was specified, otherwise it is an empty string.
465
466dit(bf(-u, --update)) This forces rsync to skip any files for which the
467destination file already exists and has a date later than the source
468file.
469
470dit(bf(-l, --links)) When symlinks are encountered, recreate the
471symlink on the destination.
472
473dit(bf(-L, --copy-links)) When symlinks are encountered, the file that
474they point to is copied, rather than the symlink.
475
476dit(bf(--copy-unsafe-links)) This tells rsync to copy the referent of
477symbolic links that point outside the source tree. Absolute symlinks
478are also treated like ordinary files, and so are any symlinks in the
479source path itself when --relative is used.
480
481dit(bf(--safe-links)) This tells rsync to ignore any symbolic links
482which point outside the destination tree. All absolute symlinks are
483also ignored. Using this option in conjunction with --relative may
484give unexpected results.
485
486dit(bf(-H, --hard-links)) This tells rsync to recreate hard links on
487the remote system to be the same as the local system. Without this
488option hard links are treated like regular files.
489
490Note that rsync can only detect hard links if both parts of the link
491are in the list of files being sent.
492
493This option can be quite slow, so only use it if you need it.
494
495dit(bf(-W, --whole-file)) With this option the incremental rsync algorithm
496is not used and the whole file is sent as-is instead. The transfer may be
497faster if this option is used when the bandwidth between the source and
498target machines is higher than the bandwidth to disk (especially when the
499"disk" is actually a networked filesystem). This is the default when both
500the source and target are on the local machine.
501
502dit(bf(--no-whole-file)) Turn off --whole-file, for use when it is the
503default.
504
505dit(bf(-p, --perms)) This option causes rsync to set the destination
506permissions to be the same as the source permissions.
507
508Without this option, each new file gets its permissions set based on the
509source file's permissions and the umask at the receiving end, while all
510other files (including updated files) retain their existing permissions
511(which is the same behavior as other file-copy utilities, such as cp).
512
513dit(bf(-o, --owner)) This option causes rsync to set the owner of the
514destination file to be the same as the source file. On most systems,
515only the super-user can set file ownership. The preservation is done
516primarily by name, but falls back to using the ID number if the ID has
517no name on the sending side or has no match on the receiving side.
518See also the --numeric-ids option and the "use chroot" setting in the
519rsyncd.conf manpage.
520
521dit(bf(-g, --group)) This option causes rsync to set the group of the
522destination file to be the same as the source file. If the receiving
523program is not running as the super-user, only groups that the
524receiver is a member of will be preserved. The preservation is done
525primarily by name, but falls back to using the ID number if the ID has
526no name on the sending side or has no match on the receiving side.
527See also the --numeric-ids option and the "use chroot" setting in the
528rsyncd.conf manpage.
529
530dit(bf(-D, --devices)) This option causes rsync to transfer character and
531block device information to the remote system to recreate these
532devices. This option is only available to the super-user.
533
534dit(bf(-t, --times)) This tells rsync to transfer modification times along
535with the files and update them on the remote system. Note that if this
536option is not used, the optimization that excludes files that have not been
537modified cannot be effective; in other words, a missing -t or -a will
538cause the next transfer to behave as if it used -I, and all files will have
539their checksums compared and show up in log messages even if they haven't
540changed.
541
542dit(bf(-n, --dry-run)) This tells rsync to not do any file transfers,
543instead it will just report the actions it would have taken.
544
545dit(bf(-S, --sparse)) Try to handle sparse files efficiently so they take
546up less space on the destination.
547
548NOTE: Don't use this option when the destination is a Solaris "tmpfs"
549filesystem. It doesn't seem to handle seeks over null regions
550correctly and ends up corrupting the files.
551
552dit(bf(-x, --one-file-system)) This tells rsync not to cross filesystem
553boundaries when recursing. This is useful for transferring the
554contents of only one filesystem.
555
556dit(bf(--existing)) This tells rsync not to create any new files -
557only update files that already exist on the destination.
558
559dit(bf(--ignore-existing))
560This tells rsync not to update files that already exist on
561the destination.
562
563dit(bf(--max-delete=NUM)) This tells rsync not to delete more than NUM
564files or directories. This is useful when mirroring very large trees
565to prevent disasters.
566
567dit(bf(--delete)) This tells rsync to delete any files on the receiving
568side that aren't on the sending side. Files that are excluded from
569transfer are excluded from being deleted unless you use --delete-excluded.
570
571This option has no effect if directory recursion is not selected.
572
573This option can be dangerous if used incorrectly! It is a very good idea
574to run first using the dry run option (-n) to see what files would be
575deleted to make sure important files aren't listed.
576
577If the sending side detects any I/O errors then the deletion of any
578files at the destination will be automatically disabled. This is to
579prevent temporary filesystem failures (such as NFS errors) on the
580sending side causing a massive deletion of files on the
581destination. You can override this with the --ignore-errors option.
582
583dit(bf(--delete-excluded)) In addition to deleting the files on the
584receiving side that are not on the sending side, this tells rsync to also
585delete any files on the receiving side that are excluded (see --exclude).
586Implies --delete.
587
588dit(bf(--delete-after)) By default rsync does file deletions on the
589receiving side before transferring files to try to ensure that there is
590sufficient space on the receiving filesystem. If you want to delete
591after transferring, use the --delete-after switch. Implies --delete.
592
593dit(bf(--ignore-errors)) Tells --delete to go ahead and delete files
594even when there are I/O errors.
595
596dit(bf(--force)) This options tells rsync to delete directories even if
597they are not empty when they are to be replaced by non-directories. This
598is only relevant without --delete because deletions are now done depth-first.
599Requires the --recursive option (which is implied by -a) to have any effect.
600
601dit(bf(-B , --block-size=BLOCKSIZE)) This controls the block size used in
602the rsync algorithm. See the technical report for details.
603
604dit(bf(-e, --rsh=COMMAND)) This option allows you to choose an alternative
605remote shell program to use for communication between the local and
606remote copies of rsync. Typically, rsync is configured to use ssh by
607default, but you may prefer to use rsh on a local network.
608
609If this option is used with bf([user@]host::module/path), then the
610remote shell em(COMMAND) will be used to run an rsync server on the
611remote host, and all data will be transmitted through that remote
612shell connection, rather than through a direct socket connection to a
613running rsync server on the remote host. See the section "CONNECTING
614TO AN RSYNC SERVER OVER A REMOTE SHELL PROGRAM" above.
615
616Command-line arguments are permitted in COMMAND provided that COMMAND is
617presented to rsync as a single argument. For example:
618
619quote(-e "ssh -p 2234")
620
621(Note that ssh users can alternately customize site-specific connect
622options in their .ssh/config file.)
623
624You can also choose the remote shell program using the RSYNC_RSH
625environment variable, which accepts the same range of values as -e.
626
627See also the --blocking-io option which is affected by this option.
628
629dit(bf(--rsync-path=PATH)) Use this to specify the path to the copy of
630rsync on the remote machine. Useful when it's not in your path. Note
631that this is the full path to the binary, not just the directory that
632the binary is in.
633
634dit(bf(-C, --cvs-exclude)) This is a useful shorthand for excluding a
635broad range of files that you often don't want to transfer between
636systems. It uses the same algorithm that CVS uses to determine if
637a file should be ignored.
638
639The exclude list is initialized to:
640
641quote(RCS/ SCCS/ CVS/ .svn/ CVS.adm RCSLOG cvslog.* tags TAGS .make.state
642.nse_depinfo *~ #* .#* ,* *.old *.bak *.BAK *.orig *.rej .del-*
643*.a *.o *.obj *.so *.Z *.elc *.ln core)
644
645then files listed in a $HOME/.cvsignore are added to the list and any
646files listed in the CVSIGNORE environment variable (space delimited).
647
648Finally, any file is ignored if it is in the same directory as a
649.cvsignore file and matches one of the patterns listed therein. See
650the bf(cvs(1)) manual for more information.
651
652dit(bf(--exclude=PATTERN)) This option allows you to selectively exclude
653certain files from the list of files to be transferred. This is most
654useful in combination with a recursive transfer.
655
656You may use as many --exclude options on the command line as you like
657to build up the list of files to exclude.
658
659See the EXCLUDE PATTERNS section for information on the syntax of
660this option.
661
662dit(bf(--exclude-from=FILE)) This option is similar to the --exclude
663option, but instead it adds all exclude patterns listed in the file
664FILE to the exclude list. Blank lines in FILE and lines starting with
665';' or '#' are ignored.
666If em(FILE) is bf(-) the list will be read from standard input.
667
668dit(bf(--include=PATTERN)) This option tells rsync to not exclude the
669specified pattern of filenames. This is useful as it allows you to
670build up quite complex exclude/include rules.
671
672See the EXCLUDE PATTERNS section for information on the syntax of
673this option.
674
675dit(bf(--include-from=FILE)) This specifies a list of include patterns
676from a file.
677If em(FILE) is bf(-) the list will be read from standard input.
678
679dit(bf(--files-from=FILE)) Using this option allows you to specify the
680exact list of files to transfer (as read from the specified FILE or "-"
681for stdin). It also tweaks the default behavior of rsync to make
682transferring just the specified files and directories easier. For
683instance, the --relative option is enabled by default when this option
684is used (use --no-relative if you want to turn that off), all
685directories specified in the list are created on the destination (rather
686than being noisily skipped without -r), and the -a (--archive) option's
687behavior does not imply -r (--recursive) -- specify it explicitly, if
688you want it.
689
690The file names that are read from the FILE are all relative to the
691source dir -- any leading slashes are removed and no ".." references are
692allowed to go higher than the source dir. For example, take this
693command:
694
695quote(rsync -a --files-from=/tmp/foo /usr remote:/backup)
696
697If /tmp/foo contains the string "bin" (or even "/bin"), the /usr/bin
698directory will be created as /backup/bin on the remote host (but the
699contents of the /usr/bin dir would not be sent unless you specified -r
700or the names were explicitly listed in /tmp/foo). Also keep in mind
701that the effect of the (enabled by default) --relative option is to
702duplicate only the path info that is read from the file -- it does not
703force the duplication of the source-spec path (/usr in this case).
704
705In addition, the --files-from file can be read from the remote host
706instead of the local host if you specify a "host:" in front of the file
707(the host must match one end of the transfer). As a short-cut, you can
708specify just a prefix of ":" to mean "use the remote end of the
709transfer". For example:
710
711quote(rsync -a --files-from=:/path/file-list src:/ /tmp/copy)
712
713This would copy all the files specified in the /path/file-list file that
714was located on the remote "src" host.
715
716dit(bf(-0, --from0)) This tells rsync that the filenames it reads from a
717file are terminated by a null ('\0') character, not a NL, CR, or CR+LF.
718This affects --exclude-from, --include-from, and --files-from.
719
720dit(bf(-T, --temp-dir=DIR)) This option instructs rsync to use DIR as a
721scratch directory when creating temporary copies of the files
722transferred on the receiving side. The default behavior is to create
723the temporary files in the receiving directory.
724
725dit(bf(--compare-dest=DIR)) This option instructs rsync to use DIR on
726the destination machine as an additional directory to compare destination
727files against when doing transfers if the files are missing in the
728destination directory. This is useful for doing transfers to a new
729destination while leaving existing files intact, and then doing a
730flash-cutover when all files have been successfully transferred (for
731example by moving directories around and removing the old directory,
732although this skips files that haven't changed; see also --link-dest).
733This option increases the usefulness of --partial because partially
734transferred files will remain in the new temporary destination until they
735have a chance to be completed. If DIR is a relative path, it is relative
736to the destination directory.
737
738dit(bf(--link-dest=DIR)) This option behaves like bf(--compare-dest) but
739also will create hard links from em(DIR) to the destination directory for
740unchanged files. Files with changed ownership or permissions will not be
741linked.
742Like bf(--compare-dest) if DIR is a relative path, it is relative
743to the destination directory.
744
745dit(bf(-z, --compress)) With this option, rsync compresses any data from
746the files that it sends to the destination machine. This
747option is useful on slow connections. The compression method used is the
748same method that gzip uses.
749
750Note this this option typically achieves better compression ratios
751that can be achieved by using a compressing remote shell, or a
752compressing transport, as it takes advantage of the implicit
753information sent for matching data blocks.
754
755dit(bf(--numeric-ids)) With this option rsync will transfer numeric group
756and user IDs rather than using user and group names and mapping them
757at both ends.
758
759By default rsync will use the username and groupname to determine
760what ownership to give files. The special uid 0 and the special group
7610 are never mapped via user/group names even if the --numeric-ids
762option is not specified.
763
764If a user or group has no name on the source system or it has no match
765on the destination system, then the numeric ID
766from the source system is used instead. See also the comments on the
767"use chroot" setting in the rsyncd.conf manpage.
768
769dit(bf(--timeout=TIMEOUT)) This option allows you to set a maximum I/O
770timeout in seconds. If no data is transferred for the specified time
771then rsync will exit. The default is 0, which means no timeout.
772
773dit(bf(--daemon)) This tells rsync that it is to run as a daemon. The
774daemon may be accessed using the bf(host::module) or
775bf(rsync://host/module/) syntax.
776
777If standard input is a socket then rsync will assume that it is being
778run via inetd, otherwise it will detach from the current terminal and
779become a background daemon. The daemon will read the config file
780(rsyncd.conf) on each connect made by a client and respond to
781requests accordingly. See the rsyncd.conf(5) man page for more
782details.
783
784dit(bf(--no-detach)) When running as a daemon, this option instructs
785rsync to not detach itself and become a background process. This
786option is required when running as a service on Cygwin, and may also
787be useful when rsync is supervised by a program such as
788bf(daemontools) or AIX's bf(System Resource Controller).
789bf(--no-detach) is also recommended when rsync is run under a
790debugger. This option has no effect if rsync is run from inetd or
791sshd.
792
793dit(bf(--address)) By default rsync will bind to the wildcard address
794when run as a daemon with the --daemon option or when connecting to a
795rsync server. The --address option allows you to specify a specific IP
796address (or hostname) to bind to. This makes virtual hosting possible
797in conjunction with the --config option.
798
799dit(bf(--config=FILE)) This specifies an alternate config file than
800the default. This is only relevant when --daemon is specified.
801The default is /etc/rsyncd.conf unless the daemon is running over
802a remote shell program and the remote user is not root; in that case
803the default is rsyncd.conf in the current directory (typically $HOME).
804
805dit(bf(--port=PORT)) This specifies an alternate TCP port number to use
806rather than the default port 873.
807
808dit(bf(--blocking-io)) This tells rsync to use blocking I/O when launching
809a remote shell transport. If the remote shell is either rsh or remsh,
810rsync defaults to using
811blocking I/O, otherwise it defaults to using non-blocking I/O. (Note that
812ssh prefers non-blocking I/O.)
813
814dit(bf(--no-blocking-io)) Turn off --blocking-io, for use when it is the
815default.
816
817dit(bf(--log-format=FORMAT)) This allows you to specify exactly what the
818rsync client logs to stdout on a per-file basis. The log format is
819specified using the same format conventions as the log format option in
820rsyncd.conf.
821
822dit(bf(--stats)) This tells rsync to print a verbose set of statistics
823on the file transfer, allowing you to tell how effective the rsync
824algorithm is for your data.
825
826dit(bf(--partial)) By default, rsync will delete any partially
827transferred file if the transfer is interrupted. In some circumstances
828it is more desirable to keep partially transferred files. Using the
829--partial option tells rsync to keep the partial file which should
830make a subsequent transfer of the rest of the file much faster.
831
832dit(bf(--progress)) This option tells rsync to print information
833showing the progress of the transfer. This gives a bored user
834something to watch.
835Implies --verbose without incrementing verbosity.
836
837When the file is transferring, the data looks like this:
838
839verb(
840 782448 63% 110.64kB/s 0:00:04
841)
842
843This tells you the current file size, the percentage of the transfer that
844is complete, the current calculated file-completion rate (including both
845data over the wire and data being matched locally), and the estimated time
846remaining in this transfer.
847
848After the a file is complete, it the data looks like this:
849
850verb(
851 1238099 100% 146.38kB/s 0:00:08 (5, 57.1% of 396)
852)
853
854This tells you the final file size, that it's 100% complete, the final
855transfer rate for the file, the amount of elapsed time it took to transfer
856the file, and the addition of a total-transfer summary in parentheses.
857These additional numbers tell you how many files have been updated, and
858what percent of the total number of files has been scanned.
859
860dit(bf(-P)) The -P option is equivalent to --partial --progress. I
861found myself typing that combination quite often so I created an
862option to make it easier.
863
864dit(bf(--password-file)) This option allows you to provide a password
865in a file for accessing a remote rsync server. Note that this option
866is only useful when accessing an rsync server using the built in
867transport, not when using a remote shell as the transport. The file
868must not be world readable. It should contain just the password as a
869single line.
870
871dit(bf(--bwlimit=KBPS)) This option allows you to specify a maximum
872transfer rate in kilobytes per second. This option is most effective when
873using rsync with large files (several megabytes and up). Due to the nature
874of rsync transfers, blocks of data are sent, then if rsync determines the
875transfer was too fast, it will wait before sending the next data block. The
876result is an average transfer rate equaling the specified limit. A value
877of zero specifies no limit.
878
879dit(bf(--write-batch=PREFIX)) Generate a set of files that can be
880transferred as a batch update. Each filename in the set starts with
881PREFIX. See the "BATCH MODE" section for details.
882
883dit(bf(--read-batch=PREFIX)) Apply a previously generated change batch,
884using the fileset whose filenames start with PREFIX. See the "BATCH
885MODE" section for details.
886
887enddit()
888
889manpagesection(EXCLUDE PATTERNS)
890
891The exclude and include patterns specified to rsync allow for flexible
892selection of which files to transfer and which files to skip.
893
894rsync builds an ordered list of include/exclude options as specified on
895the command line. Rsync checks each file and directory
896name against each exclude/include pattern in turn. The first matching
897pattern is acted on. If it is an exclude pattern, then that file is
898skipped. If it is an include pattern then that filename is not
899skipped. If no matching include/exclude pattern is found then the
900filename is not skipped.
901
902The filenames matched against the exclude/include patterns
903are relative to the destination directory, or "top
904directory", so patterns should not include the path elements
905of the source or destination directories. The only way in
906which a pattern will match the absolute path of a file or
907directory is if the source path is the root directory.
908
909Note that when used with -r (which is implied by -a), every subcomponent of
910every path is visited from top down, so include/exclude patterns get
911applied recursively to each subcomponent.
912
913Note also that the --include and --exclude options take one pattern
914each. To add multiple patterns use the --include-from and
915--exclude-from options or multiple --include and --exclude options.
916
917The patterns can take several forms. The rules are:
918
919itemize(
920
921 it() if the pattern starts with a / then it is matched against the
922 start of the filename, otherwise it is matched against the end of
923 the filename.
924 This is the equivalent of a leading ^ in regular expressions.
925 Thus "/foo" would match a file called "foo" at the top of the
926 transferred tree.
927 On the other hand, "foo" would match any file called "foo"
928 anywhere in the tree because the algorithm is applied recursively from
929 top down; it behaves as if each path component gets a turn at being the
930 end of the file name.
931 The leading / does not make the pattern an absolute pathname.
932
933 it() if the pattern ends with a / then it will only match a
934 directory, not a file, link or device.
935
936 it() if the pattern contains a wildcard character from the set
937 *?[ then expression matching is applied using the shell filename
938 matching rules. Otherwise a simple string match is used.
939
940 it() the double asterisk pattern "**" will match slashes while a
941 single asterisk pattern "*" will stop at slashes.
942
943 it() if the pattern contains a / (not counting a trailing /) or a "**"
944 then it is matched against the full filename, including any leading
945 directory. If the pattern doesn't contain a / or a "**", then it is
946 matched only against the final component of the filename. Again,
947 remember that the algorithm is applied recursively so "full filename" can
948 actually be any portion of a path below the starting directory.
949
950 it() if the pattern starts with "+ " (a plus followed by a space)
951 then it is always considered an include pattern, even if specified as
952 part of an exclude option. The "+ " part is discarded before matching.
953
954 it() if the pattern starts with "- " (a minus followed by a space)
955 then it is always considered an exclude pattern, even if specified as
956 part of an include option. The "- " part is discarded before matching.
957
958 it() if the pattern is a single exclamation mark ! then the current
959 include/exclude list is reset, removing all previously defined patterns.
960)
961
962The +/- rules are most useful in a list that was read from a file, allowing
963you to have a single exclude list that contains both include and exclude
964options.
965
966If you end an exclude list with --exclude '*', note that since the
967algorithm is applied recursively that unless you explicitly include
968parent directories of files you want to include then the algorithm
969will stop at the parent directories and never see the files below
970them. To include all directories, use --include '*/' before the
971--exclude '*'.
972
973Here are some exclude/include examples:
974
975itemize(
976 it() --exclude "*.o" would exclude all filenames matching *.o
977 it() --exclude "/foo" would exclude a file called foo in the top directory
978 it() --exclude "foo/" would exclude any directory called foo
979 it() --exclude "/foo/*/bar" would exclude any file called bar two
980 levels below a directory called foo in the top directory
981 it() --exclude "/foo/**/bar" would exclude any file called bar two
982 or more levels below a directory called foo in the top directory
983 it() --include "*/" --include "*.c" --exclude "*" would include all
984 directories and C source files
985 it() --include "foo/" --include "foo/bar.c" --exclude "*" would include
986 only foo/bar.c (the foo/ directory must be explicitly included or
987 it would be excluded by the "*")
988)
989
990manpagesection(BATCH MODE)
991
992bf(Note:) Batch mode should be considered experimental in this version
993of rsync. The interface or behaviour may change before it stabilizes.
994
995Batch mode can be used to apply the same set of updates to many
996identical systems. Suppose one has a tree which is replicated on a
997number of hosts. Now suppose some changes have been made to this
998source tree and those changes need to be propagated to the other
999hosts. In order to do this using batch mode, rsync is run with the
1000write-batch option to apply the changes made to the source tree to one
1001of the destination trees. The write-batch option causes the rsync
1002client to store the information needed to repeat this operation against
1003other destination trees in a batch update fileset (see below). The
1004filename of each file in the fileset starts with a prefix specified by
1005the user as an argument to the write-batch option. This fileset is
1006then copied to each remote host, where rsync is run with the read-batch
1007option, again specifying the same prefix, and the destination tree.
1008Rsync updates the destination tree using the information stored in the
1009batch update fileset.
1010
1011The fileset consists of 4 files:
1012
1013itemize(
1014it() bf(<prefix>.rsync_argvs) command-line arguments
1015it() bf(<prefix>.rsync_flist) rsync internal file metadata
1016it() bf(<prefix>.rsync_csums) rsync checksums
1017it() bf(<prefix>.rsync_delta) data blocks for file update & change
1018)
1019
1020The .rsync_argvs file contains a command-line suitable for updating a
1021destination tree using that batch update fileset. It can be executed
1022using a Bourne(-like) shell, optionally passing in an alternate
1023destination tree pathname which is then used instead of the original
1024path. This is useful when the destination tree path differs from the
1025original destination tree path.
1026
1027Generating the batch update fileset once saves having to perform the
1028file status, checksum and data block generation more than once when
1029updating multiple destination trees. Multicast transport protocols can
1030be used to transfer the batch update files in parallel to many hosts at
1031once, instead of sending the same data to every host individually.
1032
1033Example:
1034
1035verb(
1036$ rsync --write-batch=pfx -a /source/dir/ /adest/dir/
1037$ rcp pfx.rsync_* remote:
1038$ ssh remote rsync --read-batch=pfx -a /bdest/dir/
1039# or alternatively
1040$ ssh remote ./pfx.rsync_argvs /bdest/dir/
1041)
1042
1043In this example, rsync is used to update /adest/dir/ with /source/dir/
1044and the information to repeat this operation is stored in the files
1045pfx.rsync_*. These files are then copied to the machine named "remote".
1046Rsync is then invoked on "remote" to update /bdest/dir/ the same way as
1047/adest/dir/. The last line shows the rsync_argvs file being used to
1048invoke rsync.
1049
1050Caveats:
1051
1052The read-batch option expects the destination tree it is meant to update
1053to be identical to the destination tree that was used to create the
1054batch update fileset. When a difference between the destination trees
1055is encountered the update will fail at that point, leaving the
1056destination tree in a partially updated state. In that case, rsync can
1057be used in its regular (non-batch) mode of operation to fix up the
1058destination tree.
1059
1060The rsync version used on all destinations should be identical to the
1061one used on the original destination.
1062
1063The -z/--compress option does not work in batch mode and yields a usage
1064error. A separate compression tool can be used instead to reduce the
1065size of the batch update files for transport to the destination.
1066
1067The -n/--dryrun option does not work in batch mode and yields a runtime
1068error.
1069
1070See bf(http://www.ils.unc.edu/i2dsi/unc_rsync+.html) for papers and technical
1071reports.
1072
1073manpagesection(SYMBOLIC LINKS)
1074
1075Three basic behaviours are possible when rsync encounters a symbolic
1076link in the source directory.
1077
1078By default, symbolic links are not transferred at all. A message
1079"skipping non-regular" file is emitted for any symlinks that exist.
1080
1081If bf(--links) is specified, then symlinks are recreated with the same
1082target on the destination. Note that bf(--archive) implies
1083bf(--links).
1084
1085If bf(--copy-links) is specified, then symlinks are "collapsed" by
1086copying their referent, rather than the symlink.
1087
1088rsync also distinguishes "safe" and "unsafe" symbolic links. An
1089example where this might be used is a web site mirror that wishes
1090ensure the rsync module they copy does not include symbolic links to
1091bf(/etc/passwd) in the public section of the site. Using
1092bf(--copy-unsafe-links) will cause any links to be copied as the file
1093they point to on the destination. Using bf(--safe-links) will cause
1094unsafe links to be omitted altogether.
1095
1096Symbolic links are considered unsafe if they are absolute symlinks
1097(start with bf(/)), empty, or if they contain enough bf("..")
1098components to ascend from the directory being copied.
1099
1100manpagesection(DIAGNOSTICS)
1101
1102rsync occasionally produces error messages that may seem a little
1103cryptic. The one that seems to cause the most confusion is "protocol
1104version mismatch - is your shell clean?".
1105
1106This message is usually caused by your startup scripts or remote shell
1107facility producing unwanted garbage on the stream that rsync is using
1108for its transport. The way to diagnose this problem is to run your
1109remote shell like this:
1110
1111verb(
1112 ssh remotehost /bin/true > out.dat
1113)
1114
1115then look at out.dat. If everything is working correctly then out.dat
1116should be a zero length file. If you are getting the above error from
1117rsync then you will probably find that out.dat contains some text or
1118data. Look at the contents and try to work out what is producing
1119it. The most common cause is incorrectly configured shell startup
1120scripts (such as .cshrc or .profile) that contain output statements
1121for non-interactive logins.
1122
1123If you are having trouble debugging include and exclude patterns, then
1124try specifying the -vv option. At this level of verbosity rsync will
1125show why each individual file is included or excluded.
1126
1127manpagesection(EXIT VALUES)
1128
1129startdit()
1130dit(bf(0)) Success
1131dit(bf(1)) Syntax or usage error
1132dit(bf(2)) Protocol incompatibility
1133dit(bf(3)) Errors selecting input/output files, dirs
1134dit(bf(4)) Requested action not supported: an attempt
1135was made to manipulate 64-bit files on a platform that cannot support
1136them; or an option was specifed that is supported by the client and
1137not by the server.
1138dit(bf(5)) Error starting client-server protocol
1139dit(bf(10)) Error in socket I/O
1140dit(bf(11)) Error in file I/O
1141dit(bf(12)) Error in rsync protocol data stream
1142dit(bf(13)) Errors with program diagnostics
1143dit(bf(14)) Error in IPC code
1144dit(bf(20)) Received SIGUSR1 or SIGINT
1145dit(bf(21)) Some error returned by waitpid()
1146dit(bf(22)) Error allocating core memory buffers
1147dit(bf(23)) Partial transfer due to error
1148dit(bf(24)) Partial transfer due to vanished source files
1149dit(bf(30)) Timeout in data send/receive
1150enddit()
1151
1152manpagesection(ENVIRONMENT VARIABLES)
1153
1154startdit()
1155
1156dit(bf(CVSIGNORE)) The CVSIGNORE environment variable supplements any
1157ignore patterns in .cvsignore files. See the --cvs-exclude option for
1158more details.
1159
1160dit(bf(RSYNC_RSH)) The RSYNC_RSH environment variable allows you to
1161override the default shell used as the transport for rsync. Command line
1162options are permitted after the command name, just as in the -e option.
1163
1164dit(bf(RSYNC_PROXY)) The RSYNC_PROXY environment variable allows you to
1165redirect your rsync client to use a web proxy when connecting to a
1166rsync daemon. You should set RSYNC_PROXY to a hostname:port pair.
1167
1168dit(bf(RSYNC_PASSWORD)) Setting RSYNC_PASSWORD to the required
1169password allows you to run authenticated rsync connections to an rsync
1170daemon without user intervention. Note that this does not supply a
1171password to a shell transport such as ssh.
1172
1173dit(bf(USER) or bf(LOGNAME)) The USER or LOGNAME environment variables
1174are used to determine the default username sent to an rsync server.
1175
1176dit(bf(HOME)) The HOME environment variable is used to find the user's
1177default .cvsignore file.
1178
1179enddit()
1180
1181manpagefiles()
1182
1183/etc/rsyncd.conf or rsyncd.conf
1184
1185manpageseealso()
1186
1187rsyncd.conf(5)
1188
1189manpagediagnostics()
1190
1191manpagebugs()
1192
1193times are transferred as unix time_t values
1194
1195When transferring to FAT filesystems rsync may resync
1196unmodified files.
1197See the comments on the --modify-window option.
1198
1199file permissions, devices, etc. are transferred as native numerical
1200values
1201
1202see also the comments on the --delete option
1203
1204Please report bugs! See the website at
1205url(http://rsync.samba.org/)(http://rsync.samba.org/)
1206
1207manpagesection(CREDITS)
1208
1209rsync is distributed under the GNU public license. See the file
1210COPYING for details.
1211
1212A WEB site is available at
1213url(http://rsync.samba.org/)(http://rsync.samba.org/). The site
1214includes an FAQ-O-Matic which may cover questions unanswered by this
1215manual page.
1216
1217The primary ftp site for rsync is
1218url(ftp://rsync.samba.org/pub/rsync)(ftp://rsync.samba.org/pub/rsync).
1219
1220We would be delighted to hear from you if you like this program.
1221
1222This program uses the excellent zlib compression library written by
1223Jean-loup Gailly and Mark Adler.
1224
1225manpagesection(THANKS)
1226
1227Thanks to Richard Brent, Brendan Mackay, Bill Waite, Stephen Rothwell
1228and David Bell for helpful suggestions, patches and testing of rsync.
1229I've probably missed some people, my apologies if I have.
1230
1231Especial thanks also to: David Dykstra, Jos Backus, Sebastian Krahmer.
1232
1233
1234manpageauthor()
1235
1236rsync was written by Andrew Tridgell <tridge@samba.org> and Paul
1237Mackerras.
1238
1239rsync is now maintained by Martin Pool <mbp@samba.org>.
1240
1241Mailing lists for support and development are available at
1242url(http://lists.samba.org)(lists.samba.org)
1243
1244If you suspect you have found a security vulnerability in rsync,
1245please send it directly to Martin Pool and Andrew Tridgell. For other
1246enquiries, please use the mailing list.