borg-create.1 19 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488
  1. .\" Man page generated from reStructuredText.
  2. .
  3. .
  4. .nr rst2man-indent-level 0
  5. .
  6. .de1 rstReportMargin
  7. \\$1 \\n[an-margin]
  8. level \\n[rst2man-indent-level]
  9. level margin: \\n[rst2man-indent\\n[rst2man-indent-level]]
  10. -
  11. \\n[rst2man-indent0]
  12. \\n[rst2man-indent1]
  13. \\n[rst2man-indent2]
  14. ..
  15. .de1 INDENT
  16. .\" .rstReportMargin pre:
  17. . RS \\$1
  18. . nr rst2man-indent\\n[rst2man-indent-level] \\n[an-margin]
  19. . nr rst2man-indent-level +1
  20. .\" .rstReportMargin post:
  21. ..
  22. .de UNINDENT
  23. . RE
  24. .\" indent \\n[an-margin]
  25. .\" old: \\n[rst2man-indent\\n[rst2man-indent-level]]
  26. .nr rst2man-indent-level -1
  27. .\" new: \\n[rst2man-indent\\n[rst2man-indent-level]]
  28. .in \\n[rst2man-indent\\n[rst2man-indent-level]]u
  29. ..
  30. .TH "BORG-CREATE" "1" "2025-05-22" "" "borg backup tool"
  31. .SH NAME
  32. borg-create \- Create new archive
  33. .SH SYNOPSIS
  34. .sp
  35. borg [common options] create [options] NAME [PATH...]
  36. .SH DESCRIPTION
  37. .sp
  38. This command creates a backup archive containing all files found while recursively
  39. traversing all paths specified. Paths are added to the archive as they are given,
  40. that means if relative paths are desired, the command has to be run from the correct
  41. directory.
  42. .sp
  43. The slashdot hack in paths (recursion roots) is triggered by using \fB/./\fP:
  44. \fB/this/gets/stripped/./this/gets/archived\fP means to process that fs object, but
  45. strip the prefix on the left side of \fB\&./\fP from the archived items (in this case,
  46. \fBthis/gets/archived\fP will be the path in the archived item).
  47. .sp
  48. When giving \(aq\-\(aq as path, borg will read data from standard input and create a
  49. file \(aqstdin\(aq in the created archive from that data. In some cases it\(aqs more
  50. appropriate to use \-\-content\-from\-command, however. See section \fIReading from
  51. stdin\fP below for details.
  52. .sp
  53. The archive will consume almost no disk space for files or parts of files that
  54. have already been stored in other archives.
  55. .sp
  56. The archive name does NOT need to be unique, you can and should use the same
  57. name for a series of archives. The unique archive identifier is its ID (hash)
  58. and you can abbreviate the ID as long as it is unique.
  59. .sp
  60. In the archive name, you may use the following placeholders:
  61. {now}, {utcnow}, {fqdn}, {hostname}, {user} and some others.
  62. .sp
  63. Backup speed is increased by not reprocessing files that are already part of
  64. existing archives and weren\(aqt modified. The detection of unmodified files is
  65. done by comparing multiple file metadata values with previous values kept in
  66. the files cache.
  67. .sp
  68. This comparison can operate in different modes as given by \fB\-\-files\-cache\fP:
  69. .INDENT 0.0
  70. .IP \(bu 2
  71. ctime,size,inode (default)
  72. .IP \(bu 2
  73. mtime,size,inode (default behaviour of borg versions older than 1.1.0rc4)
  74. .IP \(bu 2
  75. ctime,size (ignore the inode number)
  76. .IP \(bu 2
  77. mtime,size (ignore the inode number)
  78. .IP \(bu 2
  79. rechunk,ctime (all files are considered modified \- rechunk, cache ctime)
  80. .IP \(bu 2
  81. rechunk,mtime (all files are considered modified \- rechunk, cache mtime)
  82. .IP \(bu 2
  83. disabled (disable the files cache, all files considered modified \- rechunk)
  84. .UNINDENT
  85. .sp
  86. inode number: better safety, but often unstable on network filesystems
  87. .sp
  88. Normally, detecting file modifications will take inode information into
  89. consideration to improve the reliability of file change detection.
  90. This is problematic for files located on sshfs and similar network file
  91. systems which do not provide stable inode numbers, such files will always
  92. be considered modified. You can use modes without \fIinode\fP in this case to
  93. improve performance, but reliability of change detection might be reduced.
  94. .sp
  95. ctime vs. mtime: safety vs. speed
  96. .INDENT 0.0
  97. .IP \(bu 2
  98. ctime is a rather safe way to detect changes to a file (metadata and contents)
  99. as it can not be set from userspace. But, a metadata\-only change will already
  100. update the ctime, so there might be some unnecessary chunking/hashing even
  101. without content changes. Some filesystems do not support ctime (change time).
  102. E.g. doing a chown or chmod to a file will change its ctime.
  103. .IP \(bu 2
  104. mtime usually works and only updates if file contents were changed. But mtime
  105. can be arbitrarily set from userspace, e.g. to set mtime back to the same value
  106. it had before a content change happened. This can be used maliciously as well as
  107. well\-meant, but in both cases mtime based cache modes can be problematic.
  108. .UNINDENT
  109. .sp
  110. The mount points of filesystems or filesystem snapshots should be the same for every
  111. creation of a new archive to ensure fast operation. This is because the file cache that
  112. is used to determine changed files quickly uses absolute filenames.
  113. If this is not possible, consider creating a bind mount to a stable location.
  114. .sp
  115. The \fB\-\-progress\fP option shows (from left to right) Original and (uncompressed)
  116. deduplicated size (O and U respectively), then the Number of files (N) processed so far,
  117. followed by the currently processed path.
  118. .sp
  119. When using \fB\-\-stats\fP, you will get some statistics about how much data was
  120. added \- the \(dqThis Archive\(dq deduplicated size there is most interesting as that is
  121. how much your repository will grow. Please note that the \(dqAll archives\(dq stats refer to
  122. the state after creation. Also, the \fB\-\-stats\fP and \fB\-\-dry\-run\fP options are mutually
  123. exclusive because the data is not actually compressed and deduplicated during a dry run.
  124. .sp
  125. For more help on include/exclude patterns, see the \fIborg_patterns\fP command output.
  126. .sp
  127. For more help on placeholders, see the \fIborg_placeholders\fP command output.
  128. .SH OPTIONS
  129. .sp
  130. See \fIborg\-common(1)\fP for common options of Borg commands.
  131. .SS arguments
  132. .INDENT 0.0
  133. .TP
  134. .B NAME
  135. specify the archive name
  136. .TP
  137. .B PATH
  138. paths to archive
  139. .UNINDENT
  140. .SS options
  141. .INDENT 0.0
  142. .TP
  143. .B \-n\fP,\fB \-\-dry\-run
  144. do not create a backup archive
  145. .TP
  146. .B \-s\fP,\fB \-\-stats
  147. print statistics for the created archive
  148. .TP
  149. .B \-\-list
  150. output verbose list of items (files, dirs, ...)
  151. .TP
  152. .BI \-\-filter \ STATUSCHARS
  153. only display items with the given status characters (see description)
  154. .TP
  155. .B \-\-json
  156. output stats as JSON. Implies \fB\-\-stats\fP\&.
  157. .TP
  158. .BI \-\-stdin\-name \ NAME
  159. use NAME in archive for stdin data (default: \(aqstdin\(aq)
  160. .TP
  161. .BI \-\-stdin\-user \ USER
  162. set user USER in archive for stdin data (default: do not store user/uid)
  163. .TP
  164. .BI \-\-stdin\-group \ GROUP
  165. set group GROUP in archive for stdin data (default: do not store group/gid)
  166. .TP
  167. .BI \-\-stdin\-mode \ M
  168. set mode to M in archive for stdin data (default: 0660)
  169. .TP
  170. .B \-\-content\-from\-command
  171. interpret PATH as command and store its stdout. See also section Reading from stdin below.
  172. .TP
  173. .B \-\-paths\-from\-stdin
  174. read DELIM\-separated list of paths to back up from stdin. All control is external: it will back up all files given \- no more, no less.
  175. .TP
  176. .B \-\-paths\-from\-command
  177. interpret PATH as command and treat its output as \fB\-\-paths\-from\-stdin\fP
  178. .TP
  179. .BI \-\-paths\-delimiter \ DELIM
  180. set path delimiter for \fB\-\-paths\-from\-stdin\fP and \fB\-\-paths\-from\-command\fP (default: \fB\en\fP)
  181. .UNINDENT
  182. .SS Include/Exclude options
  183. .INDENT 0.0
  184. .TP
  185. .BI \-e \ PATTERN\fR,\fB \ \-\-exclude \ PATTERN
  186. exclude paths matching PATTERN
  187. .TP
  188. .BI \-\-exclude\-from \ EXCLUDEFILE
  189. read exclude patterns from EXCLUDEFILE, one per line
  190. .TP
  191. .BI \-\-pattern \ PATTERN
  192. include/exclude paths matching PATTERN
  193. .TP
  194. .BI \-\-patterns\-from \ PATTERNFILE
  195. read include/exclude patterns from PATTERNFILE, one per line
  196. .TP
  197. .B \-\-exclude\-caches
  198. exclude directories that contain a CACHEDIR.TAG file ( <http://www.bford.info/cachedir/spec.html> )
  199. .TP
  200. .BI \-\-exclude\-if\-present \ NAME
  201. exclude directories that are tagged by containing a filesystem object with the given NAME
  202. .TP
  203. .B \-\-keep\-exclude\-tags
  204. if tag objects are specified with \fB\-\-exclude\-if\-present\fP, don\(aqt omit the tag objects themselves from the backup archive
  205. .TP
  206. .B \-\-exclude\-nodump
  207. exclude files flagged NODUMP
  208. .UNINDENT
  209. .SS Filesystem options
  210. .INDENT 0.0
  211. .TP
  212. .B \-x\fP,\fB \-\-one\-file\-system
  213. stay in the same file system and do not store mount points of other file systems \- this might behave different from your expectations, see the description below.
  214. .TP
  215. .B \-\-numeric\-ids
  216. only store numeric user and group identifiers
  217. .TP
  218. .B \-\-atime
  219. do store atime into archive
  220. .TP
  221. .B \-\-noctime
  222. do not store ctime into archive
  223. .TP
  224. .B \-\-nobirthtime
  225. do not store birthtime (creation date) into archive
  226. .TP
  227. .B \-\-noflags
  228. do not read and store flags (e.g. NODUMP, IMMUTABLE) into archive
  229. .TP
  230. .B \-\-noacls
  231. do not read and store ACLs into archive
  232. .TP
  233. .B \-\-noxattrs
  234. do not read and store xattrs into archive
  235. .TP
  236. .B \-\-sparse
  237. detect sparse holes in input (supported only by fixed chunker)
  238. .TP
  239. .BI \-\-files\-cache \ MODE
  240. operate files cache in MODE. default: ctime,size,inode
  241. .TP
  242. .B \-\-read\-special
  243. open and read block and char device files as well as FIFOs as if they were regular files. Also follows symlinks pointing to these kinds of files.
  244. .UNINDENT
  245. .SS Archive options
  246. .INDENT 0.0
  247. .TP
  248. .BI \-\-comment \ COMMENT
  249. add a comment text to the archive
  250. .TP
  251. .BI \-\-timestamp \ TIMESTAMP
  252. manually specify the archive creation date/time (yyyy\-mm\-ddThh:mm:ss[(+|\-)HH:MM] format, (+|\-)HH:MM is the UTC offset, default: local time zone). Alternatively, give a reference file/directory.
  253. .TP
  254. .BI \-\-chunker\-params \ PARAMS
  255. specify the chunker parameters (ALGO, CHUNK_MIN_EXP, CHUNK_MAX_EXP, HASH_MASK_BITS, HASH_WINDOW_SIZE). default: buzhash,19,23,21,4095
  256. .TP
  257. .BI \-C \ COMPRESSION\fR,\fB \ \-\-compression \ COMPRESSION
  258. select compression algorithm, see the output of the \(dqborg help compression\(dq command for details.
  259. .UNINDENT
  260. .SH EXAMPLES
  261. .INDENT 0.0
  262. .INDENT 3.5
  263. .sp
  264. .EX
  265. # Backup ~/Documents into an archive named \(dqmy\-documents\(dq
  266. $ borg create my\-documents ~/Documents
  267. # same, but list all files as we process them
  268. $ borg create \-\-list my\-documents ~/Documents
  269. # Backup /mnt/disk/docs, but strip path prefix using the slashdot hack
  270. $ borg create \-\-repo /path/to/repo docs /mnt/disk/./docs
  271. # Backup ~/Documents and ~/src but exclude pyc files
  272. $ borg create my\-files \e
  273. ~/Documents \e
  274. ~/src \e
  275. \-\-exclude \(aq*.pyc\(aq
  276. # Backup home directories excluding image thumbnails (i.e. only
  277. # /home/<one directory>/.thumbnails is excluded, not /home/*/*/.thumbnails etc.)
  278. $ borg create my\-files /home \-\-exclude \(aqsh:home/*/.thumbnails\(aq
  279. # Backup the root filesystem into an archive named \(dqroot\-archive\(dq
  280. # use zlib compression (good, but slow) \- default is lz4 (fast, low compression ratio)
  281. $ borg create \-C zlib,6 \-\-one\-file\-system root\-archive /
  282. # Backup into an archive name like FQDN\-root
  283. $ borg create \(aq{fqdn}\-root\(aq /
  284. # Backup a remote host locally (\(dqpull\(dq style) using sshfs
  285. $ mkdir sshfs\-mount
  286. $ sshfs root@example.com:/ sshfs\-mount
  287. $ cd sshfs\-mount
  288. $ borg create example.com\-root .
  289. $ cd ..
  290. $ fusermount \-u sshfs\-mount
  291. # Make a big effort in fine granular deduplication (big chunk management
  292. # overhead, needs a lot of RAM and disk space, see formula in internals docs):
  293. $ borg create \-\-chunker\-params buzhash,10,23,16,4095 small /smallstuff
  294. # Backup a raw device (must not be active/in use/mounted at that time)
  295. $ borg create \-\-read\-special \-\-chunker\-params fixed,4194304 my\-sdx /dev/sdX
  296. # Backup a sparse disk image (must not be active/in use/mounted at that time)
  297. $ borg create \-\-sparse \-\-chunker\-params fixed,4194304 my\-disk my\-disk.raw
  298. # No compression (none)
  299. $ borg create \-\-compression none arch ~
  300. # Super fast, low compression (lz4, default)
  301. $ borg create arch ~
  302. # Less fast, higher compression (zlib, N = 0..9)
  303. $ borg create \-\-compression zlib,N arch ~
  304. # Even slower, even higher compression (lzma, N = 0..9)
  305. $ borg create \-\-compression lzma,N arch ~
  306. # Only compress compressible data with lzma,N (N = 0..9)
  307. $ borg create \-\-compression auto,lzma,N arch ~
  308. # Use short hostname and user name as archive name
  309. $ borg create \(aq{hostname}\-{user}\(aq ~
  310. # Backing up relative paths by moving into the correct directory first
  311. $ cd /home/user/Documents
  312. # The root directory of the archive will be \(dqprojectA\(dq
  313. $ borg create \(aqdaily\-projectA\(aq projectA
  314. # Use external command to determine files to archive
  315. # Use \-\-paths\-from\-stdin with find to back up only files less than 1MB in size
  316. $ find ~ \-size \-1000k | borg create \-\-paths\-from\-stdin small\-files\-only
  317. # Use \-\-paths\-from\-command with find to back up files from only a given user
  318. $ borg create \-\-paths\-from\-command joes\-files \-\- find /srv/samba/shared \-user joe
  319. # Use \-\-paths\-from\-stdin with \-\-paths\-delimiter (for example, for filenames with newlines in them)
  320. $ find ~ \-size \-1000k \-print0 | borg create \e
  321. \-\-paths\-from\-stdin \e
  322. \-\-paths\-delimiter \(dq\e0\(dq \e
  323. smallfiles\-handle\-newline
  324. .EE
  325. .UNINDENT
  326. .UNINDENT
  327. .SH NOTES
  328. .sp
  329. The \fB\-\-exclude\fP patterns are not like tar. In tar \fB\-\-exclude\fP .bundler/gems will
  330. exclude foo/.bundler/gems. In borg it will not, you need to use \fB\-\-exclude\fP
  331. \(aq*/.bundler/gems\(aq to get the same effect.
  332. .sp
  333. In addition to using \fB\-\-exclude\fP patterns, it is possible to use
  334. \fB\-\-exclude\-if\-present\fP to specify the name of a filesystem object (e.g. a file
  335. or folder name) which, when contained within another folder, will prevent the
  336. containing folder from being backed up. By default, the containing folder and
  337. all of its contents will be omitted from the backup. If, however, you wish to
  338. only include the objects specified by \fB\-\-exclude\-if\-present\fP in your backup,
  339. and not include any other contents of the containing folder, this can be enabled
  340. through using the \fB\-\-keep\-exclude\-tags\fP option.
  341. .sp
  342. The \fB\-x\fP or \fB\-\-one\-file\-system\fP option excludes directories, that are mountpoints (and everything in them).
  343. It detects mountpoints by comparing the device number from the output of \fBstat()\fP of the directory and its
  344. parent directory. Specifically, it excludes directories for which \fBstat()\fP reports a device number different
  345. from the device number of their parent.
  346. In general: be aware that there are directories with device number different from their parent, which the kernel
  347. does not consider a mountpoint and also the other way around.
  348. Linux examples for this are bind mounts (possibly same device number, but always a mountpoint) and ALL
  349. subvolumes of a btrfs (different device number from parent but not necessarily a mountpoint).
  350. macOS examples are the apfs mounts of a typical macOS installation.
  351. Therefore, when using \fB\-\-one\-file\-system\fP, you should double\-check that the backup works as intended.
  352. .SS Item flags
  353. .sp
  354. \fB\-\-list\fP outputs a list of all files, directories and other
  355. file system items it considered (no matter whether they had content changes
  356. or not). For each item, it prefixes a single\-letter flag that indicates type
  357. and/or status of the item.
  358. .sp
  359. If you are interested only in a subset of that output, you can give e.g.
  360. \fB\-\-filter=AME\fP and it will only show regular files with A, M or E status (see
  361. below).
  362. .sp
  363. A uppercase character represents the status of a regular file relative to the
  364. \(dqfiles\(dq cache (not relative to the repo \-\- this is an issue if the files cache
  365. is not used). Metadata is stored in any case and for \(aqA\(aq and \(aqM\(aq also new data
  366. chunks are stored. For \(aqU\(aq all data chunks refer to already existing chunks.
  367. .INDENT 0.0
  368. .IP \(bu 2
  369. \(aqA\(aq = regular file, added (see also \fIa_status_oddity\fP in the FAQ)
  370. .IP \(bu 2
  371. \(aqM\(aq = regular file, modified
  372. .IP \(bu 2
  373. \(aqU\(aq = regular file, unchanged
  374. .IP \(bu 2
  375. \(aqC\(aq = regular file, it changed while we backed it up
  376. .IP \(bu 2
  377. \(aqE\(aq = regular file, an error happened while accessing/reading \fIthis\fP file
  378. .UNINDENT
  379. .sp
  380. A lowercase character means a file type other than a regular file,
  381. borg usually just stores their metadata:
  382. .INDENT 0.0
  383. .IP \(bu 2
  384. \(aqd\(aq = directory
  385. .IP \(bu 2
  386. \(aqb\(aq = block device
  387. .IP \(bu 2
  388. \(aqc\(aq = char device
  389. .IP \(bu 2
  390. \(aqh\(aq = regular file, hardlink (to already seen inodes)
  391. .IP \(bu 2
  392. \(aqs\(aq = symlink
  393. .IP \(bu 2
  394. \(aqf\(aq = fifo
  395. .UNINDENT
  396. .sp
  397. Other flags used include:
  398. .INDENT 0.0
  399. .IP \(bu 2
  400. \(aq+\(aq = included, item would be backed up (if not in dry\-run mode)
  401. .IP \(bu 2
  402. \(aq\-\(aq = excluded, item would not be / was not backed up
  403. .IP \(bu 2
  404. \(aqi\(aq = backup data was read from standard input (stdin)
  405. .IP \(bu 2
  406. \(aq?\(aq = missing status code (if you see this, please file a bug report!)
  407. .UNINDENT
  408. .SS Reading backup data from stdin
  409. .sp
  410. There are two methods to read from stdin. Either specify \fB\-\fP as path and
  411. pipe directly to borg:
  412. .INDENT 0.0
  413. .INDENT 3.5
  414. .sp
  415. .EX
  416. backup\-vm \-\-id myvm \-\-stdout | borg create \-\-repo REPO ARCHIVE \-
  417. .EE
  418. .UNINDENT
  419. .UNINDENT
  420. .sp
  421. Or use \fB\-\-content\-from\-command\fP to have Borg manage the execution of the
  422. command and piping. If you do so, the first PATH argument is interpreted
  423. as command to execute and any further arguments are treated as arguments
  424. to the command:
  425. .INDENT 0.0
  426. .INDENT 3.5
  427. .sp
  428. .EX
  429. borg create \-\-content\-from\-command \-\-repo REPO ARCHIVE \-\- backup\-vm \-\-id myvm \-\-stdout
  430. .EE
  431. .UNINDENT
  432. .UNINDENT
  433. .sp
  434. \fB\-\-\fP is used to ensure \fB\-\-id\fP and \fB\-\-stdout\fP are \fBnot\fP considered
  435. arguments to \fBborg\fP but rather \fBbackup\-vm\fP\&.
  436. .sp
  437. The difference between the two approaches is that piping to borg creates an
  438. archive even if the command piping to borg exits with a failure. In this case,
  439. \fBone can end up with truncated output being backed up\fP\&. Using
  440. \fB\-\-content\-from\-command\fP, in contrast, borg is guaranteed to fail without
  441. creating an archive should the command fail. The command is considered failed
  442. when it returned a non\-zero exit code.
  443. .sp
  444. Reading from stdin yields just a stream of data without file metadata
  445. associated with it, and the files cache is not needed at all. So it is
  446. safe to disable it via \fB\-\-files\-cache disabled\fP and speed up backup
  447. creation a bit.
  448. .sp
  449. By default, the content read from stdin is stored in a file called \(aqstdin\(aq.
  450. Use \fB\-\-stdin\-name\fP to change the name.
  451. .SS Feeding all file paths from externally
  452. .sp
  453. Usually, you give a starting path (recursion root) to borg and then borg
  454. automatically recurses, finds and backs up all fs objects contained in
  455. there (optionally considering include/exclude rules).
  456. .sp
  457. If you need more control and you want to give every single fs object path
  458. to borg (maybe implementing your own recursion or your own rules), you can use
  459. \fB\-\-paths\-from\-stdin\fP or \fB\-\-paths\-from\-command\fP (with the latter, borg will
  460. fail to create an archive should the command fail).
  461. .sp
  462. Borg supports paths with the slashdot hack to strip path prefixes here also.
  463. So, be careful not to unintentionally trigger that.
  464. .SH SEE ALSO
  465. .sp
  466. \fIborg\-common(1)\fP, \fIborg\-delete(1)\fP, \fIborg\-prune(1)\fP, \fIborg\-check(1)\fP, \fIborg\-patterns(1)\fP, \fIborg\-placeholders(1)\fP, \fIborg\-compression(1)\fP, \fIborg\-repo\-create(1)\fP
  467. .SH AUTHOR
  468. The Borg Collective
  469. .\" Generated by docutils manpage writer.
  470. .