borg.1 24 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766
  1. .\" Man page generated from reStructuredText.
  2. .
  3. .TH BORG 1 "2017-02-05" "" "borg backup tool"
  4. .SH NAME
  5. borg \- deduplicating and encrypting backup tool
  6. .
  7. .nr rst2man-indent-level 0
  8. .
  9. .de1 rstReportMargin
  10. \\$1 \\n[an-margin]
  11. level \\n[rst2man-indent-level]
  12. level margin: \\n[rst2man-indent\\n[rst2man-indent-level]]
  13. -
  14. \\n[rst2man-indent0]
  15. \\n[rst2man-indent1]
  16. \\n[rst2man-indent2]
  17. ..
  18. .de1 INDENT
  19. .\" .rstReportMargin pre:
  20. . RS \\$1
  21. . nr rst2man-indent\\n[rst2man-indent-level] \\n[an-margin]
  22. . nr rst2man-indent-level +1
  23. .\" .rstReportMargin post:
  24. ..
  25. .de UNINDENT
  26. . RE
  27. .\" indent \\n[an-margin]
  28. .\" old: \\n[rst2man-indent\\n[rst2man-indent-level]]
  29. .nr rst2man-indent-level -1
  30. .\" new: \\n[rst2man-indent\\n[rst2man-indent-level]]
  31. .in \\n[rst2man-indent\\n[rst2man-indent-level]]u
  32. ..
  33. .SH SYNOPSIS
  34. .sp
  35. borg [common options] <command> [options] [arguments]
  36. .SH DESCRIPTION
  37. .\" we don't include the README.rst here since we want to keep this terse.
  38. .
  39. .sp
  40. BorgBackup (short: Borg) is a deduplicating backup program.
  41. Optionally, it supports compression and authenticated encryption.
  42. .sp
  43. The main goal of Borg is to provide an efficient and secure way to backup data.
  44. The data deduplication technique used makes Borg suitable for daily backups
  45. since only changes are stored.
  46. The authenticated encryption technique makes it suitable for backups to not
  47. fully trusted targets.
  48. .sp
  49. Borg stores a set of files in an \fIarchive\fP\&. A \fIrepository\fP is a collection
  50. of \fIarchives\fP\&. The format of repositories is Borg\-specific. Borg does not
  51. distinguish archives from each other in any way other than their name,
  52. it does not matter when or where archives were created (e.g. different hosts).
  53. .SH EXAMPLES
  54. .SS A step\-by\-step example
  55. .INDENT 0.0
  56. .IP 1. 3
  57. Before a backup can be made a repository has to be initialized:
  58. .INDENT 3.0
  59. .INDENT 3.5
  60. .sp
  61. .nf
  62. .ft C
  63. $ borg init \-\-encryption=repokey /path/to/repo
  64. .ft P
  65. .fi
  66. .UNINDENT
  67. .UNINDENT
  68. .IP 2. 3
  69. Backup the \fB~/src\fP and \fB~/Documents\fP directories into an archive called
  70. \fIMonday\fP:
  71. .INDENT 3.0
  72. .INDENT 3.5
  73. .sp
  74. .nf
  75. .ft C
  76. $ borg create /path/to/repo::Monday ~/src ~/Documents
  77. .ft P
  78. .fi
  79. .UNINDENT
  80. .UNINDENT
  81. .IP 3. 3
  82. The next day create a new archive called \fITuesday\fP:
  83. .INDENT 3.0
  84. .INDENT 3.5
  85. .sp
  86. .nf
  87. .ft C
  88. $ borg create \-\-stats /path/to/repo::Tuesday ~/src ~/Documents
  89. .ft P
  90. .fi
  91. .UNINDENT
  92. .UNINDENT
  93. .sp
  94. This backup will be a lot quicker and a lot smaller since only new never
  95. before seen data is stored. The \fB\-\-stats\fP option causes Borg to
  96. output statistics about the newly created archive such as the amount of unique
  97. data (not shared with other archives):
  98. .INDENT 3.0
  99. .INDENT 3.5
  100. .sp
  101. .nf
  102. .ft C
  103. \-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
  104. Archive name: Tuesday
  105. Archive fingerprint: bd31004d58f51ea06ff735d2e5ac49376901b21d58035f8fb05dbf866566e3c2
  106. Time (start): Tue, 2016\-02\-16 18:15:11
  107. Time (end): Tue, 2016\-02\-16 18:15:11
  108. Duration: 0.19 seconds
  109. Number of files: 127
  110. \-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
  111. Original size Compressed size Deduplicated size
  112. This archive: 4.16 MB 4.17 MB 26.78 kB
  113. All archives: 8.33 MB 8.34 MB 4.19 MB
  114. Unique chunks Total chunks
  115. Chunk index: 132 261
  116. \-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
  117. .ft P
  118. .fi
  119. .UNINDENT
  120. .UNINDENT
  121. .IP 4. 3
  122. List all archives in the repository:
  123. .INDENT 3.0
  124. .INDENT 3.5
  125. .sp
  126. .nf
  127. .ft C
  128. $ borg list /path/to/repo
  129. Monday Mon, 2016\-02\-15 19:14:44
  130. Tuesday Tue, 2016\-02\-16 19:15:11
  131. .ft P
  132. .fi
  133. .UNINDENT
  134. .UNINDENT
  135. .IP 5. 3
  136. List the contents of the \fIMonday\fP archive:
  137. .INDENT 3.0
  138. .INDENT 3.5
  139. .sp
  140. .nf
  141. .ft C
  142. $ borg list /path/to/repo::Monday
  143. drwxr\-xr\-x user group 0 Mon, 2016\-02\-15 18:22:30 home/user/Documents
  144. \-rw\-r\-\-r\-\- user group 7961 Mon, 2016\-02\-15 18:22:30 home/user/Documents/Important.doc
  145. \&...
  146. .ft P
  147. .fi
  148. .UNINDENT
  149. .UNINDENT
  150. .IP 6. 3
  151. Restore the \fIMonday\fP archive by extracting the files relative to the current directory:
  152. .INDENT 3.0
  153. .INDENT 3.5
  154. .sp
  155. .nf
  156. .ft C
  157. $ borg extract /path/to/repo::Monday
  158. .ft P
  159. .fi
  160. .UNINDENT
  161. .UNINDENT
  162. .IP 7. 3
  163. Recover disk space by manually deleting the \fIMonday\fP archive:
  164. .INDENT 3.0
  165. .INDENT 3.5
  166. .sp
  167. .nf
  168. .ft C
  169. $ borg delete /path/to/repo::Monday
  170. .ft P
  171. .fi
  172. .UNINDENT
  173. .UNINDENT
  174. .UNINDENT
  175. .sp
  176. \fBNOTE:\fP
  177. .INDENT 0.0
  178. .INDENT 3.5
  179. Borg is quiet by default (it works on WARNING log level).
  180. You can use options like \fB\-\-progress\fP or \fB\-\-list\fP to get specific
  181. reports during command execution. You can also add the \fB\-v\fP (or
  182. \fB\-\-verbose\fP or \fB\-\-info\fP) option to adjust the log level to INFO to
  183. get other informational messages.
  184. .UNINDENT
  185. .UNINDENT
  186. .SH NOTES
  187. .SS Repository URLs
  188. .sp
  189. \fBLocal filesystem\fP (or locally mounted network filesystem):
  190. .sp
  191. \fB/path/to/repo\fP \- filesystem path to repo directory, absolute path
  192. .sp
  193. \fBpath/to/repo\fP \- filesystem path to repo directory, relative path
  194. .sp
  195. Also, stuff like \fB~/path/to/repo\fP or \fB~other/path/to/repo\fP works (this is
  196. expanded by your shell).
  197. .sp
  198. Note: you may also prepend a \fBfile://\fP to a filesystem path to get URL style.
  199. .sp
  200. \fBRemote repositories\fP accessed via ssh \fI\%user@host\fP:
  201. .sp
  202. \fBuser@host:/path/to/repo\fP \- remote repo, absolute path
  203. .sp
  204. \fBssh://user@host:port/path/to/repo\fP \- same, alternative syntax, port can be given
  205. .sp
  206. \fBRemote repositories with relative paths\fP can be given using this syntax:
  207. .sp
  208. \fBuser@host:path/to/repo\fP \- path relative to current directory
  209. .sp
  210. \fBuser@host:~/path/to/repo\fP \- path relative to user\(aqs home directory
  211. .sp
  212. \fBuser@host:~other/path/to/repo\fP \- path relative to other\(aqs home directory
  213. .sp
  214. Note: giving \fBuser@host:/./path/to/repo\fP or \fBuser@host:/~/path/to/repo\fP or
  215. \fBuser@host:/~other/path/to/repo\fP is also supported, but not required here.
  216. .sp
  217. \fBRemote repositories with relative paths, alternative syntax with port\fP:
  218. .sp
  219. \fBssh://user@host:port/./path/to/repo\fP \- path relative to current directory
  220. .sp
  221. \fBssh://user@host:port/~/path/to/repo\fP \- path relative to user\(aqs home directory
  222. .sp
  223. \fBssh://user@host:port/~other/path/to/repo\fP \- path relative to other\(aqs home directory
  224. .sp
  225. If you frequently need the same repo URL, it is a good idea to set the
  226. \fBBORG_REPO\fP environment variable to set a default for the repo URL:
  227. .INDENT 0.0
  228. .INDENT 3.5
  229. .sp
  230. .nf
  231. .ft C
  232. export BORG_REPO=\(aqssh://user@host:port/path/to/repo\(aq
  233. .ft P
  234. .fi
  235. .UNINDENT
  236. .UNINDENT
  237. .sp
  238. Then just leave away the repo URL if only a repo URL is needed and you want
  239. to use the default \- it will be read from BORG_REPO then.
  240. .sp
  241. Use \fB::\fP syntax to give the repo URL when syntax requires giving a positional
  242. argument for the repo (e.g. \fBborg mount :: /mnt\fP).
  243. .SS Repository / Archive Locations
  244. .sp
  245. Many commands want either a repository (just give the repo URL, see above) or
  246. an archive location, which is a repo URL followed by \fB::archive_name\fP\&.
  247. .sp
  248. Archive names must not contain the \fB/\fP (slash) character. For simplicity,
  249. maybe also avoid blanks or other characters that have special meaning on the
  250. shell or in a filesystem (borg mount will use the archive name as directory
  251. name).
  252. .sp
  253. If you have set BORG_REPO (see above) and an archive location is needed, use
  254. \fB::archive_name\fP \- the repo URL part is then read from BORG_REPO.
  255. .SS Type of log output
  256. .sp
  257. The log level of the builtin logging configuration defaults to WARNING.
  258. This is because we want Borg to be mostly silent and only output
  259. warnings, errors and critical messages, unless output has been requested
  260. by supplying an option that implies output (e.g. \fB\-\-list\fP or \fB\-\-progress\fP).
  261. .sp
  262. Log levels: DEBUG < INFO < WARNING < ERROR < CRITICAL
  263. .sp
  264. Use \fB\-\-debug\fP to set DEBUG log level \-
  265. to get debug, info, warning, error and critical level output.
  266. .sp
  267. Use \fB\-\-info\fP (or \fB\-v\fP or \fB\-\-verbose\fP) to set INFO log level \-
  268. to get info, warning, error and critical level output.
  269. .sp
  270. Use \fB\-\-warning\fP (default) to set WARNING log level \-
  271. to get warning, error and critical level output.
  272. .sp
  273. Use \fB\-\-error\fP to set ERROR log level \-
  274. to get error and critical level output.
  275. .sp
  276. Use \fB\-\-critical\fP to set CRITICAL log level \-
  277. to get critical level output.
  278. .sp
  279. While you can set misc. log levels, do not expect that every command will
  280. give different output on different log levels \- it\(aqs just a possibility.
  281. .sp
  282. \fBWARNING:\fP
  283. .INDENT 0.0
  284. .INDENT 3.5
  285. Options \fB\-\-critical\fP and \fB\-\-error\fP are provided for completeness,
  286. their usage is not recommended as you might miss important information.
  287. .UNINDENT
  288. .UNINDENT
  289. .SS Return codes
  290. .sp
  291. Borg can exit with the following return codes (rc):
  292. .TS
  293. center;
  294. |l|l|.
  295. _
  296. T{
  297. Return code
  298. T} T{
  299. Meaning
  300. T}
  301. _
  302. T{
  303. 0
  304. T} T{
  305. success (logged as INFO)
  306. T}
  307. _
  308. T{
  309. 1
  310. T} T{
  311. warning (operation reached its normal end, but there were warnings \-\-
  312. you should check the log, logged as WARNING)
  313. T}
  314. _
  315. T{
  316. 2
  317. T} T{
  318. error (like a fatal error, a local or remote exception, the operation
  319. did not reach its normal end, logged as ERROR)
  320. T}
  321. _
  322. T{
  323. 128+N
  324. T} T{
  325. killed by signal N (e.g. 137 == kill \-9)
  326. T}
  327. _
  328. .TE
  329. .sp
  330. If you use \fB\-\-show\-rc\fP, the return code is also logged at the indicated
  331. level as the last log entry.
  332. .SS Environment Variables
  333. .sp
  334. Borg uses some environment variables for automation:
  335. .INDENT 0.0
  336. .TP
  337. .B General:
  338. .INDENT 7.0
  339. .TP
  340. .B BORG_REPO
  341. When set, use the value to give the default repository location. If a command needs an archive
  342. parameter, you can abbreviate as \fB::archive\fP\&. If a command needs a repository parameter, you
  343. can either leave it away or abbreviate as \fB::\fP, if a positional parameter is required.
  344. .TP
  345. .B BORG_PASSPHRASE
  346. When set, use the value to answer the passphrase question for encrypted repositories.
  347. It is used when a passphrase is needed to access an encrypted repo as well as when a new
  348. passphrase should be initially set when initializing an encrypted repo.
  349. See also BORG_NEW_PASSPHRASE.
  350. .TP
  351. .B BORG_PASSCOMMAND
  352. When set, use the standard output of the command (trailing newlines are stripped) to answer the
  353. passphrase question for encrypted repositories.
  354. It is used when a passphrase is needed to access an encrypted repo as well as when a new
  355. passphrase should be initially set when initializing an encrypted repo. Note that the command
  356. is executed without a shell. So variables, like \fB$HOME\fP\ will work, but \fB~\fP\ won't.
  357. If BORG_PASSPHRASE is also set, it takes precedence.
  358. See also BORG_NEW_PASSPHRASE.
  359. .TP
  360. .B BORG_NEW_PASSPHRASE
  361. When set, use the value to answer the passphrase question when a \fBnew\fP passphrase is asked for.
  362. This variable is checked first. If it is not set, BORG_PASSPHRASE and BORG_PASSCOMMAND will also
  363. be checked.
  364. Main usecase for this is to fully automate \fBborg change\-passphrase\fP\&.
  365. .TP
  366. .B BORG_DISPLAY_PASSPHRASE
  367. When set, use the value to answer the "display the passphrase for verification" question when defining a new passphrase for encrypted repositories.
  368. .TP
  369. .B BORG_HOSTNAME_IS_UNIQUE=no
  370. Borg assumes that it can derive a unique hostname / identity (see \fBborg debug info\fP).
  371. If this is not the case or you do not want Borg to automatically remove stale locks,
  372. set this to \fIno\fP\&.
  373. .TP
  374. .B BORG_LOGGING_CONF
  375. When set, use the given filename as \fI\%INI\fP\-style logging configuration.
  376. .TP
  377. .B BORG_RSH
  378. When set, use this command instead of \fBssh\fP\&. This can be used to specify ssh options, such as
  379. a custom identity file \fBssh \-i /path/to/private/key\fP\&. See \fBman ssh\fP for other options.
  380. Using the \fB\-\-rsh CMD\fP commandline option overrides the environment variable.
  381. .TP
  382. .B BORG_REMOTE_PATH
  383. When set, use the given path as borg executable on the remote (defaults to "borg" if unset).
  384. Using \fB\-\-remote\-path PATH\fP commandline option overrides the environment variable.
  385. .TP
  386. .B BORG_FILES_CACHE_TTL
  387. When set to a numeric value, this determines the maximum "time to live" for the files cache
  388. entries (default: 20). The files cache is used to quickly determine whether a file is unchanged.
  389. The FAQ explains this more detailed in: \fIalways_chunking\fP
  390. .TP
  391. .B TMPDIR
  392. where temporary files are stored (might need a lot of temporary space for some operations)
  393. .UNINDENT
  394. .TP
  395. .B Some automatic "answerers" (if set, they automatically answer confirmation questions):
  396. .INDENT 7.0
  397. .TP
  398. .B BORG_UNKNOWN_UNENCRYPTED_REPO_ACCESS_IS_OK=no (or =yes)
  399. For "Warning: Attempting to access a previously unknown unencrypted repository"
  400. .TP
  401. .B BORG_RELOCATED_REPO_ACCESS_IS_OK=no (or =yes)
  402. For "Warning: The repository at location ... was previously located at ..."
  403. .TP
  404. .B BORG_CHECK_I_KNOW_WHAT_I_AM_DOING=NO (or =YES)
  405. For "Warning: \(aqcheck \-\-repair\(aq is an experimental feature that might result in data loss."
  406. .TP
  407. .B BORG_DELETE_I_KNOW_WHAT_I_AM_DOING=NO (or =YES)
  408. For "You requested to completely DELETE the repository \fIincluding\fP all archives it contains:"
  409. .TP
  410. .B BORG_RECREATE_I_KNOW_WHAT_I_AM_DOING=NO (or =YES)
  411. For "recreate is an experimental feature."
  412. .UNINDENT
  413. .sp
  414. Note: answers are case sensitive. setting an invalid answer value might either give the default
  415. answer or ask you interactively, depending on whether retries are allowed (they by default are
  416. allowed). So please test your scripts interactively before making them a non\-interactive script.
  417. .TP
  418. .B Directories and files:
  419. .INDENT 7.0
  420. .TP
  421. .B BORG_KEYS_DIR
  422. Default to \(aq~/.config/borg/keys\(aq. This directory contains keys for encrypted repositories.
  423. .TP
  424. .B BORG_KEY_FILE
  425. When set, use the given filename as repository key file.
  426. .TP
  427. .B BORG_SECURITY_DIR
  428. Default to \(aq~/.config/borg/security\(aq. This directory contains information borg uses to
  429. track its usage of NONCES ("numbers used once" \- usually in encryption context) and other
  430. security relevant data.
  431. .TP
  432. .B BORG_CACHE_DIR
  433. Default to \(aq~/.cache/borg\(aq. This directory contains the local cache and might need a lot
  434. of space for dealing with big repositories).
  435. .TP
  436. .B BORG_CONFIG_DIR
  437. Default to \(aq~/.config/borg\(aq. This directory contains the whole config directories.
  438. .UNINDENT
  439. .TP
  440. .B Building:
  441. .INDENT 7.0
  442. .TP
  443. .B BORG_OPENSSL_PREFIX
  444. Adds given OpenSSL header file directory to the default locations (setup.py).
  445. .TP
  446. .B BORG_LZ4_PREFIX
  447. Adds given LZ4 header file directory to the default locations (setup.py).
  448. .TP
  449. .B BORG_LIBB2_PREFIX
  450. Adds given prefix directory to the default locations. If a \(aqinclude/blake2.h\(aq is found Borg
  451. will be linked against the system libb2 instead of a bundled implementation. (setup.py)
  452. .UNINDENT
  453. .UNINDENT
  454. .sp
  455. Please note:
  456. .INDENT 0.0
  457. .IP \(bu 2
  458. be very careful when using the "yes" sayers, the warnings with prompt exist for your / your data\(aqs security/safety
  459. .IP \(bu 2
  460. also be very careful when putting your passphrase into a script, make sure it has appropriate file permissions
  461. (e.g. mode 600, root:root).
  462. .UNINDENT
  463. .SS File systems
  464. .sp
  465. We strongly recommend against using Borg (or any other database\-like
  466. software) on non\-journaling file systems like FAT, since it is not
  467. possible to assume any consistency in case of power failures (or a
  468. sudden disconnect of an external drive or similar failures).
  469. .sp
  470. While Borg uses a data store that is resilient against these failures
  471. when used on journaling file systems, it is not possible to guarantee
  472. this with some hardware \-\- independent of the software used. We don\(aqt
  473. know a list of affected hardware.
  474. .sp
  475. If you are suspicious whether your Borg repository is still consistent
  476. and readable after one of the failures mentioned above occurred, run
  477. \fBborg check \-\-verify\-data\fP to make sure it is consistent.
  478. Requirements for Borg repository file systems.INDENT 0.0
  479. .IP \(bu 2
  480. Long file names
  481. .IP \(bu 2
  482. At least three directory levels with short names
  483. .IP \(bu 2
  484. Typically, file sizes up to a few hundred MB.
  485. Large repositories may require large files (>2 GB).
  486. .IP \(bu 2
  487. Up to 1000 files per directory (10000 for repositories initialized with Borg 1.0)
  488. .IP \(bu 2
  489. mkdir(2) should be atomic, since it is used for locking
  490. .IP \(bu 2
  491. Hardlinks are needed for \fIborg_upgrade\fP \fB\-\-inplace\fP
  492. .UNINDENT
  493. .SS Units
  494. .sp
  495. To display quantities, Borg takes care of respecting the
  496. usual conventions of scale. Disk sizes are displayed in \fI\%decimal\fP, using powers of ten (so
  497. \fBkB\fP means 1000 bytes). For memory usage, \fI\%binary prefixes\fP are used, and are
  498. indicated using the \fI\%IEC binary prefixes\fP,
  499. using powers of two (so \fBKiB\fP means 1024 bytes).
  500. .SS Date and Time
  501. .sp
  502. We format date and time conforming to ISO\-8601, that is: YYYY\-MM\-DD and
  503. HH:MM:SS (24h clock).
  504. .sp
  505. For more information about that, see: \fI\%https://xkcd.com/1179/\fP
  506. .sp
  507. Unless otherwise noted, we display local date and time.
  508. Internally, we store and process date and time as UTC.
  509. .SS Resource Usage
  510. .sp
  511. Borg might use a lot of resources depending on the size of the data set it is dealing with.
  512. .sp
  513. If one uses Borg in a client/server way (with a ssh: repository),
  514. the resource usage occurs in part on the client and in another part on the
  515. server.
  516. .sp
  517. If one uses Borg as a single process (with a filesystem repo),
  518. all the resource usage occurs in that one process, so just add up client +
  519. server to get the approximate resource usage.
  520. .INDENT 0.0
  521. .TP
  522. .B CPU client:
  523. borg create: does chunking, hashing, compression, crypto (high CPU usage)
  524. chunks cache sync: quite heavy on CPU, doing lots of hashtable operations.
  525. borg extract: crypto, decompression (medium to high CPU usage)
  526. borg check: similar to extract, but depends on options given.
  527. borg prune / borg delete archive: low to medium CPU usage
  528. borg delete repo: done on the server
  529. It won\(aqt go beyond 100% of 1 core as the code is currently single\-threaded.
  530. Especially higher zlib and lzma compression levels use significant amounts
  531. of CPU cycles. Crypto might be cheap on the CPU (if hardware accelerated) or
  532. expensive (if not).
  533. .TP
  534. .B CPU server:
  535. It usually doesn\(aqt need much CPU, it just deals with the key/value store
  536. (repository) and uses the repository index for that.
  537. .sp
  538. borg check: the repository check computes the checksums of all chunks
  539. (medium CPU usage)
  540. borg delete repo: low CPU usage
  541. .TP
  542. .B CPU (only for client/server operation):
  543. When using borg in a client/server way with a \fI\%ssh:\-type\fP repo, the ssh
  544. processes used for the transport layer will need some CPU on the client and
  545. on the server due to the crypto they are doing \- esp. if you are pumping
  546. big amounts of data.
  547. .TP
  548. .B Memory (RAM) client:
  549. The chunks index and the files index are read into memory for performance
  550. reasons. Might need big amounts of memory (see below).
  551. Compression, esp. lzma compression with high levels might need substantial
  552. amounts of memory.
  553. .TP
  554. .B Memory (RAM) server:
  555. The server process will load the repository index into memory. Might need
  556. considerable amounts of memory, but less than on the client (see below).
  557. .TP
  558. .B Chunks index (client only):
  559. Proportional to the amount of data chunks in your repo. Lots of chunks
  560. in your repo imply a big chunks index.
  561. It is possible to tweak the chunker params (see create options).
  562. .TP
  563. .B Files index (client only):
  564. Proportional to the amount of files in your last backups. Can be switched
  565. off (see create options), but next backup might be much slower if you do.
  566. The speed benefit of using the files cache is proportional to file size.
  567. .TP
  568. .B Repository index (server only):
  569. Proportional to the amount of data chunks in your repo. Lots of chunks
  570. in your repo imply a big repository index.
  571. It is possible to tweak the chunker params (see create options) to
  572. influence the amount of chunks being created.
  573. .TP
  574. .B Temporary files (client):
  575. Reading data and metadata from a FUSE mounted repository will consume up to
  576. the size of all deduplicated, small chunks in the repository. Big chunks
  577. won\(aqt be locally cached.
  578. .TP
  579. .B Temporary files (server):
  580. None.
  581. .TP
  582. .B Cache files (client only):
  583. Contains the chunks index and files index (plus a collection of single\-
  584. archive chunk indexes which might need huge amounts of disk space,
  585. depending on archive count and size \- see FAQ about how to reduce).
  586. .TP
  587. .B Network (only for client/server operation):
  588. If your repository is remote, all deduplicated (and optionally compressed/
  589. encrypted) data of course has to go over the connection (\fBssh://\fP repo url).
  590. If you use a locally mounted network filesystem, additionally some copy
  591. operations used for transaction support also go over the connection. If
  592. you backup multiple sources to one target repository, additional traffic
  593. happens for cache resynchronization.
  594. .UNINDENT
  595. .SS Support for file metadata
  596. .sp
  597. Besides regular file and directory structures, Borg can preserve
  598. .INDENT 0.0
  599. .IP \(bu 2
  600. symlinks (stored as symlink, the symlink is not followed)
  601. .IP \(bu 2
  602. special files:
  603. .INDENT 2.0
  604. .IP \(bu 2
  605. character and block device files (restored via mknod)
  606. .IP \(bu 2
  607. FIFOs ("named pipes")
  608. .IP \(bu 2
  609. special file \fIcontents\fP can be backed up in \fB\-\-read\-special\fP mode.
  610. By default the metadata to create them with mknod(2), mkfifo(2) etc. is stored.
  611. .UNINDENT
  612. .IP \(bu 2
  613. hardlinked regular files, devices, FIFOs (considering all items in the same archive)
  614. .IP \(bu 2
  615. timestamps in nanosecond precision: mtime, atime, ctime
  616. .IP \(bu 2
  617. permissions:
  618. .INDENT 2.0
  619. .IP \(bu 2
  620. IDs of owning user and owning group
  621. .IP \(bu 2
  622. names of owning user and owning group (if the IDs can be resolved)
  623. .IP \(bu 2
  624. Unix Mode/Permissions (u/g/o permissions, suid, sgid, sticky)
  625. .UNINDENT
  626. .UNINDENT
  627. .sp
  628. On some platforms additional features are supported:
  629. .\" Yes/No's are grouped by reason/mechanism/reference.
  630. .
  631. .TS
  632. center;
  633. |l|l|l|l|.
  634. _
  635. T{
  636. Platform
  637. T} T{
  638. ACLs
  639. [5]
  640. T} T{
  641. xattr
  642. [6]
  643. T} T{
  644. Flags
  645. [7]
  646. T}
  647. _
  648. T{
  649. Linux
  650. T} T{
  651. Yes
  652. T} T{
  653. Yes
  654. T} T{
  655. Yes [1]
  656. T}
  657. _
  658. T{
  659. Mac OS X
  660. T} T{
  661. Yes
  662. T} T{
  663. Yes
  664. T} T{
  665. Yes (all)
  666. T}
  667. _
  668. T{
  669. FreeBSD
  670. T} T{
  671. Yes
  672. T} T{
  673. Yes
  674. T}
  675. _
  676. T{
  677. OpenBSD
  678. T} T{
  679. n/a
  680. T} T{
  681. n/a
  682. T}
  683. _
  684. T{
  685. NetBSD
  686. T} T{
  687. n/a
  688. T} T{
  689. No [2]
  690. T}
  691. _
  692. T{
  693. Solaris 11
  694. T} T{
  695. No [3]
  696. T} T{
  697. n/a
  698. T}
  699. _
  700. T{
  701. OpenIndiana
  702. T}
  703. _
  704. T{
  705. Windows (cygwin)
  706. T} T{
  707. No [4]
  708. T} T{
  709. No
  710. T} T{
  711. No
  712. T}
  713. _
  714. .TE
  715. .sp
  716. Other Unix\-like operating systems may work as well, but have not been tested at all.
  717. .sp
  718. Note that most of the platform\-dependent features also depend on the file system.
  719. For example, ntfs\-3g on Linux isn\(aqt able to convey NTFS ACLs.
  720. .IP [1] 5
  721. Only "nodump", "immutable", "compressed" and "append" are supported.
  722. Feature request #618 for more flags.
  723. .IP [2] 5
  724. Feature request #1332
  725. .IP [3] 5
  726. Feature request #1337
  727. .IP [4] 5
  728. Cygwin tries to map NTFS ACLs to permissions with varying degress of success.
  729. .IP [5] 5
  730. The native access control list mechanism of the OS. This normally limits access to
  731. non\-native ACLs. For example, NTFS ACLs aren\(aqt completely accessible on Linux with ntfs\-3g.
  732. .IP [6] 5
  733. extended attributes; key\-value pairs attached to a file, mainly used by the OS.
  734. This includes resource forks on Mac OS X.
  735. .IP [7] 5
  736. aka \fIBSD flags\fP\&. The Linux set of flags [1] is portable across platforms.
  737. The BSDs define additional flags.
  738. .SH SEE ALSO
  739. .sp
  740. \fIborg\-common(1)\fP for common command line options
  741. .sp
  742. \fIborg\-init(1)\fP,
  743. \fIborg\-create(1)\fP, \fIborg\-mount(1)\fP, \fIborg\-extract(1)\fP,
  744. \fIborg\-list(1)\fP, \fIborg\-info(1)\fP,
  745. \fIborg\-delete(1)\fP, \fIborg\-prune(1)\fP,
  746. \fIborg\-recreate(1)\fP
  747. .sp
  748. \fIborg\-compression(1)\fP, \fIborg\-patterns(1)\fP, \fIborg\-placeholders(1)\fP
  749. .INDENT 0.0
  750. .IP \(bu 2
  751. Main web site \fI\%https://www.borgbackup.org/\fP
  752. .IP \(bu 2
  753. Releases \fI\%https://github.com/borgbackup/borg/releases\fP
  754. .IP \(bu 2
  755. Changelog \fI\%https://github.com/borgbackup/borg/blob/master/docs/changes.rst\fP
  756. .IP \(bu 2
  757. GitHub \fI\%https://github.com/borgbackup/borg\fP
  758. .IP \(bu 2
  759. Security contact \fI\%https://borgbackup.readthedocs.io/en/latest/support.html#security\-contact\fP
  760. .UNINDENT
  761. .SH AUTHOR
  762. The Borg Collective
  763. .\" Generated by docutils manpage writer.
  764. .