2
0

borg.1 30 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863864865866867868869870871872873874875876877878879880881882883884885886887888889890891892893894895896897898899900901902903904905906907908909910911912913914915916917918919
  1. .\" Man page generated from reStructuredText.
  2. .
  3. .
  4. .nr rst2man-indent-level 0
  5. .
  6. .de1 rstReportMargin
  7. \\$1 \\n[an-margin]
  8. level \\n[rst2man-indent-level]
  9. level margin: \\n[rst2man-indent\\n[rst2man-indent-level]]
  10. -
  11. \\n[rst2man-indent0]
  12. \\n[rst2man-indent1]
  13. \\n[rst2man-indent2]
  14. ..
  15. .de1 INDENT
  16. .\" .rstReportMargin pre:
  17. . RS \\$1
  18. . nr rst2man-indent\\n[rst2man-indent-level] \\n[an-margin]
  19. . nr rst2man-indent-level +1
  20. .\" .rstReportMargin post:
  21. ..
  22. .de UNINDENT
  23. . RE
  24. .\" indent \\n[an-margin]
  25. .\" old: \\n[rst2man-indent\\n[rst2man-indent-level]]
  26. .nr rst2man-indent-level -1
  27. .\" new: \\n[rst2man-indent\\n[rst2man-indent-level]]
  28. .in \\n[rst2man-indent\\n[rst2man-indent-level]]u
  29. ..
  30. .TH "BORG" 1 "2022-06-25" "" "borg backup tool"
  31. .SH NAME
  32. borg \- deduplicating and encrypting backup tool
  33. .SH SYNOPSIS
  34. .sp
  35. borg [common options] <command> [options] [arguments]
  36. .SH DESCRIPTION
  37. .\" we don't include the README.rst here since we want to keep this terse.
  38. .
  39. .sp
  40. BorgBackup (short: Borg) is a deduplicating backup program.
  41. Optionally, it supports compression and authenticated encryption.
  42. .sp
  43. The main goal of Borg is to provide an efficient and secure way to backup data.
  44. The data deduplication technique used makes Borg suitable for daily backups
  45. since only changes are stored.
  46. The authenticated encryption technique makes it suitable for backups to not
  47. fully trusted targets.
  48. .sp
  49. Borg stores a set of files in an \fIarchive\fP\&. A \fIrepository\fP is a collection
  50. of \fIarchives\fP\&. The format of repositories is Borg\-specific. Borg does not
  51. distinguish archives from each other in any way other than their name,
  52. it does not matter when or where archives were created (e.g. different hosts).
  53. .SH EXAMPLES
  54. .SS A step\-by\-step example
  55. .INDENT 0.0
  56. .IP 1. 3
  57. Before a backup can be made a repository has to be initialized:
  58. .INDENT 3.0
  59. .INDENT 3.5
  60. .sp
  61. .nf
  62. .ft C
  63. $ borg \-r /path/to/repo rcreate \-\-encryption=repokey\-aes\-ocb
  64. .ft P
  65. .fi
  66. .UNINDENT
  67. .UNINDENT
  68. .IP 2. 3
  69. Backup the \fB~/src\fP and \fB~/Documents\fP directories into an archive called
  70. \fIMonday\fP:
  71. .INDENT 3.0
  72. .INDENT 3.5
  73. .sp
  74. .nf
  75. .ft C
  76. $ borg \-r /path/to/repo create Monday ~/src ~/Documents
  77. .ft P
  78. .fi
  79. .UNINDENT
  80. .UNINDENT
  81. .IP 3. 3
  82. The next day create a new archive called \fITuesday\fP:
  83. .INDENT 3.0
  84. .INDENT 3.5
  85. .sp
  86. .nf
  87. .ft C
  88. $ borg \-r /path/to/repo create \-\-stats Tuesday ~/src ~/Documents
  89. .ft P
  90. .fi
  91. .UNINDENT
  92. .UNINDENT
  93. .sp
  94. This backup will be a lot quicker and a lot smaller since only new never
  95. before seen data is stored. The \fB\-\-stats\fP option causes Borg to
  96. output statistics about the newly created archive such as the deduplicated
  97. size (the amount of unique data not shared with other archives):
  98. .INDENT 3.0
  99. .INDENT 3.5
  100. .sp
  101. .nf
  102. .ft C
  103. Repository: /path/to/repo
  104. Archive name: Tuesday
  105. Archive fingerprint: bcd1b53f9b4991b7afc2b339f851b7ffe3c6d030688936fe4552eccc1877718d
  106. Time (start): Sat, 2022\-06\-25 20:21:43
  107. Time (end): Sat, 2022\-06\-25 20:21:43
  108. Duration: 0.07 seconds
  109. Utilization of max. archive size: 0%
  110. Number of files: 699
  111. Original size: 31.14 MB
  112. Deduplicated size: 502 B
  113. .ft P
  114. .fi
  115. .UNINDENT
  116. .UNINDENT
  117. .IP 4. 3
  118. List all archives in the repository:
  119. .INDENT 3.0
  120. .INDENT 3.5
  121. .sp
  122. .nf
  123. .ft C
  124. $ borg \-r /path/to/repo rlist
  125. Monday Sat, 2022\-06\-25 20:21:14 [b80e24d2...b179f298]
  126. Tuesday Sat, 2022\-06\-25 20:21:43 [bcd1b53f...1877718d]
  127. .ft P
  128. .fi
  129. .UNINDENT
  130. .UNINDENT
  131. .IP 5. 3
  132. List the contents of the \fIMonday\fP archive:
  133. .INDENT 3.0
  134. .INDENT 3.5
  135. .sp
  136. .nf
  137. .ft C
  138. $ borg \-r /path/to/repo list Monday
  139. drwxr\-xr\-x user group 0 Mon, 2016\-02\-15 18:22:30 home/user/Documents
  140. \-rw\-r\-\-r\-\- user group 7961 Mon, 2016\-02\-15 18:22:30 home/user/Documents/Important.doc
  141. \&...
  142. .ft P
  143. .fi
  144. .UNINDENT
  145. .UNINDENT
  146. .IP 6. 3
  147. Restore the \fIMonday\fP archive by extracting the files relative to the current directory:
  148. .INDENT 3.0
  149. .INDENT 3.5
  150. .sp
  151. .nf
  152. .ft C
  153. $ borg \-r /path/to/repo extract Monday
  154. .ft P
  155. .fi
  156. .UNINDENT
  157. .UNINDENT
  158. .IP 7. 3
  159. Delete the \fIMonday\fP archive (please note that this does \fBnot\fP free repo disk space):
  160. .INDENT 3.0
  161. .INDENT 3.5
  162. .sp
  163. .nf
  164. .ft C
  165. $ borg \-r /path/to/repo delete \-a Monday
  166. .ft P
  167. .fi
  168. .UNINDENT
  169. .UNINDENT
  170. .sp
  171. Please note the \fB\-a\fP option here (short for \fB\-\-glob\-archives\fP) which enables you
  172. to give a globbing pattern to delete multiple archives, like \fB\-a \(aqoldcrap\-*\(aq\fP\&.
  173. You can also combine this with \fB\-\-first\fP, \fB\-\-last\fP and \fB\-\-sort\-by\fP\&.
  174. Be careful, always first use with \fB\-\-dry\-run\fP and \fB\-\-list\fP!
  175. .IP 8. 3
  176. Recover disk space by compacting the segment files in the repo:
  177. .INDENT 3.0
  178. .INDENT 3.5
  179. .sp
  180. .nf
  181. .ft C
  182. $ borg \-r /path/to/repo compact
  183. .ft P
  184. .fi
  185. .UNINDENT
  186. .UNINDENT
  187. .UNINDENT
  188. .sp
  189. \fBNOTE:\fP
  190. .INDENT 0.0
  191. .INDENT 3.5
  192. Borg is quiet by default (it works on WARNING log level).
  193. You can use options like \fB\-\-progress\fP or \fB\-\-list\fP to get specific
  194. reports during command execution. You can also add the \fB\-v\fP (or
  195. \fB\-\-verbose\fP or \fB\-\-info\fP) option to adjust the log level to INFO to
  196. get other informational messages.
  197. .UNINDENT
  198. .UNINDENT
  199. .SH NOTES
  200. .SS Positional Arguments and Options: Order matters
  201. .sp
  202. Borg only supports taking options (\fB\-s\fP and \fB\-\-progress\fP in the example)
  203. to the left or right of all positional arguments (\fBrepo::archive\fP and \fBpath\fP
  204. in the example), but not in between them:
  205. .INDENT 0.0
  206. .INDENT 3.5
  207. .sp
  208. .nf
  209. .ft C
  210. borg create \-s \-\-progress archive path # good and preferred
  211. borg create archive path \-s \-\-progress # also works
  212. borg create \-s archive path \-\-progress # works, but ugly
  213. borg create archive \-s \-\-progress path # BAD
  214. .ft P
  215. .fi
  216. .UNINDENT
  217. .UNINDENT
  218. .sp
  219. This is due to a problem in the argparse module: \fI\%https://bugs.python.org/issue15112\fP
  220. .SS Repository URLs
  221. .sp
  222. \fBLocal filesystem\fP (or locally mounted network filesystem):
  223. .sp
  224. \fB/path/to/repo\fP \- filesystem path to repo directory, absolute path
  225. .sp
  226. \fBpath/to/repo\fP \- filesystem path to repo directory, relative path
  227. .sp
  228. Also, stuff like \fB~/path/to/repo\fP or \fB~other/path/to/repo\fP works (this is
  229. expanded by your shell).
  230. .sp
  231. Note: you may also prepend a \fBfile://\fP to a filesystem path to get URL style.
  232. .sp
  233. \fBRemote repositories\fP accessed via ssh \fI\%user@host\fP:
  234. .sp
  235. \fBssh://user@host:port/path/to/repo\fP \- absolute path\(ga
  236. .sp
  237. \fBssh://user@host:port/./path/to/repo\fP \- path relative to current directory
  238. .sp
  239. \fBssh://user@host:port/~/path/to/repo\fP \- path relative to user\(aqs home directory
  240. .sp
  241. \fBssh://user@host:port/~other/path/to/repo\fP \- path relative to other\(aqs home directory
  242. .sp
  243. If you frequently need the same repo URL, it is a good idea to set the
  244. \fBBORG_REPO\fP environment variable to set a default for the repo URL:
  245. .INDENT 0.0
  246. .INDENT 3.5
  247. .sp
  248. .nf
  249. .ft C
  250. export BORG_REPO=\(aqssh://user@host:port/path/to/repo\(aq
  251. .ft P
  252. .fi
  253. .UNINDENT
  254. .UNINDENT
  255. .sp
  256. Then just leave away the \fB\-\-repo\fP option if you want
  257. to use the default \- it will be read from BORG_REPO then.
  258. .SS Repository Locations / Archive names
  259. .sp
  260. Many commands need to know the repository location, give it via \fB\-r\fP / \fB\-\-repo\fP
  261. or use the \fBBORG_REPO\fP environment variable.
  262. .sp
  263. Commands needing one or two archive names usually get them as positional argument.
  264. .sp
  265. Commands working with an arbitrary amount of archives, usually take \fB\-a ARCH_GLOB\fP\&.
  266. .sp
  267. Archive names must not contain the \fB/\fP (slash) character. For simplicity,
  268. maybe also avoid blanks or other characters that have special meaning on the
  269. shell or in a filesystem (borg mount will use the archive name as directory
  270. name).
  271. .SS Logging
  272. .sp
  273. Borg writes all log output to stderr by default. But please note that something
  274. showing up on stderr does \fInot\fP indicate an error condition just because it is
  275. on stderr. Please check the log levels of the messages and the return code of
  276. borg for determining error, warning or success conditions.
  277. .sp
  278. If you want to capture the log output to a file, just redirect it:
  279. .INDENT 0.0
  280. .INDENT 3.5
  281. .sp
  282. .nf
  283. .ft C
  284. borg create repo::archive myfiles 2>> logfile
  285. .ft P
  286. .fi
  287. .UNINDENT
  288. .UNINDENT
  289. .sp
  290. Custom logging configurations can be implemented via BORG_LOGGING_CONF.
  291. .sp
  292. The log level of the builtin logging configuration defaults to WARNING.
  293. This is because we want Borg to be mostly silent and only output
  294. warnings, errors and critical messages, unless output has been requested
  295. by supplying an option that implies output (e.g. \fB\-\-list\fP or \fB\-\-progress\fP).
  296. .sp
  297. Log levels: DEBUG < INFO < WARNING < ERROR < CRITICAL
  298. .sp
  299. Use \fB\-\-debug\fP to set DEBUG log level \-
  300. to get debug, info, warning, error and critical level output.
  301. .sp
  302. Use \fB\-\-info\fP (or \fB\-v\fP or \fB\-\-verbose\fP) to set INFO log level \-
  303. to get info, warning, error and critical level output.
  304. .sp
  305. Use \fB\-\-warning\fP (default) to set WARNING log level \-
  306. to get warning, error and critical level output.
  307. .sp
  308. Use \fB\-\-error\fP to set ERROR log level \-
  309. to get error and critical level output.
  310. .sp
  311. Use \fB\-\-critical\fP to set CRITICAL log level \-
  312. to get critical level output.
  313. .sp
  314. While you can set misc. log levels, do not expect that every command will
  315. give different output on different log levels \- it\(aqs just a possibility.
  316. .sp
  317. \fBWARNING:\fP
  318. .INDENT 0.0
  319. .INDENT 3.5
  320. Options \fB\-\-critical\fP and \fB\-\-error\fP are provided for completeness,
  321. their usage is not recommended as you might miss important information.
  322. .UNINDENT
  323. .UNINDENT
  324. .SS Return codes
  325. .sp
  326. Borg can exit with the following return codes (rc):
  327. .TS
  328. center;
  329. |l|l|.
  330. _
  331. T{
  332. Return code
  333. T} T{
  334. Meaning
  335. T}
  336. _
  337. T{
  338. 0
  339. T} T{
  340. success (logged as INFO)
  341. T}
  342. _
  343. T{
  344. 1
  345. T} T{
  346. warning (operation reached its normal end, but there were warnings \-\-
  347. you should check the log, logged as WARNING)
  348. T}
  349. _
  350. T{
  351. 2
  352. T} T{
  353. error (like a fatal error, a local or remote exception, the operation
  354. did not reach its normal end, logged as ERROR)
  355. T}
  356. _
  357. T{
  358. 128+N
  359. T} T{
  360. killed by signal N (e.g. 137 == kill \-9)
  361. T}
  362. _
  363. .TE
  364. .sp
  365. If you use \fB\-\-show\-rc\fP, the return code is also logged at the indicated
  366. level as the last log entry.
  367. .SS Environment Variables
  368. .sp
  369. Borg uses some environment variables for automation:
  370. .INDENT 0.0
  371. .TP
  372. .B General:
  373. .INDENT 7.0
  374. .TP
  375. .B BORG_REPO
  376. When set, use the value to give the default repository location.
  377. Use this so you do not need to type \fB\-\-repo /path/to/my/repo\fP all the time.
  378. .TP
  379. .B BORG_OTHER_REPO
  380. Similar to BORG_REPO, but gives the default for \fB\-\-other\-repo\fP\&.
  381. .TP
  382. .B BORG_PASSPHRASE
  383. When set, use the value to answer the passphrase question for encrypted repositories.
  384. It is used when a passphrase is needed to access an encrypted repo as well as when a new
  385. passphrase should be initially set when initializing an encrypted repo.
  386. See also BORG_NEW_PASSPHRASE.
  387. .TP
  388. .B BORG_PASSCOMMAND
  389. When set, use the standard output of the command (trailing newlines are stripped) to answer the
  390. passphrase question for encrypted repositories.
  391. It is used when a passphrase is needed to access an encrypted repo as well as when a new
  392. passphrase should be initially set when initializing an encrypted repo. Note that the command
  393. is executed without a shell. So variables, like \fB$HOME\fP will work, but \fB~\fP won\(aqt.
  394. If BORG_PASSPHRASE is also set, it takes precedence.
  395. See also BORG_NEW_PASSPHRASE.
  396. .TP
  397. .B BORG_PASSPHRASE_FD
  398. When set, specifies a file descriptor to read a passphrase
  399. from. Programs starting borg may choose to open an anonymous pipe
  400. and use it to pass a passphrase. This is safer than passing via
  401. BORG_PASSPHRASE, because on some systems (e.g. Linux) environment
  402. can be examined by other processes.
  403. If BORG_PASSPHRASE or BORG_PASSCOMMAND are also set, they take precedence.
  404. .TP
  405. .B BORG_NEW_PASSPHRASE
  406. When set, use the value to answer the passphrase question when a \fBnew\fP passphrase is asked for.
  407. This variable is checked first. If it is not set, BORG_PASSPHRASE and BORG_PASSCOMMAND will also
  408. be checked.
  409. Main usecase for this is to fully automate \fBborg change\-passphrase\fP\&.
  410. .TP
  411. .B BORG_DISPLAY_PASSPHRASE
  412. When set, use the value to answer the "display the passphrase for verification" question when defining a new passphrase for encrypted repositories.
  413. .TP
  414. .B BORG_HOST_ID
  415. Borg usually computes a host id from the FQDN plus the results of \fBuuid.getnode()\fP (which usually returns
  416. a unique id based on the MAC address of the network interface. Except if that MAC happens to be all\-zero \- in
  417. that case it returns a random value, which is not what we want (because it kills automatic stale lock removal).
  418. So, if you have a all\-zero MAC address or other reasons to better externally control the host id, just set this
  419. environment variable to a unique value. If all your FQDNs are unique, you can just use the FQDN. If not,
  420. use \fI\%fqdn@uniqueid\fP\&.
  421. .TP
  422. .B BORG_LOGGING_CONF
  423. When set, use the given filename as \fI\%INI\fP\-style logging configuration.
  424. A basic example conf can be found at \fBdocs/misc/logging.conf\fP\&.
  425. .TP
  426. .B BORG_RSH
  427. When set, use this command instead of \fBssh\fP\&. This can be used to specify ssh options, such as
  428. a custom identity file \fBssh \-i /path/to/private/key\fP\&. See \fBman ssh\fP for other options. Using
  429. the \fB\-\-rsh CMD\fP commandline option overrides the environment variable.
  430. .TP
  431. .B BORG_REMOTE_PATH
  432. When set, use the given path as borg executable on the remote (defaults to "borg" if unset).
  433. Using \fB\-\-remote\-path PATH\fP commandline option overrides the environment variable.
  434. .TP
  435. .B BORG_FILES_CACHE_SUFFIX
  436. When set to a value at least one character long, instructs borg to use a specifically named
  437. (based on the suffix) alternative files cache. This can be used to avoid loading and saving
  438. cache entries for backup sources other than the current sources.
  439. .TP
  440. .B BORG_FILES_CACHE_TTL
  441. When set to a numeric value, this determines the maximum "time to live" for the files cache
  442. entries (default: 20). The files cache is used to quickly determine whether a file is unchanged.
  443. The FAQ explains this more detailed in: \fIalways_chunking\fP
  444. .TP
  445. .B BORG_SHOW_SYSINFO
  446. When set to no (default: yes), system information (like OS, Python version, ...) in
  447. exceptions is not shown.
  448. Please only use for good reasons as it makes issues harder to analyze.
  449. .TP
  450. .B BORG_FUSE_IMPL
  451. Choose the lowlevel FUSE implementation borg shall use for \fBborg mount\fP\&.
  452. This is a comma\-separated list of implementation names, they are tried in the
  453. given order, e.g.:
  454. .INDENT 7.0
  455. .IP \(bu 2
  456. \fBpyfuse3,llfuse\fP: default, first try to load pyfuse3, then try to load llfuse.
  457. .IP \(bu 2
  458. \fBllfuse,pyfuse3\fP: first try to load llfuse, then try to load pyfuse3.
  459. .IP \(bu 2
  460. \fBpyfuse3\fP: only try to load pyfuse3
  461. .IP \(bu 2
  462. \fBllfuse\fP: only try to load llfuse
  463. .IP \(bu 2
  464. \fBnone\fP: do not try to load an implementation
  465. .UNINDENT
  466. .TP
  467. .B BORG_SELFTEST
  468. This can be used to influence borg\(aqs builtin self\-tests. The default is to execute the tests
  469. at the beginning of each borg command invocation.
  470. .sp
  471. BORG_SELFTEST=disabled can be used to switch off the tests and rather save some time.
  472. Disabling is not recommended for normal borg users, but large scale borg storage providers can
  473. use this to optimize production servers after at least doing a one\-time test borg (with
  474. selftests not disabled) when installing or upgrading machines / OS / borg.
  475. .TP
  476. .B BORG_WORKAROUNDS
  477. A list of comma separated strings that trigger workarounds in borg,
  478. e.g. to work around bugs in other software.
  479. .sp
  480. Currently known strings are:
  481. .INDENT 7.0
  482. .TP
  483. .B basesyncfile
  484. Use the more simple BaseSyncFile code to avoid issues with sync_file_range.
  485. You might need this to run borg on WSL (Windows Subsystem for Linux) or
  486. in systemd.nspawn containers on some architectures (e.g. ARM).
  487. Using this does not affect data safety, but might result in a more bursty
  488. write to disk behaviour (not continuously streaming to disk).
  489. .TP
  490. .B retry_erofs
  491. Retry opening a file without O_NOATIME if opening a file with O_NOATIME
  492. caused EROFS. You will need this to make archives from volume shadow copies
  493. in WSL1 (Windows Subsystem for Linux 1).
  494. .UNINDENT
  495. .UNINDENT
  496. .TP
  497. .B Some automatic "answerers" (if set, they automatically answer confirmation questions):
  498. .INDENT 7.0
  499. .TP
  500. .B BORG_UNKNOWN_UNENCRYPTED_REPO_ACCESS_IS_OK=no (or =yes)
  501. For "Warning: Attempting to access a previously unknown unencrypted repository"
  502. .TP
  503. .B BORG_RELOCATED_REPO_ACCESS_IS_OK=no (or =yes)
  504. For "Warning: The repository at location ... was previously located at ..."
  505. .TP
  506. .B BORG_CHECK_I_KNOW_WHAT_I_AM_DOING=NO (or =YES)
  507. For "This is a potentially dangerous function..." (check \-\-repair)
  508. .TP
  509. .B BORG_DELETE_I_KNOW_WHAT_I_AM_DOING=NO (or =YES)
  510. For "You requested to completely DELETE the repository \fIincluding\fP all archives it contains:"
  511. .UNINDENT
  512. .sp
  513. Note: answers are case sensitive. setting an invalid answer value might either give the default
  514. answer or ask you interactively, depending on whether retries are allowed (they by default are
  515. allowed). So please test your scripts interactively before making them a non\-interactive script.
  516. .UNINDENT
  517. .INDENT 0.0
  518. .TP
  519. .B Directories and files:
  520. .INDENT 7.0
  521. .TP
  522. .B BORG_BASE_DIR
  523. Defaults to \fB$HOME\fP or \fB~$USER\fP or \fB~\fP (in that order).
  524. If you want to move all borg\-specific folders to a custom path at once, all you need to do is
  525. to modify \fBBORG_BASE_DIR\fP: the other paths for cache, config etc. will adapt accordingly
  526. (assuming you didn\(aqt set them to a different custom value).
  527. .TP
  528. .B BORG_CACHE_DIR
  529. Defaults to \fB$BORG_BASE_DIR/.cache/borg\fP\&. If \fBBORG_BASE_DIR\fP is not explicitly set while
  530. \fI\%XDG env var\fP \fBXDG_CACHE_HOME\fP is set, then \fB$XDG_CACHE_HOME/borg\fP is being used instead.
  531. This directory contains the local cache and might need a lot
  532. of space for dealing with big repositories. Make sure you\(aqre aware of the associated
  533. security aspects of the cache location: \fIcache_security\fP
  534. .TP
  535. .B BORG_CONFIG_DIR
  536. Defaults to \fB$BORG_BASE_DIR/.config/borg\fP\&. If \fBBORG_BASE_DIR\fP is not explicitly set while
  537. \fI\%XDG env var\fP \fBXDG_CONFIG_HOME\fP is set, then \fB$XDG_CONFIG_HOME/borg\fP is being used instead.
  538. This directory contains all borg configuration directories, see the FAQ
  539. for a security advisory about the data in this directory: \fIhome_config_borg\fP
  540. .TP
  541. .B BORG_SECURITY_DIR
  542. Defaults to \fB$BORG_CONFIG_DIR/security\fP\&.
  543. This directory contains information borg uses to track its usage of NONCES ("numbers used
  544. once" \- usually in encryption context) and other security relevant data.
  545. .TP
  546. .B BORG_KEYS_DIR
  547. Defaults to \fB$BORG_CONFIG_DIR/keys\fP\&.
  548. This directory contains keys for encrypted repositories.
  549. .TP
  550. .B BORG_KEY_FILE
  551. When set, use the given filename as repository key file.
  552. .TP
  553. .B TMPDIR
  554. This is where temporary files are stored (might need a lot of temporary space for some
  555. operations), see \fI\%tempfile\fP for details.
  556. .UNINDENT
  557. .TP
  558. .B Building:
  559. .INDENT 7.0
  560. .TP
  561. .B BORG_OPENSSL_PREFIX
  562. Adds given OpenSSL header file directory to the default locations (setup.py).
  563. .TP
  564. .B BORG_LIBLZ4_PREFIX
  565. Adds given prefix directory to the default locations. If a \(aqinclude/lz4.h\(aq is found Borg
  566. will be linked against the system liblz4 instead of a bundled implementation. (setup.py)
  567. .TP
  568. .B BORG_LIBB2_PREFIX
  569. Adds given prefix directory to the default locations. If a \(aqinclude/blake2.h\(aq is found Borg
  570. will be linked against the system libb2 instead of a bundled implementation. (setup.py)
  571. .TP
  572. .B BORG_LIBZSTD_PREFIX
  573. Adds given prefix directory to the default locations. If a \(aqinclude/zstd.h\(aq is found Borg
  574. will be linked against the system libzstd instead of a bundled implementation. (setup.py)
  575. .UNINDENT
  576. .UNINDENT
  577. .sp
  578. Please note:
  579. .INDENT 0.0
  580. .IP \(bu 2
  581. Be very careful when using the "yes" sayers, the warnings with prompt exist for your / your data\(aqs security/safety.
  582. .IP \(bu 2
  583. Also be very careful when putting your passphrase into a script, make sure it has appropriate file permissions (e.g.
  584. mode 600, root:root).
  585. .UNINDENT
  586. .SS File systems
  587. .sp
  588. We strongly recommend against using Borg (or any other database\-like
  589. software) on non\-journaling file systems like FAT, since it is not
  590. possible to assume any consistency in case of power failures (or a
  591. sudden disconnect of an external drive or similar failures).
  592. .sp
  593. While Borg uses a data store that is resilient against these failures
  594. when used on journaling file systems, it is not possible to guarantee
  595. this with some hardware \-\- independent of the software used. We don\(aqt
  596. know a list of affected hardware.
  597. .sp
  598. If you are suspicious whether your Borg repository is still consistent
  599. and readable after one of the failures mentioned above occurred, run
  600. \fBborg check \-\-verify\-data\fP to make sure it is consistent.
  601. Requirements for Borg repository file systems
  602. .INDENT 0.0
  603. .IP \(bu 2
  604. Long file names
  605. .IP \(bu 2
  606. At least three directory levels with short names
  607. .IP \(bu 2
  608. Typically, file sizes up to a few hundred MB.
  609. Large repositories may require large files (>2 GB).
  610. .IP \(bu 2
  611. Up to 1000 files per directory (10000 for repositories initialized with Borg 1.0)
  612. .IP \(bu 2
  613. rename(2) / MoveFile(Ex) should work as specified, i.e. on the same file system
  614. it should be a move (not a copy) operation, and in case of a directory
  615. it should fail if the destination exists and is not an empty directory,
  616. since this is used for locking.
  617. .IP \(bu 2
  618. Hardlinks are needed for \fIborg_upgrade\fP (if \fB\-\-inplace\fP option is not used).
  619. Also hardlinks are used for more safe and secure file updating (e.g. of the repo
  620. config file), but the code tries to work also if hardlinks are not supported.
  621. .UNINDENT
  622. .SS Units
  623. .sp
  624. To display quantities, Borg takes care of respecting the
  625. usual conventions of scale. Disk sizes are displayed in \fI\%decimal\fP, using powers of ten (so
  626. \fBkB\fP means 1000 bytes). For memory usage, \fI\%binary prefixes\fP are used, and are
  627. indicated using the \fI\%IEC binary prefixes\fP,
  628. using powers of two (so \fBKiB\fP means 1024 bytes).
  629. .SS Date and Time
  630. .sp
  631. We format date and time conforming to ISO\-8601, that is: YYYY\-MM\-DD and
  632. HH:MM:SS (24h clock).
  633. .sp
  634. For more information about that, see: \fI\%https://xkcd.com/1179/\fP
  635. .sp
  636. Unless otherwise noted, we display local date and time.
  637. Internally, we store and process date and time as UTC.
  638. .SS Resource Usage
  639. .sp
  640. Borg might use a lot of resources depending on the size of the data set it is dealing with.
  641. .sp
  642. If one uses Borg in a client/server way (with a ssh: repository),
  643. the resource usage occurs in part on the client and in another part on the
  644. server.
  645. .sp
  646. If one uses Borg as a single process (with a filesystem repo),
  647. all the resource usage occurs in that one process, so just add up client +
  648. server to get the approximate resource usage.
  649. .INDENT 0.0
  650. .TP
  651. .B CPU client:
  652. .INDENT 7.0
  653. .IP \(bu 2
  654. \fBborg create:\fP does chunking, hashing, compression, crypto (high CPU usage)
  655. .IP \(bu 2
  656. \fBchunks cache sync:\fP quite heavy on CPU, doing lots of hashtable operations.
  657. .IP \(bu 2
  658. \fBborg extract:\fP crypto, decompression (medium to high CPU usage)
  659. .IP \(bu 2
  660. \fBborg check:\fP similar to extract, but depends on options given.
  661. .IP \(bu 2
  662. \fBborg prune / borg delete archive:\fP low to medium CPU usage
  663. .IP \(bu 2
  664. \fBborg delete repo:\fP done on the server
  665. .UNINDENT
  666. .sp
  667. It won\(aqt go beyond 100% of 1 core as the code is currently single\-threaded.
  668. Especially higher zlib and lzma compression levels use significant amounts
  669. of CPU cycles. Crypto might be cheap on the CPU (if hardware accelerated) or
  670. expensive (if not).
  671. .TP
  672. .B CPU server:
  673. It usually doesn\(aqt need much CPU, it just deals with the key/value store
  674. (repository) and uses the repository index for that.
  675. .sp
  676. borg check: the repository check computes the checksums of all chunks
  677. (medium CPU usage)
  678. borg delete repo: low CPU usage
  679. .TP
  680. .B CPU (only for client/server operation):
  681. When using borg in a client/server way with a \fI\%ssh:\-type\fP repo, the ssh
  682. processes used for the transport layer will need some CPU on the client and
  683. on the server due to the crypto they are doing \- esp. if you are pumping
  684. big amounts of data.
  685. .TP
  686. .B Memory (RAM) client:
  687. The chunks index and the files index are read into memory for performance
  688. reasons. Might need big amounts of memory (see below).
  689. Compression, esp. lzma compression with high levels might need substantial
  690. amounts of memory.
  691. .TP
  692. .B Memory (RAM) server:
  693. The server process will load the repository index into memory. Might need
  694. considerable amounts of memory, but less than on the client (see below).
  695. .TP
  696. .B Chunks index (client only):
  697. Proportional to the amount of data chunks in your repo. Lots of chunks
  698. in your repo imply a big chunks index.
  699. It is possible to tweak the chunker params (see create options).
  700. .TP
  701. .B Files index (client only):
  702. Proportional to the amount of files in your last backups. Can be switched
  703. off (see create options), but next backup might be much slower if you do.
  704. The speed benefit of using the files cache is proportional to file size.
  705. .TP
  706. .B Repository index (server only):
  707. Proportional to the amount of data chunks in your repo. Lots of chunks
  708. in your repo imply a big repository index.
  709. It is possible to tweak the chunker params (see create options) to
  710. influence the amount of chunks being created.
  711. .TP
  712. .B Temporary files (client):
  713. Reading data and metadata from a FUSE mounted repository will consume up to
  714. the size of all deduplicated, small chunks in the repository. Big chunks
  715. won\(aqt be locally cached.
  716. .TP
  717. .B Temporary files (server):
  718. A non\-trivial amount of data will be stored on the remote temp directory
  719. for each client that connects to it. For some remotes, this can fill the
  720. default temporary directory at /tmp. This can be remediated by ensuring the
  721. $TMPDIR, $TEMP, or $TMP environment variable is properly set for the sshd
  722. process.
  723. For some OSes, this can be done just by setting the correct value in the
  724. \&.bashrc (or equivalent login config file for other shells), however in
  725. other cases it may be necessary to first enable \fBPermitUserEnvironment yes\fP
  726. in your \fBsshd_config\fP file, then add \fBenvironment="TMPDIR=/my/big/tmpdir"\fP
  727. at the start of the public key to be used in the \fBauthorized_hosts\fP file.
  728. .TP
  729. .B Cache files (client only):
  730. Contains the chunks index and files index (plus a collection of single\-
  731. archive chunk indexes which might need huge amounts of disk space,
  732. depending on archive count and size \- see FAQ about how to reduce).
  733. .TP
  734. .B Network (only for client/server operation):
  735. If your repository is remote, all deduplicated (and optionally compressed/
  736. encrypted) data of course has to go over the connection (\fBssh://\fP repo url).
  737. If you use a locally mounted network filesystem, additionally some copy
  738. operations used for transaction support also go over the connection. If
  739. you backup multiple sources to one target repository, additional traffic
  740. happens for cache resynchronization.
  741. .UNINDENT
  742. .SS Support for file metadata
  743. .sp
  744. Besides regular file and directory structures, Borg can preserve
  745. .INDENT 0.0
  746. .IP \(bu 2
  747. symlinks (stored as symlink, the symlink is not followed)
  748. .IP \(bu 2
  749. special files:
  750. .INDENT 2.0
  751. .IP \(bu 2
  752. character and block device files (restored via mknod)
  753. .IP \(bu 2
  754. FIFOs ("named pipes")
  755. .IP \(bu 2
  756. special file \fIcontents\fP can be backed up in \fB\-\-read\-special\fP mode.
  757. By default the metadata to create them with mknod(2), mkfifo(2) etc. is stored.
  758. .UNINDENT
  759. .IP \(bu 2
  760. hardlinked regular files, devices, symlinks, FIFOs (considering all items in the same archive)
  761. .IP \(bu 2
  762. timestamps in nanosecond precision: mtime, atime, ctime
  763. .IP \(bu 2
  764. other timestamps: birthtime (on platforms supporting it)
  765. .IP \(bu 2
  766. permissions:
  767. .INDENT 2.0
  768. .IP \(bu 2
  769. IDs of owning user and owning group
  770. .IP \(bu 2
  771. names of owning user and owning group (if the IDs can be resolved)
  772. .IP \(bu 2
  773. Unix Mode/Permissions (u/g/o permissions, suid, sgid, sticky)
  774. .UNINDENT
  775. .UNINDENT
  776. .sp
  777. On some platforms additional features are supported:
  778. .\" Yes/No's are grouped by reason/mechanism/reference.
  779. .
  780. .TS
  781. center;
  782. |l|l|l|l|.
  783. _
  784. T{
  785. Platform
  786. T} T{
  787. ACLs
  788. [5]
  789. T} T{
  790. xattr
  791. [6]
  792. T} T{
  793. Flags
  794. [7]
  795. T}
  796. _
  797. T{
  798. Linux
  799. T} T{
  800. Yes
  801. T} T{
  802. Yes
  803. T} T{
  804. Yes [1]
  805. T}
  806. _
  807. T{
  808. Mac OS X
  809. T} T{
  810. Yes
  811. T} T{
  812. Yes
  813. T} T{
  814. Yes (all)
  815. T}
  816. _
  817. T{
  818. FreeBSD
  819. T} T{
  820. Yes
  821. T} T{
  822. Yes
  823. T} T{
  824. Yes (all)
  825. T}
  826. _
  827. T{
  828. OpenBSD
  829. T} T{
  830. n/a
  831. T} T{
  832. n/a
  833. T} T{
  834. Yes (all)
  835. T}
  836. _
  837. T{
  838. NetBSD
  839. T} T{
  840. n/a
  841. T} T{
  842. No [2]
  843. T} T{
  844. Yes (all)
  845. T}
  846. _
  847. T{
  848. Solaris and derivatives
  849. T} T{
  850. No [3]
  851. T} T{
  852. No [3]
  853. T} T{
  854. n/a
  855. T}
  856. _
  857. T{
  858. Windows (cygwin)
  859. T} T{
  860. No [4]
  861. T} T{
  862. No
  863. T} T{
  864. No
  865. T}
  866. _
  867. .TE
  868. .sp
  869. Other Unix\-like operating systems may work as well, but have not been tested at all.
  870. .sp
  871. Note that most of the platform\-dependent features also depend on the file system.
  872. For example, ntfs\-3g on Linux isn\(aqt able to convey NTFS ACLs.
  873. .IP [1] 5
  874. Only "nodump", "immutable", "compressed" and "append" are supported.
  875. Feature request #618 for more flags.
  876. .IP [2] 5
  877. Feature request #1332
  878. .IP [3] 5
  879. Feature request #1337
  880. .IP [4] 5
  881. Cygwin tries to map NTFS ACLs to permissions with varying degrees of success.
  882. .IP [5] 5
  883. The native access control list mechanism of the OS. This normally limits access to
  884. non\-native ACLs. For example, NTFS ACLs aren\(aqt completely accessible on Linux with ntfs\-3g.
  885. .IP [6] 5
  886. extended attributes; key\-value pairs attached to a file, mainly used by the OS.
  887. This includes resource forks on Mac OS X.
  888. .IP [7] 5
  889. aka \fIBSD flags\fP\&. The Linux set of flags [1] is portable across platforms.
  890. The BSDs define additional flags.
  891. .SH SEE ALSO
  892. .sp
  893. \fIborg\-common(1)\fP for common command line options
  894. .sp
  895. \fIborg\-rcreate(1)\fP, \fIborg\-rdelete(1)\fP, \fIborg\-rlist(1)\fP, \fIborg\-rinfo(1)\fP,
  896. \fIborg\-create(1)\fP, \fIborg\-mount(1)\fP, \fIborg\-extract(1)\fP,
  897. \fIborg\-list(1)\fP, \fIborg\-info(1)\fP,
  898. \fIborg\-delete(1)\fP, \fIborg\-prune(1)\fP, \fIborg\-compact(1)\fP,
  899. \fIborg\-recreate(1)\fP
  900. .sp
  901. \fIborg\-compression(1)\fP, \fIborg\-patterns(1)\fP, \fIborg\-placeholders(1)\fP
  902. .INDENT 0.0
  903. .IP \(bu 2
  904. Main web site \fI\%https://www.borgbackup.org/\fP
  905. .IP \(bu 2
  906. Releases \fI\%https://github.com/borgbackup/borg/releases\fP
  907. .IP \(bu 2
  908. Changelog \fI\%https://github.com/borgbackup/borg/blob/master/docs/changes.rst\fP
  909. .IP \(bu 2
  910. GitHub \fI\%https://github.com/borgbackup/borg\fP
  911. .IP \(bu 2
  912. Security contact \fI\%https://borgbackup.readthedocs.io/en/latest/support.html#security\-contact\fP
  913. .UNINDENT
  914. .SH AUTHOR
  915. The Borg Collective
  916. orphan:
  917. .\" Generated by docutils manpage writer.
  918. .