changes.rst 26 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628
  1. .. _important_notes:
  2. Important notes 2.x
  3. ===================
  4. This section provides information about security and corruption issues.
  5. (nothing to see here yet)
  6. .. _upgradenotes2:
  7. Upgrade Notes
  8. =============
  9. borg 1.2.x to borg 2.0
  10. ----------------------
  11. Compatibility notes:
  12. - this is a major "breaking" release that is not compatible with existing repos.
  13. We tried to put all the necessary "breaking" changes into this release, so we
  14. hopefully do not need another breaking release in the near future. The changes
  15. were necessary for improved security, improved speed, unblocking future
  16. improvements, getting rid of legacy crap / design limitations, having less and
  17. simpler code to maintain.
  18. You can use "borg transfer" to transfer archives from borg 1.1/1.2 repos to
  19. a new borg 2.0 repo, but it will need some time and space.
  20. Before using "borg transfer", you must have upgraded to borg >= 1.2.6 (or
  21. another borg version that was patched to fix CVE-2023-CVE-2023-36811) and
  22. you must have followed the upgrade instructions at top of the change log
  23. relating to manifest and archive TAMs (borg2 just requires these TAMs now).
  24. - command line syntax was changed, scripts and wrappers will need changes:
  25. - you will usually either export BORG_REPO=<MYREPO> into your environment or
  26. call borg like: "borg -r <MYREPO> <COMMAND>".
  27. in the docs, we usually omit "-r ..." for brevity.
  28. - the scp-style REPO syntax was removed, please use ssh://..., #6697
  29. - ssh:// URLs: removed support for /~otheruser/, #6855.
  30. If you used this, just replace it by: ssh://user@host:port/home/otheruser/
  31. - -P / --prefix option was removed, please use the similar -a / --match-archives.
  32. - the archive name is always given separately from the repository
  33. (differently than with borg 1.x you must not give repo::archive).
  34. - the archive name is either given as a positional parameter, like:
  35. - borg create myarchive2 /some/path
  36. - borg diff myarchive1 myarchive2
  37. - or, if the command makes sense for an arbitrary amount of archives, archives
  38. can be selected using a glob pattern, like:
  39. - borg delete -a 'sh:myarchive*'
  40. - borg recreate -a 'sh:myarchive*'
  41. - some borg 1.x commands that supported working on a repo AND on an archive
  42. were split into 2 commands, some others were renamed:
  43. - borg 2 repo commands:
  44. - borg rcreate # "repo create", was: borg init
  45. - borg rlist # "repo list"
  46. - borg rinfo # "repo info"
  47. - borg rdelete # "repo delete"
  48. - borg 2 archive commands:
  49. - borg create ARCHIVE ...
  50. - borg list ARCHIVE
  51. - borg extract ARCHIVE ...
  52. - borg diff ARCH1 ARCH2
  53. - borg rename OLDNAME NEWNAME
  54. - borg info -a ARCH_GLOB
  55. - borg delete -a ARCH_GLOB
  56. - borg recreate -a ARCH_GLOB ...
  57. - borg mount -a ARCH_GLOB mountpoint ...
  58. For more details, please consult the docs or --help option output.
  59. - create/recreate/import-tar --timestamp: defaults to local timezone
  60. now (was: UTC)
  61. - some deprecated options were removed:
  62. - removed --remote-ratelimit (use --upload-ratelimit)
  63. - removed --numeric-owner (use --numeric-ids)
  64. - removed --nobsdflags (use --noflags)
  65. - removed --noatime (default now, see also --atime)
  66. - removed --save-space option (does not change behaviour)
  67. - using --list together with --progress is now disallowed (except with --log-json), #7219
  68. - the --glob-archives option was renamed to --match-archives (the short option
  69. name -a is unchanged) and extended to support different pattern styles:
  70. - id: for identical string match (this is the new default!)
  71. - sh: for shell pattern / globbing match (this was used by --glob-archives)
  72. - re: for regular expression match
  73. So you might need to edit your scripts like e.g.::
  74. borg 1.x: --glob-archives 'myserver-*'
  75. borg 2.0: --match-archives 'sh:myserver-*'
  76. - use platformdirs 3.x.x instead of home-grown code. Due to that:
  77. - XDG_*_HOME is not honoured on macOS and on Windows.
  78. - BORG_BASE_DIR can still be used to enforce some base dir + .config/ or .cache/.
  79. - the default macOS config and cache dir will now be in ~/Library/Application Support/borg/.
  80. - create: different included/excluded status chars, #7321
  81. - dry-run: now uses "+" (was: "-") and "-" (was: "x") for included/excluded status
  82. - non-dry-run: now uses "-" (was: "x") for excluded files
  83. Option --filter=... might need an update, if you filter for the status chars
  84. that were changed.
  85. - borg is now more strict and disallows giving some options multiple times -
  86. if that makes no sense. Highlander options, see #6269. That might make scripts
  87. fail now that somehow "worked" before (but maybe didn't work as intended due to
  88. the contradicting options).
  89. .. _changelog:
  90. Change Log 2.x
  91. ==============
  92. Version 2.0.0b7 (2023-09-14)
  93. ----------------------------
  94. Please note:
  95. This is a beta release, only for testing - do not use for production repos.
  96. For upgrade and compatibility hints, please also read the section "Upgrade Notes"
  97. above.
  98. New features:
  99. - BORG_WORKAROUNDS=authenticated_no_key to extract from authenticated repos
  100. without having the borg key, #7700
  101. Fixes:
  102. - archive tam verify security fix, fixes CVE-2023-36811
  103. - remote logging/progress: use callback to send queued records, #7662
  104. - make_path_safe: remove test for backslashes, #7651
  105. - benchmark cpu: use sanitized path, #7654
  106. - create: do not try to read parent dir of recursion root, #7746
  107. Other changes:
  108. - always implicitly require archive TAMs (all archives have TAMs since borg 1.2.6)
  109. - always implicitly require manifest TAMs (manifests have TAMs since borg 1.0.9)
  110. - rlist: remove support for {tam} placeholder, archives are now always TAM-authenticated.
  111. - support / test on Python 3.12
  112. - allow msgpack 1.0.6 (which has py312 wheels), #7810
  113. - manifest: move item_keys into config dict (manifest.version == 2 now), #7710
  114. - replace "datetime.utcfromtimestamp" to avoid deprecation warnings with Python 3.12
  115. - properly normalise paths on Windows (forward slashes, integrate drive letter into path)
  116. - Docs:
  117. - move upgrade / compat. notes to own section, see #7546
  118. - fix borg delete examples, #7759
  119. - improve rcreate / related repos docs
  120. - automated-local.rst: use UUID for consistent udev rule
  121. - rewrite `borg check` docs, #7578
  122. - misc. other docs updates
  123. - Tests / CI / Vagrant:
  124. - major testsuite refactoring: a lot more tests now use pytest, #7626
  125. - freebsd: add some ACL tests, #7745
  126. - fix test_disk_full, #7617
  127. - fix failing test_get_runtime_dir test on OpenBSD, #7719
  128. - CI: run on ubuntu 22.04
  129. - CI: test building the docs
  130. - simplify flake8 config, fix some complaints
  131. - use pyinstaller 5.13.1 to build the borg binaries
  132. Version 2.0.0b6 (2023-06-11)
  133. ----------------------------
  134. New features:
  135. - diff: include changes in ctime and mtime, #7248
  136. - diff: sort JSON output alphabetically
  137. - diff --content-only: option added to ignore metadata changes
  138. - diff: add --format option, #4634
  139. - import-tar --ignore-zeros: new option to support importing concatenated tars, #7432
  140. - debug id-hash / parse-obj / format-obj: new debug commands, #7406
  141. - transfer --compression=C --recompress=M: recompress while transferring, #7529
  142. - extract --continue: continue a previously interrupted extraction, #1356
  143. - prune --list-kept/--list-pruned: only list the kept (or pruned) archives, #7511
  144. - prune --short/--format: enable users to format the list output, #3238
  145. - implement BORG_<CMD>_FORMAT env vars for prune, list, rlist, #5166
  146. - rlist: size and nfiles format keys
  147. - implement unix domain (ipc) socket support, #6183::
  148. borg serve --socket # server side (not started automatically!)
  149. borg -r socket:///path/to/repo ... # client side
  150. - add get_runtime_dir / BORG_RUNTIME_DIR (contains e.g. .sock and .pid file)
  151. - support shell-style alternatives, like: sh:image.{png,jpg}, #7602
  152. Fixes:
  153. - do not retry on permission errors (pointless)
  154. - transfer: verify chunks we get using assert_id, #7383
  155. - fix config/cache dir compatibility issues, #7445
  156. - xattrs: fix namespace processing on FreeBSD, #6997
  157. - ProgressIndicatorPercent: fix space computation for wide chars, #3027
  158. - delete: remove --cache-only option, #7440.
  159. for deleting the cache only, use: borg rdelete --cache-only
  160. - borg debug get-obj/put-obj: fixed chunk id
  161. - create: ignore empty paths, print warning, #5637
  162. - extract: support extraction of atime/mtime on win32
  163. - benchmark crud: use TemporaryDirectory below given path, #4706
  164. - Ensure that cli options specified with action=Highlander can only be set once, even
  165. if the set value is a default value. Add tests for action=Highlander, #7500, #6269.
  166. - Fix argparse error messages from misc. validators (being more specific).
  167. - put security infos into data dir, add BORG_DATA_DIR env var, #5760
  168. - setup.cfg: remove setup_requires (we have a pyproject.toml for that), #7574
  169. - do not crash for empty archives list in borg rlist date based matching, #7522
  170. - sanitize paths during archive creation and extraction, #7108 #7099
  171. - make sure we do not get backslashes into item paths
  172. Other changes:
  173. - allow msgpack 1.0.5 also
  174. - development.lock.txt: upgrade cython to 0.29.35, misc. other upgrades
  175. - clarify platformdirs requirements, #7393.
  176. 3.0.0 is only required for macOS due to breaking changes.
  177. 2.6.0 was the last breaking change for Linux/UNIX.
  178. - mount: improve mountpoint error msgs, see #7496
  179. - more Highlander options, #6269
  180. - Windows: simplify building (just use pip)
  181. - refactor toplevel exception handling, #6018
  182. - remove nonce management, related repo methods (not needed for borg2)
  183. - borg.remote: remove support for borg < 1.1.0
  184. ($LOG, logging setup, exceptions, rpc tuple data format, version)
  185. - new remote and progress logging, #7604
  186. - borg.logger: add logging debugging functionality
  187. - add function to clear empty directories at end of compact process
  188. - unify scanning and listing of segment dirs / segment files, #7597
  189. - replace `LRUCache` internals with `OrderedDict`
  190. - docs:
  191. - add installation instructions for Windows
  192. - improve --one-file-system help and docs (macOS APFS), #5618 #4876
  193. - BORG_KEY_FILE: clarify docs, #7444
  194. - installation: add link to OS dependencies, #7356
  195. - update FAQ about locale/unicode issues, #6999
  196. - improve mount options rendering, #7359
  197. - make timestamps in manual pages reproducible.
  198. - describe performing pull-backups via ssh remote forwarding
  199. - suggest to use forced command when using remote-fowarding via ssh
  200. - fix some -a / --match-archives docs issues
  201. - incl./excl. options header, clarify --path-from-stdin exclusive control
  202. - add note about MAX_DATA_SIZE
  203. - update security support docs
  204. - improve patterns help
  205. - CI / tests / vagrant:
  206. - added pre-commit for linting purposes, #7476
  207. - resolved mode bug and added sleep clause for darwin systems, #7470
  208. - "auto" compressor tests: do not assume zlib is better than lz4, #7363
  209. - add stretch64 VM with deps built from source
  210. - misc. other CI / test fixes and updates
  211. - vagrant: add lunar64 VM, fix packages_netbsd
  212. - avoid long ids in pytest output
  213. - tox: package = editable-legacy, #7580
  214. - tox under fakeroot: fix finding setup_docs, #7391
  215. - check buzhash chunksize distribution, #7586
  216. - use debian/bookworm64 box
  217. Version 2.0.0b5 (2023-02-27)
  218. ----------------------------
  219. New features:
  220. - create: implement retries for individual fs files
  221. (e.g. if a file changed while we read it, if a file had an OSError)
  222. - info: add used storage quota, #7121
  223. - transfer: support --progress
  224. - create/recreate/import-tar: add --checkpoint-volume option
  225. - support date-based matching for archive selection,
  226. add --newer/--older/--newest/--oldest options, #7062 #7296
  227. Fixes:
  228. - disallow --list with --progress, #7219
  229. - create: fix --list --dry-run output for directories, #7209
  230. - do no assume hardlink_master=True if not present, #7175
  231. - fix item_ptrs orphaned chunks of checkpoint archives
  232. - avoid orphan content chunks on BackupOSError, #6709
  233. - transfer: fix bug in obfuscated data upgrade code
  234. - fs.py: fix bug in f-string (thanks mypy!)
  235. - recreate: when --target is given, do not detect "nothing to do", #7254
  236. - locking (win32): deal with os.rmdir/listdir PermissionErrors
  237. - locking: thread id must be parsed as hex from lock file name
  238. - extract: fix mtime when ResourceFork xattr is set (macOS specific), #7234
  239. - recreate: without --chunker-params borg shall not rechunk, #7336
  240. - allow mixing --progress and --list in log-json mode
  241. - add "files changed while reading" to Statistics class, #7354
  242. - fixed keys determination in Statistics.__add__(), #7355
  243. Other changes:
  244. - use local time / local timezone to output timestamps, #7283
  245. - update development.lock.txt, including a setuptools security fix, #7227
  246. - remove --save-space option (does not change behaviour)
  247. - remove part files from final archive
  248. - remove --consider-part-files, related stats code, update docs
  249. - transfer: drop part files
  250. - check: show id of orphaned chunks
  251. - ArchiveItem.cmdline list-of-str -> .command_line str, #7246
  252. - Item: symlinks: rename .source to .target, #7245
  253. - Item: make user/group/uid/gid optional
  254. - create: do not store user/group for stdin data by default, #7249
  255. - extract: chown only if we have u/g info in archived item, #7249
  256. - export-tar: for items w/o uid/gid, default to 0/0, #7249
  257. - fix some uid/gid lookup code / tests for win32
  258. - cache.py: be less verbose during cache sync
  259. - update bash completion script commands and options, #7273
  260. - require and use platformdirs 3.x.x package, tests
  261. - better included/excluded status chars, docs, #7321
  262. - undef NDEBUG for chunker and hashindex (make assert() work)
  263. - assert_id: better be paranoid (add back same crypto code as in old borg), #7362
  264. - check --verify_data: always decompress and call assert_id(), #7362
  265. - make hashindex_compact simpler and probably faster, minor fixes, cleanups, more tests
  266. - hashindex minor fixes, refactor, tweaks, tests
  267. - pyinstaller: remove icon
  268. - validation / placeholders / JSON:
  269. - implement (text|binary)_to_json: key (text), key_b64 (base64(binary))
  270. - remove bpath, barchive, bcomment placeholders / JSON keys
  271. - archive metadata: make sure hostname and username have no surrogate escapes
  272. - text attributes (like archive name, comment): validate more strictly, #2290
  273. - transfer: validate archive names and comment before transfer
  274. - json output: use text_to_json (path, target), #6151
  275. - docs:
  276. - docs and comments consistency, readability and spelling fixes
  277. - fix --progress display description, #7180
  278. - document how borg deals with non-unicode bytes in JSON output
  279. - document another way to get UTF-8 encoding on stdin/stdout/stderr, #2273
  280. - pruning interprets timestamps in the local timezone where borg prune runs
  281. - shellpattern: add license, use copyright/license markup
  282. - key change-passphrase: fix --encryption value in examples
  283. - remove BORG_LIBB2_PREFIX (not used any more)
  284. - Installation: Update Fedora in distribution list, #7357
  285. - add .readthedocs.yaml (use py311, use non-shallow clone)
  286. - tests:
  287. - fix archiver tests on Windows, add running the tests to Windows CI
  288. - fix tox4 passenv issue, #7199
  289. - github actions updates (fix deprecation warnings)
  290. - add tests for borg transfer/upgrade
  291. - fix test hanging reading FIFO when `borg create` failed
  292. - mypy inspired fixes / updates
  293. - fix prune tests, prune in localtime
  294. - do not look up uid 0 / gid 0, but current process uid/gid
  295. - safe_unlink tests: use os.link to support win32 also
  296. - fix test_size_on_disk_accurate for large st_blksize, #7250
  297. - relaxed timestamp comparisons, use same_ts_ns
  298. - add test for extracted directory mtime
  299. - use "fail" chunker to test erroneous input file skipping
  300. Version 2.0.0b4 (2022-11-27)
  301. ----------------------------
  302. Fixes:
  303. - transfer/upgrade: fix borg < 1.2 chunker_params, #7079
  304. - transfer/upgrade: do not access Item._dict, #7077
  305. - transfer/upgrade: fix crash in borg transfer, #7156
  306. - archive.save(): always use metadata from stats, #7072
  307. - benchmark: fixed TypeError in compression benchmarks, #7075
  308. - fix repository.scan api minimum requirement
  309. - fix args.paths related argparsing, #6994
  310. Other changes:
  311. - tar_filter: recognize .tar.zst as zstd, #7093
  312. - adding performance statistics to borg create, #6991
  313. - docs: add rcompress to usage index
  314. - tests:
  315. - use github and MSYS2 for Windows CI, #7097
  316. - win32 and cygwin: test fixes / skip hanging test
  317. - vagrant / github CI: use python 3.11.0 / 3.10.8
  318. - vagrant:
  319. - upgrade pyinstaller to 5.6.2 (supports python 3.11)
  320. - use python 3.11 to build the borg binary
  321. Version 2.0.0b3 (2022-10-02)
  322. ----------------------------
  323. Fixes:
  324. - transfer: fix user/group == None crash with borg1 archives
  325. - compressors: avoid memoryview related TypeError
  326. - check: fix uninitialised variable if repo is completely empty, #7034
  327. - do not use version_tuple placeholder in setuptools_scm template, #7024
  328. - get_chunker: fix missing sparse=False argument, #7056
  329. New features:
  330. - rcompress: do a repo-wide (re)compression, #7037
  331. - implement pattern support for --match-archives, #6504
  332. - BORG_LOCK_WAIT=n env var to set default for --lock-wait option, #5279
  333. Other:
  334. - repository.scan: misc. fixes / improvements
  335. - metadata: differentiate between empty/zero and unknown, #6908
  336. - CI: test pyfuse3 with python 3.11
  337. - use more relative imports
  338. - make borg.testsuite.archiver a package, split archiver tests into many modules
  339. - support reading new, improved hashindex header format, #6960.
  340. added version number and num_empty to the HashHeader, fixed alignment.
  341. - vagrant: upgrade pyinstaller 4.10 -> 5.4.1, use python 3.9.14 for binary build
  342. - item.pyx: use more Cython (faster, uses less memory), #5763
  343. Version 2.0.0b2 (2022-09-10)
  344. ----------------------------
  345. Bug fixes:
  346. - xattrs / extended stat: improve exception handling, #6988
  347. - fix and refactor replace_placeholders, #6966
  348. New features:
  349. - support archive timestamps with utc offsets, adapt them when using
  350. borg transfer to transfer from borg 1.x repos (append +00:00 for UTC).
  351. - create/recreate/import-tar --timestamp: accept giving timezone via
  352. its utc offset. defaults to local timezone, if no utc offset is given.
  353. Other changes:
  354. - chunks: have separate encrypted metadata (ctype, clevel, csize, size)
  355. chunk = enc_meta_len16 + encrypted(msgpacked(meta)) + encrypted(compressed(data)).
  356. this breaks repo format compatibility, you need to create fresh repos!
  357. - repository api: flags support, #6982
  358. - OpenBSD only - statically link OpenSSL, #6474.
  359. Avoid conflicting with shared libcrypto from the base OS pulled in via dependencies.
  360. - restructured source code
  361. - update diagrams to odg format, #6928
  362. Version 2.0.0b1 (2022-08-08)
  363. ----------------------------
  364. New features:
  365. - massively increase archive metadata stream size limit, #1473.
  366. currently rather testing the code, scalability will improve later, see #6945.
  367. - rcreate --copy-crypt-key: copy crypt_key from key of other repo, #6710.
  368. default: create new, random authenticated encryption key.
  369. - prune/delete --checkpoint-interval=1800 and ctrl-c/SIGINT support, #6284
  370. Fixes:
  371. - ctrl-c must not kill important subprocesses, #6912
  372. - transfer: check whether ID hash method and chunker secret are same.
  373. add PlaintextKey and AuthenticatedKey support to uses_same_id_hash function.
  374. - check: try harder to create the key, #5719
  375. - SaveFile: use a custom mkstemp with mode support, #6933, #6400
  376. - make setuptools happy, #6874
  377. - fix misc. compiler warnings
  378. - list: fix {flags:<WIDTH>} formatting, #6081
  379. Other changes:
  380. - new crypto does not need to call ._assert_id(), update code and docs.
  381. https://github.com/borgbackup/borg/pull/6463#discussion_r925436156
  382. - check: --verify-data does not need to decompress with new crypto modes
  383. - Key: crypt_key instead of enc_key + enc_hmac_key, #6611
  384. - misc. docs updates and improvements
  385. - CI: test on macOS 12 without fuse / fuse tests
  386. - repository: add debug logging for issue #6687
  387. - _version.py: remove trailing blank, add LF at EOF (make pep8 checker happy)
  388. Version 2.0.0a4 (2022-07-17)
  389. ----------------------------
  390. New features:
  391. - recreate: consider level for recompression, #6698, #3622
  392. Other changes:
  393. - stop using libdeflate
  394. - CI: add mypy (if we add type hints, it can do type checking)
  395. - big changes to the source code:
  396. - split up archiver module, transform it into a package
  397. - use Black for automated code formatting
  398. - remove some legacy code
  399. - adapt/fix code for mypy
  400. - use language_level = 3str for cython (this will be the default in cython 3)
  401. - docs: document HardLinkManager and hlid, #2388
  402. Version 2.0.0a3 (2022-07-04)
  403. ----------------------------
  404. Fixes:
  405. - check repo version, accept old repos only for --other-repo (e.g. rcreate/transfer).
  406. v2 is the default repo version for borg 2.0. v1 repos must only be used in a
  407. read-only way, e.g. for --other-repo=V1_REPO with borg init and borg transfer!
  408. New features:
  409. - transfer: --upgrader=NoOp is the default.
  410. This is to support general-purpose transfer of archives between related borg2
  411. repos.
  412. - transfer: --upgrader=From12To20 must be used to transfer (and convert) archives
  413. from borg 1.2 repos to borg 2.0 repos.
  414. Other changes:
  415. - removed some deprecated options
  416. - removed -P (aka --prefix) option, #6806. The option -a (aka --glob-archives)
  417. can be used for same purpose and is more powerful, e.g.: -a 'PREFIX*'
  418. - rcreate: always use argon2 kdf for new repos, #6820
  419. - rcreate: remove legacy encryption modes for new repos, #6490
  420. Version 2.0.0a2 (2022-06-26)
  421. ----------------------------
  422. Changes:
  423. - split repo and archive name into separate args, #948
  424. - use -r or --repo or BORG_REPO env var to give the repository
  425. - use --other-repo or BORG_OTHER_REPO to give another repo (e.g. borg transfer)
  426. - use positional argument for archive name or `-a ARCH_GLOB`
  427. - remove support for scp-style repo specification, use ssh://...
  428. - simplify stats output: repo ops -> repo stats, archive ops -> archive stats
  429. - repository index: add payload size (==csize) and flags to NSIndex entries
  430. - repository index: set/query flags, iteration over flagged items (NSIndex)
  431. - repository: sync write file in get_fd
  432. - stats: deduplicated size now, was deduplicated compressed size in borg 1.x
  433. - remove csize support at most places in the code (chunks index, stats, get_size,
  434. Item.chunks)
  435. - replace problematic/ugly hardlink_master approach of borg 1.x by:
  436. - symmetric hlid (all hardlinks pointing to same inode have same hlid)
  437. - all archived hardlinked regular files have a chunks list
  438. - borg rcreate --other-repo=OTHER_REPO: reuse key material from OTHER_REPO, #6554.
  439. This is useful if you want to use borg transfer to transfer archives from an
  440. existing borg 1.1/1.2 repo. If the chunker secret and the id key and algorithm
  441. stay the same, the deduplication will also work between past and future backups.
  442. - borg transfer:
  443. - efficiently copy archives from a borg 1.1/1.2 repo to a new repo.
  444. uses deduplication and does not decompress/recompress file content data.
  445. - does some cleanups / fixes / conversions:
  446. - disallow None value for .user/group/chunks/chunks_healthy
  447. - cleanup msgpack related str/bytes mess, use new msgpack spec, #968
  448. - obfuscation: fix byte order for size, #6701
  449. - compression: use the 2 bytes for type and level, #6698
  450. - use version 2 for new archives
  451. - convert timestamps int/bigint -> msgpack.Timestamp, see #2323
  452. - all hardlinks have chunks, maybe chunks_healthy, hlid
  453. - remove the zlib type bytes hack
  454. - make sure items with chunks have precomputed size
  455. - removes the csize element from the tuples in the Item.chunks list
  456. - clean item of attic 0.13 'acl' bug remnants
  457. - crypto: see 1.3.0a1 log entry
  458. - removed "borg upgrade" command (not needed any more)
  459. - compact: removed --cleanup-commits option
  460. - docs: fixed quickstart and usage docs with new cli command syntax
  461. - docs: removed the parts talking about potential AES-CTR mode issues
  462. (we will not use that any more).
  463. Version 1.3.0a1 (2022-04-15)
  464. ----------------------------
  465. Although this was released as 1.3.0a1, it can be also seen as 2.0.0a1 as it was
  466. later decided to do breaking changes and thus the major release number had to
  467. be increased (thus, there will not be a 1.3.0 release, but 2.0.0).
  468. New features:
  469. - init: new --encryption=(repokey|keyfile)-[blake2-](aes-ocb|chacha20-poly1305)
  470. - New, better, faster crypto (see encryption-aead diagram in the docs), #6463.
  471. - New AEAD cipher suites: AES-OCB and CHACHA20-POLY1305.
  472. - Session keys are derived via HKDF from random session id and master key.
  473. - Nonces/MessageIVs are counters starting from 0 for each session.
  474. - AAD: chunk id, key type, messageIV, sessionID are now authenticated also.
  475. - Solves the potential AES-CTR mode counter management issues of the legacy crypto.
  476. - init: --key-algorithm=argon2 (new default KDF, older pbkdf2 also still available)
  477. borg key change-passphrase / change-location keeps the key algorithm unchanged.
  478. - key change-algorithm: to upgrade existing keys to argon2 or downgrade to pbkdf2.
  479. We recommend you to upgrade unless you have to keep the key compatible with older versions of borg.
  480. - key change-location: usable for repokey <-> keyfile location change
  481. - benchmark cpu: display benchmarks of cpu bound stuff
  482. - export-tar: new --tar-format=PAX (default: GNU)
  483. - import-tar/export-tar: can use PAX format for ctime and atime support
  484. - import-tar/export-tar: --tar-format=BORG: roundtrip ALL item metadata, #5830
  485. - repository: create and use version 2 repos only for now
  486. - repository: implement PUT2: header crc32, overall xxh64, #1704
  487. Other changes:
  488. - require python >= 3.9, #6315
  489. - simplify libs setup, #6482
  490. - unbundle most bundled 3rd party code, use libs, #6316
  491. - use libdeflate.crc32 (Linux and all others) or zlib.crc32 (macOS)
  492. - repository: code cleanups / simplifications
  493. - internal crypto api: speedups / cleanups / refactorings / modernisation
  494. - remove "borg upgrade" support for "attic backup" repos
  495. - remove PassphraseKey code and borg key migrate-to-repokey command
  496. - OpenBSD: build borg with OpenSSL (not: LibreSSL), #6474
  497. - remove support for LibreSSL, #6474
  498. - remove support for OpenSSL < 1.1.1