changes.rst 34 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853
  1. Changelog
  2. =========
  3. Version 0.30.2 (not released yet)
  4. ---------------------------------
  5. Bug fixes:
  6. - fix silently ignoring I/O errors
  7. - file stats are packed with 'int_to_bigint' in the archive. Unpack these
  8. before passing to llfuse.
  9. - do not sleep for >60s while waiting for lock, #773
  10. Version 0.30.1
  11. --------------
  12. Compatibility / maintenance notes:
  13. - Python 3.2 is dead and everybody is dropping support for it.
  14. Python 3.3 is rather old and not feeling too well either.
  15. - Thus, 0.30.x is the last borgbackup version that is compatible with python
  16. 3.2 and 3.3, all 1.x.x releases require python 3.4 or 3.5.
  17. - 1.0.0rc1 is already released, use that (and later 1.x.x), if possible.
  18. - 0.30.x releases will get a few critical fixes, so you can use them for
  19. a while, but do not expect 0.30.x to be maintained for a long time.
  20. Neither will any new features be added in 0.30.x.
  21. Nor will any minor/cosmetic bugs be fixed in 0.30.x.
  22. - There will be no binary releases for 0.30.x - just use the 1.x.x releases
  23. if you want a binary.
  24. - The 1.x.x binaries include python 3.5, so using them might be an option for
  25. older systems that do not have python >= 3.4.
  26. - Alternatively, you can always install python 3.4 or 3.5 to /usr/local/bin
  27. (make altinstall) without causing issues/conflicts with your system python.
  28. Bug fixes:
  29. - silently skips disk I/O errors, includes truncated files into archive, #748
  30. - seeking to an invalid position is an IOError in python 3.2, #621
  31. - Cache: fix exception handling in __init__, release lock, #610
  32. Other changes:
  33. - allow llfuse version 0.41.x, #642
  34. - document and automate llfuse requirement (setup.py / requirements.d/fuse.txt)
  35. - require msgpack==0.4.6 - no python 3.2 support in 0.4.7+
  36. Missing in 0.30.0 change log:
  37. - Vagrantfile: avoid pkg-config missing error msg on netbsd
  38. - add chunks.archive.d trick to FAQ
  39. - Vagrantfile: remove python 3.2, use older pip/venv for trusty
  40. pyenv installs latest virtualenv/pip that is not compatible with py 3.2 any more
  41. Version 0.30.0
  42. --------------
  43. Compatibility notes:
  44. - you may need to use -v (or --info) more often to actually see output emitted
  45. at INFO log level (because it is suppressed at the default WARNING log level).
  46. See the "general" section in the usage docs.
  47. - for borg create, you need --list (additionally to -v) to see the long file
  48. list (was needed so you can have e.g. --stats alone without the long list)
  49. - see below about BORG_DELETE_I_KNOW_WHAT_I_AM_DOING (was:
  50. BORG_CHECK_I_KNOW_WHAT_I_AM_DOING)
  51. Bug fixes:
  52. - fix crash when using borg create --dry-run --keep-tag-files, #570
  53. - make sure teardown with cleanup happens for Cache and RepositoryCache,
  54. avoiding leftover locks and TEMP dir contents, #285 (partially), #548
  55. - fix locking KeyError, partial fix for #502
  56. - log stats consistently, #526
  57. - add abbreviated weekday to timestamp format, fixes #496
  58. - strip whitespace when loading exclusions from file
  59. - unset LD_LIBRARY_PATH before invoking ssh, fixes strange OpenSSL library
  60. version warning when using the borg binary, #514
  61. - add some error handling/fallback for C library loading, #494
  62. - added BORG_DELETE_I_KNOW_WHAT_I_AM_DOING for check in "borg delete", #503
  63. - remove unused "repair" rpc method name
  64. New features:
  65. - borg create: implement exclusions using regular expression patterns.
  66. - borg create: implement inclusions using patterns.
  67. - borg extract: support patterns, #361
  68. - support different styles for patterns:
  69. - fnmatch (`fm:` prefix, default when omitted), like borg <= 0.29.
  70. - shell (`sh:` prefix) with `*` not matching directory separators and
  71. `**/` matching 0..n directories
  72. - path prefix (`pp:` prefix, for unifying borg create pp1 pp2 into the
  73. patterns system), semantics like in borg <= 0.29
  74. - regular expression (`re:`), new!
  75. - --progress option for borg upgrade (#291) and borg delete <archive>
  76. - update progress indication more often (e.g. for borg create within big
  77. files or for borg check repo), #500
  78. - finer chunker granularity for items metadata stream, #547, #487
  79. - borg create --list now used (additionally to -v) to enable the verbose
  80. file list output
  81. - display borg version below tracebacks, #532
  82. Other changes:
  83. - hashtable size (and thus: RAM and disk consumption) follows a growth policy:
  84. grows fast while small, grows slower when getting bigger, #527
  85. - Vagrantfile: use pyinstaller 3.1 to build binaries, freebsd sqlite3 fix,
  86. fixes #569
  87. - no separate binaries for centos6 any more because the generic linux binaries
  88. also work on centos6 (or in general: on systems with a slightly older glibc
  89. than debian7
  90. - dev environment: require virtualenv<14.0 so we get a py32 compatible pip
  91. - docs:
  92. - add space-saving chunks.archive.d trick to FAQ
  93. - important: clarify -v and log levels in usage -> general, please read!
  94. - sphinx configuration: create a simple man page from usage docs
  95. - add a repo server setup example
  96. - disable unneeded SSH features in authorized_keys examples for security.
  97. - borg prune only knows "--keep-within" and not "--within"
  98. - add gource video to resources docs, #507
  99. - add netbsd install instructions
  100. - authors: make it more clear what refers to borg and what to attic
  101. - document standalone binary requirements, #499
  102. - rephrase the mailing list section
  103. - development docs: run build_api and build_usage before tagging release
  104. - internals docs: hash table max. load factor is 0.75 now
  105. - markup, typo, grammar, phrasing, clarifications and other fixes.
  106. - add gcc gcc-c++ to redhat/fedora/corora install docs, fixes #583
  107. Version 0.29.0
  108. --------------
  109. Compatibility notes:
  110. - when upgrading to 0.29.0 you need to upgrade client as well as server
  111. installations due to the locking and commandline interface changes otherwise
  112. you'll get an error msg about a RPC protocol mismatch or a wrong commandline
  113. option.
  114. if you run a server that needs to support both old and new clients, it is
  115. suggested that you have a "borg-0.28.2" and a "borg-0.29.0" command.
  116. clients then can choose via e.g. "borg --remote-path=borg-0.29.0 ...".
  117. - the default waiting time for a lock changed from infinity to 1 second for a
  118. better interactive user experience. if the repo you want to access is
  119. currently locked, borg will now terminate after 1s with an error message.
  120. if you have scripts that shall wait for the lock for a longer time, use
  121. --lock-wait N (with N being the maximum wait time in seconds).
  122. Bug fixes:
  123. - hash table tuning (better chosen hashtable load factor 0.75 and prime initial
  124. size of 1031 gave ~1000x speedup in some scenarios)
  125. - avoid creation of an orphan lock for one case, #285
  126. - --keep-tag-files: fix file mode and multiple tag files in one directory, #432
  127. - fixes for "borg upgrade" (attic repo converter), #466
  128. - remove --progress isatty magic (and also --no-progress option) again, #476
  129. - borg init: display proper repo URL
  130. - fix format of umask in help pages, #463
  131. New features:
  132. - implement --lock-wait, support timeout for UpgradableLock, #210
  133. - implement borg break-lock command, #157
  134. - include system info below traceback, #324
  135. - sane remote logging, remote stderr, #461:
  136. - remote log output: intercept it and log it via local logging system,
  137. with "Remote: " prefixed to message. log remote tracebacks.
  138. - remote stderr: output it to local stderr with "Remote: " prefixed.
  139. - add --debug and --info (same as --verbose) to set the log level of the
  140. builtin logging configuration (which otherwise defaults to warning), #426
  141. note: there are few messages emitted at DEBUG level currently.
  142. - optionally configure logging via env var BORG_LOGGING_CONF
  143. - add --filter option for status characters: e.g. to show only the added
  144. or modified files (and also errors), use "borg create -v --filter=AME ...".
  145. - more progress indicators, #394
  146. - use ISO-8601 date and time format, #375
  147. - "borg check --prefix" to restrict archive checking to that name prefix, #206
  148. Other changes:
  149. - hashindex_add C implementation (speed up cache re-sync for new archives)
  150. - increase FUSE read_size to 1024 (speed up metadata operations)
  151. - check/delete/prune --save-space: free unused segments quickly, #239
  152. - increase rpc protocol version to 2 (see also Compatibility notes), #458
  153. - silence borg by default (via default log level WARNING)
  154. - get rid of C compiler warnings, #391
  155. - upgrade OS X FUSE to 3.0.9 on the OS X binary build system
  156. - use python 3.5.1 to build binaries
  157. - docs:
  158. - new mailing list borgbackup@python.org, #468
  159. - readthedocs: color and logo improvements
  160. - load coverage icons over SSL (avoids mixed content)
  161. - more precise binary installation steps
  162. - update release procedure docs about OS X FUSE
  163. - FAQ entry about unexpected 'A' status for unchanged file(s), #403
  164. - add docs about 'E' file status
  165. - add "borg upgrade" docs, #464
  166. - add developer docs about output and logging
  167. - clarify encryption, add note about client-side encryption
  168. - add resources section, with videos, talks, presentations, #149
  169. - Borg moved to Arch Linux [community]
  170. - fix wrong installation instructions for archlinux
  171. Version 0.28.2
  172. --------------
  173. New features:
  174. - borg create --exclude-if-present TAGFILE - exclude directories that have the
  175. given file from the backup. You can additionally give --keep-tag-files to
  176. preserve just the directory roots and the tag-files (but not backup other
  177. directory contents), #395, attic #128, attic #142
  178. Other changes:
  179. - do not create docs sources at build time (just have them in the repo),
  180. completely remove have_cython() hack, do not use the "mock" library at build
  181. time, #384
  182. - avoid hidden import, make it easier for PyInstaller, easier fix for #218
  183. - docs:
  184. - add description of item flags / status output, fixes #402
  185. - explain how to regenerate usage and API files (build_api or
  186. build_usage) and when to commit usage files directly into git, #384
  187. - minor install docs improvements
  188. Version 0.28.1
  189. --------------
  190. Bug fixes:
  191. - do not try to build api / usage docs for production install,
  192. fixes unexpected "mock" build dependency, #384
  193. Other changes:
  194. - avoid using msgpack.packb at import time
  195. - fix formatting issue in changes.rst
  196. - fix build on readthedocs
  197. Version 0.28.0
  198. --------------
  199. Compatibility notes:
  200. - changed return codes (exit codes), see docs. in short:
  201. old: 0 = ok, 1 = error. now: 0 = ok, 1 = warning, 2 = error
  202. New features:
  203. - refactor return codes (exit codes), fixes #61
  204. - add --show-rc option enable "terminating with X status, rc N" output, fixes 58, #351
  205. - borg create backups atime and ctime additionally to mtime, fixes #317
  206. - extract: support atime additionally to mtime
  207. - FUSE: support ctime and atime additionally to mtime
  208. - support borg --version
  209. - emit a warning if we have a slow msgpack installed
  210. - borg list --prefix=thishostname- REPO, fixes #205
  211. - Debug commands (do not use except if you know what you do: debug-get-obj,
  212. debug-put-obj, debug-delete-obj, debug-dump-archive-items.
  213. Bug fixes:
  214. - setup.py: fix bug related to BORG_LZ4_PREFIX processing
  215. - fix "check" for repos that have incomplete chunks, fixes #364
  216. - borg mount: fix unlocking of repository at umount time, fixes #331
  217. - fix reading files without touching their atime, #334
  218. - non-ascii ACL fixes for Linux, FreeBSD and OS X, #277
  219. - fix acl_use_local_uid_gid() and add a test for it, attic #359
  220. - borg upgrade: do not upgrade repositories in place by default, #299
  221. - fix cascading failure with the index conversion code, #269
  222. - borg check: implement 'cmdline' archive metadata value decoding, #311
  223. - fix RobustUnpacker, it missed some metadata keys (new atime and ctime keys
  224. were missing, but also bsdflags). add check for unknown metadata keys.
  225. - create from stdin: also save atime, ctime (cosmetic)
  226. - use default_notty=False for confirmations, fixes #345
  227. - vagrant: fix msgpack installation on centos, fixes #342
  228. - deal with unicode errors for symlinks in same way as for regular files and
  229. have a helpful warning message about how to fix wrong locale setup, fixes #382
  230. - add ACL keys the RobustUnpacker must know about
  231. Other changes:
  232. - improve file size displays, more flexible size formatters
  233. - explicitly commit to the units standard, #289
  234. - archiver: add E status (means that an error occurred when processing this
  235. (single) item
  236. - do binary releases via "github releases", closes #214
  237. - create: use -x and --one-file-system (was: --do-not-cross-mountpoints), #296
  238. - a lot of changes related to using "logging" module and screen output, #233
  239. - show progress display if on a tty, output more progress information, #303
  240. - factor out status output so it is consistent, fix surrogates removal,
  241. maybe fixes #309
  242. - move away from RawConfigParser to ConfigParser
  243. - archive checker: better error logging, give chunk_id and sequence numbers
  244. (can be used together with borg debug-dump-archive-items).
  245. - do not mention the deprecated passphrase mode
  246. - emit a deprecation warning for --compression N (giving a just a number)
  247. - misc .coverragerc fixes (and coverage measurement improvements), fixes #319
  248. - refactor confirmation code, reduce code duplication, add tests
  249. - prettier error messages, fixes #307, #57
  250. - tests:
  251. - add a test to find disk-full issues, #327
  252. - travis: also run tests on Python 3.5
  253. - travis: use tox -r so it rebuilds the tox environments
  254. - test the generated pyinstaller-based binary by archiver unit tests, #215
  255. - vagrant: tests: announce whether fakeroot is used or not
  256. - vagrant: add vagrant user to fuse group for debianoid systems also
  257. - vagrant: llfuse install on darwin needs pkgconfig installed
  258. - vagrant: use pyinstaller from develop branch, fixes #336
  259. - benchmarks: test create, extract, list, delete, info, check, help, fixes #146
  260. - benchmarks: test with both the binary and the python code
  261. - archiver tests: test with both the binary and the python code, fixes #215
  262. - make basic test more robust
  263. - docs:
  264. - moved docs to borgbackup.readthedocs.org, #155
  265. - a lot of fixes and improvements, use mobile-friendly RTD standard theme
  266. - use zlib,6 compression in some examples, fixes #275
  267. - add missing rename usage to docs, closes #279
  268. - include the help offered by borg help <topic> in the usage docs, fixes #293
  269. - include a list of major changes compared to attic into README, fixes #224
  270. - add OS X install instructions, #197
  271. - more details about the release process, #260
  272. - fix linux glibc requirement (binaries built on debian7 now)
  273. - build: move usage and API generation to setup.py
  274. - update docs about return codes, #61
  275. - remove api docs (too much breakage on rtd)
  276. - borgbackup install + basics presentation (asciinema)
  277. - describe the current style guide in documentation
  278. - add section about debug commands
  279. - warn about not running out of space
  280. - add example for rename
  281. - improve chunker params docs, fixes #362
  282. - minor development docs update
  283. Version 0.27.0
  284. --------------
  285. New features:
  286. - "borg upgrade" command - attic -> borg one time converter / migration, #21
  287. - temporary hack to avoid using lots of disk space for chunks.archive.d, #235:
  288. To use it: rm -rf chunks.archive.d ; touch chunks.archive.d
  289. - respect XDG_CACHE_HOME, attic #181
  290. - add support for arbitrary SSH commands, attic #99
  291. - borg delete --cache-only REPO (only delete cache, not REPO), attic #123
  292. Bug fixes:
  293. - use Debian 7 (wheezy) to build pyinstaller borgbackup binaries, fixes slow
  294. down observed when running the Centos6-built binary on Ubuntu, #222
  295. - do not crash on empty lock.roster, fixes #232
  296. - fix multiple issues with the cache config version check, #234
  297. - fix segment entry header size check, attic #352
  298. plus other error handling improvements / code deduplication there.
  299. - always give segment and offset in repo IntegrityErrors
  300. Other changes:
  301. - stop producing binary wheels, remove docs about it, #147
  302. - docs:
  303. - add warning about prune
  304. - generate usage include files only as needed
  305. - development docs: add Vagrant section
  306. - update / improve / reformat FAQ
  307. - hint to single-file pyinstaller binaries from README
  308. Version 0.26.1
  309. --------------
  310. This is a minor update, just docs and new pyinstaller binaries.
  311. - docs update about python and binary requirements
  312. - better docs for --read-special, fix #220
  313. - re-built the binaries, fix #218 and #213 (glibc version issue)
  314. - update web site about single-file pyinstaller binaries
  315. Note: if you did a python-based installation, there is no need to upgrade.
  316. Version 0.26.0
  317. --------------
  318. New features:
  319. - Faster cache sync (do all in one pass, remove tar/compression stuff), #163
  320. - BORG_REPO env var to specify the default repo, #168
  321. - read special files as if they were regular files, #79
  322. - implement borg create --dry-run, attic issue #267
  323. - Normalize paths before pattern matching on OS X, #143
  324. - support OpenBSD and NetBSD (except xattrs/ACLs)
  325. - support / run tests on Python 3.5
  326. Bug fixes:
  327. - borg mount repo: use absolute path, attic #200, attic #137
  328. - chunker: use off_t to get 64bit on 32bit platform, #178
  329. - initialize chunker fd to -1, so it's not equal to STDIN_FILENO (0)
  330. - fix reaction to "no" answer at delete repo prompt, #182
  331. - setup.py: detect lz4.h header file location
  332. - to support python < 3.2.4, add less buggy argparse lib from 3.2.6 (#194)
  333. - fix for obtaining ``char *`` from temporary Python value (old code causes
  334. a compile error on Mint 17.2)
  335. - llfuse 0.41 install troubles on some platforms, require < 0.41
  336. (UnicodeDecodeError exception due to non-ascii llfuse setup.py)
  337. - cython code: add some int types to get rid of unspecific python add /
  338. subtract operations (avoid ``undefined symbol FPE_``... error on some platforms)
  339. - fix verbose mode display of stdin backup
  340. - extract: warn if a include pattern never matched, fixes #209,
  341. implement counters for Include/ExcludePatterns
  342. - archive names with slashes are invalid, attic issue #180
  343. - chunker: add a check whether the POSIX_FADV_DONTNEED constant is defined -
  344. fixes building on OpenBSD.
  345. Other changes:
  346. - detect inconsistency / corruption / hash collision, #170
  347. - replace versioneer with setuptools_scm, #106
  348. - docs:
  349. - pkg-config is needed for llfuse installation
  350. - be more clear about pruning, attic issue #132
  351. - unit tests:
  352. - xattr: ignore security.selinux attribute showing up
  353. - ext3 seems to need a bit more space for a sparse file
  354. - do not test lzma level 9 compression (avoid MemoryError)
  355. - work around strange mtime granularity issue on netbsd, fixes #204
  356. - ignore st_rdev if file is not a block/char device, fixes #203
  357. - stay away from the setgid and sticky mode bits
  358. - use Vagrant to do easy cross-platform testing (#196), currently:
  359. - Debian 7 "wheezy" 32bit, Debian 8 "jessie" 64bit
  360. - Ubuntu 12.04 32bit, Ubuntu 14.04 64bit
  361. - Centos 7 64bit
  362. - FreeBSD 10.2 64bit
  363. - OpenBSD 5.7 64bit
  364. - NetBSD 6.1.5 64bit
  365. - Darwin (OS X Yosemite)
  366. Version 0.25.0
  367. --------------
  368. Compatibility notes:
  369. - lz4 compression library (liblz4) is a new requirement (#156)
  370. - the new compression code is very compatible: as long as you stay with zlib
  371. compression, older borg releases will still be able to read data from a
  372. repo/archive made with the new code (note: this is not the case for the
  373. default "none" compression, use "zlib,0" if you want a "no compression" mode
  374. that can be read by older borg). Also the new code is able to read repos and
  375. archives made with older borg versions (for all zlib levels 0..9).
  376. Deprecations:
  377. - --compression N (with N being a number, as in 0.24) is deprecated.
  378. We keep the --compression 0..9 for now to not break scripts, but it is
  379. deprecated and will be removed later, so better fix your scripts now:
  380. --compression 0 (as in 0.24) is the same as --compression zlib,0 (now).
  381. BUT: if you do not want compression, you rather want --compression none
  382. (which is the default).
  383. --compression 1 (in 0.24) is the same as --compression zlib,1 (now)
  384. --compression 9 (in 0.24) is the same as --compression zlib,9 (now)
  385. New features:
  386. - create --compression none (default, means: do not compress, just pass through
  387. data "as is". this is more efficient than zlib level 0 as used in borg 0.24)
  388. - create --compression lz4 (super-fast, but not very high compression)
  389. - create --compression zlib,N (slower, higher compression, default for N is 6)
  390. - create --compression lzma,N (slowest, highest compression, default N is 6)
  391. - honor the nodump flag (UF_NODUMP) and do not backup such items
  392. - list --short just outputs a simple list of the files/directories in an archive
  393. Bug fixes:
  394. - fixed --chunker-params parameter order confusion / malfunction, fixes #154
  395. - close fds of segments we delete (during compaction)
  396. - close files which fell out the lrucache
  397. - fadvise DONTNEED now is only called for the byte range actually read, not for
  398. the whole file, fixes #158.
  399. - fix issue with negative "all archives" size, fixes #165
  400. - restore_xattrs: ignore if setxattr fails with EACCES, fixes #162
  401. Other changes:
  402. - remove fakeroot requirement for tests, tests run faster without fakeroot
  403. (test setup does not fail any more without fakeroot, so you can run with or
  404. without fakeroot), fixes #151 and #91.
  405. - more tests for archiver
  406. - recover_segment(): don't assume we have an fd for segment
  407. - lrucache refactoring / cleanup, add dispose function, py.test tests
  408. - generalize hashindex code for any key length (less hardcoding)
  409. - lock roster: catch file not found in remove() method and ignore it
  410. - travis CI: use requirements file
  411. - improved docs:
  412. - replace hack for llfuse with proper solution (install libfuse-dev)
  413. - update docs about compression
  414. - update development docs about fakeroot
  415. - internals: add some words about lock files / locking system
  416. - support: mention BountySource and for what it can be used
  417. - theme: use a lighter green
  418. - add pypi, wheel, dist package based install docs
  419. - split install docs into system-specific preparations and generic instructions
  420. Version 0.24.0
  421. --------------
  422. Incompatible changes (compared to 0.23):
  423. - borg now always issues --umask NNN option when invoking another borg via ssh
  424. on the repository server. By that, it's making sure it uses the same umask
  425. for remote repos as for local ones. Because of this, you must upgrade both
  426. server and client(s) to 0.24.
  427. - the default umask is 077 now (if you do not specify via --umask) which might
  428. be a different one as you used previously. The default umask avoids that
  429. you accidentally give access permissions for group and/or others to files
  430. created by borg (e.g. the repository).
  431. Deprecations:
  432. - "--encryption passphrase" mode is deprecated, see #85 and #97.
  433. See the new "--encryption repokey" mode for a replacement.
  434. New features:
  435. - borg create --chunker-params ... to configure the chunker, fixes #16
  436. (attic #302, attic #300, and somehow also #41).
  437. This can be used to reduce memory usage caused by chunk management overhead,
  438. so borg does not create a huge chunks index/repo index and eats all your RAM
  439. if you back up lots of data in huge files (like VM disk images).
  440. See docs/misc/create_chunker-params.txt for more information.
  441. - borg info now reports chunk counts in the chunk index.
  442. - borg create --compression 0..9 to select zlib compression level, fixes #66
  443. (attic #295).
  444. - borg init --encryption repokey (to store the encryption key into the repo),
  445. fixes #85
  446. - improve at-end error logging, always log exceptions and set exit_code=1
  447. - LoggedIO: better error checks / exceptions / exception handling
  448. - implement --remote-path to allow non-default-path borg locations, #125
  449. - implement --umask M and use 077 as default umask for better security, #117
  450. - borg check: give a named single archive to it, fixes #139
  451. - cache sync: show progress indication
  452. - cache sync: reimplement the chunk index merging in C
  453. Bug fixes:
  454. - fix segfault that happened for unreadable files (chunker: n needs to be a
  455. signed size_t), #116
  456. - fix the repair mode, #144
  457. - repo delete: add destroy to allowed rpc methods, fixes issue #114
  458. - more compatible repository locking code (based on mkdir), maybe fixes #92
  459. (attic #317, attic #201).
  460. - better Exception msg if no Borg is installed on the remote repo server, #56
  461. - create a RepositoryCache implementation that can cope with >2GiB,
  462. fixes attic #326.
  463. - fix Traceback when running check --repair, attic #232
  464. - clarify help text, fixes #73.
  465. - add help string for --no-files-cache, fixes #140
  466. Other changes:
  467. - improved docs:
  468. - added docs/misc directory for misc. writeups that won't be included
  469. "as is" into the html docs.
  470. - document environment variables and return codes (attic #324, attic #52)
  471. - web site: add related projects, fix web site url, IRC #borgbackup
  472. - Fedora/Fedora-based install instructions added to docs
  473. - Cygwin-based install instructions added to docs
  474. - updated AUTHORS
  475. - add FAQ entries about redundancy / integrity
  476. - clarify that borg extract uses the cwd as extraction target
  477. - update internals doc about chunker params, memory usage and compression
  478. - added docs about development
  479. - add some words about resource usage in general
  480. - document how to backup a raw disk
  481. - add note about how to run borg from virtual env
  482. - add solutions for (ll)fuse installation problems
  483. - document what borg check does, fixes #138
  484. - reorganize borgbackup.github.io sidebar, prev/next at top
  485. - deduplicate and refactor the docs / README.rst
  486. - use borg-tmp as prefix for temporary files / directories
  487. - short prune options without "keep-" are deprecated, do not suggest them
  488. - improved tox configuration
  489. - remove usage of unittest.mock, always use mock from pypi
  490. - use entrypoints instead of scripts, for better use of the wheel format and
  491. modern installs
  492. - add requirements.d/development.txt and modify tox.ini
  493. - use travis-ci for testing based on Linux and (new) OS X
  494. - use coverage.py, pytest-cov and codecov.io for test coverage support
  495. I forgot to list some stuff already implemented in 0.23.0, here they are:
  496. New features:
  497. - efficient archive list from manifest, meaning a big speedup for slow
  498. repo connections and "list <repo>", "delete <repo>", "prune" (attic #242,
  499. attic #167)
  500. - big speedup for chunks cache sync (esp. for slow repo connections), fixes #18
  501. - hashindex: improve error messages
  502. Other changes:
  503. - explicitly specify binary mode to open binary files
  504. - some easy micro optimizations
  505. Version 0.23.0
  506. --------------
  507. Incompatible changes (compared to attic, fork related):
  508. - changed sw name and cli command to "borg", updated docs
  509. - package name (and name in urls) uses "borgbackup" to have less collisions
  510. - changed repo / cache internal magic strings from ATTIC* to BORG*,
  511. changed cache location to .cache/borg/ - this means that it currently won't
  512. accept attic repos (see issue #21 about improving that)
  513. Bug fixes:
  514. - avoid defect python-msgpack releases, fixes attic #171, fixes attic #185
  515. - fix traceback when trying to do unsupported passphrase change, fixes attic #189
  516. - datetime does not like the year 10.000, fixes attic #139
  517. - fix "info" all archives stats, fixes attic #183
  518. - fix parsing with missing microseconds, fixes attic #282
  519. - fix misleading hint the fuse ImportError handler gave, fixes attic #237
  520. - check unpacked data from RPC for tuple type and correct length, fixes attic #127
  521. - fix Repository._active_txn state when lock upgrade fails
  522. - give specific path to xattr.is_enabled(), disable symlink setattr call that
  523. always fails
  524. - fix test setup for 32bit platforms, partial fix for attic #196
  525. - upgraded versioneer, PEP440 compliance, fixes attic #257
  526. New features:
  527. - less memory usage: add global option --no-cache-files
  528. - check --last N (only check the last N archives)
  529. - check: sort archives in reverse time order
  530. - rename repo::oldname newname (rename repository)
  531. - create -v output more informative
  532. - create --progress (backup progress indicator)
  533. - create --timestamp (utc string or reference file/dir)
  534. - create: if "-" is given as path, read binary from stdin
  535. - extract: if --stdout is given, write all extracted binary data to stdout
  536. - extract --sparse (simple sparse file support)
  537. - extra debug information for 'fread failed'
  538. - delete <repo> (deletes whole repo + local cache)
  539. - FUSE: reflect deduplication in allocated blocks
  540. - only allow whitelisted RPC calls in server mode
  541. - normalize source/exclude paths before matching
  542. - use posix_fadvise to not spoil the OS cache, fixes attic #252
  543. - toplevel error handler: show tracebacks for better error analysis
  544. - sigusr1 / sigint handler to print current file infos - attic PR #286
  545. - RPCError: include the exception args we get from remote
  546. Other changes:
  547. - source: misc. cleanups, pep8, style
  548. - docs and faq improvements, fixes, updates
  549. - cleanup crypto.pyx, make it easier to adapt to other AES modes
  550. - do os.fsync like recommended in the python docs
  551. - source: Let chunker optionally work with os-level file descriptor.
  552. - source: Linux: remove duplicate os.fsencode calls
  553. - source: refactor _open_rb code a bit, so it is more consistent / regular
  554. - source: refactor indicator (status) and item processing
  555. - source: use py.test for better testing, flake8 for code style checks
  556. - source: fix tox >=2.0 compatibility (test runner)
  557. - pypi package: add python version classifiers, add FreeBSD to platforms
  558. Attic Changelog
  559. ---------------
  560. Here you can see the full list of changes between each Attic release until Borg
  561. forked from Attic:
  562. Version 0.17
  563. ~~~~~~~~~~~~
  564. (bugfix release, released on X)
  565. - Fix hashindex ARM memory alignment issue (#309)
  566. - Improve hashindex error messages (#298)
  567. Version 0.16
  568. ~~~~~~~~~~~~
  569. (bugfix release, released on May 16, 2015)
  570. - Fix typo preventing the security confirmation prompt from working (#303)
  571. - Improve handling of systems with improperly configured file system encoding (#289)
  572. - Fix "All archives" output for attic info. (#183)
  573. - More user friendly error message when repository key file is not found (#236)
  574. - Fix parsing of iso 8601 timestamps with zero microseconds (#282)
  575. Version 0.15
  576. ~~~~~~~~~~~~
  577. (bugfix release, released on Apr 15, 2015)
  578. - xattr: Be less strict about unknown/unsupported platforms (#239)
  579. - Reduce repository listing memory usage (#163).
  580. - Fix BrokenPipeError for remote repositories (#233)
  581. - Fix incorrect behavior with two character directory names (#265, #268)
  582. - Require approval before accessing relocated/moved repository (#271)
  583. - Require approval before accessing previously unknown unencrypted repositories (#271)
  584. - Fix issue with hash index files larger than 2GB.
  585. - Fix Python 3.2 compatibility issue with noatime open() (#164)
  586. - Include missing pyx files in dist files (#168)
  587. Version 0.14
  588. ~~~~~~~~~~~~
  589. (feature release, released on Dec 17, 2014)
  590. - Added support for stripping leading path segments (#95)
  591. "attic extract --strip-segments X"
  592. - Add workaround for old Linux systems without acl_extended_file_no_follow (#96)
  593. - Add MacPorts' path to the default openssl search path (#101)
  594. - HashIndex improvements, eliminates unnecessary IO on low memory systems.
  595. - Fix "Number of files" output for attic info. (#124)
  596. - limit create file permissions so files aren't read while restoring
  597. - Fix issue with empty xattr values (#106)
  598. Version 0.13
  599. ~~~~~~~~~~~~
  600. (feature release, released on Jun 29, 2014)
  601. - Fix sporadic "Resource temporarily unavailable" when using remote repositories
  602. - Reduce file cache memory usage (#90)
  603. - Faster AES encryption (utilizing AES-NI when available)
  604. - Experimental Linux, OS X and FreeBSD ACL support (#66)
  605. - Added support for backup and restore of BSDFlags (OSX, FreeBSD) (#56)
  606. - Fix bug where xattrs on symlinks were not correctly restored
  607. - Added cachedir support. CACHEDIR.TAG compatible cache directories
  608. can now be excluded using ``--exclude-caches`` (#74)
  609. - Fix crash on extreme mtime timestamps (year 2400+) (#81)
  610. - Fix Python 3.2 specific lockf issue (EDEADLK)
  611. Version 0.12
  612. ~~~~~~~~~~~~
  613. (feature release, released on April 7, 2014)
  614. - Python 3.4 support (#62)
  615. - Various documentation improvements a new style
  616. - ``attic mount`` now supports mounting an entire repository not only
  617. individual archives (#59)
  618. - Added option to restrict remote repository access to specific path(s):
  619. ``attic serve --restrict-to-path X`` (#51)
  620. - Include "all archives" size information in "--stats" output. (#54)
  621. - Added ``--stats`` option to ``attic delete`` and ``attic prune``
  622. - Fixed bug where ``attic prune`` used UTC instead of the local time zone
  623. when determining which archives to keep.
  624. - Switch to SI units (Power of 1000 instead 1024) when printing file sizes
  625. Version 0.11
  626. ~~~~~~~~~~~~
  627. (feature release, released on March 7, 2014)
  628. - New "check" command for repository consistency checking (#24)
  629. - Documentation improvements
  630. - Fix exception during "attic create" with repeated files (#39)
  631. - New "--exclude-from" option for attic create/extract/verify.
  632. - Improved archive metadata deduplication.
  633. - "attic verify" has been deprecated. Use "attic extract --dry-run" instead.
  634. - "attic prune --hourly|daily|..." has been deprecated.
  635. Use "attic prune --keep-hourly|daily|..." instead.
  636. - Ignore xattr errors during "extract" if not supported by the filesystem. (#46)
  637. Version 0.10
  638. ~~~~~~~~~~~~
  639. (bugfix release, released on Jan 30, 2014)
  640. - Fix deadlock when extracting 0 sized files from remote repositories
  641. - "--exclude" wildcard patterns are now properly applied to the full path
  642. not just the file name part (#5).
  643. - Make source code endianness agnostic (#1)
  644. Version 0.9
  645. ~~~~~~~~~~~
  646. (feature release, released on Jan 23, 2014)
  647. - Remote repository speed and reliability improvements.
  648. - Fix sorting of segment names to ignore NFS left over files. (#17)
  649. - Fix incorrect display of time (#13)
  650. - Improved error handling / reporting. (#12)
  651. - Use fcntl() instead of flock() when locking repository/cache. (#15)
  652. - Let ssh figure out port/user if not specified so we don't override .ssh/config (#9)
  653. - Improved libcrypto path detection (#23).
  654. Version 0.8.1
  655. ~~~~~~~~~~~~~
  656. (bugfix release, released on Oct 4, 2013)
  657. - Fix segmentation fault issue.
  658. Version 0.8
  659. ~~~~~~~~~~~
  660. (feature release, released on Oct 3, 2013)
  661. - Fix xattr issue when backing up sshfs filesystems (#4)
  662. - Fix issue with excessive index file size (#6)
  663. - Support access of read only repositories.
  664. - New syntax to enable repository encryption:
  665. attic init --encryption="none|passphrase|keyfile".
  666. - Detect and abort if repository is older than the cache.
  667. Version 0.7
  668. ~~~~~~~~~~~
  669. (feature release, released on Aug 5, 2013)
  670. - Ported to FreeBSD
  671. - Improved documentation
  672. - Experimental: Archives mountable as fuse filesystems.
  673. - The "user." prefix is no longer stripped from xattrs on Linux
  674. Version 0.6.1
  675. ~~~~~~~~~~~~~
  676. (bugfix release, released on July 19, 2013)
  677. - Fixed an issue where mtime was not always correctly restored.
  678. Version 0.6
  679. ~~~~~~~~~~~
  680. First public release on July 9, 2013