central-backup-server.rst 7.5 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219
  1. .. include:: ../global.rst.inc
  2. .. highlight:: none
  3. Central repository server with Ansible or Salt
  4. ==============================================
  5. This section will give an example how to setup a borg repository server for multiple
  6. clients.
  7. Machines
  8. --------
  9. There are multiple machines used in this section and will further be named by their
  10. respective fully qualified domain name (fqdn).
  11. * The backup server: `backup01.srv.local`
  12. * The clients:
  13. - John Doe's desktop: `johndoe.clnt.local`
  14. - Webserver 01: `web01.srv.local`
  15. - Application server 01: `app01.srv.local`
  16. User and group
  17. --------------
  18. The repository server needs to have only one UNIX user for all the clients.
  19. Recommended user and group with additional settings:
  20. * User: `backup`
  21. * Group: `backup`
  22. * Shell: `/bin/bash` (or other capable to run the `borg serve` command)
  23. * Home: `/home/backup`
  24. Most clients shall initiate a backup from the root user to catch all
  25. users, groups and permissions (e.g. when backing up `/home`).
  26. Folders
  27. -------
  28. The following folder tree layout is suggested on the repository server:
  29. * User home directory, /home/backup
  30. * Repositories path (storage pool): /home/backup/repos
  31. * Clients restricted paths (`/home/backup/repos/<client fqdn>`):
  32. - johndoe.clnt.local: `/home/backup/repos/johndoe.clnt.local`
  33. - web01.srv.local: `/home/backup/repos/web01.srv.local`
  34. - app01.srv.local: `/home/backup/repos/app01.srv.local`
  35. Restrictions
  36. ------------
  37. Borg is instructed to restrict clients into their own paths:
  38. ``borg serve --restrict-to-path /home/backup/repos/<client fqdn>``
  39. The client will be able to access any file or subdirectory inside of ``/home/backup/repos/<client fqdn>``
  40. but no other directories. You can allow a client to access several separate directories by passing multiple
  41. ``--restrict-to-path`` flags, for instance: ``borg serve --restrict-to-path /home/backup/repos/<client fqdn> --restrict-to-path /home/backup/repos/<other client fqdn>``,
  42. which could make sense if multiple machines belong to one person which should then have access to all the
  43. backups of their machines.
  44. There is only one ssh key per client allowed. Keys are added for ``johndoe.clnt.local``, ``web01.srv.local`` and
  45. ``app01.srv.local``. But they will access the backup under only one UNIX user account as:
  46. ``backup@backup01.srv.local``. Every key in ``$HOME/.ssh/authorized_keys`` has a
  47. forced command and restrictions applied as shown below:
  48. ::
  49. command="cd /home/backup/repos/<client fqdn>;
  50. borg serve --restrict-to-path /home/backup/repos/<client fqdn>",
  51. restrict <keytype> <key> <host>
  52. .. note:: The text shown above needs to be written on a single line!
  53. The options which are added to the key will perform the following:
  54. 1. Change working directory
  55. 2. Run ``borg serve`` restricted to the client base path
  56. 3. Restrict ssh and do not allow stuff which imposes a security risk
  57. Due to the ``cd`` command we use, the server automatically changes the current
  58. working directory. Then client doesn't need to have knowledge of the absolute
  59. or relative remote repository path and can directly access the repositories at
  60. ``<user>@<host>:<repo>``.
  61. .. note:: The setup above ignores all client given commandline parameters
  62. which are normally appended to the `borg serve` command.
  63. Client
  64. ------
  65. The client needs to initialize the `pictures` repository like this:
  66. ::
  67. borg init backup@backup01.srv.local:pictures
  68. Or with the full path (should actually never be used, as only for demonstrational purposes).
  69. The server should automatically change the current working directory to the `<client fqdn>` folder.
  70. ::
  71. borg init backup@backup01.srv.local:/home/backup/repos/johndoe.clnt.local/pictures
  72. When `johndoe.clnt.local` tries to access a not restricted path the following error is raised.
  73. John Doe tries to backup into the Web 01 path:
  74. ::
  75. borg init backup@backup01.srv.local:/home/backup/repos/web01.srv.local/pictures
  76. ::
  77. ~~~ SNIP ~~~
  78. Remote: borg.remote.PathNotAllowed: /home/backup/repos/web01.srv.local/pictures
  79. ~~~ SNIP ~~~
  80. Repository path not allowed
  81. Ansible
  82. -------
  83. Ansible takes care of all the system-specific commands to add the user, create the
  84. folder, install and configure software.
  85. ::
  86. - hosts: backup01.srv.local
  87. vars:
  88. user: backup
  89. group: backup
  90. home: /home/backup
  91. pool: "{{ home }}/repos"
  92. auth_users:
  93. - host: johndoe.clnt.local
  94. key: "{{ lookup('file', '/path/to/keys/johndoe.clnt.local.pub') }}"
  95. - host: web01.clnt.local
  96. key: "{{ lookup('file', '/path/to/keys/web01.clnt.local.pub') }}"
  97. - host: app01.clnt.local
  98. key: "{{ lookup('file', '/path/to/keys/app01.clnt.local.pub') }}"
  99. tasks:
  100. - package: name=borg state=present
  101. - group: name="{{ group }}" state=present
  102. - user: name="{{ user }}" shell=/bin/bash home="{{ home }}" createhome=yes group="{{ group }}" groups= state=present
  103. - file: path="{{ home }}" owner="{{ user }}" group="{{ group }}" mode=0700 state=directory
  104. - file: path="{{ home }}/.ssh" owner="{{ user }}" group="{{ group }}" mode=0700 state=directory
  105. - file: path="{{ pool }}" owner="{{ user }}" group="{{ group }}" mode=0700 state=directory
  106. - authorized_key: user="{{ user }}"
  107. key="{{ item.key }}"
  108. key_options='command="cd {{ pool }}/{{ item.host }};borg serve --restrict-to-path {{ pool }}/{{ item.host }}",restrict'
  109. with_items: "{{ auth_users }}"
  110. - file: path="{{ home }}/.ssh/authorized_keys" owner="{{ user }}" group="{{ group }}" mode=0600 state=file
  111. - file: path="{{ pool }}/{{ item.host }}" owner="{{ user }}" group="{{ group }}" mode=0700 state=directory
  112. with_items: "{{ auth_users }}"
  113. Salt
  114. ----
  115. This is a configuration similar to the one above, configured to be deployed with
  116. Salt running on a Debian system.
  117. ::
  118. Install borg backup from pip:
  119. pkg.installed:
  120. - pkgs:
  121. - python3
  122. - python3-dev
  123. - python3-pip
  124. - python-virtualenv
  125. - libssl-dev
  126. - openssl
  127. - libacl1-dev
  128. - libacl1
  129. - build-essential
  130. - libfuse-dev
  131. - fuse
  132. - pkg-config
  133. pip.installed:
  134. - pkgs: ["borgbackup"]
  135. - bin_env: /usr/bin/pip3
  136. Setup backup user:
  137. user.present:
  138. - name: backup
  139. - fullname: Backup User
  140. - home: /home/backup
  141. - shell: /bin/bash
  142. # CAUTION!
  143. # If you change the ssh command= option below, it won't necessarily get pushed to the backup
  144. # server correctly unless you delete the ~/.ssh/authorized_keys file and re-create it!
  145. {% for host in backupclients %}
  146. Give backup access to {{host}}:
  147. ssh_auth.present:
  148. - user: backup
  149. - source: salt://conf/ssh-pubkeys/{{host}}-backup.id_ecdsa.pub
  150. - options:
  151. - command="cd /home/backup/repos/{{host}}; borg serve --restrict-to-path /home/backup/repos/{{host}}"
  152. - restrict
  153. {% endfor %}
  154. Enhancements
  155. ------------
  156. As this section only describes a simple and effective setup it could be further
  157. enhanced when supporting (a limited set) of client supplied commands. A wrapper
  158. for starting `borg serve` could be written. Or borg itself could be enhanced to
  159. autodetect it runs under SSH by checking the `SSH_ORIGINAL_COMMAND` environment
  160. variable. This is left open for future improvements.
  161. When extending ssh autodetection in borg no external wrapper script is necessary
  162. and no other interpreter or application has to be deployed.
  163. See also
  164. --------
  165. * `SSH Daemon manpage <https://www.openbsd.org/cgi-bin/man.cgi/OpenBSD-current/man8/sshd.8>`_
  166. * `Ansible <https://docs.ansible.com>`_
  167. * `Salt <https://docs.saltstack.com/>`_