{"id":230,"date":"2020-05-09T19:13:21","date_gmt":"2020-05-10T02:13:21","guid":{"rendered":"https:\/\/opensourceit.org\/blog\/?p=230"},"modified":"2021-05-16T10:14:23","modified_gmt":"2021-05-16T17:14:23","slug":"file-sync-and-remote-storage-backup","status":"publish","type":"post","link":"https:\/\/opensourceit.org\/blog\/2020\/05\/09\/file-sync-and-remote-storage-backup\/","title":{"rendered":"File Sync and Remote Storage\/Backup"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/nextcloud.com\/wp-content\/themes\/next\/assets\/img\/features\/mobileDesktop.png?x53054\" alt=\"picture of Nextcloud mobile and desktop apps\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Overview<\/h2>\n\n\n\n<p><em>NOTE:  This guide assumes you have <a href=\"https:\/\/opensourceit.org\/blog\/2020\/05\/12\/set-up-remote-file-management-contacts-calendar-tasks-and-more-with-nextcloud\/\">set up Nextcloud<\/a> as your file synchronization system.<\/em><\/p>\n\n\n\n<p>Remote storage\/backup is, arguably, essential, for anyone.  Whether it&#8217;s your work data, or just photos from your daily life &#8211; you don&#8217;t want to suddenly loose all that data because of a hardware failure, or other technical issue.<\/p>\n\n\n\n<p>Likewise, automatic and immediate synchronization of your data is also very useful.  So, typically, these features are paired together.<\/p>\n\n\n\n<p>Unfortunately, at the current time, there are no good open source solutions for file synchronization and remote storage\/backup that make use of inexpensive <a rel=\"noreferrer noopener\" href=\"https:\/\/en.wikipedia.org\/wiki\/Object_storage\" target=\"_blank\">object storage<\/a>.<span id='easy-footnote-1-230' class='easy-footnote-margin-adjust'><\/span><span class='easy-footnote'><a href='https:\/\/opensourceit.org\/blog\/2020\/05\/09\/file-sync-and-remote-storage-backup\/#easy-footnote-bottom-1-230' title='I\u2019ve looked at Nextcloud, Pydio and Seafile. Nextcloud was unusable due to file synchronization defects, Pydio lacked sufficient documentation for a Docker solution and I gave up after a day of trying, and Seafile\u2019s object storage back-end is not available for their community edition. Also worth noting &amp;#8211; when an object storage solution becomes a part of this guide, it will most likely &lt;em&gt;not&lt;\/em&gt;\u00a0use Digital Ocean\u2019s \u201cSpaces\u201d product, as they seem to have strict and opaque rate throttling which will make transferring any large file storage system you currently have impossible.  &lt;strong&gt;UPDATE 5\/16\/21:&lt;\/strong&gt;  tried Pydio again &amp;#8211; got a lot farther, but their Android solution is broken, which is a show stopper for me.'><sup>1<\/sup><\/a><\/span>  (But if you know of one, let me know!)  So instead of about $5 bucks for object storage on the order of 250 gigabytes, you&#8217;re going to probably have to spend about $15 bucks for <a rel=\"noreferrer noopener\" href=\"https:\/\/en.wikipedia.org\/wiki\/Block-level_storage\" target=\"_blank\">block storage<\/a> on the order of 150 gigabytes. Even so, open source block storage can still be on par with or\u00a0<em>cheaper<\/em>\u00a0than proprietary object storage solutions like Dropbox or Box, if your data storage needs are around 150 GB.<\/p>\n\n\n\n<p>The other option to go cheaper is to <a href=\"https:\/\/opensourceit.org\/blog\/2020\/08\/17\/dont-depend-on-the-cloud-for-everything-host-at-home\/\" data-type=\"post\" data-id=\"571\">host your own regular disk storage at home<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Configure External Storage<\/h2>\n\n\n\n<p>After adding block storage to your VPS<span id='easy-footnote-2-230' class='easy-footnote-margin-adjust'><\/span><span class='easy-footnote'><a href='https:\/\/opensourceit.org\/blog\/2020\/05\/09\/file-sync-and-remote-storage-backup\/#easy-footnote-bottom-2-230' title='On Digital Ocean, you can find instructions under the &amp;#8220;More&amp;#8221; menu for your block storage on the &lt;a rel=&quot;noreferrer noopener&quot; href=&quot;https:\/\/cloud.digitalocean.com\/volumes&quot; target=&quot;_blank&quot;&gt;https:\/\/cloud.digitalocean.com\/volumes&lt;\/a&gt; page.'><sup>2<\/sup><\/a><\/span>, you will also need to configure external storage support on Nextcloud.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Go to Settings &gt; Administration\/External storages in Nextcloud.<\/li><li>Enter &#8220;\/&#8221; for your &#8220;Folder name&#8221;, if you want your block storage to store all of<br>your files.<\/li><li>Click the three-dot menu on the right and check-mark &#8220;enable sharing&#8221;.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Install the&nbsp;<a rel=\"noreferrer noopener\" href=\"https:\/\/docs.nextcloud.com\/desktop\/2.6\/installing.html\" target=\"_blank\">Nextcloud Desktop Synchronization Client<\/a><\/h2>\n\n\n\n<p>Straight forward installation for all major platforms (via the link above).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Install and Set Up Local Backups<\/h2>\n\n\n\n<p>While not necessarily essential, I <em>highly<\/em> recommend scheduling daily incremental backups for your Nextcloud folder.  Without local backups, it is possible for your remote files to be encrypted by a ransomware attacker and sync&#8217;d to your desktop before you have a chance to notice.  On Linux, I use <s><a rel=\"noreferrer noopener\" href=\"https:\/\/wiki.gnome.org\/Apps\/DejaDup\" target=\"_blank\">D\u00e9j\u00e0 Dup<\/a><\/s><span id='easy-footnote-3-230' class='easy-footnote-margin-adjust'><\/span><span class='easy-footnote'><a href='https:\/\/opensourceit.org\/blog\/2020\/05\/09\/file-sync-and-remote-storage-backup\/#easy-footnote-bottom-3-230' title='Unfortunately, I can&amp;#8217;t recommend D\u00e9j\u00e0 Dup anymore, since its auto-deletion on full disk doesn&amp;#8217;t seem to work and there&amp;#8217;s no way to easily specify a backup retention period shorter than 6 months, so it will likely fill up your available disk space if you&amp;#8217;re backing up a reasonable amount of data (e.g. ~100GB)'><sup>3<\/sup><\/a><\/span><a rel=\"noreferrer noopener\" href=\"https:\/\/backintime.readthedocs.io\/en\/latest\/\" target=\"_blank\">Back In Time<\/a>, but, unfortunately, I&#8217;m not currently aware of any user-friendly open source backup systems for Microsoft or Apple products.  (If someone is aware of them, please let me know!)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Overview NOTE: This guide assumes you have set up Nextcloud as your file synchronization system. Remote storage\/backup is, arguably, essential, for anyone. Whether it&#8217;s your work data, or just photos from your daily life &#8211; you don&#8217;t want to suddenly loose all that data because of a hardware failure, or other technical issue. Likewise, automatic [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-230","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/posts\/230","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/comments?post=230"}],"version-history":[{"count":18,"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/posts\/230\/revisions"}],"predecessor-version":[{"id":659,"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/posts\/230\/revisions\/659"}],"wp:attachment":[{"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/media?parent=230"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/categories?post=230"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/opensourceit.org\/blog\/wp-json\/wp\/v2\/tags?post=230"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}