Distributed/replicated storage options
from possiblylinux127@lemmy.zip to selfhosted@lemmy.world on 15 May 06:46
https://lemmy.zip/post/38605239

Is there a lightweight storage solution that makes shared storage easy without needing a NAS? I’m looking for something that isn’t necessarily highly available. I’m looking to be able to shift services around without having the complexity and overhead of Ceph. My current option is Unison which isn’t ideal but workable.

#selfhosted

threaded - newest

solrize@lemmy.ml on 15 May 07:05 next collapse

NFS is still a thing.

mhzawadi@lemmy.horwood.cloud on 15 May 07:25 next collapse

I use NFS for docker nodes, works a treat and rock solid.

suzune@ani.social on 15 May 13:13 collapse

Me too. I don’t know what OP means by “distributed” but “not highly available” and at the same time “rsync or unison is enough”, “but not NFS”.

This is somehow contradicting itself.

possiblylinux127@lemmy.zip on 15 May 07:31 collapse

I’m looking for a distributed solution

solrize@lemmy.ml on 15 May 09:11 collapse

Gluster? I don’t know much about it. As someone else asked, how much data are you talking about? Do you need a file store (mutable files), or are you ok with an object store (immutable)?

possiblylinux127@lemmy.zip on 15 May 09:44 collapse

Gluster is abandoned for the most part

I’m mostly looking for a easy way to move files between VMs automatically when I move containers. I think it should be possible with scripting and rsync/unison

Strit@lemmy.linuxuserspace.show on 15 May 07:55 next collapse

SyncThing? It has no centralized point and syncs with devices when they are online.

adry@piefed.social on 15 May 08:40 collapse

+1 I use it to on all of my devices for sharing 1 folder, just set one as introducer, and keep adding nodes (e.g. phone, Work mini, laptops, PC, ...) Once you have that set, start adding folders as needed for specific cases (e.g. a folder shared among all mentioned except for Work mini.)

koala@programming.dev on 15 May 07:59 next collapse

What volume of data you are discussing? How many physical nodes? Can you give a complete usage example of what you want to achieve?

In general, there’s a steep change in making things distributed properly, and distributed systems are often designed for big and complex situations, so they “can afford” being big and complex too.

paperd@lemmy.zip on 16 May 03:39 collapse

ZFS datasets.