Opinions about using a mini PC with a HDD enclosure as NAS
from PrivateNoob@sopuli.xyz to selfhosted@lemmy.world on 17 Dec 23:00
https://sopuli.xyz/post/20299029
from PrivateNoob@sopuli.xyz to selfhosted@lemmy.world on 17 Dec 23:00
https://sopuli.xyz/post/20299029
I was thinking on buying a 2-4 bay HDD powered enclosure as a NAS for my mini pc, since I already have that, and buying or building a full-fledged diy NAS seems a bit expensive.
I want to hear some opinions from you guys, since it seems using this method is a mixed area from the selfhosted pros. I would be hoping that by using a powered enclosure, that would alleviate or solve the USB port overcharging issue, which have appeared in my mini pc when trying out an external HDD with a normal sata to usb converter.
Did you have any experiences with a setup like this one?
threaded - newest
Consider the machine being on 24/7 and cooling.
Furthermore, depending on the current power supply, you might need to upgrade it to keep everything running.
Get old HP thinclient T510, or Igel M340C. Got a few of those practically free online. Has Via Eden 1.2Ghz 2 core. Not powerful at all. But cold. Mine runs on hot summer days approximately between 40-50C. HP has I think 19V power source, Igel runs on 12V brick.
Get a USB-C DAS (enclosure) for your disks, those use their own power supply. Since it is USB-C performance will be very good and stable and you’ll be happy with it.
It’s viable, but when you’re buying a DAS for the drives, figure out what the USB chipset is and make sure it’s not a flaky piece of crap.
Things have gotten better, but some random manufacturers are still using trash bridge chips and you’ll be in for a bad time. (By which I mean your drives will vanish in the middle of a write, and corrupt themselves.)
Seconded. It’s not a bad idea, but it’s another point of failure for sure.
To add on - several of those USB controllers implement stuff in non-standard ways, so if your board fails you either need another one of the exact same model and firmware to read the data off those drives again. It’s very likely if you just bought another DAS/USB controller that the drives/partitions would be unreadable, and you’d have to start over again.
OP, it’s not a bad idea unless you don’t have a backup plan. If you are planning on having no backups, then this is much more risky than just an external hard drive, this could very well lead to complete data loss. If you have a solid backup plan, then go for it! If you don’t, then for the love of god you aren’t ready for it.
Honestly, if you only need a few bays, just look at getting a Synology.
Always have a offside backup for any data you deeply care about it’s never worth he risk.
So as a TLDR a DAS really should only be used as an offside backup plan or secondary storage then? I might really have to do a DIY NAS with a desktop PC then. Thank you for the warning!
I mean it’s up to you, your decision. In my experience going the usb route though only leads to more cost later, to me it’s better to just save your money and go with a solid solution in a couple of months. You don’t have to go crazy. An old desktop with some extra sata ports is a fine start
I’ve had “trash controllers” in Orico units which rewite the drive details which makes them annoying to work with but I’ve never heard of
That sounds likes its underpowered and when the draw is up the supply can’t handle it, which could happen for internal drives if your supply isn’t up to powering enough drives.
Use a reputable brand like TerraMaster and you’ll not have those sorts of problems.
Yes, and you might want to ask in the datahoarders community.
While I dont use a mini-pc, I have a server with 48TB in it on spinning disks, and I’ve built a hybrid DAS/NAS that I back up to.
I use this 4-bay DAS: www.amazon.com/gp/aw/d/B078YQHWYW I chose it because it supports USB 3.2 Gen 2 and I’ve been pretty happy with it.
It’s usually plugged into my server directly, and I use ZFS to snapshot and send to it. However, I also can plug it into a Pi5 and use ZFS send over SSH to treat it like a NAS. The Pi can of course run Samba/CIFS and SSH for sshfs.
The biggest downside to this structure is probably the metadata speeds for ZFS over USB (looking up snapshot names), but you could always use a cache drive with ZFS.
I highly, highly recommend ZFS and figuring out your software requirements before picking hardware.
Happy to answer any specific questions, too.
Reviews on that page are kind of dodgy, but they are for all 3 products listed which makes it difficult to tell which review is for what.
Have you had any of the listed issues? Heat, unrecognized success, etc?
None.
I think the unrecognized issues are because people think it will behave like a device with a controller vs just USB pass-through. Every disk I’ve plugged in just shows up fine on the host. I also have only used it with linux.
As for heat, my drives go to sleep when not in use, but even for long stints of backups it wasn’t an issue.
Reviews for just the 4-bay: www.amazon.com/…/ref=cm_cr_arp_mb_viewopt_smt?for…
Thanks for the reply! I have a couple USB 3.0 2-drive docks that just sit out in the open - consolidating in to a single, enclosed unit with a fan would be nice (since mine or open, you really hear the HD spin up/click when accessing it).
What do you use to adjust your drives’ spin down? hdparm? hd-idle? I have one drive that is constantly spinning/accessed so the thermal concerns with the unit do weigh on me.
Oh man it’s been a while, but I think I used hdparm. They basically show up as individual USB drives and were SMART capable.
The DAS is disconnected now for a road test (this system will eventually live in a van), but once I reconnect it I could check if you would like.
If it crosses your mind once it’s all hooked up :-)
Have you had data loss occurences in these bay enclosures? Some other commenters have said, that using it as a primary storage is really risky because some crappy controllers could ruin the drives’s data for example.
I have not, but I also run it as a RAIDZ, so if I did have issues with one, the parity should cover it. That being said it is a backup for me.
Yes there is someone talking everybody down about USB enclosures*.
Maybe he got burned or something…
Can say never had an issue and I replaced many motherboards over 20 years, and also many enclosures.
Don’t go too cheap, but don’t worry too much. I highly recommend a raid setup anyway. And always do backups, bit this is unrelated to USB specifically
I use an M1 Mac Mini running Asahi Linux with a USB 3.0 4-bay enclosure. Works great so far.
And what’s your experience with it? Is the data transfer speed fast enough for you? Where do you do backups?
I don’t have backups, but I do have a 14TB parity drive in the DAS, using SnapRAID to update it nightly.
The transfer speed of the USB connection is higher than my ethernet speed, so it never bottlenecks me.
You may not be able to do RAID or other redundant/performant arrays with USB. You can definitely achieve a big JBOD array but it will be less resilient and slower than a RAID array. Enclosures often don’t cool as well so heat may degrade your disks faster as well. I did this for a while with some old disks and some $30 HDD toasters. I only put data on there I could afford to lose. I wish there was a standalone hardware RAID solution… like a NAS without the network. That would have a huge draw for hobbyists that don’t want to buy an expensive NAS. I’ve searched for this but haven’t found anything. Message me if you know of such a product! Maybe consider building your own NAS with an old PC. Way cheaper than a prebuilt and fun to build! I had an old Dell Optiplex 990 that is now a 32 TB NAS. Had to get a new case but it’s a decent backup to my Synology.
This is completely untrue.
You can get plently of performant arrays over USB. You do know how much USB 3.1 or 4 can transmit?
DAS enclosures can do a great job of cooling by separating and not sharing the air inside a single case.
Yeah a DIY NAS PC sounds like a fun choice, it’s just too bad that this mini PC was a waste of cash if talking about storage. I do have an old PC, but it’s a 3770K which is mighty beast for sure, but definitely a more power hungry device.
That’s why you should always use them as jbod and setup Linux software raid (or zfs raid? Not familiar) directly.
Never go without a raid… Not a good idea in any case.
As for heat, I used jbod enclosures with fan, anything with more than 2 drives should have one, or don’t bother.
I wouldn’t go with single drive enclosures (even if I did for 10 years) as better not to cheap out on this matter. A 4 x 10€ cheap enclosure might be tempting, but shilling out 100€ for a nice actively cooled 4-disk jbod is a much better choice. Then go sw raid on top of it.
I built my own and it honestly wasn’t that expensive (at the time back in 2018). I just started with the basics but built it to be expandable. I used a Define 6 case which gave me room for 12 HDDs, a mobo with the highest number of SATA ports, processor, RAM, etc and then just added drives 1-2 at a time as they filled up. My only regret is that I didn’t and still haven’t learned Linux well enough to rely on it because it runs Windows, the PC is showing its age now, and I need to think about the replacement solution and how I’ll be able to migrate 70+ TB of media and all my configurations to the new machine.
If you do run Windows, Drivepool and SnapRAID are useful for pooling everything into a single virtual disk and setting up a software RAID that will protect from drive failures without locking your data away.
You can also use snapraid (and mergefs) on Linux to do the same thing! I’m excited to recognize this because I recently turned an old PC into a crappy nas with Open Media Vault and used these two.
And what kinda mobo have you went with? A microATX perhaps?
It’s a midtower case so I just went with an ATX board. I would like to figure out a compact solution for the future but it’s hard to house and control a bunch of HDDs in a small footprint. I don’t want to spend thousands on a NAS and I haven’t found a trustworthy DAS solution that will hold all my drives.
You might play around with PCPartPicker since it allows for so many filtering options for things like SATA ports on a mobo or drive slots in a case and see what you can come up with.
I am currently getting a replacement for my old win10+drivepool setup using hand me down parts from my old main pc. I decided to go with UNRAID this time and other than a few headaches, its been pretty simple to get going. I am already a big fan of the container/docker/app setup. My setup is 3 12tb seagate iron wolf nas drives recertified/refurbished from ebay, the nvme ssd I used as my prior boot drive as a cache drive, and a r7 1700 and ab350m pro 4 mobo with a pny xlr8 1070gpu. It was mostly free since I was replacing it with a newer gaming build. I think I spent $280 on the hdds?
I’ve personally gone with an N100 Mini PC running Proxmox and two of these daisy-chained (purchased on sale). www.amazon.com/…/B0D28Q187R/
The MAIWO DAS uses garbage JMicron firmware by default, and there are significant issues with their sleep functions. Because of that, it took me forever to figure out why SnapRAID kept failing mid-sync. Fortunately, new firmware seems to have fixed their issues and they’ve been rock solid ever since. I specifically had to update the firmware for all 4 of the USB controllers on each DAS.
Direct link to firmware that worked for me. gbatemp.net/…/bin-16028_jms578_std_v00-04-01-04_s…
JMS578_STD_v00.04.01.04_Self Power + ODD.bin
MD5: 7701fb7a968e3ad4ca926dd7854806ff
Firmware updater tool for Windows found here. I ran this from a Virtualbox Windows 10 VM inside my Arch install: gbatemp.net/…/jmicron-jms578-sata-crystal-enclosu…
FwUpdateTool_v1_19_16_24.exe
MD5: 735ec8d9f99c457ce793739480c55706
Mirrors for posterity:
files.catbox.moe/e4121s.zip
mega.nz/file/OJAX2KhQ#67kIDJun92nqi56mFur_9vALSi2…
Blog post detailing firmware update procedure for an external drive: ralimtek.com/posts/2021/jms578/
Detailed post on JMS578: gbatemp.net/…/how-to-update-firmware-of-jmicron-j…
Alternate FOSS software for flashing I found later, but never used. github.com/BertoldVdb/jms578flash
Wow thank you for these links, you’re insane. And if you would start this homelab process again, then would you go with this mini PC + DAS layout again, or with desktop pc as a NAS?
I had a setup similar to this for a year or two that ended with an hdd destroying itself one night. Probably because of the drive and not the usb enclosure I was using. Until then it worked fine, it’s definitely a viable route.
If you can swing a desktop pc case it’ll probably end up easier and cheaper and have some headroom for upgrades, that’s the route I went down after trying an escalating series of mini-pcs and running into their limits one too many times.
Sounds like a good idea, since according to the comments it seems I really shouldn’t be using DAS as a primary storage (not with USB specifically).
If you use a reputable brand, such as TerraMaster you’ll avoid all of the scare stories you hear.
Almost everything bad seems to be along the lines of
Something like this:
www.terra-master.com/uk/products/…/d6-320.html
It’ll be faster than your spinning rust anyway, as long as you have high speed ports on your mini PC.
I was very intrigued until they wanted my email before showing me the “Quick Installation Guide”.
No such thing in their website from europe
I just did a websearch and first result was a download link on their US website too which didn’t require registration.
There seems to be a lot of nonsense on here.
I don’t know but usually uk websites are the worsts of the bunch
Err, you mean the piece of paper that came in the box, or is available to download on their website as a link without having to register?
www.terra-master.com/us/d6-320.html?page=menu&mid…
I followed the support link in their menu, clicked on quick guide and got this page: support.terra-master.com/quickguide/
Are you not presented with a form forcing you to enter an email?
<img alt="" src="https://feddit.dk/pictrs/image/7f8ee3d7-77d8-42ae-a153-57e325fee5c9.webp">
That’s weird that there are several ways to get access to the Quick Guides, and some seem to want an email.
However it doesn’t use it and takes junk (I just used a@b.com which was accepted), but sad that the form you found needed it.
But to answer your question, no I missed that link and went to “downloads” which also has the guide but doesn’t appear to require any email.
Great, was starting to wonder if I was being singled out and they just wanted my email 😀
I still don’t understand why they have that form at all.
The reputable brand that quietly updated my device in the middle of the night and reset my password to a randomly generated one, locking me out of the device? That brand? The brand that runs their OS off of a USB stick inside the device so it’s always a ticking time bomb that might just stop working randomly? That one?
Bought only the nas hardware, no software or enclosures with OS from the and had no problems
Update your DAS? What are you talking about?
Are you alright?
I have the QNAP TL-D800S. It’s an 8 bay DAS but there is also a 4 bay variant. Works well for me. It uses SFF cables to connect to the PC and comes with the appropriate PCIe card which seems more robust to me than anything USB for this.
Yeah this option seems like a more robust option than using an USB one. Unfortunately my mini PC doesn’t offer a sata connection, but thank you for the suggestion!
It would need a PCIe slot, not a SATA connection. But I assume it doesn’t have that either then.
Do you think that PCIe card would fit on a lenovo 1L PC? Those have a PCIe slot, but only small cards fit.
Are you talking about these? They don’t look like they have a PCIe slot…
In any case, the specifications say
Yes, many of them have a PCIe slot, example. Thanks for the specifications
I use the usb version of the qnap 4 bay and never had an issue. Into a nuc holding all media. Boot and docker config all on the nuc nvme.
I have used mini PCs as a servers for years with file serving being a major duty of them. Granted my storage needs aren’t excessive, but most NUCs or Nuc-likes can hold two drives, some can have a third if you include 2.5" drives. My AsRock A300 can hold 4 drives (two of each), but its m.2 support sucks so that’s not as much of a boon as it sounds. If you need significant storage, there is no replacement for something that can hold 3.5" drives though since those can now reach 20+ GB a drive.
I used intel nuc j5005 for 4 years iirc with 2 bay hdd enclosure, Orico brand. Never had any problem that i hear about such as random diaconnecting. Granted i used it to host my media. So i dont pratically mind if the data is gone.
I used openmediavault with usb boot drive. Internal 2.5’ drive as docker appdata. All my media files is stored on the external enclosure. The only problem i noticed is the temperature but thats because of high ambient temp.
If youre planning to use ext enclosure for critical data. Might wanna think twice. But, if you have proper backup plan. Sure why not.
I would either get a used HP Proliant microserver Gen 8 (I own one. Pretty sweet) or get a mini ITX nas case, 4 or more bays. Depending on USB doesn’t seem like a good idea to me. You can always sell your mini PC. I have slowly learned to avoid the sunk cost fallacy.
Those microservers are dope!
I use a couple of mini pcs in exactly the setup you are talking about. Only downside is throughput. Anything built in is gonna be faster for read write ops, but usb3 is plenty fast for most things including media and data sync. I run Ubuntu with ZFS, and created raid arrays for data redundancy. It works really well. I virtualize using Incus with docker inside of those tiny VMs. It’s awesome.
There are small SATA backplanes that allow you to fit 3 HDDs into two 5.25" slots (or 4 HDDs in 3 slots). You can find used ones for cheap (mine was 30€), and with some cheap tower case you could get something NAS-like with hot-swap drive bays for way cheaper
Did that for 3 years. Not pretty but it worked
Doing it now with a not so mini second hand pc
I used USB enclosures for my RAIDs for over 20 years. The turning point has been usb3 and then usb-c even better, but I found really no difference as in the bottleneck where the mechanical drives.
Moved to an all internal sata setup a few months back because I upgraded the space and moved to a desktop form factor.
Can still recommend the USB approach tough.
BUY A QUALITY EBCLOSURE.
I always used Linux software raid, but purchased a 4 slots USB raid/jbod enclosure to keep the number of used USB ports down.
I never ever had issues with the setup, but I purchased a known-brand enclosure, one with also e-SATA, which unfortunately was/is more a fad than even been really used.