I've always used ZFS because it's vastly superior to other options. When I see storage companies building without fault tolerance, or without a merkle tree (so that you can backup deltas efficiently without having to recompute them) it's a sign their marketing team has more influence over the company than their engineers.
Sadly, the few ZFS COTS options have been somewhat underpowered. QNAP supports ZFS filesystems, but their backup configuration won't let you arrange for a nas to pull from the source (instead of the source doing a push.) You can still pull it off by scheduling your own cron job, but this somewhat defeats the purpose of paying extra for a vendor solution.
UBNT is still supporting my 15 year old edgerouters with security updates, and their interface is clean and usable for anyone with basic network experience. And their video surveillance solutions are unusual in that they allow you to keep your footage entirely onsite and offline, an uncommon level of privacy. If they can bring the same polish to their storage solutions, I'll be using these new products for a long time.
The same is true for our AI processing on the cameras. This is entirely local and private. You can even air gap the UniFi Protect system from the Internet and it'll operate fine.
I do like the onboard AI, and it works well for entity detection (like people). We haven't found the face detection to be very reliable in outdoor security applications. There doesn't seem to be a way to correct/combine classes if someone's detected as multiple individuals on different occasions, so we end up with the same person detected as 5 "unknown"s. This is not a hard problem to solve. You'd just allow embedding matching to different face groups, but it's annoying as a user.
IME those sub-$100 Chinese IP cameras have you at the mercy of whatever firmware they cut from the master branch the week they shipped it. People don't buy UI because they win on specs-per-dollar. They buy it because they win on results-per-dollar.
With face detection? License plates? Tamper protection?
I'm guessing you're thinking Reolink or other Chinese ultra-commodity cam. It's fine, it's just in a different product class and ecosystem - and that's where enterprises fit in, they want that support+ecosystem and not DIYing.
Some do. I got the TS-873A a few years back, it works. Their software is kind of weird, and I wouldn't connect it to their cloud offering, but it does work.
Ubiquiti's biggest feature is no monthly recurring cost. I really hope they continue the streak on products like this. Seems like anything else bought up these days is switched to an MRR model with no vision into the long term viability.
They've been at this for a while. They do have offerings you subscribe for and pay monthly. They have also consistently offered an option for each of those offerings to bring your own or self host. They've earned my trust.
Recently they removed the option to take certain types of backup locally (for the Network app). Now it only does it to the cloud, for those who allow this. It’s these small things that make me cautiously pessimistic that long term Ubiquity won’t pull the rug from under the customers.
Once you invest thousands in network equipment or cameras you’re less likely to jump ship when they start sneaking things in. And this is long lived equipment, not the kind you anyway replace every couple of years. So that’s a relatively strong lock-in.
They would be shooting themselves in the foot in the long term.
I was surprised to learn that Ubiquiti is a publicly traded company, but also the CEO and founder owns the mass majority of the shares, so he is not beholden by shareholders wanting to enshittify the company for the same of increased stock prices.
In my opinion, as long as the majority of their profits come from people continuing to buy the self-host devices, it is fairly unlikely they'll ever stop offering those devices. Why change a working business model?
Yes, subscription models are enticing for that recurring revenue... number must go up, right? /s
If a majority of your sales are not in subscription products though, I think it would be foolish for a business to blow off its own leg trying to chase that particular dragon.
Then again... businesses have made dumber calls in the past out of nowhere...
> I genuinely curious what bottlenecks you've hit.
1. My UDM Pro absolutely chokes and stalls with intrusion detection enabled on the firewall and 8 cameras connected. Network goes down, cameras disconnect, devices disconnect from Wi-Fi every time a car drives past a camera due to AI features triggering, etc.
For something meant for small businesses I wish they would just shove an Intel i5 or something in it. They make great switches, great APs, great everything else, just too stingy on processors on the few pieces of central equipment that people would actually be willing to spend more on.
And for a $3999 enterprise NAS with dual 25 Gbps SFP ports and 16 drives? It could surely use something more beefy than a Neoverse N2. I'd say an i7 or even i9 is warranted here.
3. The UNAS 8 I don't own but I believe it would struggle with >1Gbps links and encryption enabled
1. Same here - but it's only become a problem as protect has gained features (# of cameras stayed the same). I got a UNVR Instant and all the issues went away (I have been waiting for an updated 1U NVR but still not out yet). It sucks, but otoh protect is light years better than it had been.
I dont mind using ARM for NAS, but (to be fair I have not looked in a while) the issue is they tend to not have many pcie lanes. Looks like the N2 can have up to 64 @pcie5 so if it's built well, I don't think the CPU will be too much of a bottleneck.
Hell I'll put it out there - some company should make a NAS-specific ARM chip line to make lines of way less expensive (well pre the current troubles) base NAS enclosures with lots of NVMe etc.
Unifi docs say that the AI feature run directly on the camera or via optional devices like the AI Port or AI Key. Odd that it impacts your UDM Pro and wifi.
I'm sure even if the camera runs the neural net, the detection itself triggers clips to be stored, re-encoded, indexed, etc. and the UDM Pro's processor is underpowered even for this.
It's even underpowered for streaming -- I found Protect to be extremely laggy, taking often 30+ seconds to open the camera stream when 3-4 stream receivers were connected.
I have a udm se, 10 g3 cams, 4k bullet+ai, door entry + cam +ai, couple of the display viewports running all day and a nano hd access point and symmetric gig with intrusion etc turned on. I also have wireguard users connecting in remotely.
No problems with performance whatsoever at this point.
Ok its not enterprisy its just a small business with 20 people but seems fine to me. I run synology servers.
The Cloud Key Gen 2 is underpowered depending what you do with it, and it runs hot. UniFi seriously needs to refresh it. (At least it’s better than the Gen 1. The Gen 1 was disastrously bad.)
The ENAS looks like fairly nice hardware. It even has ECC RAM. Not cheap, though.
It says 8 Arm Neoverse N2 cores in the blog post. So not directly ARM Cortex, derived from ARM Cortex-X3 but same family as NVIDIA Grace, Google Axion and AWS Graviton4.
It's based on Neoverse N2 which in our other platforms (e.g., ENVR Core, UDM Beast, EF Core) has contributed to vast improvements in performance versus ARM Cortex.
> "Dual 25 Gigabit SFP28 ports and redundant power supplies for resilience"
Can you actually saturate the links with the spinning drives?
I've had the hardest time making my TrueNAS ZFS server fast when it was filled with HDD spinning disks. I initially also had 12 of them trying to get maximum speed. I have 128GB RAM and a 10G ethernet connection. I tried all types of optimizations like L2ARC via NVMe, etc, and it wasn't very effective and just too much time spent tweaking and testing.
Instead I just threw up my hands and replaced all the spinning disks with NVMe drives for the data I actually shared (8x 4TB NVMe drives.) And now it very usable and no need for LRArc, etc. Random or streaming access is equally fast.
Best choice I made. Now I did do this over a year ago so I skipped the NVMe price inflation.
I still keep 4 spinning disks but it is for archival data that I expect to never access unless something bad happens. It is slow and I use it like a tape drive.
I have a backup node with a 40G NIC & a ZFS pool of just 8x HDDs set up as a pool of two RAIDZ1 vdevs striped together (i.e. 4x drives in raidz1-0 & 4x drives in raidz1-1 make up the "backup" pool). Restoring full backup images to another server I usually get ~11-12 Gbps over NFS, no flash cache or anything involved.
Honestly, outside of random access/small file access, my primary NVMe ZFS server isn't all that much faster in raw throughput - despite being 22x NVMe drives going direct to the CPU instead of 8 HDDs going through a SATA controller. I think it's easier to hit other bottlenecks with ZFS/network transfers well before the disk throughput itself. E.g., enabling jumbo frames for NFS did still give me a decent perf/efficiency bonus.
> Can you actually saturate the links with the spinning drives?
There can easily be a bottleneck depending on how the setup the sata/sas, but if you can get sustained sequential reads or writes, 16x drives at 6 Gbps sata should be able to saturate 2x 25 Gbps ethernet. The store link shows two expansion ports as well which should help get bandwidth to the point where 25 Gbps is useful.
Less likely with random reads/writes or mixed use.
with the zil/slog on nvme yes -- you would want redundant power, UPS and a raid of nvme drives but with all that in place the data would get securely written to flash media before being flushed to spinning rust.
That seems reasonable, I don't buy NAS for datacenters (just run a modest 80tb one for my home lab) but equivalent rackmount 16-bay ones from other vendors would be more expensive (maybe $5k-6k?) and with less polish.
That's without storage. They are charging $750 each for 24tb HDD's, so filling it up brings that cost to $16k. Only need to run it for 13+ years and have zero HDD failures in that time, and then pay for all the media you are going to load it up with. Not exactly sure this would be cheaper or easier than just paying for streaming services and cancelling them when you don't need them.
As a Synology owner, I would not recommend anyone to get into Synology at this point after the drive BS they pulled off. I'm planning on building myself a DIY server with Unraid instead.
Been a long time fan of Ubiquiti, and I think this product will do particularly well in small-medium businesses. Think of the local marketing firm with 40 employees. They likely have an office with Unifi networking, and they LIKELY hire an MSP to do their IT work. An MSP will easily try to sell this as their storage solution since they can manage the infrastructure with one login to the UBNT dashboard.
Is this some xBSD or UniFi OS (debian) with ZFSoL? Can't tell from what they've written. 8C+64GB: enough for essential block+file service, but not for dedup and other demanding ZFS features. Also, doesn't appear the controller is redundant; just the power supplies. iSCSI is headlined; nice they didn't limit this to file. No mention of object store, or NVMe-oF.
Seems like a nice, basic, affordable platform for workgroup/SME stuff. Not NetApp/Pure Storage "enterprise" grade though.
They seem to follow the anti-corruption layer model for most of their offerings, so I would expect they use what ever OS is best supported by the upstream.
It is a large reason they can mitigate vendor risk IMHO, offering different tiers of switches as an example without being held hostage by on particular switch IC vendor like many brands.
I do wish someone would take up comstar though, netapp bought and killed several jbod lines etc… to kill it before Oracle bought Sun and also killed it to protect their enterprise storage offerings.
NVMe-oF may be a possibility because there are FPGA IP vendors but without comstar there are some challenges IMHO.
I was literally looking today to see if there was any news on this, because it’s been widely assumed that they’d release it.
$4000 is… a lot. I can buy a used CSE-846 for about 1/4 of that, an X10–era mobo for a few hundred bucks, and have 1.5x the bays (tbf, also 4U instead of 3U). Managing ZFS is just not that hard; it’s not Ceph. If you want easy mode, throw TrueNAS on it, and you’ll get an awesome UX that abstracts away everything difficult.
If this were < $3000, I’d probably buy it. I’ve been holding off on replacing my two CSE-826 because I’ve been waiting for this to come out. Disappointing.
Think about the competitors - they're aiming at the Synology RackStations and similar, which are $3-5k without drives.
The segment UI and Synology are in are 10x more than the minisforum, beelink, qnap, cwwk type devices, but still 1/10 of the price of getting started in enterprise gear from HPe, Dell, Pure, etc.
This is not a homelab replacement part. It’s enterprise with all the positive and negatives that come with that phrase. The second you start talking about old X hardware, it’s a different product class.
For that use case I recommend UNas from ugreen or the minis forum ryzen Ai stuff.
i like their gear, I bought a whole bunch, but I couldn't and can't figure out how to give my wife access to their Protect app as well. It's absurd to the point where their MFA sent doesn't work when trying to authorize her - and judging by reddit posts etc I'm not the only one. Such mundane things are where UI falls apart, wrong details. Instead of giving elves resources to pack each individual rackmount screw, if they spent some more time on workflows and software, they'd be a truly great company.
What is the current state of ZFS? I know it had some licensing issues traditionally, despite it being a delight to use every time I've tried it. Is it back?
Never went away, Linux is now the primary target platform for OpenZFS (which is basically synonymous with ZFS these days). TrueNAS/iXSystems (probably the main commercial company using ZFS) moved from FreeBSD to Linux. Major new features like pool expansion have been added after years of requests. Etc., it's a good time for ZFS on Linux.
There ARE licensing issues related to shipping it compiled into the kernel, but you can install it as a kernel module on every mainline distro nowadays which is functionally the same from a user perspective.
ZFS on Linux works great, but with most distributions, it will compile the kernel module on device upon installation. Only Ubuntu distributes binaries.
As a consequence, you don't necessarily want a rolling distro, as the ZFS module can get out of sync with the kernel.
ZFS itself is build for both BSD and Linux from the same source, so there's feature parity there.
It's true for HDDs. They don't maintain a list of compatible third-party HDDs, but you use them perfectly fine. No errors, drive health monitoring works, etc.
>Now, with the release of DSM 7.3, Synology has quietly walked the policy back. Third-party hard drives and 2.5-inch SATA SSDs can once again be used without triggering warning messages or reduced functionality. Drives from Seagate, WD, and others will work exactly as they did before—complete with full monitoring, alerts, and storage features.
They still require you to buy their overpriced (even by AI bubble standards) NVMe drives with zero third-party support. There is a project that adds third-party SSD support for newer Synology devices, but you need to redo it every time your NAS updates, so it's very much unsupported. Would definitely not say that they "recanted immediately".
I am highly interested in this, especially if it works well with Time Machine to do backups over the network. I've got a fully 10GbE + WiFi 7 network w/ Ubiquiti gear already, would love to ditch my janky DIY NAS setup for something that is integrated with the rest and could potentially give me a better backup setup for my photography as well as enough storage to act as a media server.
I have a UNAS-Pro, which runs the same Unifi Drive software as this, and it works great for Time Machine backups. Dead simple.
I also have tons of other Ubiquiti gear, and honestly there's not a ton of synergy between the NAS and everything else. It's a great NAS though. And also, it's only a NAS. It's not an application server like a Synology NAS.
Wireless Time Machine backup works until one day, Time Machine decides to shit the bed. Do not trust it. Invest in a different backup solution if your data is at all important to you. Something like Arq or Backblaze or tarsnap.
I hear this sentiment a lot, but I've not had a problem with Time Machine in years across multiple MacBooks in my household. Backing up to TrueNAS. Unifi networking. It Just Works.
I just checked any my oldest TM backup for the MacBook from which I'm typing is 2023-09-14. This MacBook has a 2 TB SSD and I have the TM volume quota set to 3 TB. TM culls old backups as needed.
The TM GUI is still terrible, but you can use `tmutil listbackups` to easily access backups from the command line.
I use the 3-2-1 strategy for backups. I keep one copy off-site by using cloud backups, currently I primarily use Backblaze for that purpose but am considering alternatives for several reasons. I keep a second copy on an external SSD via Time Machine, and I keep one copy on-device. I'd like to use network Time Machine to get rid of the inconvenience of having a bunch of USB external SSDs floating around, especially since none of them are large enough to backup my entire drive if I get close to filling it.
I appreciate the perspective, I definitely take backups seriously for my photography.
A 2-drive Synology (e.g. DS225+) in RAID 0 or RAID 1 works fine for this, for 90% less than this beast. Synology documented their optimal settings for Time Machine a couple years ago, too. Hope this is helpful. [1]
Or if you want something from a vendor butting running decade old hardware configs and trying to lock people into their drive ecosystem, UNas or many other options.
Gives the peace of mind that even when the sparsebundle shits the bed, you can rollback to a suitable snapshot and only lose a small period of backups, rather than having to lose the entire history and start again from scratch.
(I say when, not if, through considerable experience over the last 15 years that it will always, inevitably, shit the bed.)
Are Ubiquiti products commonplace for companies that contract with the US government outside of the DoD/DoW?
Since DoD/DoW generally requires STIG compliance, and none authored are for any specific Ubiquiti product, we can cross that off the list. Sure they can get exceptions or use a more generalized STIG but stakeholders generally have pre-defined limitations on what they will and will not allow on networks they sponsor.
I love by Dream Machine Pro. Seems to just work and keep everything up to date. I have it running my security cameras as well and it has been pretty much bullet proof.
What needs do you have for a router that the Cloud Gateway is missing or is bad at? A PiHole equivalent is about all I can think I'm missing.
+1 for Dream Machine Pro. Own one at home and have stretched them pretty far in SMB environments.
I use it with 8 APs in a mesh and a few switches, all UI, and it just works. I also have a lot of success helping out some local SMBs by setting up UI for them.
IPv6 support is basic at best. The zone-based firewall is very prescriptive and limited. ACL stuff is not great. To increase the MTU of the physical interface connected to the ISP I would need to hack a systemd unit that did it on boot (I either need it at 1508 so the PPPoE interface uses 1500, or I need to MSS clamp it and have it effectively reduced to 1492). Initial configuration requires the device to be connected to the Internet.
There were a few other niggles, and in the end I just found it easier to do what I need on OpenWRT.
I went with eero and really wish I'd gone with unifi
Apart from the shitty software and basic features either missing or locked behind a monthly cost, the network itself is not bad at all, I get 600-700mbps on wifi throughout the house and have my servers wired on 2.5gbe
But the one thing I really thought I was buying into by choosing an amazon brand was ease when it came to buying upgrades, and yet I ended up having to buy extra hardware (like the wired gateway) from ebay and sellers in the US as amazon does not sell their own hardware everywhere
I started with Unifi and it's been pretty great overall. I've integrated all the cameras into Home Assistant, it's all local, and can bridge with HomeBridge so it all shows up and plays nicely with HomeKit as well. Rock solid and very few complaints.
I've had standalone routers, Eero Pro, Google Wifi, TP Link Deco, TP Link Omada, and probably some I'm forgetting. They all had something that just enraged me.
I finally bought a Unifi and I'm very happy with it so far, 6 months in. There's a few things I haven't tried, like rebooting it while it doesn't have an internet connection (I'm looking at you, Deco!), but so far my big complaints are that it's opinionated about the initial setup, and setting up a static IP for a device that isn't connected yet is a serious PITA. I had devices on my old system that I didn't want to have to change IPs (because the computers talk to each other) and that was not easy. If I had to do it again, I'd probably just let it do what it wants and deal with changing all those configs to the new IPs.
FWIW, I just have it as a router, and my Wifi is still some of my expensive standalone Asus wifi routers acting as just access points. I didn't see a point in replacing them when they were working great as APs.
Who said it was bad? I thought we were all pretty much in agreement that it was good, and the only thing holding it back from wider adoption into e.g. the Linux kernel was the poison-pill of Oracle's ownership and licensing.
another thing holding it back is the threat of a lawsuit from Netapp.
source: used to work for a storage vendor that was marketing a NAS based on ZFS and got credible threats from Netapp to the point that we sought a partnership with Oracle that included indemnification under Oracles settlement with Netapp.
I remember all this too. The time period that I was in this scene was AFTER 2010 though so who knows. As mentioned in response to the sibling "credible sources" bro, I was just a lowly support engineer so i had to trust that the CEO wasn't lying to us about all this.
Maybe he was ... they do that sometimes.
I looked around a little. the C&D from Netapp was in ~July 2010 and the partnership and product with Oracle in the Fall (Around the cease fire) and we continued with that (via the Oracle Partnership) through 2011-2015 when the company ran out of cash and laid us all off.
sorry, don't have a link to the CEO telling us that we were signing a partnership with oracle that included the indemnification.
I was just a lowly support engineer so not privy to all the legal details that the executives were dealing with. I too had to just take them at their word.
I'm glad to see UBNT in this space.
I've always used ZFS because it's vastly superior to other options. When I see storage companies building without fault tolerance, or without a merkle tree (so that you can backup deltas efficiently without having to recompute them) it's a sign their marketing team has more influence over the company than their engineers.
Sadly, the few ZFS COTS options have been somewhat underpowered. QNAP supports ZFS filesystems, but their backup configuration won't let you arrange for a nas to pull from the source (instead of the source doing a push.) You can still pull it off by scheduling your own cron job, but this somewhat defeats the purpose of paying extra for a vendor solution.
UBNT is still supporting my 15 year old edgerouters with security updates, and their interface is clean and usable for anyone with basic network experience. And their video surveillance solutions are unusual in that they allow you to keep your footage entirely onsite and offline, an uncommon level of privacy. If they can bring the same polish to their storage solutions, I'll be using these new products for a long time.
The same is true for our AI processing on the cameras. This is entirely local and private. You can even air gap the UniFi Protect system from the Internet and it'll operate fine.
I do like the onboard AI, and it works well for entity detection (like people). We haven't found the face detection to be very reliable in outdoor security applications. There doesn't seem to be a way to correct/combine classes if someone's detected as multiple individuals on different occasions, so we end up with the same person detected as 5 "unknown"s. This is not a hard problem to solve. You'd just allow embedding matching to different face groups, but it's annoying as a user.
The cost is just insane though. $4-$500 for a camera that I can get equivalent specs for $50-100.
IME those sub-$100 Chinese IP cameras have you at the mercy of whatever firmware they cut from the master branch the week they shipped it. People don't buy UI because they win on specs-per-dollar. They buy it because they win on results-per-dollar.
With face detection? License plates? Tamper protection?
I'm guessing you're thinking Reolink or other Chinese ultra-commodity cam. It's fine, it's just in a different product class and ecosystem - and that's where enterprises fit in, they want that support+ecosystem and not DIYing.
Reolink CX820 8MP $129 https://reolink.com/product/cx820/
Unifi G6 8MP ~$300 https://techspecs.ui.com/unifi/physical-security/uvc-g6-dome...
Avigilon H6A 8MP ~$1200 https://www.avigilon.com/security-cameras/h6a-dome
They're not all $500, some are $150-300. Overall price comparable to Honeywell, but more than, say, Lorex.
All the basic G6 cameras are in the $200 range and have edge compute?
What's the comparison at $50-100?
Can I use it without running some inane management VM?
The UDM runs mine, but prior to that I ran a Docker container with it. It worked well.
https://hub.docker.com/r/linuxserver/unifi-controller
Genuine question, if you're running unifi, why don't you want the management vm? Synology makes a decent NAS without the controller.
Synology hardware stopped being decent a while ago.
Plus their drive type restrictions which are poison in a cost-sensitive NAS.
(Seemingly rolled back recently, but a roll back can be easily rolled back itself. I don't trust them enough to count on that not happening.)
I like the hardware, cannot stand needing to run another machine just for management.
If you get one of the Cloud devices, you won't need to, as they bring their own.
What's UBNT?
Stock symbol for Ubquiti, the company being discussed.
Thanks. I wish people could just say the company name instead of using random aliases, but I guess it's some sort of cultural thing.
Ubiquity Networks Inc.
> QNAP supports ZFS filesystems
Do they have ecc on those models? Do you have an example model on hand?
Some do. I got the TS-873A a few years back, it works. Their software is kind of weird, and I wouldn't connect it to their cloud offering, but it does work.
Ubiquiti's biggest feature is no monthly recurring cost. I really hope they continue the streak on products like this. Seems like anything else bought up these days is switched to an MRR model with no vision into the long term viability.
*yet
They will at some point just cash out.
They've been at this for a while. They do have offerings you subscribe for and pay monthly. They have also consistently offered an option for each of those offerings to bring your own or self host. They've earned my trust.
>>they’ve earned my trust
Boy I hope Broadcom didn’t hear that…
Recently they removed the option to take certain types of backup locally (for the Network app). Now it only does it to the cloud, for those who allow this. It’s these small things that make me cautiously pessimistic that long term Ubiquity won’t pull the rug from under the customers.
Once you invest thousands in network equipment or cameras you’re less likely to jump ship when they start sneaking things in. And this is long lived equipment, not the kind you anyway replace every couple of years. So that’s a relatively strong lock-in.
They would be shooting themselves in the foot in the long term. I was surprised to learn that Ubiquiti is a publicly traded company, but also the CEO and founder owns the mass majority of the shares, so he is not beholden by shareholders wanting to enshittify the company for the same of increased stock prices.
I tend to agree with you.
In my opinion, as long as the majority of their profits come from people continuing to buy the self-host devices, it is fairly unlikely they'll ever stop offering those devices. Why change a working business model?
Yes, subscription models are enticing for that recurring revenue... number must go up, right? /s
If a majority of your sales are not in subscription products though, I think it would be foolish for a business to blow off its own leg trying to chase that particular dragon.
Then again... businesses have made dumber calls in the past out of nowhere...
They are already a public company.
93% owned by the founder.
You can take a public company private and then run it to the ground. See also: Twitter.
How does that work now they are a subsidiary of SpaceX?
Does that make the rotting corpse of Twitter public again?
Yes. Although the amount of SpaceX stock that's available for public is fairly little.
And those classes available for the public has less voting rights than Elons stock so even worse.
I just wish they would put better processors in their stuff. Is this yet another NAS powered by an ARM Cortex?
I have heard others say the same as you about Ubiquiti devices. I genuinely curious what bottlenecks you've hit.
I've only been using Ubiquiti as a pro-sumer, but it has held up well for my use case of Plex and little game servers.
I use a Synology NAS for my storage though, which is a slightly beefier mobile AMD chipset.
I'd be very interested to know what I should and shouldn't expect from my ARM based network stack though!
> I genuinely curious what bottlenecks you've hit.
1. My UDM Pro absolutely chokes and stalls with intrusion detection enabled on the firewall and 8 cameras connected. Network goes down, cameras disconnect, devices disconnect from Wi-Fi every time a car drives past a camera due to AI features triggering, etc.
For something meant for small businesses I wish they would just shove an Intel i5 or something in it. They make great switches, great APs, great everything else, just too stingy on processors on the few pieces of central equipment that people would actually be willing to spend more on.
And for a $3999 enterprise NAS with dual 25 Gbps SFP ports and 16 drives? It could surely use something more beefy than a Neoverse N2. I'd say an i7 or even i9 is warranted here.
3. The UNAS 8 I don't own but I believe it would struggle with >1Gbps links and encryption enabled
1. Same here - but it's only become a problem as protect has gained features (# of cameras stayed the same). I got a UNVR Instant and all the issues went away (I have been waiting for an updated 1U NVR but still not out yet). It sucks, but otoh protect is light years better than it had been.
I dont mind using ARM for NAS, but (to be fair I have not looked in a while) the issue is they tend to not have many pcie lanes. Looks like the N2 can have up to 64 @pcie5 so if it's built well, I don't think the CPU will be too much of a bottleneck.
Hell I'll put it out there - some company should make a NAS-specific ARM chip line to make lines of way less expensive (well pre the current troubles) base NAS enclosures with lots of NVMe etc.
Yeah mine solved once I got a UNVR as well but I would have rather paid for a better processor in the UDM Pro and not needed to buy a separate UNVR.
Unifi docs say that the AI feature run directly on the camera or via optional devices like the AI Port or AI Key. Odd that it impacts your UDM Pro and wifi.
I'm sure even if the camera runs the neural net, the detection itself triggers clips to be stored, re-encoded, indexed, etc. and the UDM Pro's processor is underpowered even for this.
It's even underpowered for streaming -- I found Protect to be extremely laggy, taking often 30+ seconds to open the camera stream when 3-4 stream receivers were connected.
Yeah . Sounds like horseshit to me to be frank.
I have a udm se, 10 g3 cams, 4k bullet+ai, door entry + cam +ai, couple of the display viewports running all day and a nano hd access point and symmetric gig with intrusion etc turned on. I also have wireguard users connecting in remotely.
No problems with performance whatsoever at this point.
Ok its not enterprisy its just a small business with 20 people but seems fine to me. I run synology servers.
The Cloud Key Gen 2 is underpowered depending what you do with it, and it runs hot. UniFi seriously needs to refresh it. (At least it’s better than the Gen 1. The Gen 1 was disastrously bad.)
The ENAS looks like fairly nice hardware. It even has ECC RAM. Not cheap, though.
It says 8 Arm Neoverse N2 cores in the blog post. So not directly ARM Cortex, derived from ARM Cortex-X3 but same family as NVIDIA Grace, Google Axion and AWS Graviton4.
It's based on Neoverse N2 which in our other platforms (e.g., ENVR Core, UDM Beast, EF Core) has contributed to vast improvements in performance versus ARM Cortex.
> "Dual 25 Gigabit SFP28 ports and redundant power supplies for resilience"
Can you actually saturate the links with the spinning drives?
I've had the hardest time making my TrueNAS ZFS server fast when it was filled with HDD spinning disks. I initially also had 12 of them trying to get maximum speed. I have 128GB RAM and a 10G ethernet connection. I tried all types of optimizations like L2ARC via NVMe, etc, and it wasn't very effective and just too much time spent tweaking and testing.
Instead I just threw up my hands and replaced all the spinning disks with NVMe drives for the data I actually shared (8x 4TB NVMe drives.) And now it very usable and no need for LRArc, etc. Random or streaming access is equally fast.
Best choice I made. Now I did do this over a year ago so I skipped the NVMe price inflation.
I still keep 4 spinning disks but it is for archival data that I expect to never access unless something bad happens. It is slow and I use it like a tape drive.
You can fill it with NVME, and SFP28 is so common the prices are cheap:
https://www.fs.com/c/25g-sfp28-3215
But no, spinning disks won't saturate it, even if you were doing 100% sequential reads.
I have a backup node with a 40G NIC & a ZFS pool of just 8x HDDs set up as a pool of two RAIDZ1 vdevs striped together (i.e. 4x drives in raidz1-0 & 4x drives in raidz1-1 make up the "backup" pool). Restoring full backup images to another server I usually get ~11-12 Gbps over NFS, no flash cache or anything involved.
Honestly, outside of random access/small file access, my primary NVMe ZFS server isn't all that much faster in raw throughput - despite being 22x NVMe drives going direct to the CPU instead of 8 HDDs going through a SATA controller. I think it's easier to hit other bottlenecks with ZFS/network transfers well before the disk throughput itself. E.g., enabling jumbo frames for NFS did still give me a decent perf/efficiency bonus.
> Can you actually saturate the links with the spinning drives?
There can easily be a bottleneck depending on how the setup the sata/sas, but if you can get sustained sequential reads or writes, 16x drives at 6 Gbps sata should be able to saturate 2x 25 Gbps ethernet. The store link shows two expansion ports as well which should help get bandwidth to the point where 25 Gbps is useful.
Less likely with random reads/writes or mixed use.
with the zil/slog on nvme yes -- you would want redundant power, UPS and a raid of nvme drives but with all that in place the data would get securely written to flash media before being flushed to spinning rust.
Store page: https://store.ui.com/us/en/category/network-storage/products...
$3999
That seems reasonable, I don't buy NAS for datacenters (just run a modest 80tb one for my home lab) but equivalent rackmount 16-bay ones from other vendors would be more expensive (maybe $5k-6k?) and with less polish.
> a modest 80tb one for my home lab
I laughed.
Pays for itself in ~40 months of not paying $100/month for streaming services.
Edit: Drives are not included :(
That's without storage. They are charging $750 each for 24tb HDD's, so filling it up brings that cost to $16k. Only need to run it for 13+ years and have zero HDD failures in that time, and then pay for all the media you are going to load it up with. Not exactly sure this would be cheaper or easier than just paying for streaming services and cancelling them when you don't need them.
You don't have to buy from them, you can get third party hard drives. Although those are expensive too
Yeah, not dramatically cheaper.
The drives are the expensive part, though - 16x24TB HDDs adds another $11k.
(Not that you need that much for canceling streaming, I’d get a home Synology or diy TrueNAS for that anyway)
As a Synology owner, I would not recommend anyone to get into Synology at this point after the drive BS they pulled off. I'm planning on building myself a DIY server with Unraid instead.
Been a long time fan of Ubiquiti, and I think this product will do particularly well in small-medium businesses. Think of the local marketing firm with 40 employees. They likely have an office with Unifi networking, and they LIKELY hire an MSP to do their IT work. An MSP will easily try to sell this as their storage solution since they can manage the infrastructure with one login to the UBNT dashboard.
Is this some xBSD or UniFi OS (debian) with ZFSoL? Can't tell from what they've written. 8C+64GB: enough for essential block+file service, but not for dedup and other demanding ZFS features. Also, doesn't appear the controller is redundant; just the power supplies. iSCSI is headlined; nice they didn't limit this to file. No mention of object store, or NVMe-oF.
Seems like a nice, basic, affordable platform for workgroup/SME stuff. Not NetApp/Pure Storage "enterprise" grade though.
They seem to follow the anti-corruption layer model for most of their offerings, so I would expect they use what ever OS is best supported by the upstream.
It is a large reason they can mitigate vendor risk IMHO, offering different tiers of switches as an example without being held hostage by on particular switch IC vendor like many brands.
I do wish someone would take up comstar though, netapp bought and killed several jbod lines etc… to kill it before Oracle bought Sun and also killed it to protect their enterprise storage offerings.
NVMe-oF may be a possibility because there are FPGA IP vendors but without comstar there are some challenges IMHO.
Their other UNAS devices are based on debian11. I'm curious what the bootdrive on the ENAS runs since ZFS is dkms on debian
Could be Linux as well since ZFS on Linux is pretty good now. It would fit in with their other devices which are also Linux based AFAIK.
How much?
I was literally looking today to see if there was any news on this, because it’s been widely assumed that they’d release it.
$4000 is… a lot. I can buy a used CSE-846 for about 1/4 of that, an X10–era mobo for a few hundred bucks, and have 1.5x the bays (tbf, also 4U instead of 3U). Managing ZFS is just not that hard; it’s not Ceph. If you want easy mode, throw TrueNAS on it, and you’ll get an awesome UX that abstracts away everything difficult.
If this were < $3000, I’d probably buy it. I’ve been holding off on replacing my two CSE-826 because I’ve been waiting for this to come out. Disappointing.
Think about the competitors - they're aiming at the Synology RackStations and similar, which are $3-5k without drives.
The segment UI and Synology are in are 10x more than the minisforum, beelink, qnap, cwwk type devices, but still 1/10 of the price of getting started in enterprise gear from HPe, Dell, Pure, etc.
This is not a homelab replacement part. It’s enterprise with all the positive and negatives that come with that phrase. The second you start talking about old X hardware, it’s a different product class.
For that use case I recommend UNas from ugreen or the minis forum ryzen Ai stuff.
I recently bought a used Dell R240 and 4x 20TB for less than this. From TechmikeNY if anyone's interested.
i like their gear, I bought a whole bunch, but I couldn't and can't figure out how to give my wife access to their Protect app as well. It's absurd to the point where their MFA sent doesn't work when trying to authorize her - and judging by reddit posts etc I'm not the only one. Such mundane things are where UI falls apart, wrong details. Instead of giving elves resources to pack each individual rackmount screw, if they spent some more time on workflows and software, they'd be a truly great company.
I created a user for my wife, set up the Protect App on her phone and she has the same access to the cameras as me.
What is the current state of ZFS? I know it had some licensing issues traditionally, despite it being a delight to use every time I've tried it. Is it back?
Never went away, Linux is now the primary target platform for OpenZFS (which is basically synonymous with ZFS these days). TrueNAS/iXSystems (probably the main commercial company using ZFS) moved from FreeBSD to Linux. Major new features like pool expansion have been added after years of requests. Etc., it's a good time for ZFS on Linux.
There ARE licensing issues related to shipping it compiled into the kernel, but you can install it as a kernel module on every mainline distro nowadays which is functionally the same from a user perspective.
ZFS on Linux works great, but with most distributions, it will compile the kernel module on device upon installation. Only Ubuntu distributes binaries.
As a consequence, you don't necessarily want a rolling distro, as the ZFS module can get out of sync with the kernel.
ZFS itself is build for both BSD and Linux from the same source, so there's feature parity there.
I really want a object store in my storage appliance :(
Would be nice to have a CSI, but I can probably just use democratic-csi like I already do on my homemade ZFS based storage appliance.
> with ... no firmware restrictions on drive models, organizations can scale capacity without being restricted by proprietary hardware ecosystems.
This looks like a dig at Synology, who do this.
They did it for a very short time. The community backlash was so bad that they recanted immediately.
I'm not at all surprised that Ubiquiti is getting ahead of that and promising it from the start.
Not immediately, it took about half a year of watching sales numbers drop, and they still have restrictions.
Kinda, NVME devices still need to be on their HCL and are priced about what you would expect.
> Synology recanted immediately
Is that correct? Looking at a common flagship model, the 4-Bay DS925+
and then the "Compatibility list" here https://www.synology.com/en-global/compatibility?search_by=d...
I see only Synology branded drives.
Synology do not make their own hard drives. They are rebadged.
It's true for HDDs. They don't maintain a list of compatible third-party HDDs, but you use them perfectly fine. No errors, drive health monitoring works, etc.
https://www.guru3d.com/story/synology-reverses-policy-bannin...
>Now, with the release of DSM 7.3, Synology has quietly walked the policy back. Third-party hard drives and 2.5-inch SATA SSDs can once again be used without triggering warning messages or reduced functionality. Drives from Seagate, WD, and others will work exactly as they did before—complete with full monitoring, alerts, and storage features.
NVMe SSDs are different.
They still require you to buy their overpriced (even by AI bubble standards) NVMe drives with zero third-party support. There is a project that adds third-party SSD support for newer Synology devices, but you need to redo it every time your NAS updates, so it's very much unsupported. Would definitely not say that they "recanted immediately".
I am highly interested in this, especially if it works well with Time Machine to do backups over the network. I've got a fully 10GbE + WiFi 7 network w/ Ubiquiti gear already, would love to ditch my janky DIY NAS setup for something that is integrated with the rest and could potentially give me a better backup setup for my photography as well as enough storage to act as a media server.
I have a UNAS-Pro, which runs the same Unifi Drive software as this, and it works great for Time Machine backups. Dead simple.
I also have tons of other Ubiquiti gear, and honestly there's not a ton of synergy between the NAS and everything else. It's a great NAS though. And also, it's only a NAS. It's not an application server like a Synology NAS.
I only wish UNAS support ZFS.
Wireless Time Machine backup works until one day, Time Machine decides to shit the bed. Do not trust it. Invest in a different backup solution if your data is at all important to you. Something like Arq or Backblaze or tarsnap.
I hear this sentiment a lot, but I've not had a problem with Time Machine in years across multiple MacBooks in my household. Backing up to TrueNAS. Unifi networking. It Just Works.
I just checked any my oldest TM backup for the MacBook from which I'm typing is 2023-09-14. This MacBook has a 2 TB SSD and I have the TM volume quota set to 3 TB. TM culls old backups as needed.
The TM GUI is still terrible, but you can use `tmutil listbackups` to easily access backups from the command line.
I also use Arq to B2.
I use the 3-2-1 strategy for backups. I keep one copy off-site by using cloud backups, currently I primarily use Backblaze for that purpose but am considering alternatives for several reasons. I keep a second copy on an external SSD via Time Machine, and I keep one copy on-device. I'd like to use network Time Machine to get rid of the inconvenience of having a bunch of USB external SSDs floating around, especially since none of them are large enough to backup my entire drive if I get close to filling it.
I appreciate the perspective, I definitely take backups seriously for my photography.
A 2-drive Synology (e.g. DS225+) in RAID 0 or RAID 1 works fine for this, for 90% less than this beast. Synology documented their optimal settings for Time Machine a couple years ago, too. Hope this is helpful. [1]
[1] https://kb.synology.com/en-us/DSM/tutorial/How_to_back_up_fi...
Or if you want something from a vendor butting running decade old hardware configs and trying to lock people into their drive ecosystem, UNas or many other options.
Stay away from synology.
I think a combination of:
1/ ZFS datasets with hourly (or daily) snapshots
2/ Samba with vfs_fruit
Gives the peace of mind that even when the sparsebundle shits the bed, you can rollback to a suitable snapshot and only lose a small period of backups, rather than having to lose the entire history and start again from scratch.
(I say when, not if, through considerable experience over the last 15 years that it will always, inevitably, shit the bed.)
I'm reminded of the Sun Fire X4500 "Thumper" for which ZFS was originally developed. 48 SATA drives packed in a slide-out rack: https://www.youtube.com/watch?v=-zQ5RLAyA7w
Looks interesting, but likely lacks FIPS support which makes it an issue for companies that work with the government.
Are Ubiquiti products commonplace for companies that contract with the US government outside of the DoD/DoW?
Since DoD/DoW generally requires STIG compliance, and none authored are for any specific Ubiquiti product, we can cross that off the list. Sure they can get exceptions or use a more generalized STIG but stakeholders generally have pre-defined limitations on what they will and will not allow on networks they sponsor.
Maybe worth noting that TrueNAS added FIPS in 2024:
* https://www.truenas.com/blog/truenas-security-in-2024/
FIPS mode is the greatest
Not really deal breaker for most customers
I've never been a fan of Ubiquiti's proprietary solutions, but this might actually be one product that I can be enthusiastic about.
They are getting better.
After a long time they introduced ONVIF into their camera products which basically opened it to everyone.
I've recently been convinced to implement a Unifi stack for my home network. I got a Cloud Gateway, a 10G switch and a couple WiFi APs.
The Cloud Gateway will be sold or given away. It's utter crap. I'm now building an OpenWRT container on IncusOS as my Internet gateway/router.
The switch is meh. It's easy to admin, which is nice - though I'm having to run UnifiOS on another container on said IncusOS.
The APs are fine. Decent power and the central administration with the switch is actually quite nice.
If I knew everything I know now, I wouldn't have bought any of those but they will do for now.
I love by Dream Machine Pro. Seems to just work and keep everything up to date. I have it running my security cameras as well and it has been pretty much bullet proof.
What needs do you have for a router that the Cloud Gateway is missing or is bad at? A PiHole equivalent is about all I can think I'm missing.
+1 for Dream Machine Pro. Own one at home and have stretched them pretty far in SMB environments.
I use it with 8 APs in a mesh and a few switches, all UI, and it just works. I also have a lot of success helping out some local SMBs by setting up UI for them.
IPv6 support is basic at best. The zone-based firewall is very prescriptive and limited. ACL stuff is not great. To increase the MTU of the physical interface connected to the ISP I would need to hack a systemd unit that did it on boot (I either need it at 1508 so the PPPoE interface uses 1500, or I need to MSS clamp it and have it effectively reduced to 1492). Initial configuration requires the device to be connected to the Internet.
There were a few other niggles, and in the end I just found it easier to do what I need on OpenWRT.
just genuinely curious about your MTU use case and why this is required...?
I really like the DM Pro and have it deployed to an office of about 50 people. It's a pretty no-fuss solution and fairly simple to manage.
For my personal setup, I decided to go with OPNSense and I couldn't be happier. Much more control, at the cost of being a little more hands on.
I think the best (rough) comparison here is MacOS vs Linux (or more accurately in this case, FreeBSD).
I went with eero and really wish I'd gone with unifi
Apart from the shitty software and basic features either missing or locked behind a monthly cost, the network itself is not bad at all, I get 600-700mbps on wifi throughout the house and have my servers wired on 2.5gbe
But the one thing I really thought I was buying into by choosing an amazon brand was ease when it came to buying upgrades, and yet I ended up having to buy extra hardware (like the wired gateway) from ebay and sellers in the US as amazon does not sell their own hardware everywhere
I started with Unifi and it's been pretty great overall. I've integrated all the cameras into Home Assistant, it's all local, and can bridge with HomeBridge so it all shows up and plays nicely with HomeKit as well. Rock solid and very few complaints.
I've had standalone routers, Eero Pro, Google Wifi, TP Link Deco, TP Link Omada, and probably some I'm forgetting. They all had something that just enraged me.
I finally bought a Unifi and I'm very happy with it so far, 6 months in. There's a few things I haven't tried, like rebooting it while it doesn't have an internet connection (I'm looking at you, Deco!), but so far my big complaints are that it's opinionated about the initial setup, and setting up a static IP for a device that isn't connected yet is a serious PITA. I had devices on my old system that I didn't want to have to change IPs (because the computers talk to each other) and that was not easy. If I had to do it again, I'd probably just let it do what it wants and deal with changing all those configs to the new IPs.
FWIW, I just have it as a router, and my Wifi is still some of my expensive standalone Asus wifi routers acting as just access points. I didn't see a point in replacing them when they were working great as APs.
What were your constraints and how were they not met? Looking to buy the same, Dream Machine specifically.
What do you know now then?
See the answer I gave to the sibling comment.
Did we decide ZFS is good after all this time?
Who said it was bad? I thought we were all pretty much in agreement that it was good, and the only thing holding it back from wider adoption into e.g. the Linux kernel was the poison-pill of Oracle's ownership and licensing.
another thing holding it back is the threat of a lawsuit from Netapp.
source: used to work for a storage vendor that was marketing a NAS based on ZFS and got credible threats from Netapp to the point that we sought a partnership with Oracle that included indemnification under Oracles settlement with Netapp.
Oracle and NetApp 'mutually dismissed' in 2010:
* https://www.theregister.com/off-prem/2010/09/09/oracle-and-n...
* https://www.computerworld.com/article/1585889/opinion-patent...
NetApp originally sued then-independent Sun in 2007, and Sun counter-sued.
Free/TrueNAS/iXsystems has been offering ZFS-based solutions for many years now, and I haven't heard NetApp going after them:
* https://en.wikipedia.org/wiki/TrueNAS
* https://en.wikipedia.org/wiki/IXsystems
I remember all this too. The time period that I was in this scene was AFTER 2010 though so who knows. As mentioned in response to the sibling "credible sources" bro, I was just a lowly support engineer so i had to trust that the CEO wasn't lying to us about all this.
Maybe he was ... they do that sometimes.
I looked around a little. the C&D from Netapp was in ~July 2010 and the partnership and product with Oracle in the Fall (Around the cease fire) and we continued with that (via the Oracle Partnership) through 2011-2015 when the company ran out of cash and laid us all off.
Do we add this corp. body count to Oracle then? I'm pretty sure that Oracle partnership wasn't cheap.
only threats, no court cases or journalist writing about ZFS indemnification? IOW please provide links to credible sources.
sorry, don't have a link to the CEO telling us that we were signing a partnership with oracle that included the indemnification.
I was just a lowly support engineer so not privy to all the legal details that the executives were dealing with. I too had to just take them at their word.
ETA: I searched a bit. Here's a link
https://www.enterprisestorageforum.com/networking/netapp-thr...
Maybe threats were enough? I certainly wouldn't want to test it myself.
ZFS was always good. Linux support for ZFS was not so good for longer than you'd hope, but it's been reliable for some time now.
ZFS is amazing. It feels like magic.