It’s success compared to the other possibility: not raising money and going out of business. We still cheer when a rocket separates from the first stage and ignites the next. Things going as planned during a risky and challenging endeavor is still a good thing.
shill. or fan, prolly.
i don't use the more current word fanboy. ugh.
(when older words are good enough, why invent a new word. but I see that as a trend. each new generation wants to distinguish themselves from the past one. So they invent new words as one way of doing that. and some of them get adopted into general circulation or use.)
Unless the two words, fan and fanboy, mean the different things, which i'm not interested in checking out anyway.
(VP of Eng here) I filled out their sales form last year and never heard from them. We're currently spending $900k/year on AWS, and they didn't even acknowledge my request. crazy stuff.
I also think they work with government customers. I saw an open job position on their website requiring TS/SCI security clearance and full scope polygraph.
We had the opposite experience. We contacted them through their form this year and they were happy to discuss with us even when we communicated from the beginning we wouldn't be customer in the short to medium term and even for single rack systems.
The rack were not insanely expensive, expandable so you don't have to build fully stacked racks from the beginning. Purely based on a hardware, compares to other blade systems but pricier.
The interesting part was the software, management interface, Terraform provider and how everything just fit together. Having storage, network and compute all in a single managed rack package brings a lot of value and brings down TCO. Really appreciated the security group like approach to network policies.
Unfortunately I haven't worked with HPE or Dell recently so I'm not sure what they currently offer.
Ignoring a sales request for a company that wants to spend ~1M only to say pls reach out to me again after we had our second funding round in 2026? The OP literally could go back to their sales lead db and respond like a real business. So yeah unprofessional and embarrassing.
we spend 2-2.5M a year I wouldn’t consider us their product scale yet.
My understanding is the full rack is about $1.2M and smallest half rack is about $600k and this was before the RAM and other price hikes now.
You are still going to have some residual cloud workloads(so all AWS won’t migrate ) and HA and DR regions etc plus the maintenance and incidentals (power , connectivity ).
I don’t expect anyone less than 5M spends and high base loads is a good fit for their offering.
You are 100% correct but you’d be shocked at the mortal terror that “self hosting” inflicts in the minds of even people who should really know better.
Also forget Dell. Check out DataPacket.com and other metal hosters. You don’t need to physically rack unless you are huge or have special hardware or security needs.
The cloud industry has done an incredible job at a kind of soft pervasive propaganda that running stuff is “hard.”
It is worth the exercise to honestly assess the maintenance, initial costs, ongoing costs, etc etc for owning your own. I did this at a company for a single server to let the ml group test fine tuning frameworks/throw crazy ideas at before spending real money on a training run and it paid for itself in like 3 months. Sometimes the math is overwhelmingly positive, sometimes it isn't. In general, the smaller/earlier you are the less it makes sense. Not because of the per hour costs, but because of the distraction away from implementing the core idea of the company. It is worth some, maybe a lot of, inefficiency to stay focused. When you get bigger and have strong fit and a clear direction it is a lot easier to focus on optimizing hosting costs and spending leadership time away from the core problem of the company.
Oh man I cannot tell you how many times I've gotten into arguments on here and other technical forums years ago about self-hosting and how 'stupid' I was to not want to rent cloud servers
You’re expressing a very narrow engineer’s perspective that doesn’t consider the realities of managing bare metal hosting at any kind of scale.
These are business decisions, made in terms of core competencies, capex vs. opex, and the difficulties and cost of building out a reliable, sustainable hosting operation that handles all the compliance and security requirements, and the full range of “ilities” that real businesses have to deal with.
The fact that Bob in IT might be capable of doing some of this on his own doesn’t really enter into the picture. It’s not relevant.
There’s a reason that most companies don’t operate their own electricity generation systems. Much the same is true for computing systems.
There’s a sort of arguable sweet spot where someone motivated and knowledgeable can manage their own hardware, even if it’s just rented from Hetzner etc. But that just doesn’t scale.
Once you do try to scale that - not just the hardware but the staffing that’s needed to avoid a bus factor of 1, to ensure the required uptime especially if it needs to be 24x7, to handle disaster recovery, failover, security and compliance issues etc. etc., you quickly run into all the reasons that infrastructure management services and other computing services - i.e., cloud - have won out so definitively.
If you’re small enough that none of those things matter very much to you, and knowledgeable enough to run your whole system yourself, and have the time and inclination to deal with it, go for it! But such people are outliers who are really indulging a hobby more than anything else. It generally makes extremely little business sense.
Many people who have ever had to deal with the long tail of insanities in physical hosting, like "the ceiling burst and dumped water on a rack", "the RAID controller's capacitors exploded and now you need to figure out what still works", or "for some reason three of the servers won't talk to this switch but talk to anything else using the same cables, and the switch ports work for other devices", would happily pay a premium to only deal with SaaS logistics.
(Those were all firsthand examples; I'm not saying everyone needs cloud providers, but there are reasons beyond "really good salespeople" that people opt for offloading those logistics.)
Ok but add up a trickle of those examples, with staff to handle them, and you're still comfortably in the black.
You dont even have extra organizational overhead. Every cloud first company has a head of devops sitting in the chair where head of infra would be. They somehow wind up with like half the staffing anyways compared to running bare metal.
Our colo experience was pretty smooth, nothing insane like that, and saved us a bundle. Apparently ymmv. I hate working with AWS APIs by comparison, some of the worst UX I've ever seen.
I've dealt with both. I am continually amazed that people not only pay for AWS, but that it is so complicated, and that they use it in all sorts of absurd ways, not even just hosting 'vms' but using all sorts of amazon tools to do trivial tasks. I am sorry I just dont get it. Is it like learning salesforce and once you're sucked in you're just in? I am so glad I do not work at an AWS shop anymore and am very glad to be in a position where we do not use it.
I probably wouldn't start with buying a big server if I was just starting out. I would consider renting one from Hetzner, OVH, or many others.
There are also many other alternatives. Example: VPS providers like Vultr which have expanded to offer more traditional "cloud" features like object storage, load balancers, managed DBs, etc. Their pricing is way more competitive than AWS, especially when you consider bandwidth.
You’re forgetting blame: if an on-prem system has an issue, that’s 100% on you. If AWS/GCP/Azure has an outage, that’s just bad luck, and everyone else suffers too.
Frankly. Most of that stuff is corporate bullshit. Compliance is 99% fucking theatre, cover your ass audits with a fancy check list.
The capex vs opex theatre is just stupid economics and bad generalization from wall street types.
Almost nothing of it is really real.
And your analogy may impress other glorified salesman, but it doesn't hold water for a second, electricity is fungible, computing is not, electricity is stateless, you computing infrastructure carries your data. Power consumption generally is not a competitive differentiator,computing often is. And of course, the economics IN THE FUCKING REAL WORLD is broken: It is very hard to compete with the prices of the grid, not so in the modern cloud world where hyperscalers captured market enough to feel free to start extracting monopolistic rent from their consumers. And even the premise is uninformed, heavy industry frequently resorts to co-generation, and now, ironically, even data centers projects are exploring it.
I wonder what's the selling point at that scale. If your ~monthly~ cloud spend ends in "M", you can easily justify hiring the talent needed to wrangle conventional bare-metal (in fact you can do so at much lower spends, but at these spends it becomes a rounding error).
Edit: my bad, read that as monthly instead of yearly. Still, a yearly spend of millions would still make sense to bring that in-house.
An in-house team is most likely competing with something like Dell or VMware, not really Oxide. A significant part of Oxide’s value proposition is that you’re buying hardware and software purpose built for each other. Unless you’re also going to go so far as to do all of that, which companies like Google do, of course, it’s not really the same thing.
This matters when your various vendors start pointing at each other when something goes wrong. Oxide is truly “one throat to choke” in a way others just aren’t, and stand by that quality.
(Not to mention other various efficiencies, like power, or removing things like the BIOS and BMC junk that’s in basically every other server you buy right now. And the ability to send attenuation from boot up through the host OS. Just tons of things they’re differentiated on that your in house team just isn’t going to do.)
VC or private equity fueled companies are weird. At my place we are spending 8 figures a year just in AWS, and it's not like they planning to move to bare metal but, they're in fact removing stuff from their old datacenter. And that bill doesn't include some of the other SaaS like Mongo or Elastic.
With bills of that magnitude, each time I do a little house cleaning and delete some old data, change storage classes, or discover some unused servers... the savings (that are barely a rounding error on their bill) could pay for a whole year of an engineer or a bunch of servers that could power a good chunk of their production traffic.
I can't think of an outcome that would be more odious to Steve Tuck and Brian Cantrill. Brian in particular still talks about the soul-crushing experience of Oracle's hostile takeover of Sun Microsystems.
To answer these questions (or accusations?): Yes, I was at Joyent for the acquisition by Samsung -- but I also was not a founder, did not have a board seat, etc., so the involvement that I had, while substantial at some level (working with the Samsung team when they were doing their significant due diligence, for example) was also ultimately limited. My job was to make the acquisition work, not to determine the fate of the company for which I was ultimately an employee.
It's also absurd to call the sale a "sellout" -- the company was not for sale when Samsung came calling. The deal that Samsung proposed was a good and fair one, and if I HAD been on the board, I would have absolutely voted for the acquisition. (It should be said that Samsung themselves had a very high threshold to close the deal -- 97% of shares IIRC?)
And all of THAT said: while I was supportive of the acquisition by Samsung of Joyent (and worked hard to make that acquisition work), when we started Oxide, Steve and I had (and have!) zero interest in building a company to be acquired. Oxide is our life's work (and I mean that "our" broadly, as many at Oxide feel that same calling), and our objective with Oxide is to build an independent, generational company. Indeed, this Series D is all about advancing that objective!
Joyent was likely a part of what convinced Brian Cantrill that a new cloud machine was needed. They had their own stack running on commodity OEM hardware in their own cloud - likely a painful experience, since Brian talks a lot about how much of a difference it makes to own the complete root of trust and everything in it.
I doubt that. Oxide was founded by a bunch of ex-Sun people who have already been burned by the Oracle acquisition. If you read through what they say, their company values, and how they act, it's pretty clear their intent is to grow a sustainable long-term business and they're not looking for an exit.
We are trying to build a sustainable long-term business! It's just that you need enormous amounts of money to get there when shipping this large a product.
The idea behind VC funding generally is that you need large infusions of capital to get to the point where the business becomes sustainable long-term. The first one is the most expensive, and so on. Hardware is capital-intensive compared to SaaS, and especially so in the current environment.
Read the blog post on their series C [0]. It's not long, but the most relevant excepts are:
> So if we didn’t need to raise, why seek the capital? Well, we weren’t seeking it, really. But our investors, seeing the business take off, were eager to support it. And we, in turn, were eager to have them: they were the ones, after all, who joined us in taking a real leap when it felt like there was a lot more risk on the table.
> ...
> Our intent in starting Oxide was not to be an acquisition target but rather build a generational company; this is our life’s work, not a means to an end. With our Series C, customers don’t have to merely take our word for it: we have the capital to assure our survival into the indefinite future.
Maybe you could read that and think its complete bullshit and they're lying their asses off. Considering the people behind Oxide and their history, that's vanishingly unlikely though.
The reasonable conclusion is that they would not have raised yet more money if it wasn't due to being offered very generous terms by investors who wouldn't threaten the long-term future of the business.
It says "they've entirely derisked capital" and now ~6 months later they raised twice as much. Lying is a strong word but that post clearly wasn't accurate at the time.
They've raised a lot of money and there will be pressure for an exit sooner rather than later.
You can be cashflow positive and still benefit from having a larger pool of cash to throw around, particularly in any situation involving hardware manufacturing.
If you tell your investors "our limiting factor is how fast we can spend to deliver on additional requirements for these new customers", then it can both be true that you're not going to miss payroll for 5 years no matter what happens tomorrow and more cash would be beneficial.
Depends on the VC. Some VC's are happy to own great businesses, even long term. Most are definitely vultures after a quick turn around. Mostly it has to do with where the VC gets their funding. Most VC's get their funding from offering a fund with a 2-5 year time-frame. Some are 10 yr funds, and some are long-term funds or are funded by a family office or two, which can be happy with great businesses long term.
It makes sense for Broadcom to remove that avenue of escape, and it makes sense for Oxide's investors to charge a premium to Broadcom, and materialize their returns.
The customers will have to deal with it, of course. At least they bought physical systems instead of renting them, so they can use them until they're obsolete.
Is there anything they're doing that can't be replicated by hypervisor/management software on commodity x86 servers? Seems like their "secret sauce" is a software stack that "just works" more than any actual special feature of the hardware.
I feel like Broadcom with its VMWare acquisition could easily take these guys out if they wanted to (or for that matter, any OEM that has a line of servers + network & storage hardware). They don't, most likely because there isn't actually enough profit to be made there (Oxide having to raise money multiple times might be a hint).
Managing a single commodity device is pretty simple. Could even be a shell script with a few IPMI commands.
Managing 100s of devices from a mix of vendors is possible becomes itself a massive ball of crap to stick all the pieces together.
Then add firmware management because now there is a plethora of firmware updates to worry about.
And then dealing with networking discovery & orchestration for such setups is an added horror few even try to visualize.
Then abstract all these differences away so one can provision two different vendor’s servers connected to two different vendor’s managed switches in different racks to a new VLAN. And do it with SR-IOV while you’re at it…
Oh, I forgot shared storage… details, details…
Commodity computing is the modern day Tower of Babel.
Yes, it can be done much simpler if one treats all switches as unmanaged, all storage as local, and all networking as flat. That’s just not acceptable for a lot of use cases though…
Good question. Can’t eliminate the BIOS/UEFI on commodity systems. Can’t remove/cut down the BMC. Can’t plumb the hardware root of trust into the OS and VMs. Can’t do dynamic rack-level power capping (future roadmap). There’s a whole bunch of the software stack that only works because the hardware and software were designed together.
Oxide exists in part because commodity systems don’t work for building a cloud at scale (Joyent). Similarly, AWS, GCP, and Azure don’t use commodity systems, they use hardware that was designed to work together with their software, Nitro being a prime example.
Their machines are x86 but they've rearchitected basically everything else in the pursuit of a cohesive and integrated machine, they don't even have a BIOS. The secret sauce is having full control of the software stack, and as close to full control of the firmware as is possible on x86.
Yes, custom hardware is a significant part of Oxide. You have to build your own to do that stuff, and that’s why they did. I alluded to some of the things upthread.
I found out about this round from this thread, just like everybody else, but
> Oxide having to raise money multiple times might be a hint
That’s not the only reason to raise a round, by far, especially when you, you know, are building custom hardware. It isn’t a SaaS business.
> Is there anything they're doing that can't be replicated by hypervisor/management software on commodity x86 servers?
It was technically possible with (e.g.) OpenStack for years (decades?) before Oxide ever existing, and yet even with such a solution being around, some folks still went with Oxide. (Or, depending on the scale you want to talk about: Proxmox, XCP-ng.)
> Is there anything they're doing that can't be replicated by hypervisor/management software on commodity x86 servers? Seems like their "secret sauce" is a software stack that "just works" more than any actual special feature of the hardware.
There's a reason Apple is consistently one of the top 5 most valuable companies. It isn't because their hardware does anything that can't be done on "commodity" hardware, its that they built a software stack that "just works" and part of that was tight coupling to the hardware.
Just like the last Oxide post, I just have to say how excited I am for their product as a concept. I really hope to see them continue to do well!
Selfishly of course so I can make sure there are more episodes of Oxide and Friends for years to come. Adam annd Bryan's ability to reference thirty year old simpsons episodes is unmatched.
I've seen posts about Oxide for years now, but do they actually ship hardware? I've never seen images, or posts about companies with their new Oxide Thingamajig™
Joe Schmoe LLC will probably do just fine by sticking to popular clouds. I reckon adopting Oxide Computer would pay off at much larger volumes of traffic, or if you have to do on-prem due to regulatory reasons.
It would be nice to know more about pricing so the Enthusiast Joe can have a better idea, but it's more a boutique vibe right now.
Putting together bits and pieces from different sources: a half-rack is the minimum SKU, and it has 1024 cores and 16 TiB RAM for somewhere around $600k. (So many people have repeated the latter number that it must be true! I.e., add salt grains to taste.)
Just the thing for an ambitious enthusiast to upgrade to from their Raspberry Pi rack!
> In this episode, we sit down with Jessie Frazelle, CEO and co-founder of Zoo, a company working on innovative software and hardware technology. Jessie shares her fascinating journey, from getting her start at digital agencies to working at tech giants like Google and Microsoft and ultimately co-founding her own successful startup, Zoo.
> Zoo makes CAD truly AI-native with a modern geometry engine, readable code, and an editable feature tree at its core, enabling AI to make precise geometric changes without trapping users in a chat-only workflow. https://zoo.dev View our current openings: https://zoo.dev/careers Check out our blog: https://zoo.dev/blog
I've been following closely and have been both very impressed with what they're building but also very disappointed. They have a great vision for a seamless hardware project, but completely missed the point of what the software automation to tie it all together should look like.
I'd love to give Bryan Cantrill or ahl a 30 min demo. Feel free to ping!
left hand: governance gaps, privacy, owning instead of renting
right hand: nearly every employee of every org buying these things is sending almost everything to LLMs - or using software ULTIMATELY written by, tested by or whatevered by, these LLMs. LLMs that were created by or distilled from anthropic, openai, or google, who see everything SALIENT about what you do, or what ALL of your customers do, even if they are careful about not looking at the specifics of what you do
Woot!, they are on a tear:
2023: Series A 44 Million https://oxide.computer/blog/oxide-unveils-the-worlds-first-c...
2025: Series B 100 Million https://oxide.computer/blog/our-100m-series-b
2026: Series C 200 Million https://oxide.computer/blog/our-200m-series-c
2026: Series D 445 Million https://www.sec.gov/Archives/edgar/data/1795071/000179507126...
I don’t know who needs to hear this but raising a ton of money is not success.
Also interesting from their Series C press release from earlier this year:
> With this large Series C, we have entirely de-risked capital going forward, which in turn assures our independence.
> I don’t know who needs to hear this but raising a ton of money is not success.
You don't raise this much money this fast without having some success to show the investors.
Oxide raising this much money is a big accomplishment.
It’s success compared to the other possibility: not raising money and going out of business. We still cheer when a rocket separates from the first stage and ignites the next. Things going as planned during a risky and challenging endeavor is still a good thing.
Good points.
>I don’t know who needs to hear this
Plenty of people on this forum need to hear it. Because they think otherwise.
>but raising a ton of money is not success.
Yes. It's not even an accurate predictor of future success.
>With this large Series C, we have entirely de-risked capital going forward, which in turn assures our independence.
Independence from whom?
If they mean from everyone, they left out two important categories:
The Series C givers.
The other big C. Customers.
lol why are you cheering?
Because they now have money to do cool stuff?
perhaps they like their work
shill. or fan, prolly. i don't use the more current word fanboy. ugh.
(when older words are good enough, why invent a new word. but I see that as a trend. each new generation wants to distinguish themselves from the past one. So they invent new words as one way of doing that. and some of them get adopted into general circulation or use.)
Unless the two words, fan and fanboy, mean the different things, which i'm not interested in checking out anyway.
(VP of Eng here) I filled out their sales form last year and never heard from them. We're currently spending $900k/year on AWS, and they didn't even acknowledge my request. crazy stuff.
They work with HFT/quant firms. Look at some of their former engineers who are now at matX.
Intel/Barefoot Tofino 2, VHDL/SystemVerilog, FPGA, QSFP28 (100GbE networking), P4 programming.
Their buyers don’t have customer stories. They don’t sell to SaaS companies.
I also think they work with government customers. I saw an open job position on their website requiring TS/SCI security clearance and full scope polygraph.
I believe JPL and INL were their launch customers for gov.
We had the opposite experience. We contacted them through their form this year and they were happy to discuss with us even when we communicated from the beginning we wouldn't be customer in the short to medium term and even for single rack systems.
How did that compare to the big firms? HPE, Dell, and so on.
The rack were not insanely expensive, expandable so you don't have to build fully stacked racks from the beginning. Purely based on a hardware, compares to other blade systems but pricier.
The interesting part was the software, management interface, Terraform provider and how everything just fit together. Having storage, network and compute all in a single managed rack package brings a lot of value and brings down TCO. Really appreciated the security group like approach to network policies.
Unfortunately I haven't worked with HPE or Dell recently so I'm not sure what they currently offer.
You don't go to oxide for lowest cost.
I think the idea is that, in fact, you do.
Not one-time cost, but rather TCO.
You get a fully auditable hardware and software BOM, and you get an air-gapped, API-driven, on-prem cloud.
You still have a fairly large up front cost ($600k base in 2023ish numbers, probably over $1M now?), and an ongoing support subscription.
Hit me up @oxidecomputer.com
This is an embarrassing response.
How so?
Ignoring a sales request for a company that wants to spend ~1M only to say pls reach out to me again after we had our second funding round in 2026? The OP literally could go back to their sales lead db and respond like a real business. So yeah unprofessional and embarrassing.
we spend 2-2.5M a year I wouldn’t consider us their product scale yet.
My understanding is the full rack is about $1.2M and smallest half rack is about $600k and this was before the RAM and other price hikes now.
You are still going to have some residual cloud workloads(so all AWS won’t migrate ) and HA and DR regions etc plus the maintenance and incidentals (power , connectivity ).
I don’t expect anyone less than 5M spends and high base loads is a good fit for their offering.
I mean its capex vs opex, assuming a 5 year deprecation period thats 1.2 million isnt too bad, its 10% of their aws spend.
If your CIO is not ideologically averse on paying people instead of paying jeff bezos, you can save money even buying dell.
You are 100% correct but you’d be shocked at the mortal terror that “self hosting” inflicts in the minds of even people who should really know better.
Also forget Dell. Check out DataPacket.com and other metal hosters. You don’t need to physically rack unless you are huge or have special hardware or security needs.
The cloud industry has done an incredible job at a kind of soft pervasive propaganda that running stuff is “hard.”
It is worth the exercise to honestly assess the maintenance, initial costs, ongoing costs, etc etc for owning your own. I did this at a company for a single server to let the ml group test fine tuning frameworks/throw crazy ideas at before spending real money on a training run and it paid for itself in like 3 months. Sometimes the math is overwhelmingly positive, sometimes it isn't. In general, the smaller/earlier you are the less it makes sense. Not because of the per hour costs, but because of the distraction away from implementing the core idea of the company. It is worth some, maybe a lot of, inefficiency to stay focused. When you get bigger and have strong fit and a clear direction it is a lot easier to focus on optimizing hosting costs and spending leadership time away from the core problem of the company.
Oh man I cannot tell you how many times I've gotten into arguments on here and other technical forums years ago about self-hosting and how 'stupid' I was to not want to rent cloud servers
You’re expressing a very narrow engineer’s perspective that doesn’t consider the realities of managing bare metal hosting at any kind of scale.
These are business decisions, made in terms of core competencies, capex vs. opex, and the difficulties and cost of building out a reliable, sustainable hosting operation that handles all the compliance and security requirements, and the full range of “ilities” that real businesses have to deal with.
The fact that Bob in IT might be capable of doing some of this on his own doesn’t really enter into the picture. It’s not relevant.
There’s a reason that most companies don’t operate their own electricity generation systems. Much the same is true for computing systems.
There are also many shades of gray between "big cloud" AWS/Azure/GCP and "my own rack" bare metal hosting.
Agreed, it’s why I said “at any kind of scale”.
There’s a sort of arguable sweet spot where someone motivated and knowledgeable can manage their own hardware, even if it’s just rented from Hetzner etc. But that just doesn’t scale.
Once you do try to scale that - not just the hardware but the staffing that’s needed to avoid a bus factor of 1, to ensure the required uptime especially if it needs to be 24x7, to handle disaster recovery, failover, security and compliance issues etc. etc., you quickly run into all the reasons that infrastructure management services and other computing services - i.e., cloud - have won out so definitively.
If you’re small enough that none of those things matter very much to you, and knowledgeable enough to run your whole system yourself, and have the time and inclination to deal with it, go for it! But such people are outliers who are really indulging a hobby more than anything else. It generally makes extremely little business sense.
Right like learning AWS is significantly harder than buying a big server and maintaining it
Many people who have ever had to deal with the long tail of insanities in physical hosting, like "the ceiling burst and dumped water on a rack", "the RAID controller's capacitors exploded and now you need to figure out what still works", or "for some reason three of the servers won't talk to this switch but talk to anything else using the same cables, and the switch ports work for other devices", would happily pay a premium to only deal with SaaS logistics.
(Those were all firsthand examples; I'm not saying everyone needs cloud providers, but there are reasons beyond "really good salespeople" that people opt for offloading those logistics.)
Ok but add up a trickle of those examples, with staff to handle them, and you're still comfortably in the black.
You dont even have extra organizational overhead. Every cloud first company has a head of devops sitting in the chair where head of infra would be. They somehow wind up with like half the staffing anyways compared to running bare metal.
Our colo experience was pretty smooth, nothing insane like that, and saved us a bundle. Apparently ymmv. I hate working with AWS APIs by comparison, some of the worst UX I've ever seen.
or things like "Datacenter bombed by Iran..."
I've dealt with both. I am continually amazed that people not only pay for AWS, but that it is so complicated, and that they use it in all sorts of absurd ways, not even just hosting 'vms' but using all sorts of amazon tools to do trivial tasks. I am sorry I just dont get it. Is it like learning salesforce and once you're sucked in you're just in? I am so glad I do not work at an AWS shop anymore and am very glad to be in a position where we do not use it.
I probably wouldn't start with buying a big server if I was just starting out. I would consider renting one from Hetzner, OVH, or many others.
There are also many other alternatives. Example: VPS providers like Vultr which have expanded to offer more traditional "cloud" features like object storage, load balancers, managed DBs, etc. Their pricing is way more competitive than AWS, especially when you consider bandwidth.
Then buy a small server first. You don’t need a “big” server when you’re just starting out.
Most corporations past a certain point have in-house counsel because it would be ruinous to pay Big Law for every little thing.
That's not a narrow legal perspective, it's one look at a very obvious balance sheet. The same could go for hosting.
Your legal department does not replace your retained lawyers, they add to it. It’s separate roles.
Sure, just like CDN or rarely-used excess capacity could be separate roles to the bulk of your compute.
If you're racking up 750/hr putting big law on routine corporate tasks then you are probably messing up. Hire an admin.
You’re forgetting blame: if an on-prem system has an issue, that’s 100% on you. If AWS/GCP/Azure has an outage, that’s just bad luck, and everyone else suffers too.
Until someone gets the bright idea that you should be multi-region.
Frankly. Most of that stuff is corporate bullshit. Compliance is 99% fucking theatre, cover your ass audits with a fancy check list.
The capex vs opex theatre is just stupid economics and bad generalization from wall street types.
Almost nothing of it is really real.
And your analogy may impress other glorified salesman, but it doesn't hold water for a second, electricity is fungible, computing is not, electricity is stateless, you computing infrastructure carries your data. Power consumption generally is not a competitive differentiator,computing often is. And of course, the economics IN THE FUCKING REAL WORLD is broken: It is very hard to compete with the prices of the grid, not so in the modern cloud world where hyperscalers captured market enough to feel free to start extracting monopolistic rent from their consumers. And even the premise is uninformed, heavy industry frequently resorts to co-generation, and now, ironically, even data centers projects are exploring it.
tbf they are probably looking for customers with cloud spend ending in 'm'
I wonder what's the selling point at that scale. If your ~monthly~ cloud spend ends in "M", you can easily justify hiring the talent needed to wrangle conventional bare-metal (in fact you can do so at much lower spends, but at these spends it becomes a rounding error).
Edit: my bad, read that as monthly instead of yearly. Still, a yearly spend of millions would still make sense to bring that in-house.
(Former Oxide)
An in-house team is most likely competing with something like Dell or VMware, not really Oxide. A significant part of Oxide’s value proposition is that you’re buying hardware and software purpose built for each other. Unless you’re also going to go so far as to do all of that, which companies like Google do, of course, it’s not really the same thing.
This matters when your various vendors start pointing at each other when something goes wrong. Oxide is truly “one throat to choke” in a way others just aren’t, and stand by that quality.
(Not to mention other various efficiencies, like power, or removing things like the BIOS and BMC junk that’s in basically every other server you buy right now. And the ability to send attenuation from boot up through the host OS. Just tons of things they’re differentiated on that your in house team just isn’t going to do.)
VC or private equity fueled companies are weird. At my place we are spending 8 figures a year just in AWS, and it's not like they planning to move to bare metal but, they're in fact removing stuff from their old datacenter. And that bill doesn't include some of the other SaaS like Mongo or Elastic.
With bills of that magnitude, each time I do a little house cleaning and delete some old data, change storage classes, or discover some unused servers... the savings (that are barely a rounding error on their bill) could pay for a whole year of an engineer or a bunch of servers that could power a good chunk of their production traffic.
Logical.
They probably will be aquihired by someone like Broadcom.
I can't think of an outcome that would be more odious to Steve Tuck and Brian Cantrill. Brian in particular still talks about the soul-crushing experience of Oracle's hostile takeover of Sun Microsystems.
How about the sellout of Joyent to Samsung?
Joyent was founded in 2004. Bryan joined in 2014 - I doubt he had much, if any, say in the sale proceeding or not.
He became CTO in 2014. I was familiar with him at Joyent some years before that though.
edit/update: and the Samsung acquisition was in 2016. So I'd hope the CTO would have _some_ involvement in that decision.
This all became pretty personal over here!
To answer these questions (or accusations?): Yes, I was at Joyent for the acquisition by Samsung -- but I also was not a founder, did not have a board seat, etc., so the involvement that I had, while substantial at some level (working with the Samsung team when they were doing their significant due diligence, for example) was also ultimately limited. My job was to make the acquisition work, not to determine the fate of the company for which I was ultimately an employee.
It's also absurd to call the sale a "sellout" -- the company was not for sale when Samsung came calling. The deal that Samsung proposed was a good and fair one, and if I HAD been on the board, I would have absolutely voted for the acquisition. (It should be said that Samsung themselves had a very high threshold to close the deal -- 97% of shares IIRC?)
And all of THAT said: while I was supportive of the acquisition by Samsung of Joyent (and worked hard to make that acquisition work), when we started Oxide, Steve and I had (and have!) zero interest in building a company to be acquired. Oxide is our life's work (and I mean that "our" broadly, as many at Oxide feel that same calling), and our objective with Oxide is to build an independent, generational company. Indeed, this Series D is all about advancing that objective!
Joyent was likely a part of what convinced Brian Cantrill that a new cloud machine was needed. They had their own stack running on commodity OEM hardware in their own cloud - likely a painful experience, since Brian talks a lot about how much of a difference it makes to own the complete root of trust and everything in it.
I doubt that. Oxide was founded by a bunch of ex-Sun people who have already been burned by the Oracle acquisition. If you read through what they say, their company values, and how they act, it's pretty clear their intent is to grow a sustainable long-term business and they're not looking for an exit.
VC funding is not for "a sustainable long-term business".
We are trying to build a sustainable long-term business! It's just that you need enormous amounts of money to get there when shipping this large a product.
The idea behind VC funding generally is that you need large infusions of capital to get to the point where the business becomes sustainable long-term. The first one is the most expensive, and so on. Hardware is capital-intensive compared to SaaS, and especially so in the current environment.
Read the blog post on their series C [0]. It's not long, but the most relevant excepts are:
> So if we didn’t need to raise, why seek the capital? Well, we weren’t seeking it, really. But our investors, seeing the business take off, were eager to support it. And we, in turn, were eager to have them: they were the ones, after all, who joined us in taking a real leap when it felt like there was a lot more risk on the table.
> ...
> Our intent in starting Oxide was not to be an acquisition target but rather build a generational company; this is our life’s work, not a means to an end. With our Series C, customers don’t have to merely take our word for it: we have the capital to assure our survival into the indefinite future.
Maybe you could read that and think its complete bullshit and they're lying their asses off. Considering the people behind Oxide and their history, that's vanishingly unlikely though.
The reasonable conclusion is that they would not have raised yet more money if it wasn't due to being offered very generous terms by investors who wouldn't threaten the long-term future of the business.
[0]: https://oxide.computer/blog/our-200m-series-c
It says "they've entirely derisked capital" and now ~6 months later they raised twice as much. Lying is a strong word but that post clearly wasn't accurate at the time.
They've raised a lot of money and there will be pressure for an exit sooner rather than later.
I don't think that's necessarily true.
You can be cashflow positive and still benefit from having a larger pool of cash to throw around, particularly in any situation involving hardware manufacturing.
If you tell your investors "our limiting factor is how fast we can spend to deliver on additional requirements for these new customers", then it can both be true that you're not going to miss payroll for 5 years no matter what happens tomorrow and more cash would be beneficial.
No, it's not necessarily true but it is a well trod path.
Depends on the VC. Some VC's are happy to own great businesses, even long term. Most are definitely vultures after a quick turn around. Mostly it has to do with where the VC gets their funding. Most VC's get their funding from offering a fund with a 2-5 year time-frame. Some are 10 yr funds, and some are long-term funds or are funded by a family office or two, which can be happy with great businesses long term.
I expect the majority of Oxide's customers are actively trying to escape Broadcom's VMWare hell. Can't see how something like that would make sense.
It makes sense for Broadcom to remove that avenue of escape, and it makes sense for Oxide's investors to charge a premium to Broadcom, and materialize their returns.
The customers will have to deal with it, of course. At least they bought physical systems instead of renting them, so they can use them until they're obsolete.
Some of their larger costumer might want to buy them instead so it doesn't happen.
Makes sense for Broadcom.
Is there anything they're doing that can't be replicated by hypervisor/management software on commodity x86 servers? Seems like their "secret sauce" is a software stack that "just works" more than any actual special feature of the hardware.
I feel like Broadcom with its VMWare acquisition could easily take these guys out if they wanted to (or for that matter, any OEM that has a line of servers + network & storage hardware). They don't, most likely because there isn't actually enough profit to be made there (Oxide having to raise money multiple times might be a hint).
Managing a single commodity device is pretty simple. Could even be a shell script with a few IPMI commands.
Managing 100s of devices from a mix of vendors is possible becomes itself a massive ball of crap to stick all the pieces together.
Then add firmware management because now there is a plethora of firmware updates to worry about.
And then dealing with networking discovery & orchestration for such setups is an added horror few even try to visualize.
Then abstract all these differences away so one can provision two different vendor’s servers connected to two different vendor’s managed switches in different racks to a new VLAN. And do it with SR-IOV while you’re at it…
Oh, I forgot shared storage… details, details…
Commodity computing is the modern day Tower of Babel.
Yes, it can be done much simpler if one treats all switches as unmanaged, all storage as local, and all networking as flat. That’s just not acceptable for a lot of use cases though…
Good question. Can’t eliminate the BIOS/UEFI on commodity systems. Can’t remove/cut down the BMC. Can’t plumb the hardware root of trust into the OS and VMs. Can’t do dynamic rack-level power capping (future roadmap). There’s a whole bunch of the software stack that only works because the hardware and software were designed together.
Oxide exists in part because commodity systems don’t work for building a cloud at scale (Joyent). Similarly, AWS, GCP, and Azure don’t use commodity systems, they use hardware that was designed to work together with their software, Nitro being a prime example.
It's not actually secret — it's open source! We talk openly about our architecture.
Bryan has a good take on the incentive structures holding back commodity hardware vendors: https://m.youtube.com/shorts/O8GSWKpK79s
Their machines are x86 but they've rearchitected basically everything else in the pursuit of a cohesive and integrated machine, they don't even have a BIOS. The secret sauce is having full control of the software stack, and as close to full control of the firmware as is possible on x86.
What can't be replicated is a culture of simplicity, quality, and security. I've seen this firsthand working at IBM.
(Former oxide)
Yes, custom hardware is a significant part of Oxide. You have to build your own to do that stuff, and that’s why they did. I alluded to some of the things upthread.
I found out about this round from this thread, just like everybody else, but
> Oxide having to raise money multiple times might be a hint
That’s not the only reason to raise a round, by far, especially when you, you know, are building custom hardware. It isn’t a SaaS business.
EDIT: here’s another commentor with an example of this: https://news.ycombinator.com/item?id=49176704
> Is there anything they're doing that can't be replicated by hypervisor/management software on commodity x86 servers?
It was technically possible with (e.g.) OpenStack for years (decades?) before Oxide ever existing, and yet even with such a solution being around, some folks still went with Oxide. (Or, depending on the scale you want to talk about: Proxmox, XCP-ng.)
> Is there anything they're doing that can't be replicated by hypervisor/management software on commodity x86 servers? Seems like their "secret sauce" is a software stack that "just works" more than any actual special feature of the hardware.
There's a reason Apple is consistently one of the top 5 most valuable companies. It isn't because their hardware does anything that can't be done on "commodity" hardware, its that they built a software stack that "just works" and part of that was tight coupling to the hardware.
Which only matters to consumers. Businesses at scale have teams doing this stuff and costs matter.
I've written on this before but Oxide are sitting in very narrow market segment in terms of value and I can't see how it's viable.
The market is anyone who wants a private cloud but isn’t as big as an Amazon or Google who could build it themselves. Seems like a big enough TAM.
> Broadcom with its VMWare acquisition could easily take these guys out if they wanted to.
Depends on what you mean by that. Broadcom cremated a lot of VMware's goodwill in the market.
Well that isn't that much. $1M / month feels more like it.
Forbid a business can grow, haha
Say you are spending $1M. Round up. Or even 0.9M. Their sales might only return inquiries with cloud costs ending in M.
Just like the last Oxide post, I just have to say how excited I am for their product as a concept. I really hope to see them continue to do well!
Selfishly of course so I can make sure there are more episodes of Oxide and Friends for years to come. Adam annd Bryan's ability to reference thirty year old simpsons episodes is unmatched.
$400m of Simpsons references is undeniably a good use of VC.
Is is a perfectly cromulent use of capital.
I've seen posts about Oxide for years now, but do they actually ship hardware? I've never seen images, or posts about companies with their new Oxide Thingamajig™
We've shipped kind of a lot of hardware at this point!
there are even images of it on our website!
The CEO of Shopify tweeted about it at one point:
* https://twitter.com/tobi/status/1793798092212367669
as far as I can tell, yes?
It seems like Jane street and lawrence national laboratory are two confirmed customers.
With those two names it makes more since that I haven't seen anything regarding their use. Not exactly Joe Schmoe LLC as customers.
Joe Schmoe LLC will probably do just fine by sticking to popular clouds. I reckon adopting Oxide Computer would pay off at much larger volumes of traffic, or if you have to do on-prem due to regulatory reasons.
It would be nice to know more about pricing so the Enthusiast Joe can have a better idea, but it's more a boutique vibe right now.
Putting together bits and pieces from different sources: a half-rack is the minimum SKU, and it has 1024 cores and 16 TiB RAM for somewhere around $600k. (So many people have repeated the latter number that it must be true! I.e., add salt grains to taste.)
Just the thing for an ambitious enthusiast to upgrade to from their Raspberry Pi rack!
I couldn't find any evidence Jane Street is a customer, only that Jane street is an investor. Do you have a source for that?
Not OP, but someone I met who worked for Jane Street said that he was pretty sure that Oxide sold to them and was their primary customer.
Most of their customers wouldn't be the type to let others know.
I will implicitly trust anything Jessie Frazelle works on. Rare combination of taste, skill, and passion.
She stepped down several years ago.
She was still listed as an advisor in some capacity, but she moved on to a different startup.
From a 2024 interview:
> In this episode, we sit down with Jessie Frazelle, CEO and co-founder of Zoo, a company working on innovative software and hardware technology. Jessie shares her fascinating journey, from getting her start at digital agencies to working at tech giants like Google and Microsoft and ultimately co-founding her own successful startup, Zoo.
* https://www.youtube.com/watch?v=9MkDJMiB_8U
> Zoo makes CAD truly AI-native with a modern geometry engine, readable code, and an editable feature tree at its core, enabling AI to make precise geometric changes without trapping users in a chat-only workflow. https://zoo.dev View our current openings: https://zoo.dev/careers Check out our blog: https://zoo.dev/blog
* https://www.linkedin.com/company/zoodotdev/
* https://zoo.dev
yep, another fan here!
So with all the money raised, it's telling me there is a chance of a home-lab Oxide rack :-) (Congrats guys)
They just raised $200M in February and $100M a year ago.
Must be a pain scaling hardware procurement in a market where everything is overpriced.
Preparing for an IPO maybe?
Funding RAM purchases...
Wish I could have heard back about my job application there. It looks like a really exciting place to work.
I've been following closely and have been both very impressed with what they're building but also very disappointed. They have a great vision for a seamless hardware project, but completely missed the point of what the software automation to tie it all together should look like.
I'd love to give Bryan Cantrill or ahl a 30 min demo. Feel free to ping!
left hand: governance gaps, privacy, owning instead of renting
right hand: nearly every employee of every org buying these things is sending almost everything to LLMs - or using software ULTIMATELY written by, tested by or whatevered by, these LLMs. LLMs that were created by or distilled from anthropic, openai, or google, who see everything SALIENT about what you do, or what ALL of your customers do, even if they are careful about not looking at the specifics of what you do
Preempted the blog post.
Man, they are just sucking up capital. If somebody like Antropic has made them the primary 'CPU' rack, then that's they kind of cash you need.
I mean, you could probably get multiple GIGAbytes of RAM with 445M.
The real question is why did Steve Klabnik leave
Exactly what I said here: https://steveklabnik.com/writing/i-see-a-future-in-jj/
I am still a huge fan and supporter of Oxide, and I'm really glad to see them still doing well.
Just read the post you linked but didn't really get it. You left oxide to build something on jj?