I find all current LLMs to have pretty poor spatial awareness. It is becoming better, but still very poor. How are you dealing with that? Got any special tricks, any advice?
It's currently in the plugins and we're working on bringing it to CADAM. Basically you'll be able to use the GUI, and give face/edge selection context to your prompt "extrude a hole through this face". It's directly tied to us adding brep support.
How can this approach be better than just selecting the edge and click the extrude button/write extrude command? Now you have to start writing a prompt and hope that what you want to do is understood by the LLM. I mean, CAD is really not so complicated with the tools we currently have. You just have to learn how to use them.
That's more of an example to address the point. We've find our users often use this feature in our onshape/fusion extensions in complex assemblies. Being able to select faces and edges as context in addition to prompts can be quite a powerful interface in more complex projects where users need to adjust tolerances or edit multiple objects to prevent interference
We're intent on building a dedicated editor, that way we can build a lot of nice UI! We'd also like to build public mcps for some of the popular cad tools
I asked it to create 3d model of "AMF-O97L45-DB". It pulled datasheet and generated 3D model. Left is reality, right is what was generated: https://imgur.com/a/oNaz51q
I think it's primarily for designing chemical processing systems, though I know it through the pipe layout software being used off-label to design vehicle electrical harnesses.
Yeah, no, that's a lie. This isn't a CAD model. It's a fantasy 3d model that looks like it's straight out of Gearhead Garage (1999).
Any time I see these 'AI CAD' solutions it's always toys, toys, toys. Show me something functional that you've actually manufactured (shitty 3D prints don't count). Or at least show me something that can actually be assembled and isn't just a bunch of boxes with no fasteners to hold them together.
not to say this isn't cool, but it's about as useful as having claude generate a JavaScript illustration of how a v8 works and then expecting someone to manufacturer an engine from that
For anyone doing CAD at a professional level (ie not 3d printed trinkets), the important parts are the physical parameters and tolerances designed into the model. For example I suspect your crankshaft would rip itself apart at engine speeds, not to mention all the plumbing, oil and coolant delivery, and auxiliary pumps and belts are missing
I see cams intersecting eachother and still nothing that is actually ready to be manufactured or even looks like a design that has had any thought put into it. It's the CAD equivalent of idle doodling.
Do you have a single person on your team that's actually a mechanical engineer with practical industry experience?
Yes and we have a number of mechanical engineers using our extensions! AI in CAD is defo a WIP but when you trace the progress it's not too hard to envisage what the future will look like.
For the Fusion demo we intentionally didn't include the block or any accessories in the visualization as we wanted demonstrate Adam's ability to reason through the mechanical workings of an engine, like how the cams push the valves or the way the the crankshaft drives the connecting rods.
I find all current LLMs to have pretty poor spatial awareness. It is becoming better, but still very poor. How are you dealing with that? Got any special tricks, any advice?
Can you talk more about the UI for face/edge selection that you're working on? Is that only going to be in the OnShape/Fusion plugins?
It's currently in the plugins and we're working on bringing it to CADAM. Basically you'll be able to use the GUI, and give face/edge selection context to your prompt "extrude a hole through this face". It's directly tied to us adding brep support.
How can this approach be better than just selecting the edge and click the extrude button/write extrude command? Now you have to start writing a prompt and hope that what you want to do is understood by the LLM. I mean, CAD is really not so complicated with the tools we currently have. You just have to learn how to use them.
That's more of an example to address the point. We've find our users often use this feature in our onshape/fusion extensions in complex assemblies. Being able to select faces and edges as context in addition to prompts can be quite a powerful interface in more complex projects where users need to adjust tolerances or edit multiple objects to prevent interference
Very cool. Why not start with an MCP instead?
An existing LLM could drive the generation while the MCP can render the final result?
We're intent on building a dedicated editor, that way we can build a lot of nice UI! We'd also like to build public mcps for some of the popular cad tools
I asked it to create 3d model of "AMF-O97L45-DB". It pulled datasheet and generated 3D model. Left is reality, right is what was generated: https://imgur.com/a/oNaz51q
- wrong pitch
- wrong pins position
- missing pins
It could be a nice touch to give some examples of what it's possible to ask CADAM!
Yes good idea! We've added a few in the read me if you'd like to take a look
FYI there is already a product with a very similar name, CADEM.
Oh thanks! What's CADEM?
I think it's primarily for designing chemical processing systems, though I know it through the pipe layout software being used off-label to design vehicle electrical harnesses.
> A complete V8 internal combustion engine
Yeah, no, that's a lie. This isn't a CAD model. It's a fantasy 3d model that looks like it's straight out of Gearhead Garage (1999).
Any time I see these 'AI CAD' solutions it's always toys, toys, toys. Show me something functional that you've actually manufactured (shitty 3D prints don't count). Or at least show me something that can actually be assembled and isn't just a bunch of boxes with no fasteners to hold them together.
We could defo update our readme! What do you think of this?: https://x.com/aaronli/status/2064876123109089742?s=20
Fable 5 in our Fusion Extension.
not to say this isn't cool, but it's about as useful as having claude generate a JavaScript illustration of how a v8 works and then expecting someone to manufacturer an engine from that
For anyone doing CAD at a professional level (ie not 3d printed trinkets), the important parts are the physical parameters and tolerances designed into the model. For example I suspect your crankshaft would rip itself apart at engine speeds, not to mention all the plumbing, oil and coolant delivery, and auxiliary pumps and belts are missing
I see cams intersecting eachother and still nothing that is actually ready to be manufactured or even looks like a design that has had any thought put into it. It's the CAD equivalent of idle doodling.
Do you have a single person on your team that's actually a mechanical engineer with practical industry experience?
Yes and we have a number of mechanical engineers using our extensions! AI in CAD is defo a WIP but when you trace the progress it's not too hard to envisage what the future will look like.
For the Fusion demo we intentionally didn't include the block or any accessories in the visualization as we wanted demonstrate Adam's ability to reason through the mechanical workings of an engine, like how the cams push the valves or the way the the crankshaft drives the connecting rods.
Can you claim your product here? https://thecadhub.com/details/adam-cad/