Startups · AI

Rack-Scale AI Hardware Architect

Mythic · Austin, TX · Hybrid

← All jobs
About Mythic

Backed by NEA and Lux.

About the role

You will lead rack and platform pathfinding across board and chassis layout, scale-up and scale-out fabric topology, connector and cable plant, power delivery, and the cooling required at high rack densities. None of it can be settled apart from software: how a model is partitioned across devices sets the bandwidth required between layers, and the bandwidth the fabric can economically carry sets which partitionings are viable.

What they're looking for

  • Minimum Bachelor’s degree in Electrical Engineering, Mechanical Engineering, Computer Engineering, or a related field, with relevant experience in server, datacenter, HPC, or AI system design
  • Demonstrated architecture and design ownership of dense, rack-based server systems taken to production, including authoring the specifications ODM and OEM partners build against
  • Expert command of removing heat from racks, cooling architecture, cold plates, manifolds, CDUs, flow and thermal budgeting, and the facility-side interface
More about this role

Mythic builds AI compute platforms around large numbers of small, energy-efficient accelerators rather than a handful of very large ones. Serving frontier-scale models on that kind of architecture pushes the hardest engineering problems out of the die and into the rack: how many thousands of devices are packaged, connected, powered, and cooled in a very small volume. We are looking for a System Architect to own the rack-level reference design for these platforms.

You will lead rack and platform pathfinding across board and chassis layout, scale-up and scale-out fabric topology, connector and cable plant, power delivery, and the cooling required at high rack densities. None of it can be settled apart from software: how a model is partitioned across devices sets the bandwidth required between layers, and the bandwidth the fabric can economically carry sets which partitionings are viable. The role sits at the intersection of electrical, mechanical, and software engineering, and the goal is an architecture quite different from today’s GPU racks that delivers a comparable result at rack level.

  • Rack-level reference architecture — board, chassis, backplane, rack topology, mechanical...

Read the full posting on Mythic's site ↗

New Product Development

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.