About the role
We are looking for a highly motivated member of technical staff to join our engineering team to work on system modelling on 100k+ chip AI clusters. This is an unique opportunity to work on an high-visibility open source projects to architecture & model performance for the next generation of AI chips. If you’re passionate about performance engineering, system modelling, first principles, and want to work at the intersection of hardware and software, this is a rare chance to make industry wide impact.
What they're looking for
- Strong skills in Python
- Deep understanding about disaggregated prefill, wide expert parallelism, tensor parallelism, pipeline parallelism, sequence parallelism, etc
- Experience with frontier MoE training and inference workloads
- Knowledgeable about GEMM sizes & proportions of wall time & FLOPs on every major operator in an modern transformer
- Intuition about Amdahl principles, arithmetic intensity, weak & strong scaling
- Previous experience as an ML engineer or kernel programmer
More about this role
Work Setting: In-office/Remote
Work Location: United States, New York, Mexico, San Francisco, Canada
Work Hours: Office hours
Find out more here: https://semianalysis.com
SemiAnalysis is an independent research and analysis firm specializing in the Semiconductor and AI industries. Our in-depth coverage spans the entire supply chain, from semiconductor fabrication processes to cutting-edge AI Models, software, and infrastructure. We are recognized as the leading authority on the semiconductor supply chain, with the highest concentration of industry experts within one team, and a deep-rooted passion for delving into the intricacies.
We’re a global team of over 50 analysts, each with extensive networks across the semiconductor supply chain and AI ecosystem, publishing industry shaping articles while participating in 40+ conferences annually.
Our newsletter reaches more than 200,000 subscribers worldwide, including senior management and c-suite leaders at the leading semiconductor and AI companies.
Industry Models – we develop and publish industry models on accelerator shipments, datacentre demand and supply, GPU total cost of ownership, and more. We work with hyperscalers, neoclouds,...
Browse similar: Startup jobs · San Francisco Bay Area