Startups · AI

Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure

Google · United States · On-site

← All jobs
About Google

Learn more about Google. Explore our innovative AI products and services, and how we. Backed by Kleiner Perkins.

About the role

In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. Found on 1752vc Careers, the job board for startup and VC roles.

What they're looking for

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience
  • 8 years of experience in software development, systems engineering, or hardware/software co-design
  • 5 years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks
  • Experience with ML frameworks (e.g., JAX, PyTorch, TensorFlow) and large language model (LLM) inference or training workloads
More about this role
  • Lead the technical goal, roadmap, and software architecture for hardware/software co-design, optimizing large-scale ML inference and training systems.
  • Design, develop, and oversee simulation frameworks, cycle-accurate performance models, and system analysis tools to evaluate architectural trade-offs.
  • Architect scalable software solutions, kernels, and execution pipelines that bridge frontier ML model architectures with next-generation custom silicon accelerators.
  • Drive system-level performance optimization across distributed ML infrastructure, balancing compute, memory bandwidth, and inter-chip networking requirements.
  • Provide technical leadership and mentorship across hardware, compiler, and ML research teams to align on goals and transition co-design innovations into production.
  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience.
  • 8 years of experience in software development, systems engineering, or hardware/software co-design.
  • 5 years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks.
  • Experience with ML...

Read the full posting on Google's site ↗

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.