# Machine Learning Infrastructure Engineer at Abridge

- Company: Abridge
- What the company does: Discover how Abridge transforms documentation for clinical conversations powered by generative AI, enhancing healthcare understanding and improving patient care. Backed by Bessemer, Khosla and Lightspeed.
- Company website: https://www.abridge.com/
- Type: Startups (AI role)
- Level: Mid level
- Location: SF Office
- Work setup: Remote
- Pay: $221K to $260K base salary per year (USD)
- Posted: 2025-08-25
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/abridge/c7f09dee-07ca-444f-803d-961e7f88056b
- Page: https://www.1752.vc/careers/jobs/abridge-machine-learning-infrastructure-engineer/

## About the role

As an ML Infrastructure Engineer at Abridge, you’ll play a pivotal role in building and optimizing the core inference infrastructure that powers our machine learning models. Your work will be instrumental in enhancing the scalability, efficiency, and performance of our AI-driven solutions. You will work with our Infrastructure and Research teams to build, deploy, optimize and orchestrate across our AI models. Design, deploy and maintain scalable Kubernetes clusters for AI model inference and training

## What they're looking for

- Expertise with model serving frameworks such as NVIDIA Triton Server, VLLM, TRT-LLM and so on
- Expertise with ML toolchains such as PyTorch, Tensorflow or distributed training and inference libraries
- Familiarity with GPU cluster management and CUDA optimization
- Knowledge of infrastructure as code (Terraform, Ansible) and GitOps practices
- Experience with container registries, image optimization, and multi-stage builds for ML workloads
- Experience orchestrating across ASR models or LLM models for building various GenAI applications

Tags: Builder