Discover how Abridge transforms documentation for clinical conversations powered by generative AI, enhancing healthcare understanding and improving patient care. Backed by Bessemer, Khosla and Lightspeed.
About the role
As an ML Infrastructure Engineer at Abridge, you’ll play a pivotal role in building and optimizing the core inference infrastructure that powers our machine learning models. Your work will be instrumental in enhancing the scalability, efficiency, and performance of our AI-driven solutions. You will work with our Infrastructure and Research teams to build, deploy, optimize and orchestrate across our AI models. Design, deploy and maintain scalable Kubernetes clusters for AI model inference and training
What they're looking for
- Expertise with model serving frameworks such as NVIDIA Triton Server, VLLM, TRT-LLM and so on
- Expertise with ML toolchains such as PyTorch, Tensorflow or distributed training and inference libraries
- Familiarity with GPU cluster management and CUDA optimization
- Knowledge of infrastructure as code (Terraform, Ansible) and GitOps practices
- Experience with container registries, image optimization, and multi-stage builds for ML workloads
- Experience orchestrating across ASR models or LLM models for building various GenAI applications
More about this role
Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.
Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.
We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh.
As an ML Infrastructure Engineer at Abridge, you’ll play a pivotal role in building and optimizing the core inference infrastructure...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs