# Research Engineer - Pre-training at Pluralis

- Company: Pluralis
- What the company does: Pluralis Research works on Protocol Learning — decentralized, communication-efficient model-parallel training for foundation models. Backed by USV.
- Company website: https://pluralis.ai/
- Type: Startups (AI role)
- Level: Mid level
- Location: San Francisco
- Work setup: Remote
- Posted: 2026-08-31
- Apply by: 2026-10-15
- Apply: https://jobs.ashbyhq.com/pluralis-research/da969db9-7c3a-494e-ac43-fdb7b4320070
- Page: https://www.1752.vc/careers/jobs/pluralis-research-engineer-pre-training/

## About the role

Distributed pretraining : Implement and optimize model-parallel training. Data, pipeline, and tensor parallelism for large models on heterogeneous GPUs under low-bandwidth, high-latency links. Performance optimization : Implement techniques that reduce communication overhead while maintaining model convergence in challenging network environments.

## What they're looking for

- Hands-on distributed training (required) : You've trained models across many devices in PyTorch with FSDP, DeepSpeed, Megatron, or your own implementation. You understand data, tensor, and pipeline parallelism
- Strong engineering : Production-quality Python. Concurrency, failure handling, profiling before optimizing
- Evidence of execution : Shipped systems, research code, open-source work, or serious personal projects
- Mission alignment : You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI

Tags: Research