Open-Source Reinforcement Learning (RL) & Fine-tuning for LLMs. Backed by Y Combinator.
About the role
We’re looking for someone who loves open-source and collaborating with the OSS community but also has deep understanding in how transformers and Unsloth works.
What they're looking for
- Deep knowledge and implementation experience with multi-GPU training techniques such as FSDP
- Important contributions to ML open-source projects (e.g., transformers, TRL, kernels, Unsloth) with reviewable code
- Heavy experience working with ML frameworks like Unsloth, Transformers, TRL, and PyTorch
- Familiarity with inference engines such as vLLM
- Familiarity with low-level languages and kernels like Triton
- Understanding of cloud services such as GCP or AWS (bonus)
More about this role
We’re looking for someone who loves open-source and collaborating with the OSS community but also has deep understanding in how transformers and Unsloth works.
_MUST COMPLETE CHALLENGES BEFORE APPLYING: _ https://x.com/danielhanchen/status/1891194528931209644
- Deep knowledge and implementation experience with multi-GPU training techniques such as FSDP
- Important contributions to ML open-source projects (e.g., transformers, TRL, kernels, Unsloth) with reviewable code.
- Heavy experience working with ML frameworks like Unsloth, Transformers, TRL, and PyTorch.
- Familiarity with inference engines such as vLLM
- Familiarity with low-level languages and kernels like Triton
- Understanding of cloud services such as GCP or AWS (bonus).
Can be initially remote, with the ability to work in-person in San Francisco later.
Browse similar: AI jobs · AI startup jobs · Startup jobs · Founding team roles · San Francisco Bay Area