See metrics from all of your apps, tools & services in one place with Datadog’s cloud monitoring as a service solution. Try it for free. Backed by Index, CRV and ICONIQ.
About the role
As a Senior Software Engineer on this team, you'll work hands-on with a distributed storage system at petabyte scale, and help us evolve our platform to support the next level of scale that will power the AI era. We will move from a custom storage format towards open standards (Parquet, Arrow, DataFusion) enabling on prem solutions, increasingly complex analytical/batch workloads, and powering AI observability, sustainably into the future. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Enthusiastic and experienced with large-scale distributed systems and/or storage engines
- Comfortable with improving and operating large distributed systems that customers rely on for critical business functions
- Strong fundamentals in columnar/file storage formats (Parquet, ORC, Arrow) or comparable systems
More about this role
Husky is what we call the distributed, petabyte-scale columnar event store at the heart of our Event Platform, which powers dozens of Datadog’s most popular products – Logs, RUM, APM, Cloud Network Monitoring, Netflow, and many more. Husky was built from the ground up at Datadog to store and query massive volumes of event data at low cost, with data fully queryable within seconds of arrival.
As a Senior Software Engineer on this team, you'll work hands-on with a distributed storage system at petabyte scale, and help us evolve our platform to support the next level of scale that will power the AI era. We will move from a custom storage format towards open standards (Parquet, Arrow, DataFusion) enabling on prem solutions, increasingly complex analytical/batch workloads, and powering AI observability, sustainably into the future. You'll partner closely with Husky Ingestion, Metadata, and Platform, and increasingly with Lakehouse on the Iceberg-compatible boundary between Husky and analytical/batch workloads. You will also work with the open source community to build the next generation of reusable software solutions that can be operated at scale.
Datadog has a culture that is...
Browse similar: Startup jobs