Real-time B2B data via simple APIs. Backed by Y Combinator.
About the role
We are looking for a foundational member of our engineering team: a highly motivated Software Engineer to own the design, creation, and evolution of our data platform. You will be part of the team that owns the data ingestion and management infrastructure that powers Crustdata’s capabilities. If you are passionate about building robust, scalable data systems and want to see your work directly influence customers, this is the role for you.
What they're looking for
- Experience: You have 3+ years of professional software engineering experience, with a significant focus on data engineering or building backend systems at scale
- Strong Coder: You possess strong programming skills in Python or another modern language (e.g., Java, Go)
- Big Data Expertise: You have hands-on experience with modern big data technologies such as Spark, Flink, or Dask
- Pipeline Orchestration: You have practical experience with workflow management tools like Temporal, Airflow, Dagster, or Prefect
- Problem Solver: You are a pragmatic problem-solver who can navigate ambiguity, manage complexity, and take ownership of projects from inception to completion
- Startup Mentality: You are excited to work in a fast-paced, collaborative environment and wear multiple hats
More about this role
We are looking for a foundational member of our engineering team: a highly motivated Software Engineer to own the design, creation, and evolution of our data platform. You will be part of the team that owns the data ingestion and management infrastructure that powers Crustdata’s capabilities.
If you are passionate about building robust, scalable data systems and want to see your work directly influence customers, this is the role for you.
Architect & Build: Design, build, and maintain our core data infrastructure, including our data warehouse and data lake, using modern cloud technologies (AWS, GCP, or Azure).
Pipeline Development: Develop and scale robust, fault-tolerant data pipelines (ETL/ELT) to ingest and process massive volumes of structured and unstructured data from diverse sources.
Enable Data Science & ML: Create the foundational platform to support our data scientists and ML engineers. This includes building systems for feature engineering, model training, and deploying ML models into production.
Orchestration at Scale: Implement and manage workflow orchestration for hundreds of daily data jobs, ensuring reliability, monitorability, and efficiency using tools like...
Browse similar: Startup jobs · San Francisco Bay Area