Accounts payable automation software that helps mid-market businesses streamline invoices, reduce manual work, and improve accuracy. Backed by QED Investors.
About the role
The Principal Data Engineer is a senior technical leader within AvidXchange's Data Engineering organization responsible for architecting, building, and scaling modern data platforms. In this role, you will drive the migration of legacy Azure SQL Server workloads to Databricks, design real-time streaming pipelines with Apache Kafka, enable AI and agentic capabilities such as Databricks Genie, and define the long-term data architecture strategy. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- A go-getter with an entrepreneurial mindset – that means you are not afraid of taking risks, winning big or facing the unknown
- Someone who understands that business is people centric. Connecting with others as humans first allows you to develop mutually beneficial working relationships
- Focused on making a difference for our customers. AvidXchange exists to help solve complex problems for our customers so we can all realize our potential
More about this role
Overview
The Principal Data Engineer is a senior technical leader within AvidXchange's Data Engineering organization responsible for architecting, building, and scaling modern data platforms. In this role, you will drive the migration of legacy Azure SQL Server workloads to Databricks, design real-time streaming pipelines with Apache Kafka, enable AI and agentic capabilities such as Databricks Genie, and define the long-term data architecture strategy. You will partner closely with Software Engineering, Product, Architecture, DevOps, and Analytics teams to deliver secure, high-performing, and reliable data solutions at enterprise scale.
What You'll Do
Data Platform Architecture & Modernization
· Lead the design and implementation of scalable, cloud-native data architectures on Databricks (Delta Lake, Unity Catalog, Lakehouse patterns).
· Own and execute the migration strategy from legacy Azure SQL Server to Databricks, including schema translation, ETL/ELT re-platforming, data validation, and cutover planning.
· Define data modeling standards (medallion architecture, star/snowflake schemas) and ensure consistency across all pipelines and domains.
· Evaluate and recommend tools,...
Browse similar: Startup jobs