Opportunity at
ElasticLead Data Engineer
This full-time, on-site Lead Data Engineer role is in the United States and sits on the Data Engineering and Architecture team. The engineer helps grow a…
Career Tools
About This Role
This full-time, on-site Lead Data Engineer role is in the United States and sits on the Data Engineering and Architecture team. The engineer helps grow a data platform that lets teams across the company work with data confidently. The work is measured by whether data is trusted and useful to the people who depend on it, not just by whether pipelines keep running. The engineer designs, maintains and improves the…
Job Description
This full-time, on-site Lead Data Engineer role is in the United States and sits on the Data Engineering and Architecture team. The engineer helps grow a data platform that lets teams across the company work with data confidently. The work is measured by whether data is trusted and useful to the people who depend on it, not just by whether pipelines keep running.
The engineer designs, maintains and improves the pipelines and infrastructure behind the platform. Duties run from ingest and streaming jobs through transformation and delivery of data products, using tools such as dbt, Kafka, Iceberg, Spark, Airflow and Flink. The posting also covers resource provisioning on Google Cloud Platform using Terraform.
Stakeholder work is substantial. The engineer meets partners to learn what they need, helps define how data should move across systems, co-creates data contracts, writes documentation and helps colleagues get more value from the tools. Monitoring and tuning pipeline performance, reviewing code for good practice and handling access requests in line with platform policy are also part of the job.
The posting asks for eight or more years in data engineering or a related field, with hands-on experience across the orchestration, processing and table-format tools named above. Familiarity with analytical, transactional, document and vector database systems is expected, along with Bash, Python and SQL. Extra credit is given for handling data security and access rules on SOX-regulated datasets, and for knowing the Elastic Stack.
Responsibilities
- Design, maintain and improve data pipelines and infrastructure for the data platform
- Own work across ingestion, streaming, transformation and delivery
- Provision and manage Google Cloud Platform resources with Terraform
- Meet stakeholders to define data flows and co-create data contracts
- Write clear documentation and guide teammates on using the platform
- Track pipeline throughput and tune processes so operations stay steady
- Review code and enforce standard processes across the platform
- Handle access requests and help keep the platform within its policies
Requirements
- Eight-plus years in data engineering or adjacent roles
- Hands-on use of Airflow to orchestrate data flows
- Working use of dbt Labs, Kafka, Flink and Spark for transforming and processing data
- Grasp of Iceberg table formats and warehouse or lakehouse design
- Skilled with Terraform for provisioning infrastructure as code
- Proficiency in Bash, Python and SQL
- Familiarity with analytical, transactional, document and vector database systems
- Experience with Google Cloud Platform for managing cloud resources
Qualifications
- Experience protecting SOX-regulated datasets through security and access controls
- Familiarity with the Elastic Stack
Core Skills
Benefits
- Pay set by the scope of the work rather than past salary
- Medical coverage for staff and their families in many regions
- Choice of location and working hours for many positions
- Generous annual vacation allowance
- Matching for charitable giving and service of up to $2,000 in local currency equivalent, plus up to 40 hours a year for volunteer projects
- Parental leave of at least 16 weeks
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Is this role on-site?
Yes. The listing is marked on-site and the location is United States.
What is the base salary range?
The typical starting base salary is 113,100 to 178,900 USD. The posting does not describe any variable compensation for this role.
Which cloud platform is used?
The role manages resources on Google Cloud Platform using Terraform.
What experience is needed?
Eight or more years in data engineering or a related role, with experience using Airflow, Spark, Kafka, Flink and dbt Labs.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.