Data Engineer

Job Title: Consultant Data Engineer
Location: Remote
Job Summary:

We're looking for a Senior Data Engineer with strong data platform experience to help with support of existing AWS/dbt platform and that can help with standing up our new GCP platform, working with data engineer.
Duties/Responsibilities:

- Design, build, and maintain scalable systems for ingestion, transformation, and storage of data, with a focus on testing and observability

- Implement frameworks, tooling, and automation to safely increase development velocity

- Develop data pipelines, optimize pipelines, SQL or other data workflows from (1) source ingestion and preparation, (2) training and tuning and (3) downstream systems integration (EHR modules, micro-services, dashboards)

Required Skills:

- Proficiency in SQL and Python with strong familiarity towards modern data engineering frameworks, infrastructure, and tooling

- Knowledge of dbt, PySpark, Glue , Terraform to support current infrastructure on AWS

- Great to have experience setting up GCP infra : Iceberg, Dataplex, Terraform to help with initial steps of GCP migration project.

- A collaborative mindset, dependable execution, drive to reflect and improve, and humility to ask questions and learn.

Education & Experience

- Bachelor's degree (or equivalent) in Computer Science, Data Science, Statistics, Engineering or a related field

- 5+ years of experience in data engineering, platform engineering, or ML engineering

- Experience working with major cloud data platforms and tools:

- Preferred experience:

- Healthcare, behavioral health, EHR systems, and/or regulated industries

- Specific expertise with: AWS/GCP, dbt, Airflow, Airbyte, Redshift/BigQuery

Originally posted on Himalayas