Senior Data Engineer

We are looking for a Senior Data Engineer with a strong software engineering background and deep expertise in building modern cloud-based data platforms.

You will be responsible for designing and developing scalable data infrastructure, building reliable data pipelines, and establishing engineering best practices across our data ecosystem. This role is ideal for someone who enjoys solving complex engineering challenges while enabling analytics, machine learning, and product teams with high-quality data.

Responsibilities
Data Platform
- Design, build, and evolve GoMining's cloud data platform on Google Cloud Platform.
- Develop scalable data architecture following modern engineering principles, including Medallion Architecture.
- Define and maintain data models, data contracts, and integration standards across systems.

Data Engineering
- Build and maintain reliable batch and streaming data pipelines.
- Integrate data from internal services and third-party APIs.
- Develop scalable ETL/ELT workflows and automate data processing.
- Build and maintain analytical data marts for business and product teams.

Platform Reliability
- Ensure data quality, consistency, and reliability across the platform.
- Implement monitoring, alerting, and SLA management for data pipelines.
- Continuously improve platform performance, scalability, and operational efficiency.

Engineering Excellence
- Drive Infrastructure as Code (IaC), CI/CD, and automation across the data platform.
- Contribute to the development of ML and AI infrastructure.
- Establish engineering best practices, code quality standards, and technical documentation.
- Collaborate closely with Analytics, Data Science, Product, and Engineering teams.

Technology Stack
- Python
- SQL
- Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Composer)
- Apache Airflow
- Terraform
- Kubernetes
- Docker
- CI/CD
- REST APIs
- Git