Databricks Engineer - Data Analytics & AI Division

The Project

We are looking for a Data Engineer (Databricks) to join our partner's international team. The role focuses on building and optimizing modern data platforms, developing scalable data pipelines, and supporting cloud-based analytics solutions in a dynamic environment.

Requirements
Requirements

- Bachelor's degree in Computer Science, Information Technology, or a related field

- More than 4 years of experience in data engineering, big data, or cloud-based analytics, with a strong preference for experience in banking or fintech sector

- More than 2 years of hands-on experience with Databricks (Workflows, Jobs, Notebooks, and Clusters), including Delta Lake, Spark Structured Streaming

- Expertise in Apache Spark (PySpark/Scala) for large-scale data processing and real-time analytics

- Advanced experience in SQL and Python/Scala, with experience in data transformations and ETL pipelines

- Strong understanding of Delta Lake architecture for data versioning, ACID transactions, and schema evolution

- Experience with Cloud Platforms, particularly Databricks on Azure

- Knowledge of Lakehouse architecture and designing scalable, secure, and cost-efficient data pipelines is a plus

- Familiarity with streaming architectures (Kafka) is a plus

- Experience in MLOps and model deployment using MLflow in Databricks is a plus

- Ability to collaborate with data scientists, analysts, and business teams to understand data needs

- Strong problem-solving skills, with the ability to troubleshoot performance bottlenecks and optimize workloads

- Excellent communication skills to explain technical concepts to non-technical stakeholders

Benefits
Benefits

- Full-remote working

- International working environment

- Modern technologies and challenging projects

- Opportunity to work with experienced professionals

- Long-term career opportunities

Originally posted on Himalayas