Data Engineer (AI/BI) | Databricks-Centric - RibbitZ

Our client RibbitZ is looking for Data Engineer (AI/BI) | Databricks-Centric to work remotely.


Job Description:


Availability: Must be available until 4:30 PM ET (USA)

We are looking for an experienced Data Engineer with strong AI Platform Engineering expertise to build and scale modern data and AI solutions in a Databricks-centric environment.

Key Responsibilities:

- Build and scale Databricks AI/BI solutions (dashboards, Genie experiences, data pipelines)

- Develop ETL/ELT pipelines using Apache Spark and Delta Lake (Medallion Architecture)

- Integrate data from enterprise systems like PeopleSoft, Salesforce, and D2L

- Ensure data quality, governance, and security (Unity Catalog, encryption, access control)

- Enable AI/ML teams with high-quality datasets and feature stores

- Design and architect cloud data lakes and data marts (ADLS, S3)

- Document and enable teams on Databricks, governance, and architecture best practices

- Support AIOps/MLOps workflows using MLflow (experiment tracking, model registry, deployment)

Required Skills & Experience:

-
 Strong hands-on experience with Databricks (Delta Lake, Apache Spark)

- Experience building ELT pipelines and Medallion Architecture

- Proficiency in SQL, Python, or Scala

- Experience integrating enterprise platforms and systems

- Strong knowledge of data governance and metadata management

- Must have experience in AI Platform Engineering

Preferred Qualifications:

- Experience with Databricks Unity Catalog

- Experience in AI/ML model deployment (MLflow)

- Exposure to AIOps lifecycle workflows

- Cloud experience with Azure or AWS

- Knowledge of data warehouse design

Originally posted on Himalayas