Data Engineer

We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats.
KEY RESPONSIBILITIES

Develop and optimize Spark workloads in cloud environments Work with

large datasets using Parquet and Iceberg

Translate requirements into robust engineering solutions

Ensure performance, reliability, and maintainability

Contribute to monitoring, documentation, and deployment
MUST HAVE
Strong Python and PySpark
Hands-on Apache Spark, cloud preferred
Databricks experience
Large-scale data systems expertise
Client-facing delivery background

Independent problem-solving in ambiguous settings
NICE TO HAVE
AWS Glue and Lake Formation
Airflow and orchestration tools
Distributed data architectures
Capital markets exposure

Originally posted on Himalayas