Senior Data Engineer (WFH)
About the job:
We're looking for someone very tech-savvy, with PySpark experience, real-time streaming, and ideally experience with trading data/teams.
Streaming Data Expertise
- Proven experience designing, building, and maintaining real-time data streaming solutions using modern event-driven architectures.
- Strong understanding of low-latency data processing for energy trading, market data feeds, telemetry, and operational systems.
Python & PySpark Proficiency
- Advanced hands-on experience with Python and PySpark for large-scale data engineering, transformation, and analytics workloads.
- Ability to optimize distributed processing pipelines and develop robust, production-grade data solutions.
Business Engagement & Solution Design
- Strong communication and stakeholder management skills with the ability to translate complex business requirements into scalable technical solutions.
- Experience working directly with trading, risk, operations, and business teams to deliver measurable business value.
Data Governance & Medallion Architecture
- Deep understanding of data governance principles, including data quality, lineage, cataloging, security, and compliance.
- Proven experience implementing and managing Medallion Architecture (Bronze, Silver, Gold) to support trusted and scalable analytics platforms.
Security-First Engineering Mindset
- Designs and implements data platforms based on rigorous security principles, including least-privilege access, data protection, auditing, and regulatory compliance.
- Ensures security is embedded throughout the data lifecycle and solution architecture.
Independent Delivery & Ownership
- Self-motivated and capable of working independently with minimal supervision.
- Demonstrates strong ownership, problem-solving ability, and the capacity to drive initiatives from design through implementation and operational support.
Who can apply:
Only those candidates can apply who:
- have minimum 5 years of experience
Salary:
Competitive salary
Experience:
5 year(s)
Deadline:
2035-01-01 00:00:00
This role requires you to be in India. If that means relocating or flying in, it is worth checking fares before you commit to a start date.
Compare flights and hotels โGet remote jobs like this by email
10 hand-picked jobs, one email a day. No spam, unsubscribe anytime.
Similar for you
Get 10 hand-picked remote jobs like this one in your inbox every morning. One email a day, matched to what you browse. No spam, one-click unsubscribe.
No thanks โ continue to the application โ