Senior Azure Data Engineer
EXCLUSIVE NETWORKS | Introduction
Exclusive Networks (EXN) is a global cybersecurity specialist that provides partners and end-customers with a wide range of services and product portfolios via proven routes to market. With offices in over 45 countries and the ability to serve customers in over 170 countries, we combine a local perspective with the scale and delivery of a single global organization.
Our best-in-class vendor portfolio is carefully curated with all leading industry players. Our services range from managed security to specialist technical accreditation and training and capitalize on rapidly evolving technologies and changing business models. For more information visit .
At Exclusive Networks, we are passionate about making a difference. That means delivering the best to our clients, doing our part to create a prosperous and trusted digital world, and helping our people to realize their potential.
DUTIES AND RESPONSIBILITIES | About the role
We are seeking a skilled Senior Azure Data Engineer to join our Global IT team. In this role, you will play a key part in building and maintaining our Data Platforms within the Data & Analytics domain. Your primary responsibility will be to design and deliver robust, scalable data pipelines and architectures that meet business requirements, while ensuring high quality and alignment with best practices.
You will lead a team of data engineers and work closely with Product Owners, IT Project Managers, Scrum Masters, and Operational Business Process Owners to deliver innovative data solutions that support strategic objectives. Collaboration with leadership teams and other departments will be essential to ensure effective integration of solutions within our data platform ecosystem.
This role is part of an IT transformation initiative, including the adoption of agile methodologies, where you will actively contribute to shaping the future of our data infrastructure.
As the Azure Data Engineer, you will look after:
1. Leadership and Data Strategy
- Lead a team of data engineers, providing technical guidance, mentoring, and performance management.
- Define and drive the data platform strategy in alignment with the product vision and business objectives.
- Collaborate with senior stakeholders to shape the roadmap for data capabilities and ensure alignment with enterprise architecture and transformation goals.
2. Data Platform Development
- Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Implement data ingestion, transformation, and integration workflows from multiple data sources.
3. Data Modeling and Architecture
- Create and manage data models for structured and unstructured data in alignment with business requirements.
- Build and optimize data storage solutions using Azure SQL Database, Data Lake.
- Design and implement robust and scalable data architecture to support real-time and batch processing.
4. Performance Optimization
- Monitor and improve the performance of data pipelines and query execution.
- Optimize costs and resource utilization of Azure services such as Databricks and Synapse.
5. Collaboration with Stakeholders
- Work closely with data scientists, analysts, and business teams to understand requirements and deliver data solutions.
- Collaborate with DevOps engineers to deploy and manage data platform services through CI/CD pipelines.
6. Troubleshooting and Maintenance
- Identify and resolve issues in data pipelines, data quality, and integrations.
- Perform regular system monitoring, maintenance, and updates to ensure high availability and reliability.
7. Automation and Innovation
- Automate repetitive tasks using tools like Azure Functions and Logic Apps.
- Stay updated on new Azure tools and technologies to recommend and implement innovative solutions.
8. Documentation and Reporting
- Document data workflows,