Data Engineer
We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos . The ideal candidate will be responsible for architecting, developing, and optimizing data pipelines that will facilitate the efficient processing of large datasets.
Responsibilities:
- Designing and implementing robust data pipeline solutions within Azure Data Lake.
- Integrating and transforming data from various sources to enable comprehensive analytics and reporting.
- Ensuring data quality and integrity, implementing data governance practices.
- Collaborating with cross-functional teams to understand data requirements and develop scalable solutions.
- Monitoring and optimizing data processing workflows for performance and reliability.
- Documenting processes and architecture to ensure maintainability and scalability.
- Staying abreast of new Azure technologies and best practices for data engineering.
Requirements
The successful candidate will possess the following qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- A minimum of 5 years of experience working as a Data Engineer, with a strong emphasis on Azure Data Lake.
- Proficiency in Azure Data Services, particularly Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
- Demonstrated experience with data modeling, ETL processes, and data warehousing solutions.
- Strong programming skills in Python, SQL, and familiar with Java or C#.
- Excellent problem-solving skills and a detail-oriented approach to work.
- Ability to communicate technical concepts clearly to non-technical stakeholders.
- Strong organizational skills with the ability to manage multiple priorities and meet deadlines.
Benefits
Perks & benefits
- Paid Time Off
- Work From Home
- Health Insurance
- OPD
- Training and Development
Originally posted on Himalayas