Software Developer/Data Engineer

Software Developer/Data Engineer - 12 Month Contract
Educational Qualifications
- BSc Computer Science / BEng

Professional Qualifications
- AWS Professional Certification

Years of Experience
- 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems

Skills / Requirements

- 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems

- Required to code complex transformations using loader specifications provided by the BA

- Experience working with Big Data sets and solving data-related challenges

- Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue

- Proficiency in coding languages: PySpark, Python, SQL

- Hands-on experience with AWS services , including S3, Athena, Lambda Functions, GLUE, EC2

- AWS experience and AWS certification required

- Experience in data modeling and data architecture design

Key Responsibilities

- Implement scalable data pipelines and architectures using PySpark, Python, SQL

- Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue

- Serve as a technical resource for team members and mentor junior engineers

- Collaborate with the team to deliver high-quality solutions that meet business requirements

- Ensure code is well-designed, maintainable, and follows best practices and standards

- Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met

- Utilize project development tools such as JIRA, Confluence, and GIT

- Assist DEVOPS Engineer in automation and CI/CD practices

- Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.

Originally posted on Himalayas