Senior Data Engineer

Senior Data engineer
Role:

- 10+ years hands on experience in software development.

- Strong in algorithms and data structures, knowledge of Object-oriented design, Design Patterns

- Multi-threaded programming

- Strong troubleshooting, debugging, and analytical skills.

- Google cloud development experience

Mandatory Skills

- SQL skills (BQ, Hive and Spark)

- Spark jobs debugging and tuning

- Python, PySpark

- Good architecture skills to understand end to end flows/data pipelines

- -big data architecture, hadoop, hive, Sql, and airflow

- Knowledge of Unix, Github

Secondary skills

- Client stakeholder management

- Offshore team and delivery management

- Certification in relevant skills

Responsibilities

- The candidate must have complete understanding with hands-on experience in design, coding, and testing aspects

- Design, implement, and support multi-tier software applications, document and test systems, modify as necessary

- Work independently and with other engineers, and Ops teams, design and develop strategic and tactical processes, and create solutions that meet business requirements.

- Demonstrate thought processes in solving business and technical problems. Design and code should be easy to maintain, available, performing well, and can be reused across a sub-system or feature. Code may persist for the lifetime of a software version.

- Own to deliver very high-quality code that is thoroughly tested and is supported by unit tests for a flawless execution

- Can be relied on to deliver features and sub-systems on time and to requirements

- Works well within a team and contributes effectively to the success of those they interact with regularly.

Education:

Bachelors degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

Originally posted on Himalayas