Data Engineer

Data Engineer Job Description A Data Engineer is a data professional who uses their expertise in data engineering and programming to build systems that collect, manage, and convert raw data into usable information for business analysts. Requirements and skills - Previous 7+ years of experience as a data engineer or in a similar role - Technical expertise with data models, data mining, and segmentation techniques - Knowledge of programming languages (e.g., Java and Python) - Hands-on experience with SQL database design - Great numerical and analytical skills - Degree in Computer Science, IT, or similar field; a masters is a plus. - Data engineering certification (e.g., IBM Certified Data Engineer) is a plus. - Big data technologies such as Hadoop, Spark, and Kafka. - Also be familiar with cloud platforms such as AWS, Google Cloud, and Azure. - Should be proficient in SQL, Excel, Tableau, or other BI tools. They should also have a good understanding of statistical analysis and modelling techniques, as well as business acumen. Responsibilities - Analyse and organize raw data. - Build data systems and pipelines. - Evaluate business needs and objectives. - Interpret trends and patterns. - Conduct complex data analysis and report on results. - Prepare data for prescriptive and predictive modelling. - Build algorithms and prototypes. - Combine raw information from different sources. - Explore ways to enhance data quality and reliability. - Identify opportunities for data acquisition. - Develop analytical tools and programs. - Collaborate with data scientists and architects on several projects. Originally posted on Himalayas