Data Engineer - Machine Learning/R/Python (2-5 Yrs) Delhi (Systems/Product Software)

Job Purpose : - The individual is expected to work on the development and management of a Big Data platform which shall be used to handle billions of data points from various sources in real time. The platform serves multiple purposes - it is used for predefined and ad-hoc user generated queries, real-time Machine Learning algorithms and various business metrics and reports.
-The individual is expected to create the data flow pipeline and setup workflows to handle the various kinds of requirements being served by the platform. We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analysing of huge sets of data.
-The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.
-Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities - Implementing ETL process and building, maintaining, monitoring the data pipeline - Monitor data quality and enable system owned resolution channels - Monitoring performance and advising any necessary infrastructure changes - Ability to rationalnalize data science models through an operationalization platform - version, archive, manage the model deployment - Defining data retention policies Skills Knowledge : - Experience in Big Data and Machine Learning Technologies/Frameworks - Hands-on with Scala, Apache Spark, Hadoop, HDFS, MLlib, Airflow - Ability to work in a container-based environment - docker, kubernetes - Experience with data science tools - R and python

Required Skills : English