Data Engineer - Python/Hadoop (5-10 Yrs) Mumbai (Systems/Product Software)

MINIMUM QUALIFICATIONS : - Previous experience in data engineering - Familiar with more modern data engineering pipelines and how they all fit together.Experience with integration of data from multiple data sources - Able to articulate needs on both sides easily.Can talk with backend and data science people both with ease. Data Engineer will work directly with the backend engineering team.
-Proficiency with REST APIs, Cassandra, Python, MongoDB, Postgres, and querying.
-Proficiency with both relational and non-relational databases and how to combine them - Proficiency with distributed computing engines,frameworks like Hadoop v2, Spark - Experience with building stream-processing systems, (e.g., using solutions such as Spark-Streaming or Storm) - Ability to manage Hadoop/Spark cluster or other ingestion tools, with all included services - Previous Experience with various messaging systems, such as Kafka or Amazon Kinesis( for example) - Coding Experience with any of the programming languages - Python,Java, Scala - Excellent communication skills - Willingness to document work in a wiki and track work through an issue tracking system - 5 years of data engineering experience - BS in Computer Science or a related field and relevant experience PREFERRED QUALIFICATIONS : - Previous start-up experience - Machine Learning experience or learning different ML techniques (for bigger data sets) - Experience with AWS cloud platform and services - Ability to solve any ongoing issues with operating the cluster/data pipelines Software development methodologies skills such as : - Experience with a source control system - Experience with an issue tracking system - Preliminary testing and verification - Experience with the design and development life-cycle - Knowledge of debugging and problem-solving methodology, particularly as reported against Production software - Have worked on shipping product - Knowledge with Data Structures(e.g., queues,arrays,maps) - Additional skills that add value to our company (technical or domain) - A passion for our product space and a desire to improve the lives of others

Required Skills : English