Square Panda - Data Engineer - Python/Java (5-8 Yrs) Mumbai (Systems/Product Software)

Job Description : - Square Panda is seeking a Data Engineer at our Mumbai Office - India headquarters who will work with the internal Square Panda team (engineering, product, educational curriculum). Square Pandas Educational Cloud Platform delivers critical functionality to our innovative educational technology products.
-This role is to help build out Generation 2 data platform, maintain it and ensure data science people have all the tools they need - from a data flow perspective. As we grow the codebase and architecture they will need to come up and implement required test cases. Think of this person as the glue between data science on one side and backend platform and data structures on the other.
-Previous experience with a shipping, consumer product is a big plus. The Square Panda team is fun-loving, quirky, and full of self-starters. We are looking for someone who values working independently but with the support of a skilled and diverse group of individuals.
-You should be motivated, can figure out what to do next when there is downtime, and want to have an impact on the world.
-This position reports to the Director of Software Engineering, with important relationships to the Product Team. MINIMUM QUALIFICATIONS : - Previous experience in data engineering - Familiar with more modern data engineering pipelines and how they all fit together.Experience with integration of data from multiple data sources - Able to articulate needs on both sides easily.Can talk with backend and data science people both with ease. Data Engineer will work directly with the backend engineering team.
-Proficiency with REST APIs, Cassandra, Python, MongoDB, Postgres, and querying.
-Proficiency with both relational and non-relational databases and how to combine them - Proficiency with distributed computing engines,frameworks like Hadoop v2, Spark - Experience with building stream-processing systems, (e.g., using solutions such as Spark-Streaming or Storm) - Ability to manage Hadoop/Spark cluster or other ingestion tools, with all included services - Previous Experience with various messaging systems, such as Kafka or Amazon Kinesis( for example) - Coding Experience with any of the programming languages - Python,Java, Scala - Excellent communication skills - Willingness to document work in a wiki and track work through an issue tracking system - 5 years of data engineering experience - BS in Computer Science or a related field and relevant experience PREFERRED QUALIFICATIONS : - Previous start-up experience - Machine Learning experience or learning different ML techniques (for bigger data sets) - Experience with AWS cloud platform and services - Ability to solve any ongoing issues with operating the cluster/data pipelines Software development methodologies skills such as : - Experience with a source control system - Experience with an issue tracking system - Preliminary testing and verification - Experience with the design and development life-cycle - Knowledge of debugging and problem-solving methodology, particularly as reported against Production software - Have worked on shipping product - Knowledge with Data Structures(e.g., queues,arrays,maps) - Additional skills that add value to our company (technical or domain) - A passion for our product space and a desire to improve the lives of others

Required Skills : English