Pattem Digital - Senior Data Engineer - Big Data/Hadoop/Python (5-10 Yrs) Bangalore (Systems/Product Software)

We are looking for a Senior Data Engineer to join our team at the earliest. You will be entrusted with meeting our strategy on Microsoft Azure-based marketing platform. Apply now if you are great at data engineering and are a great advocate of top quality data and impeccable security measures. At Pattem Digital, you will create enterprise data models for new and prevailing data structures in the company while improving cloud data services. Know your work : - Build large scale data processing and analytic platforms to meet the business objectives - Develop, maintain, and test data solutions across many data platforms like relational databases, big data platforms, etc.
-Create data ingestion transformation routines - acquire data from various (external/internal) sources - Parse data on distributed crawlers from various web sources and develop secure APIs for exchanging information - Knowledgeable in data processing platforms, open source, and software paradigms - Equip Machine Learning and other data science capabilities on Hadoop in the company - Balance operational cost, maintenance, scalability, and deployability - Process Automation - Automate data integration process using Python and other scripting languages - Create a design specification, deployment plans, and other technical documents What you need to apply : - 5 years experience in development, software architecture, and data virtualization - 3 years of experience working with big data - Strong and extensive hands-on Experience with Azure cloud big data architecture - Experience with Azure Data Lake, Azure SQL Data Warehouse, Data Catalog, Azure Analysis Services - Hands on experience with Azure HDInsight/Spark/Eventhub, Azure Virtual Machines, Blob Storage, Azure SQL Database, StorSimple, Azure DNS, Virtual Network, DocumentDB, Redis Cache, Azure App Service - Experience with Big Data Technology Stack: Hadoop/Spark/Hive/MapR - Experience designing and building cloud-native applications as well as Azure Cloud migration experience.
-MUST have strong Hands-on experience in Azure, preferably data heavy/analytics applications leveraging relational and NoSQL databases, data warehouse, and big data.
-Experience with Azure IaaS and PaaS services.
-Hands on experience with data virtualization technologies: CIS (Tibco) and Denodo - Project experience using an Azure cloud, data lake storage, installation, security and infrastructure (IaaS) set up - Experience with Big Data Management (BDM) for relational and non-relational data (formats like JSON, XML, Avro, parquet, copybook, etc.) - Performance tune complex ETL mappings for relational and non-relational workloads - Advanced SQL programming, PL/SQL or T-SQL What you get : - Amazing workplace and colleagues in the IT corridor of Bangalore - Competitive salary at par with the best in the industry - Immense exposure to new technologies Notice Period - 3 Weeks No of Positions - 4

Required Skills : English