DataPhi is now seeking highly motivated data engineers with either MS Azure or AWS engineering background to join our Data analytics team.

Primary Responsibilities:

• Use knowledge to architect data warehousing and BI solutions that solve problems that cut across multiple business functions
• Interact with business customers, gathering requirements and delivering complete Data Engineering, Data Warehousing, and analytics solutions.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources

Job Requirements:

• Minimum 8 years of end-to-end Data Engineering Development experience – Total professional experience does not matter much.
• 5 to 6 years of experience in working on data engineering/ETL tools like Azure Data Factory (ADF) or SSIS or AWS Glue.
• Must have - Microsoft Certified: Azure Data Engineer Associate (DP-203)
• Should have worked with Azure Function and Python to perform serverless code execution.
• Experience in handling large data sets using ADF and Pyspark / Scala code.
• Extensive hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Databricks Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, Azure Stream Analytics, Databricks
• Experience in working with different source/target systems like Oracle Database, SQL Server Database, Blob Storage, Azure Data Lake Storage using Azure Data Factory.
• Experience on working with different Azure services for storage and data transfer.
• Should have working experience on Data Pipeline and Data flow within ADF.
• Ability to read data from sources using APIs/Web Services.
• Having worked with API to write data to target systems.
• Working experience on performing transformation on data required during an ETL process.
• Experience with Data Cleanup, Data Cleansing, and optimization related exercises.
• Experience working with non-structured data sets in Azure will be an added advantage.
• Experience with other analytics tools like Power BI, Azure Analysis service would be an advantage.
• Experience with private and public cloud architectures.

Excellent written and verbal communication skills.

Qualifications:

• M.Tech / B.E. / B.Tech (Computer Science, Information systems, IT) / MCA / MCS

Key Requirements:

• MS Azure Data Factory, Python, PySpark Coding
• Azure Function Apps, Azure Databricks
• Min 3 Full Cycle Data Engineering Implementations
• Certification - Microsoft Certified: Azure Data Engineer Associate (DP-203)