Cloud ETL Pipeline Engineer

𝗝𝗼𝗯 𝗿𝗼𝗹𝗲 – 𝗣𝘆𝘁𝗵𝗼𝗻 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗿

𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻 : Remote (India)

𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲 : 5–7 Years

𝗔𝗯𝗼𝘂𝘁 𝘁𝗵𝗲 𝗥𝗼𝗹𝗲 :

We’re looking for an experienced Python Developer with a strong background in Azure cloud services and ETL pipeline development. The ideal candidate will design, build, and optimize data workflows and analytics solutions using Azure Synapse, PySpark, and Azure Functions, ensuring performance, scalability, and reliability across large datasets.

𝗞𝗲𝘆 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀 :

1. Design and develop scalable ETL pipelines using Python, PySpark, and Azure Data Factory.

2. Build Azure Functions for automation, event-driven tasks, and integration workflows.

3. Optimize SQL and PySpark jobs for performance and cost efficiency.

4. Manage and orchestrate data pipelines across Synapse, Data Lake, and Blob Storage.

5. Implement RBAC, data encryption, and governance policies to ensure compliance.

6. Collaborate with DevOps teams to deploy CI / CD pipelines for data engineering solutions.

7. Work closely with cross-functional teams to translate business requirements into technical designs.

8. Maintain technical documentation, architecture diagrams, and testing frameworks.

𝗧𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝗦𝗸𝗶𝗹𝗹𝘀 𝗥𝗲𝗾𝘂𝗶𝗿𝗲𝗱 :

1. 𝗣𝗿𝗼𝗴𝗿𝗮𝗺𝗺𝗶𝗻𝗴 : Python (Advanced), PySpark, SQL

2. 𝗔𝘇𝘂𝗿𝗲 𝗖𝗹𝗼𝘂𝗱 : Azure Functions, Synapse Analytics, Data Factory, Data Lake, Blob Storage

3. 𝗘𝗧𝗟 𝗧𝗼𝗼𝗹𝘀 : Azure Data Factory, Databricks (preferred), or custom Python ETL

4. 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲𝘀 : Azure SQL, PostgreSQL, or equivalent RDBMS

5. 𝗩𝗲𝗿𝘀𝗶𝗼𝗻 𝗖𝗼𝗻𝘁𝗿𝗼𝗹 & 𝗖𝗜 / 𝗖𝗗 : Git, GitHub, Azure DevOps, YAML pipelines

6. 𝗗𝗮𝘁𝗮 𝗔𝗿𝗰𝗵𝗶𝘁𝗲𝗰𝘁𝘂𝗿𝗲 : Data Modeling, Data Warehousing, Governance

7. Monitoring : Azure Monitor, Application Insights, Log Analytics

𝗦𝗼𝗳𝘁 𝗦𝗸𝗶𝗹𝗹𝘀 :

1. Strong analytical and problem-solving skills.

2. Excellent communication and collaboration in remote teams.

3. Adaptable to fast-paced Agile environments.

𝗣𝗿𝗲𝗳𝗲𝗿𝗿𝗲𝗱 𝗤𝘂𝗮𝗹𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀 :

1. Microsoft Certified : Azure Data Engineer Associate (or equivalent).

2. Experience with Power BI / Tableau visualization tools.

3. Familiarity with REST APIs, JSON, and AI / ML data pipelines.

𝗪𝗵𝘆 𝗝𝗼𝗶𝗻 𝗨𝘀 :

1. Remote-first culture with flexible work hours.

2. Exposure to global-scale AI and Data Automation projects.

3. Collaborative, innovation-driven environment.

4. Continuous upskilling through enterprise-level engagements.