Python developer Jobs in India

Lead Python Data Engineer

Location: Noida

Experience: 8+ Years

Algoworks

www.algoworks.com

About the Company

We are a global team of engineers, architects, designers, researchers, operators and innovators who share a passion for achieving client goals. Our engineering services help businesses thrive at the intersection of technology and people. From the latest AI implementations to legacy platform migrations and everything in between, our services span the enterprise technology spectrum. Our world class experience transformation playbook elevates digital success and increases ROI with a relentless focus on the human experience. Our customer base includes Fortune 500 companies around the globe. We've got the skills and insights and we're also fun to work with. Our global team spans a diverse cultural spectrum, with wide ranging interests, enabling us to bring personality and depth to every engagement.

Follow the video below to know about US! Candidate Video

Role Overview

We are seeking a highly skilled Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate will have extensive experience in designing and implementing data solutions using various technologies, including PySpark,

Spark SQL, and Power BI. This role requires a proactive individual who can work independently and collaboratively in a fast-paced environment.

Required Technical Skills

· 7+ years of hands-on experience in software development, with a strong emphasis on Python programming.

· Deep expertise in PySpark (Spark SQL, DataFrames, and Datasets) for building and optimizin g scalable data pipelines. (PySpark)

· Solid experience with Azure Databricks (Unity Catalog), including working with Delta tables, workflows, and scripting in Python.

· Understanding of data governance, data management, security, and compliance in cloud environments.

· Familiar with Azure cloud services, especially Azure Data Lake, Azure Data Factory,

· Experience with Power BI, including DAX and Power Query.

· Modeling data for Data Warehousing and Visualization projects through Semantic Layers.

· Skilled in writing complex SQL queries and building views involving joins across multiple tables.

· Proficient in tools like DevOps (project management), and version control and CI/CD pipelines.

Nice to have Skills

· Experience Azure AI, Azure Copilot Studio and Azure Fabric.

· Experience building workflows with Power Automate.

· EventHub or Kafka for streaming data ingestion.

· Proficient in designing and implementing real-time data streaming solutions.

· Experience across the Software Development Lifecycle (SDLC), with a strong grasp of Agile Scrum methodologies.

Soft Skills Collaboration

· Strong collaboration mindset with enthusiasm for mobbing sessions and cross - team coordination.

· Excellent problem-solving and code review skills.

· Strong communication skills with the ability to understand business requirements and translate them into technical solutions.

· Proactive and responsive during business hours for any ad-hoc calls or meetings.

· Demonstrated ability to prioritize effectively, think creatively, and adapt quickly to new technologies and feedback.

Candidates with strong experience in:

· Pyspark,

· Dataframes

· Datasets

· Azure Databricks may also be considered.

Skills Required
Devops, Power Bi, Azure Databricks, Dax, Pyspark, Azure Data Factory, Power Query, Azure Data Lake, Sql, Spark SQL, Python