IN-Manager_ Data Engineer (Databricks / Pyspark)- Data and Analytics_Advisory_Gurgaon

Description

& Summary : A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Responsibilities :

• Design and develop data pipelines using Databricks and PySpark to ingest, process, and transform large volumes of data.
• Implement ETL / ELT workflows to move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using cloud-native tools.
• Work with structured and unstructured data stored in AWS or Azure Data Lakes.
• Apply strong SQL and Python skills to manipulate and analyze data efficiently.
• Collaborate with cross-functional teams to deliver cloud-based serverless data solutions.
• Design innovative data solutions that address complex business requirements and support data-driven decision-making.
• Maintain documentation and enforce best practices for data architecture, governance, and performance optimization.

Mandatory skill sets :

Preferred skill sets :

ETL,Pyspark

Years of experience required : 4 to 10 Years

Education qualification :

Bachelor's degree in computer science, data science or any other Engineering discipline. Master’s degree is a plus.

Education Degrees / Field of Study required : Bachelor Degree, Master DegreeDegrees / Field of Study preferred : Certifications Required Skills PySpark Optional Skills Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Analytical Thinking, Apache Airflow, Apache Hadoop, Azure Data Factory, Coaching and Feedback, Communication, Creativity, Data Anonymization, Data Architecture, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Databricks Unified Data Analytics Platform, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling {+ 32 more} Desired Languages Travel Requirements Not Specified Available for Work Visa Sponsorship? No Government Clearance Required? No Job Posting End Date