Senior Data Engineer

Persistent SystemsPune, Republic Of India, IN

29 days ago

Job description

About Position :

We are looking for a highly skilled and innovative Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and Snowflake, along with hands-on experience integrating AI tools such as ChatGPT, Copilot, or Databricks AI Functions. The ideal candidate will architect and build scalable data pipelines, enable intelligent data processing, and drive AI-powered analytics across enterprise datasets.

Role : Senior Data Engineer (ADB + Snowflake)
Location : Pune, Hyderabad, Bangalore
Experience : 6 to 12 Years
Job Type : Full Time Employment

What You'll Do :

Design and develop scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.

Implement and optimize data warehousing solutions using Snowflake.

Integrate AI capabilities into data workflows using tools like ChatGPT, Copilot, Databricks AI Functions, or Snowflake Copilot. [learn.Microsoft.Com], [docs.Snowflake.Com]

Collaborate with data scientists and analysts to enable AI-powered insights, including summarization, classification, and sentiment analysis.

Build and maintain ETL / ELT workflows, ensuring data quality, performance, and governance.

Use LangChain, pyspark-ai, or similar libraries to embed LLMs into PySpark workloads. [justinmatters.Co.Uk]

Work with stakeholders to understand business requirements and translate them into technical solutions.

Ensure security, compliance, and performance optimization across cloud data platforms.

Document architecture, workflows, and best practices for AI-enhanced data engineering.

Expertise You'll Bring :

6–12 years of experience in data engineering, with strong hands-on expertise in Azure Databricks, PySpark, and Snowflake.

Deep understanding of Lakehouse architecture, Delta Lake, and data warehousing principles.

Proficiency in Python, SQL, and Spark for building scalable data pipelines and transformation workflows.

Experience integrating AI tools such as ChatGPT, Copilot, or Databricks AI Functions into data workflows for intelligent automation and enhanced analytics.

Familiarity with LangChain, pyspark-ai, or similar frameworks for embedding LLMs into data engineering tasks.

Knowledge of Snowflake Copilot, Snowpark, and AI-powered query generation.

Strong grasp of data governance, security, and metadata management using tools like Unity Catalog.

Experience with CI / CD pipelines, DevOps practices, and infrastructure-as-code tools (e.G., Terraform, GitHub Actions).

Ability to collaborate with data scientists, analysts, and business stakeholders to deliver AI-enhanced insights.

Excellent problem-solving, communication, and documentation skills.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.Com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Senior Data Engineer • Pune, Republic Of India, IN

Related jobs

Promoted

Senior Data Engineer

HealthyMe AINagpur, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

IntelliasNagpur, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 8 days ago

Promoted

Data Engineer

Randstad EnterpriseNagpur, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzoneNagpur, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 8 days ago

Promoted

Lead Data Engineer

INDI Staffing ServicesNagpur, IN

At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show moreLast updated: 8 days ago

Promoted

Senior AWS Data Engineer

CYAN360Nagpur, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

All European CareersNagpur, IN

Remote

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer - Data Acquisition

InfoBeansNagpur, IN

We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Saras Analyticsnagpur, maharashtra, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Masteknagpur, maharashtra, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago

Promoted

Sr. Data Engineer

HNR TechNagpur, IN

We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Straivenagpur, maharashtra, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted

Sr Data Engineer

Mitchell Martin Inc.Nagpur, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 21 days ago

Promoted

Data Engineer

RecroNagpur, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

SystemBenderNagpur, IN

Location : Gurgaon / Pune / Bengaluru (Remote).Duration : 03-06 Months (Possibility of extension).We are seeking a highly skilled and experienced. Amazon Web Services (AWS) platform.The ideal candidate wi...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

SGS & Conagpur, maharashtra, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

SAIVA AINagpur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsNagpur, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago