Senior Data Engineer

CoditasPune, Maharashtra, India

30+ days ago

Job description

Roles and Responsibilities

Understand Business requirements and implement scalable solutions.
Translate complex technical and functional requirements into detailed designs
Develop a highly scalable, reliable, and high-performance data processing pipeline to

extract, transform and load data from various systems to the Enterprise Data warehouse / Data Lake / Data Mesh

Provide research, high-level design and estimates for data transformation and data integration from source applications to end-use

Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.

Develop comprehensive data products and implement them on cloud or in-house servers for production use.

Technical Skills

Minimum 6-10 years of progressive experience building solutions in Big Data environments.

Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement.

Hands-on experience of Apache Spark with Python for batch and stream processing.

Should have knowledge of experience in batch and stream data processing

Exposure working on projects across multiple domains.

Strong hands on capabilities on SQL and NoSQL technologies.

Minimum 3+ years of experience with AWS services like S3, DMS, Redshift, Glue, Lambda, Kinesis, MSK etc. is must have or similar services of either Azure / GCP.

Strong analytical / quantitative skills and comfortable working with huge sets of data.

Excellent written and verbal communication skills.

Create a job alert for this search

Senior Data Engineer • Pune, Maharashtra, India

Related jobs

Promoted

Senior Data Engineer

Nityo InfotechPune, IN

Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

MSBC GroupPune, Maharashtra, India

As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, ...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

Incept Labspune, maharashtra, in

Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer

USEReadypune, India

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

DataceriaPune, Maharashtra, India

Company : Dataceria software solutions Pvt ltd.Job Position : Senior Data engineer _snowflake Location : Pune Timings to align with UK and USA timings Hybrid : 3 days in NT office Pune Interview st...Show moreLast updated: 21 days ago

Promoted

Senior Data Engineer

Futran SolutionsPune, Maharashtra, India

Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 30+ days ago

Promoted

Staff / Senior Data Engineer

HG InsightsPune, Maharashtra, India

At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

AIQUPune, IN

We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

InfarsightPune, Maharashtra, India

Infarsight helps enterprises scale strategic business transformation through automation, AI, and product innovation.We streamline operations with platforms like Task Sight, Trip Sight, and Fleet Si...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladepune, maharashtra, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

Saras Analyticspune, maharashtra, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Helpshift, a Keywords TechnologyPune, Maharashtra, India

We are on a mission to rid the world of bad customer service by “mobilizing” the way help is delivered.Today’s consumers want an always-available customer service experience that leaves them feelin...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIPune, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Persistent SystemsPune, Maharashtra, India

We are looking for an experienced Azure Databricks and Snowflake Data Engineer to lead and execute complex user migrations from legacy systems to modern cloud-based solutions.This role involves col...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

Straivepune, maharashtra, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

HealthyMe AIPune, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 22 days ago

Promoted

Senior Data Engineer( DWH)

MastercardPune, Maharashtra, India

Mastercard is a global technology company in the payments industry.Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, ...Show moreLast updated: 13 days ago

Promoted

5447 | Senior Data Engineer

EXLPune, Maharashtra, India

We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 23 hours ago