Senior Data Migration Engineer

ConfidentialChennai, Pune

6 days ago

Job description

Job Summary :

We are seeking a skilled Senior Data Migration Engineer with expertise in AWS, Databricks, Python, PySpark, and SQL to lead and execute complex data migration projects. The ideal candidate will design, develop, and implement data migration solutions to move large volumes of data from legacy systems to modern cloud-based platforms, ensuring data integrity, accuracy, and minimal downtime.

Job Responsibilities

Software Development :

Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL
Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
Implement efficient and maintainable code using best practices and coding standards.

AWS & Databricks Implementation :

Work with Databricks platform for big data processing and analytics.

Develop and maintain ETL processes using Databricks notebooks.

Implement and optimize data pipelines for data transformation and integration.

Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.

Leverage PySpark for large-scale data processing and transformation tasks.

Continuous Learning :

Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.

Share knowledge with the team and contribute to a culture of continuous improvement.

SQL Database Management :

Utilize expertise in SQL to design, optimize, and maintain relational databases.

Write complex SQL queries for data retrieval, manipulation, and analysis.

Qualifications & Skills :

Education : Bachelor s degree in Computer Science, Engineering, Data Science, or a related field. Advanced degrees are a plus.

4 to 8 Years of experience in Databricks and big data frameworks

Proficient in AWS services and data migration

Experience in Unity Catalogue

Familiarity with Batch and real time processing

Data engineering with strong skills in Python, PySpark, SQL

Certifications : AWS Certified Solutions Architect, Databricks Certified Professional, or similar are a plus.

Soft Skills :

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Ability to work in a fast-paced, agile environment.

Career Level - IC2

Job Responsibilities

Software Development :

Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL

Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.

Implement efficient and maintainable code using best practices and coding standards.

AWS & Databricks Implementation :

Work with Databricks platform for big data processing and analytics.

Develop and maintain ETL processes using Databricks notebooks.

Implement and optimize data pipelines for data transformation and integration.

Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.

Leverage PySpark for large-scale data processing and transformation tasks.

Continuous Learning :

Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.

Share knowledge with the team and contribute to a culture of continuous improvement.

SQL Database Management :

Utilize expertise in SQL to design, optimize, and maintain relational databases.

Write complex SQL queries for data retrieval, manipulation, and analysis.

Skills Required

Aws, Databricks, Python, Pyspark, Sql

Create a job alert for this search

Senior Data Engineer • Chennai, Pune

Related jobs

Promoted

Senior Data Engineer

Coditaspune, maharashtra, in

Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

EXLpune, maharashtra, in

We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Innova SolutionsPune, Maharashtra, India

We're Hiring : Lead Data Consultant / Senior Data Engineer Location : [Insert Location] | Industry : Financial Services & Insurance (FSI) Are you passionate about building scalable, cloud-native d...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Mastekpune, maharashtra, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer- AWS

InfoCeptspune, maharashtra, in

Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

MSBC Grouppune, maharashtra, in

As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, ...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

Guidanz IncPune, IN

BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladepune, maharashtra, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Senior Azure Data Engineer

Programmers.iopune, maharashtra, in

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago

Promoted

Data Migration Specialist (Deltek)

VerdantasPune, Maharashtra, India

Data Migration Specialist As a Data Migration Specialist, you will be responsible for securely and accurately transferring data from legacy ERP systems to Deltek Vantagepoint.This role requires str...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

SGS & Copune, maharashtra, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer with AWS_ Exp : 6+ Years

Atyeti Incpune, maharashtra, in

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer-Remote

Cimpress Indiapune, maharashtra, in

Remote

NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 22 days ago

Promoted

Senior Data Engineer

SAIVA AIPune, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Migration Consultant

Numeric Technologiespune, maharashtra, in

Title : SAP Data Conversion Senior Software Engineer.Duration : Permanent - Immediate Joiner.As a Sr Software Engineer (SAP) in Data Migration we expect this developer to participate in project data ...Show moreLast updated: 13 days ago

Promoted

Senior Databricks Engineer

Newscape ConsultingPune, Maharashtra, India

About the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Persistent SystemsPune, India

A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer

HealthyMe AIPune, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago