Talent.com
Senior Data Migration Engineer

Senior Data Migration Engineer

ConfidentialKolkata, Mumbai
11 days ago
Job description

Job Summary :

We are seeking a skilled Senior Data Migration Engineer with expertise in AWS, Databricks, Python, PySpark, and SQL to lead and execute complex data migration projects. The ideal candidate will design, develop, and implement data migration solutions to move large volumes of data from legacy systems to modern cloud-based platforms, ensuring data integrity, accuracy, and minimal downtime.

Job Responsibilities

Software Development :

  • Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
  • Implement efficient and maintainable code using best practices and coding standards.

AWS & Databricks Implementation :

  • Work with Databricks platform for big data processing and analytics.
  • Develop and maintain ETL processes using Databricks notebooks.
  • Implement and optimize data pipelines for data transformation and integration.
  • Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.
  • Leverage PySpark for large-scale data processing and transformation tasks.
  • Continuous Learning :

  • Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.
  • Share knowledge with the team and contribute to a culture of continuous improvement.
  • SQL Database Management :

  • Utilize expertise in SQL to design, optimize, and maintain relational databases.
  • Write complex SQL queries for data retrieval, manipulation, and analysis.
  • Qualifications & Skills :

  • Education : Bachelor s degree in Computer Science, Engineering, Data Science, or a related field. Advanced degrees are a plus.
  • 4 to 8 Years of experience in Databricks and big data frameworks
  • Proficient in AWS services and data migration
  • Experience in Unity Catalogue
  • Familiarity with Batch and real time processing
  • Data engineering with strong skills in Python, PySpark, SQL
  • Certifications : AWS Certified Solutions Architect, Databricks Certified Professional, or similar are a plus.
  • Soft Skills :

  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration abilities.
  • Ability to work in a fast-paced, agile environment.
  • Career Level - IC2

    Job Responsibilities

    Software Development :

  • Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
  • Implement efficient and maintainable code using best practices and coding standards.
  • AWS & Databricks Implementation :

  • Work with Databricks platform for big data processing and analytics.
  • Develop and maintain ETL processes using Databricks notebooks.
  • Implement and optimize data pipelines for data transformation and integration.
  • Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.
  • Leverage PySpark for large-scale data processing and transformation tasks.
  • Continuous Learning :

  • Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.
  • Share knowledge with the team and contribute to a culture of continuous improvement.
  • SQL Database Management :

  • Utilize expertise in SQL to design, optimize, and maintain relational databases.
  • Write complex SQL queries for data retrieval, manipulation, and analysis.
  • Skills Required

    Aws, Databricks, Python, Pyspark, Sql

    Create a job alert for this search

    Senior Data Engineer • Kolkata, Mumbai

    Related jobs
    • Promoted
    SAP Data Migration expert

    SAP Data Migration expert

    Numeric TechnologiesKolkata, IN
    As a Sr Software Engineer (SAP) in Data Migration we expect this developer to participate in project data migration activities to support the successful data conversion from ECC to S / 4HANA (Green f...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladekolkata, west bengal, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKolkata, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsKolkata, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sundewwest bengal, west bengal, in
    We are looking for a Data Engineer with strong Databricks expertise to join our team.This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing l...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasKolkata, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKolkata, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticskolkata, west bengal, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesKolkata, West Bengal, India
    Required Technical Skill Set • •.Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI / CD, Data Governance, Purview, Informatica.Desire...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiakolkata, west bengal, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 27 days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inckolkata, west bengal, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    All European Careerskolkata, west bengal, in
    Remote
    For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekkolkata, west bengal, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labskolkata, west bengal, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    IndsafriKolkata, IN
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 28 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kolkata, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Kolkata, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 20 days ago
    • Promoted
    Data Migration Consultant

    Data Migration Consultant

    Numeric Technologieskolkata, west bengal, in
    Title : SAP Data Conversion Senior Software Engineer.Duration : Permanent - Immediate Joiner.As a Sr Software Engineer (SAP) in Data Migration we expect this developer to participate in project data ...Show moreLast updated: 17 days ago