Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

10decodersChennai, Tamil Nadu, India
8 days ago
Job description

1.Role : AWS Data Engineer :

Location : - Chennai, Hyderabad, Pune, Bangalore

Exp : - 6+ years

Work timings : - 2 to 11 PM

 Primary Skills : Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS

,Cloud Formation and other AWS serverless ; Strong exp in SQL

Detailed JD

 Seeking a developer who has good Experience in Athena, Python code, Glue,

Lambda, DMS , RDS, Redshift Cloud Formation and other AWS serverless

resources.

 Can optimize data models for performance and efficiency. Able to write SQL

queries to support data analysis and reporting Design, implement, and

maintain the data architecture for all AWS data services.

 Work with stakeholders to identify business needs and requirements for data-

related projects Design and implement ETL processes to load data into the

data warehouse

 Good Experience in Athena, Python code, Glue, Lambda, DMS, RDS,

Redshift, Cloud Formation and other AWS serverless resources

2.Role : Senior Data Engineer - Azure

Experience Level : 5 - 8 Years; Location : Chennai

About the Role : We are seeking a highly skilled and experienced Data Engineer to join our

team, focusing on building and maintaining robust data pipelines and infrastructure for our U.S.

healthcare payer operations. You will be responsible for the ingestion, transformation, and

availability of large, complex healthcare datasets, enabling our data scientists and ML engineers

to develop impactful solutions. This role requires a strong foundation in data warehousing,

ETL / ELT processes, and cloud-based data platforms within a highly regulated environment.

Responsibilities :

  • Design, develop, and optimize scalable data pipelines (ETL / ELT) to ingest, transform, and load

diverse healthcare data from various sources into our data warehouse / lake.

  • Build and maintain robust data models (e.g., star schema, snowflake schema) to support analytics,
  • reporting, and machine learning initiatives.

  • Write highly optimized SQL queries and Python scripts for data manipulation, cleansing,
  • validation, and transformation.

  • Ensure data quality, integrity, and reliability across all data pipelines.
  • Collaborate with data scientists, ML engineers, and business stakeholders to understand data
  • requirements and translate them into efficient data solutions.

  • Implement and manage data governance policies, security measures, and access controls for
  • sensitive healthcare data (e.g., HIPAA compliance).

  • Monitor data pipeline performance, troubleshoot issues, and implement solutions for continuous
  • improvement.

  • Automate data workflows using orchestration tools and integrate with CI / CD pipelines.
  • Contribute to the selection, evaluation, and implementation of new data technologies and tools.
  • Document data pipelines, data models, and data flow processes thoroughly.
  • Required Technical Skills :

  • Programming Language : Strong proficiency in Python for data processing and automation.
  • Databases : Expert-level SQL skills for complex querying, data manipulation, and optimization.
  • Experience with relational and NoSQL databases.

  • Data Pipelines : Proven experience designing and implementing ETL / ELT processes.
  • Cloud Platforms : Extensive hands-on experience with data services on AWS or Azure (e.g.,
  • AWS S3, Redshift, Glue, EMR, Athena, Azure Data Lake, Azure Synapse Analytics, Azure Data

    Factory).

  • Containerization : Familiarity with Docker for deploying data-related applications.
  • Version Control : Proficient with Git and GitHub.
  • Testing : Experience with Python unittest framework and Pytest for data pipeline testing.
  • CI / CD : Understanding of CI / CD concepts and experience integrating data pipeline
  • deployments with AWS CodePipeline or alternatives.

  • Data Modeling : Strong knowledge of data warehousing concepts and data modeling techniques.
  • Create a job alert for this search

    Senior Data Engineer • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESChennai, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLChennai, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TECHY GEEKSChennai
    About the Role : We are looking for a highly skilled and motivated Senior Data Engineer to join our team.In this role, you will be responsible for designing, building...Show moreLast updated: 7 days ago
    • Promoted
    Lead / Senior Data Engineer - ETL / AWS

    Lead / Senior Data Engineer - ETL / AWS

    ResourcetreeChennai
    We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong kn...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainChennai, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dexianchennai, tamil nadu, in
    We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract. Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticschennai, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionschennai, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentChennai, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisChennai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AiChennai, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeChennai, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Net Zero InsightsChennai, IN
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ViasatChennai, Tamil Nadu, India
    At Viasat, we’re on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, Tamil Nadu, India
    We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIChennai, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.chennai, tamil nadu, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago