Talent.com
This job offer is not available in your country.
Neoware Technology Solutions - AWS Data Engineer - Python / SQL / ETL

Neoware Technology Solutions - AWS Data Engineer - Python / SQL / ETL

Neoware Technology SolutionsBangalore
30+ days ago
Job description

Job Title : Data Engineer

Experience Level : 5 - 8 Years Location : Chennai

About the Role : We are seeking a highly skilled and experienced Data Engineer to join our team, focusing on building and maintaining robust data pipelines and infrastructure for our U.S. healthcare payer operations. You will be responsible for the ingestion, transformation, and availability of large, complex healthcare datasets, enabling our data scientists and ML engineers to develop impactful solutions. This role requires a strong foundation in data warehousing, ETL / ELT processes, and cloud-based data platforms within a highly regulated :

  • Design, develop, and optimize scalable data pipelines (ETL / ELT) to ingest, transform, and load diverse healthcare data from various sources into our data warehouse / lake.
  • Build and maintain robust data models (e.g., star schema, snowflake schema) to support analytics, reporting, and machine learning initiatives.
  • Write highly optimized SQL queries and Python scripts for data manipulation, cleansing, validation, and transformation.
  • Ensure data quality, integrity, and reliability across all data pipelines.
  • Collaborate with data scientists, ML engineers, and business stakeholders to understand data requirements and translate them into efficient data solutions.
  • Implement and manage data governance policies, security measures, and access controls for sensitive healthcare data (e.g., HIPAA compliance).
  • Monitor data pipeline performance, troubleshoot issues, and implement solutions for continuous improvement.
  • Automate data workflows using orchestration tools and integrate with CI / CD pipelines.
  • Contribute to the selection, evaluation, and implementation of new data technologies and tools.
  • Document data pipelines, data models, and data flow processes thoroughly.

Required Technical Skills :

  • Programming Language : Strong proficiency in Python for data processing and automation.
  • Databases : Expert-level SQL skills for complex querying, data manipulation, and optimization. Experience with relational and NoSQL databases.
  • Data Pipelines : Proven experience designing and implementing ETL / ELT processes.
  • Cloud Platforms : Extensive hands-on experience with data services on AWS o (e.g., AWS S3, Redshift, Glue, EMR, Athena)
  • Containerization : Familiarity with Docker for deploying data-related applications.
  • Version Control : Proficient with Git and GitHub.
  • Testing : Experience with Python unittest framework and Pytest for data pipeline testing.
  • CI / CD : Understanding of CI / CD concepts and experience integrating data pipeline deployments with AWS CodePipeline or alternatives.
  • Data Modeling : Strong knowledge of data warehousing concepts and data modeling techniques.
  • (ref : hirist.tech)

    Create a job alert for this search

    Aws Data Engineer • Bangalore

    Related jobs
    • Promoted
    AWS Engineer with GenAI

    AWS Engineer with GenAI

    Gainwell TechnologiesBengaluru, Karnataka, India
    AWS Engineer with GenAI and Python / C# / Java.The AWS Engineer is responsible for end-to-end deployment, configuration, and reliability of AWS-based product demo environments, integrating GenAI pipeli...Show moreLast updated: 25 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Mindtreehosur, tamil nadu, in
    Show moreLast updated: 19 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    L&T Technology ServicesBengaluru, Karnataka, India
    Graduate with 8-10 years of experience working as a AWS Data Engineer.Excellent knowledge of PySpark, JavaScript, AWS - RDS, and Redshift.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekBengaluru, Karnataka, India
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 1 day ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglitehosur, tamil nadu, in
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 9 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ValueMomentumhosur, tamil nadu, in
    We are seeking a highly skilled.You will work closely with development, operations, and security teams to ensure continuous delivery, high availability, and optimal performance of our applications....Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 22 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    NAM Info IncBengaluru, Karnataka, India
    We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Rol...Show moreLast updated: 9 days ago
    • Promoted
    AWS Data engineer / Architect

    AWS Data engineer / Architect

    Tata Consultancy ServicesBengaluru, Karnataka, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 20 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    DBiz.aihosur, tamil nadu, in
    We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 9 days ago
    • Promoted
    AWS Data Engineer for Bangalore

    AWS Data Engineer for Bangalore

    DeloitteBengaluru, Karnataka, India
    Looking for Skilled AWS Data Engineer, Interested candidates please find the JD below : .Bachelor’s Degree and 3+ years’ experience in the implementation of modern data ecosystems in AWS / Cloud platfo...Show moreLast updated: 9 days ago
    • Promoted
    Sr. AWS Cloud Engineer

    Sr. AWS Cloud Engineer

    Mastekhosur, tamil nadu, in
    Cloud Engineer Job description : .Have work experience in the following areas : .Experience in designing, building, and maintaining AWS Cloud Infrastructure. Proficient in AWS services including EC2, S3...Show moreLast updated: 25 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USABangalore, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 6 days ago
    • Promoted
    Cloud Engineer Lead (AWS)

    Cloud Engineer Lead (AWS)

    Datapel Systemshosur, tamil nadu, in
    The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.hosur, tamil nadu, in
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 28 days ago