Talent.com
This job offer is not available in your country.
ETL LEAD with IBM DataStage experienced

ETL LEAD with IBM DataStage experienced

IntraEdgeBelgaum, IN
30+ days ago
Job description

Job Title : ETL Developer – DataStage, AWS, Snowflake

Experience : 5–7 Years

Location : Remote

Job Type : Full-time

About the Role

We are looking for a talented and motivated ETL Developer / Senior Developer to join our data engineering team. You will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data) , AWS Glue , and Snowflake . You will collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets supporting analytics and AI / ML use cases.

Key Responsibilities

  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue / Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake , leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews , performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI / CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA / UAT / Production environments as needed.
  • Adhere to agile delivery practices, sprint planning, and documentation requirements.

Required Skills and Experience

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version) .
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake : loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL , Unix scripting , and basic Python for data handling or automation.
  • Familiarity with S3 , version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake / data warehouse architectures and DevOps practices.
  • Good to Have

  • Experience with Collibra, BigID , or other metadata / governance tools
  • Exposure to Data Mesh / Data Domain models
  • Experience with agile / Scrum delivery and Jira / Confluence tools
  • AWS or Snowflake certification is a plus
  • Create a job alert for this search

    Lead Etl • Belgaum, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesBelgaum, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Data Analyst - Databricks

    Data Analyst - Databricks

    V2SoftBelgaum, IN
    The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad ho...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Database Administrator (PostgreSQL | AWS | ETL | Snowflake)

    Senior Database Administrator (PostgreSQL | AWS | ETL | Snowflake)

    CESBelgaum, IN
    We are seeking a highly skilled and proactive Senior Database Administrator to join our.This hybrid role blends traditional DBA responsibilities with modern data. Comparative data loads and ensure o...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mitra AIBelgaum, IN
    We are seeking a candidate who is comfortable working on B shift (3PM - 11PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIES. Develop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom f...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Cloud Data Delivery & Modernization Lead

    Cloud Data Delivery & Modernization Lead

    Pacific Data IntegratorsBelgaum, IN
    Core Technical & Domain Skills.Extensive hands-on experience with cloud modernization of ETL pipelines.Strong data debugging skills and deep understanding of enterprise analytics stack.Proven track...Show moreLast updated: 13 hours ago
    • Promoted
    Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)

    Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)

    Tech One ITBelgaum, IN
    We are seeking a highly skilled.EMDA (Environmental Monitoring Data Analytics) team.The role focuses on developing, deploying, and maintaining ETL workflows for a. Pfizer’s global manufacturing site...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Data Engineering Role

    Data Engineering Role

    100x.incBelgaum, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIBelgaum, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    Databricks Engineer

    Databricks Engineer

    RapidBrainsBelgaum, IN
    ETL, and cloud-based data solutions.The ideal candidate should be highly skilled in.SQL, Databricks, PySpark, and cloud technologies. AWS (S3, Redshift, Lambda, EC2).Automate ETL processes and impro...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIBelgaum, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Eucloid Data SolutionsBelgaum, IN
    Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which ma...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalBelgaum, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Analyst – BI

    Senior Data Analyst – BI

    Gravity Infosolutions, Inc.Belgaum, IN
    Seeking a Senior Data Analyst with strong BI experience to lead data-driven decision-making across eCommerce datasets (Sales, Marketing, Payments, Fulfillment). The role involves designing analytica...Show moreLast updated: 7 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    MindBrainBelgaum, IN
    We are looking for a hands-on Lead Data Engineer to help optimize and maintain our ETL pipelines and data infrastructure. You’ll work with analysts, engineers, and leadership to ensure reliable, sca...Show moreLast updated: 13 hours ago
    • Promoted
    Senior Full Stack SDE with Data Engineering for Analytics

    Senior Full Stack SDE with Data Engineering for Analytics

    TruckmentumBelgaum, IN
    Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Stage Developer (ETL using IBM DataStage 11,Remote Opportunity)

    Lead Data Stage Developer (ETL using IBM DataStage 11,Remote Opportunity)

    Prasha Consultancy Services Private LimitedBelgaum, IN
    Remote
    A US / Canadian based IT MNC is hiring for Lead Data Stage Developer for one of their Banking client.Shift Timing : 2 : 30 PM to 11 : 30 PM. Senior IBM DataStage 11 Developer.The ideal candidate will also ...Show moreLast updated: 5 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Pinnacle Group, Inc.Belgaum, IN
    PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes. Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsBelgaum, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 12 days ago