Talent.com
This job offer is not available in your country.
Data Platform Engineer (Python Airflow AWS Snowflake Data Engineer)

Data Platform Engineer (Python Airflow AWS Snowflake Data Engineer)

Epergne SolutionsPune, Maharashtra, India
9 hours ago
Job description

Epergne Solutions is looking for Data Platform Engineer (Python + Airflow Data Engineer)

Total Yrs. of Experience

  • 6+ yrs

Relevant Yrs. of experience

  • 5+ yrs

    • Mandatory skills

  • Python / Airflow Data Engineer

    • Budget : As per market Standards

    Work Location

  • India

    • Mode- Work from Office

    Positions : Contract

    Payroll : Epergne solutions

    Detailed JD

  • (Roles and Responsibilities )

    • We are seeking a highly skilled with 3 to 6 years of experience, specifically with a strong background in AWS technologies. The ideal

    candidate will have a deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling efficient data pipeline orchestration and management.

    Responsibilities :

  • Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.
  • Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
  • Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
  • Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
  • Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and minimal downtime.
  • Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.
  • Develop and maintain documentation for data pipelines, processes, and system architecture.
  • Stay updated with the latest industry trends and best practices related to data engineering and AWS services.

    • Requirements :

  • Bachelor s degree in Computer Science, Engineering, or a related field.
  • Proficiency in Python and SQL for data processing and manipulation.
  • Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.
  • Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.
  • Understanding of Snowflake is preferred.
  • Experience with optimizing and scaling data pipelines for performance and efficiency.
  • Good understanding of data modeling, ETL processes, and data warehousing concepts.
  • Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
  • Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.

    • Preferred Qualifications :

  • AWS certification(s) related to data engineering o r big data.
  • Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
  • Familiarity with other data orchestration tools in addition to Apache Airflow.
  • Knowledge of version control systems like Bitbucket, Git

    • Preferred candidates who can join in 30 days / lesser Notice Period

    Create a job alert for this search

    Data Engineer Aws • Pune, Maharashtra, India

    Related jobs
    • Promoted
    • New!
    Data Engineer-AWS

    Data Engineer-AWS

    Crazy SolutionsPune, Maharashtra, India
    Design, develop, and maintain scalable and efficient data pipelines using industry-standard tools and technologies.Design, implement, and optimize complex SQL queries to extract, transform, and loa...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Data Engineer _ AWS + Python

    Data Engineer _ AWS + Python

    FractalPune, Maharashtra, India
    It's fun to work in a company where people truly BELIEVE in what they are doing!.Data Analytics Engineer- AWS at Fractal. Fractal is one of the most prominent players in the Artificial Intelligence ...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS – Data Engineer

    AWS – Data Engineer

    Epergne SolutionsPune, Maharashtra, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormati...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS, Python, Pyspark, EMR,Apache Airflow- Data Platform Engineer -Remote

    AWS, Python, Pyspark, EMR,Apache Airflow- Data Platform Engineer -Remote

    Rapsys Technologies Pte Ltd.Pune, Maharashtra, India
    We're Hiring : Data Platform Engineer!.We are seeking an experienced Data Platform Engineer to design, build, and maintain scalable data infrastructure using AWS cloud services.The ideal candidate w...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Senior Data Engineer (AWS, Airflow, EMR, Python, Spark, Gitlab / GitHub)

    Senior Data Engineer (AWS, Airflow, EMR, Python, Spark, Gitlab / GitHub)

    NielsenIQPune, Maharashtra, India
    Become a substential part of the Data Platform team, which provides engineering services across the Media Measurement department. Design, develop, test and deploy big data applications and pipelines...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Tech Lead - AWS Data Engineer Job

    Tech Lead - AWS Data Engineer Job

    YASH TechnologiesPune, Maharashtra, India
    Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Sr. Data Engineer - AWS+Python+Pyspark Job

    Sr. Data Engineer - AWS+Python+Pyspark Job

    YASH TechnologiesPune, Maharashtra, India
    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences,...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Lead Consultant - Data Engineer AWS+ Python

    Lead Consultant - Data Engineer AWS+ Python

    GenpactPune, Maharashtra, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Hexaware TechnologiesPune, Maharashtra, India
    Hands on experience working in a public cloud environment and on-prem infrastructure.Specialty on Columnar Databases like. AWS cloud infrastructure services (Redshift, S3, Lambda).Experience with a ...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Yash Technologies - Data Engineer

    Yash Technologies - Data Engineer

    NexthirePune, Maharashtra, India
    Design, develop, and implement cloud solutions on AWS, utilizing a wide range of AWS services, including Glue ETL, Glue Data Catalog, Athena, Redshift, RDS, DynamoDB, Step Function, Event Bridge, L...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Senior Platform Engineer

    Senior Platform Engineer

    AutodeskPune, Maharashtra, India
    We are seeking a highly skilled and experienced Senior Platform Engineer to join our Data Platform team.The ideal candidate will have a strong background in data platforms, data warehousing, and da...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Arting Digital Private LimitedPune, Maharashtra, India
    Data Engineering, SQL, Python, Snowflake, dbt, Apache Airflow.Cloud Platforms : AWS / Azure / GCP.CI / CD, Git, Infrastructure as Code (Terraform). Team Leadership & Stakeholder Collaboration.Design, b...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Lead Consultant - Data Engineer AWS + Python

    Lead Consultant - Data Engineer AWS + Python

    GenpactPune, Maharashtra, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS Platform Engineer

    AWS Platform Engineer

    Cummins Inc.Pune, Maharashtra, India
    Responsible for defining, building and communicating a shared technical and architectural vision for a Product Team to help ensure the system or solution is fit for its intended purpose.Defines, ex...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Epergne SolutionsPune, Maharashtra, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Consultant, AWS Data Engineer

    Consultant, AWS Data Engineer

    GenpactPune, Maharashtra, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS Cloud Engineer

    AWS Cloud Engineer

    Screen Magic Mobile Media Pvt. Ltd.Pune, Maharashtra, India
    Job Title : AWS Cloud Infrastructure Engineer About SMS Magic For over 15 years, SMS Magic has been a trusted messaging leader for businesses worldwide. We cater to a diverse set of industries incl...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Techno WisePune, Maharashtra, India
    Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics re...Show moreLast updated: 9 hours ago