Talent.com
This job offer is not available in your country.
Data Engineer - Apache Airflow / Spark

Data Engineer - Apache Airflow / Spark

Awign Enterprise Pvt ltdHyderabad
30+ days ago
Job description

Position : Data Engineer

Exp : 8+

Location : Gurgaon, Jaipur, Chennai, Bengaluru, Hyderabad, Pune

Job Description :

About the team : As a Data Engineer in the team you will be relied on to independently develop and deliver high-quality features and finish tasks to a high standard. Youll be part of an emerging team, focussing on building and improving our innovative BNL Data Warehouse offerings applying marketing suites.

What we are looking for :

  • For this position the ideal candidate has 8 years of experience in software development, and with data structures / algorithms with a focus on backend and data engineering.

Level of skills and experience :

  • 5 years of hands-on experience in using Python, JVM and Shell Scripting with production experience.
  • 3 years of proven experience on building cloud native data intensive applications, Amazon Web Service experience is a must and good to have experience in GCP.
  • Experience on Data Warehouse design and development per the business nature using any of the modern data warehouses.
  • Having experience in Databricks and dbt experience is required.
  • Highly proficient in architecting and implementing workflow management systems, Airflow is a must.
  • Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
  • Hands-on experience of building and maintaining Spark applications.
  • Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.
  • Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must.
  • Experience with observability systems (such as Datadog or Prometheus / Grafana)
  • Strong experience on building CI / CD processes, experience with GitHub Actions, ArgoCD or Jenkins is good to have.
  • Experience with unit testing and test automation frameworks.
  • Comfortable providing, receiving constructive feedback, particularly while participating in code reviews and ability to not only code, but also provide good quality readable business documentation.
  • Focus on business value vs engineering interest and focus on business value vs engineering interest.
  • Pro-active / service-oriented towards our internal customers
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Hyderabad

    Related jobs
    • Promoted
    Cognos Developer - TM1 / ETL

    Cognos Developer - TM1 / ETL

    MERGEN CORPORATES PRIVATE LIMITEDHyderabad
    Description : Company Description : Mergen Corporates is a trusted ServiceNow Managed Services Partner, delive...Show moreLast updated: 4 days ago
    • Promoted
    Snowflake Engineer - SQL / ETL

    Snowflake Engineer - SQL / ETL

    Pylon Management ConsultingHyderabad
    Primary Roles and Responsibilities : - Good expertise in SQL,Snowflake.Ability to provide solutions that are forward-thinking in data engineering ...Show moreLast updated: 30+ days ago
    • Promoted
    Caliber Technologies - Data Analyst - Python / SQL

    Caliber Technologies - Data Analyst - Python / SQL

    CALIBER TECHNOLOGIES PRIVATE LIMITEDHyderabad
    Description : Key Responsibilities : - Work closely with product managers and analytics leads to translate b...Show moreLast updated: 6 days ago
    • Promoted
    SDE-2 Full Stack

    SDE-2 Full Stack

    NxtWaveHyderabad, Telangana, India
    As a Fullstack SDE - II at NxtWave, you.Build applications at a scale and see them released quickly to the NxtWave learners (within weeks). Get to take ownership of the features you build and work c...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    DNA Technology ServicesHyderabad, IN
    We are looking for an experienced.The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS / Azure), and modern data engineering practices, with the ability to design and imp...Show moreLast updated: 14 days ago
    • Promoted
    Sailpoint Developer(IAM)

    Sailpoint Developer(IAM)

    Providence IndiaHyderabad, Telangana, India
    At Providence, we use our voice to advocate for vulnerable populations and needed reforms in health care.We pursue innovative ways to transform health care by keeping people healthy, and making our...Show moreLast updated: 13 days ago
    • Promoted
    Zensar Technologies - Snowflake Developer - Data Engineering

    Zensar Technologies - Snowflake Developer - Data Engineering

    Zensar TechnologiesHyderabad
    Snowflake Developer Location : Hyderabad Experience : 4-10 Years Notice Period : Immediate / 15 Days &l...Show moreLast updated: 30+ days ago
    • Promoted
    DigiHelic Solutions - Snowflake Developer - ETL Tools

    DigiHelic Solutions - Snowflake Developer - ETL Tools

    Digihelic Solutions Private LimitedHyderabad
    Job Role - Snowflake Developer Experience - 5-7 Years Location - Model - Hybrid Mandatory Skills - Snowflake, PySpark Show moreLast updated: 30+ days ago
    • Promoted
    Lead Snowflake Data Engineer

    Lead Snowflake Data Engineer

    ConfidentialHyderabad / Secunderabad, Telangana, Chennai
    Location : Hyderabad, Chennai (WFO).Notice Period : Immediate or Serving.Share your resume at [HIDDEN TEXT].Essential Functions and Tasks : . Participate in the design, development, and maintenance of ...Show moreLast updated: 25 days ago
    • Promoted
    MERN Stack Developer

    MERN Stack Developer

    ACL Digitalhyderabad, telangana, in
    Translate the high-level requirement into technical requirements, design & develop the solution.React, NodeJS, Express, MongoDB, PostgreSQL. Hands-on experience of working with TypeScript.Strong und...Show moreLast updated: 9 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    AnblicksHyderabad, Telangana, India
    Snowflake / Matillion Developer.A Snowflake + Matillion Developer is responsible for designing, building, and optimizing data pipelines for loading, transforming, and managing large volumes of data...Show moreLast updated: 14 days ago
    • Promoted
    Snowflake Data Engineer - DBT

    Snowflake Data Engineer - DBT

    BPMLinksHyderabad, Telangana, India
    Proficiency in DBT, Matillion ETL for Snowflake.Expertise in SQL query optimization, data modeling, and GitHub workflows. Certifications in Snowflake and Matillion is a plus.Show moreLast updated: 9 days ago
    • Promoted
    UT-48 Advanced Data Engineer Contract

    UT-48 Advanced Data Engineer Contract

    Talent SmartHyderabad, Telangana, India
    Job Location : Hyderabad / Bangalore.Proficiency In Python, SQL, Databricks, Snowflake Data Modelling, Data Orchestration, ETL Process, Apache Spark, Pyspark, Data Integration and workflow orchestrati...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Minimum of 3+ years of working experience with.Datawarehouse and data lake service.Obvious track record of designing and implementing. Exposed to ETL / ELT and governance tools (incl.Experience within...Show moreLast updated: 15 hours ago
    • Promoted
    SAP BTP IS - PI / PO to CPI migration

    SAP BTP IS - PI / PO to CPI migration

    Quantum Integratorssecunderabad, telangana, in
    SAP BTP IS - PI / PO to CPI migration.Full-time with Quanta Systems Technologies.We are seeking a highly skilled.SAP BTP – Integration Specialist. The ideal candidate will have deep technical knowledg...Show moreLast updated: 11 days ago
    • Promoted
    3i Infotech - Matillion Developer - ETL & Data Pipeline

    3i Infotech - Matillion Developer - ETL & Data Pipeline

    3i Infotech LimitedHyderabad
    Position : Matillion Developer Banking Domain (Snowflake) Type : Full-Time Experience : 6+ years ...Show moreLast updated: 6 days ago
    • Promoted
    Snowflake Data Engineer - PySpark / ETL

    Snowflake Data Engineer - PySpark / ETL

    Jobtravia Pvt. Ltd.Hyderabad
    Job Title : Snowflake Data Engineer Location : Pune, Hyderabad | Hybrid Experience : 5+ Years &...Show moreLast updated: 30+ days ago
    • Promoted
    Full Stack SDE-2

    Full Stack SDE-2

    NxtWaveHyderabad, Telangana, India
    As a Fullstack SDE - II at NxtWave, you.Build applications at a scale and see them released quickly to the NxtWave learners (within weeks). Get to take ownership of the features you build and work c...Show moreLast updated: 30+ days ago
    • Promoted
    Techstar Software - Snowflake Engineer - PostgreSQL / ETL

    Techstar Software - Snowflake Engineer - PostgreSQL / ETL

    Techstar Software Development India Pvt. Ltd.Hyderabad
    Please note, who can join max 15 days only, higher Notice Period not being considered.Role : Snowflake Engineer with PostgreSQL and ETL< / ...Show moreLast updated: 19 days ago
    • Promoted
    MLOps Observability Engineer

    MLOps Observability Engineer

    Intraedge Technologies Ltd.Hyderabad
    The MLOps Observability Engineer will design, implement, and maintain the comprehensive monitoring, logging, and tracing solutions for our entire ML platform and production models.This includes bui...Show moreLast updated: 6 days ago