Talent.com
This job offer is not available in your country.
Inferenz - Lead Data Engineer - Apache Airflow

Inferenz - Lead Data Engineer - Apache Airflow

InferenzAhmedabad
16 days ago
Job description

About the Company

We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.

This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable insights.

If you are passionate about data architecture, ELT best practices, and modern cloud data stack, wed like to meet you.

About the Role :

We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.

Responsibilities :

  • Pipeline Design & Orchestration : Build and maintain robust, scalable data pipelines using Apache Airflow, including incremental & full-load strategies, retries, and logging.
  • Data Modelling & Transformation : Develop modular, tested, and documented transformations in dbt, ensuring scalability and maintainability.

Snowflake Development : Design and maintain warehouse in Snowflake, optimize Snowflake schemas, implement performance tuning (clustering keys, warehouse scaling, materialized views), manage access control, and utilize streams & tasks for automation.

Data Quality & Monitoring : Implement validation frameworks (null checks, type checks, threshold alerts) and automated testing for data integrity and reliability.

Collaboration : Partner with analysts, data scientists, and business stakeholders to translate requirements into scalable technical solutions.

Performance Optimization : Develop incremental and full-load strategies with continuous monitoring, retries, and logging and tune query performance and job execution efficiency.

Infrastructure Automation : Use Terraform or similar IaC tools to provision and manage Snowflake, Airflow, and related environments.

Partner with data analysts, scientists, and business stakeholders to translate reporting and analytics requirements into technical :

  • Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, or a related field.
  • 710 years of experience in data engineering, with strong hands-on expertise in :

  • Snowflake (data modelling, performance tuning, access control, streams & tasks, external tables)
  • Apache Airflow (DAG design, task dependencies, dynamic tasks, error handling)
  • dbt (modular SQL development, Jinja templating, testing, documentation)
  • Proficiency in SQL and Python (Spark experience is a plus).
  • Experience building and managing pipelines on AWS, GCP, or Azure.
  • Strong understanding of data warehousing concepts and ELT best practices.
  • Familiarity with version control (Git) and CI / CD workflows.
  • Exposure to infrastructure-as-code tools like Terraform for provisioning Snowflake or Airflow environments.
  • Excellent problem-solving, collaboration, and communication skills, with the ability to lead technical projects.
  • Good to have :

  • Experience with streaming data pipelines (Kafka, Kinesis, Pub / Sub)
  • Exposure to BI / analytics tools (Looker, Tableau, Power BI)
  • Knowledge of data governance and security best practices.
  • (ref : hirist.tech)

    Create a job alert for this search

    Lead Data Engineer • Ahmedabad

    Related jobs
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsNadiad, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsAnand, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 6 days ago
    • Promoted
    Data pipeline engineer

    Data pipeline engineer

    JRD SystemsGandhinagar, IN
    The Role : Backend and Data Pipeline Engineer : .We are investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data inte...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIAnand, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    LemongrassAhmedabad, IN
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesAnand, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 14 days ago
    • Promoted
    Data / ML Engineer

    Data / ML Engineer

    GleantapAhmedabad, IN
    Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost). Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 21 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIAhmedabad, IN
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 17 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisAhmedabad, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeAhmedabad, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseGandhinagar, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaAhmedabad, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentAhmedabad, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 22 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    XebiaAnand, IN
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 21 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesNadiad, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainAhmedabad, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXAhmedabad, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekAhmedabad, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionGandhinagar, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Nadiad, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 24 days ago