Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Data-Hat AIpanchkula, haryana, in
2 days ago
Job description

Department : Data Engineering & AI Solutions

Reports To : Lead Data Solutions Architect

Travel : International travel required (up to 30–40%)

Position Summary :

We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of experience, you’ll be responsible for implementing robust data pipelines, enforcing governance frameworks, and ensuring end-to-end data accessibility for advanced machine learning and analytics use cases.

This is a strategic and hands-on role that sits at the heart of AI delivery, demanding a combination of deep technical acumen, system architecture expertise, and the ability to collaborate across business, data science, and engineering teams. The ideal candidate combines technical mastery with a consultative mindset and is capable of aligning technical workstreams with business outcomes.

Key Responsibilities :

🔹 Data Pipeline Engineering

  • Design, build, and maintain cloud-native, scalable ETL / ELT pipelines for structured and unstructured data ingestion, transformation, and delivery.
  • Leverage tools such as Apache Airflow, dbt, Spark, Kafka, and native cloud data services to optimize data flow and processing latency.
  • Implement event-driven architectures and real-time data streaming solutions where applicable.

🔹 Data Infrastructure Architecture

  • Architect and manage data infrastructure components across cloud environments (AWS, Azure, GCP), including storage, compute, orchestration, and security layers.
  • Enable containerized deployment of data services using Docker and Kubernetes, ensuring high availability and scalability of infrastructure.
  • Ensure data systems are optimized for AI workloads, including support for large-scale model training and real-time inference.
  • 🔹 Data Modeling & Governance

  • Design and implement enterprise-grade data models, schema definitions, and metadata management practices.
  • Enforce data governance policies, lineage tracking, access control, and compliance standards (e.g., GDPR, ISO 27001).
  • Establish data quality frameworks, including anomaly detection, validation rules, and automated monitoring mechanisms.
  • 🔹 Collaboration & Stakeholder Engagement

  • Act as a technical liaison between Data Scientists, ML Engineers, Business Analysts, and senior stakeholders to ensure alignment of data architecture with AI goals.
  • Lead technical workshops and provide mentorship to junior engineers and project teams.
  • Translate high-level business requirements into detailed technical execution plans.
  • 🔹 Optimization & Monitoring

  • Proactively monitor pipeline performance, identify system bottlenecks, and implement enhancements for throughput, latency, and cost-efficiency.
  • Set up automated alerts, logging, and dashboarding using observability tools (e.g., Prometheus, Grafana, CloudWatch).
  • 🔹 Documentation & Knowledge Sharing

  • Develop and maintain comprehensive documentation covering data flows, infrastructure configuration, architectural decisions, and operational procedures.
  • Deliver internal training sessions and contribute to reusable libraries, templates, and engineering standards.
  • 🔹 International Implementation Support

  • Travel internationally to work directly with clients and partners, conducting technical assessments, supporting deployments, and providing hands-on engineering leadership in the field.
  • Required Qualifications :

    🔹 Education :

  • Bachelor’s degree in Computer Science, Data Engineering, or a related technical discipline is required.
  • Master’s degree in Data Science, Information Systems, or Software Engineering is highly preferred .
  • 🔹 Technical Expertise :

  • Data Warehousing & Lakehouse : Advanced experience with Snowflake, Redshift, BigQuery, or Delta Lake architectures.
  • Cloud Platforms : Deep hands-on expertise in at least one major cloud provider (AWS, Azure, GCP).
  • ETL / ELT Tools : Proficient with dbt, Apache Airflow, Informatica, or similar.
  • Programming Languages : Strong coding skills in Python (essential), SQL (advanced), and optionally Scala or Java.
  • Containerization & Orchestration : Experience with Docker, Kubernetes , and Helm.
  • CI / CD Pipelines : Familiarity with tools like GitLab CI, Jenkins, or cloud-native DevOps pipelines.
  • Security & Compliance : Knowledge of role-based access control, encryption, data masking, and regulatory compliance frameworks.
  • Soft Skills & Leadership :

  • Strong interpersonal and communication skills - capable of working across cultures, geographies, and organizational levels.
  • Proven ability to lead technical conversations with business context and explain abstract data architecture in understandable terms.
  • Demonstrated success in client-facing roles or cross-functional teams.
  • High degree of ownership, autonomy, and problem-solving capability.
  • Preferred / Bonus Qualifications :

  • Certifications in AWS / Azure / GCP data or ML specialties.
  • Experience in MLOps and AI / ML model deployment lifecycles.
  • Background in sectors such as government, energy, or finance.
  • Company Description

    Generative AI solutions are reshaping how we work, and AI Agents are the future. Data-Hat AI assists Enterprises in navigating the AI landscape and building profitable and scalable Enterprise AI solutions. As transformation leaders implore the AI landscape, they seek experts to assist in developing solutions and building strategies. And that’s where Data-Hat AI comes in! Guided by an industry veteran, Kshitij Kumar (KK), who has over 2 decades of experience in introducing and implementing Data and AI solutions in Large Enterprises in the US, UK and Europe; a global team of AI and ML experts design Enterprise level AI, GenAI and AI Agent solutions. We go beyond product development, we collaborate with stakeholders and technology leaders to build a Data and AI strategy, develop a Minimal Viable Product (MVP) and establish ROI. We help Enterprises with impactful AI solutions development.

    Create a job alert for this search

    Data Engineer • panchkula, haryana, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalbaddi, himachal pradesh, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + Companybaddi, himachal pradesh, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHbaddi, himachal pradesh, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadybaddi, himachal pradesh, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticspanchkula, haryana, in
    Requirements : Expert Data Engineer.Hands-on experience with PySpark / Spark-SQL.Hands-on with Spark, SQL optimization.Deep understanding of DWH, Data modelling. Cloud - Azure, Databricks, AWS.Skills : ...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXbaddi, himachal pradesh, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 15 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionspanchkula, haryana, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incbaddi, himachal pradesh, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 26 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Servicespanchkula, haryana, in
    Familiarity with CI / CD pipelines and version control (e.Strong problem-solving skills and ability to work in a fast-paced environment. GCP Professional Data Engineer certification.Experience with da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIChandigarh, India, India
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutionsbaddi, himachal pradesh, in
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Data-Hat AIbaddi, himachal pradesh, in
    Data Engineering & AI Solutions .Lead Data Solutions Architect .International travel required (up to 30–40%) .We are hiring a senior-level Data Engineer to lead the design, development, and optimiz...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDpanchkula, haryana, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladepanchkula, haryana, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisebaddi, himachal pradesh, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesbaddi, himachal pradesh, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Namasys Analyticsbaddi, himachal pradesh, in
    Immediate joiners preferred; up to 15 days acceptable.Seeking a Data Engineer to design, build, and maintain scalable data pipelines that automate ingestion and transformation from multiple data so...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgebaddi, himachal pradesh, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemsbaddi, himachal pradesh, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 15 days ago
    • Promoted
    Engineer

    Engineer

    Alp Consulting Ltd.baddi, himachal pradesh, in
    As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 26 days ago