Talent.com
Senior Data Engineer

Senior Data Engineer

Nityo InfotechBengaluru, Karnataka, India
11 days ago
Job description

Senior Data Engineer

Position Overview

We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site. This role requires a self-starter who can architect and implement robust data foundation layers while providing technical leadership and guidance to the engineering team. The ideal candidate will have deep expertise in modern data platforms, particularly Databricks / Delta Lake, and a strong understanding of how to build scalable, reliable data infrastructure that powers enterprise analytics and AI initiatives.

Key Responsibilities

Data Foundation & Architecture

  • Design, build, and maintain scalable data foundation layers that serve as the backbone for analytics, reporting, and AI / ML initiatives
  • Architect end-to-end data solutions including storage, integration, pipelines, and modeling components
  • Establish best practices and standards for data architecture across the organization
  • Evaluate and recommend new technologies and tools to enhance the data platform

Data Storage & Management

  • Design and implement data storage solutions using modern cloud-based platforms
  • Build and optimize data warehouses, data lakes, and lakehouse architectures
  • Implement data partitioning, indexing, and optimization strategies for performance at scale
  • Ensure data availability, reliability, and disaster recovery capabilities
  • Data Pipelines & Integration

  • Develop robust, scalable ETL / ELT pipelines for batch and real-time data processing
  • Build data integration frameworks connecting diverse data sources (APIs, databases, files, streaming)
  • Implement data quality checks and monitoring throughout the pipeline
  • Optimize pipeline performance and troubleshoot production issues
  • Automate data workflows and orchestration processes
  • Data Modeling

  • Design conceptual, logical, and physical data models aligned with business requirements
  • Implement dimensional modeling (star / snowflake schemas) for analytics use cases
  • Create and maintain data dictionaries and documentation
  • Ensure data models support both operational and analytical workloads
  • Team Leadership & Collaboration

  • Mentor and guide junior and mid-level data engineers on technical best practices
  • Conduct code reviews and ensure high-quality, maintainable code standards
  • Lead technical design discussions and architectural decisions
  • Collaborate with data scientists, analysts, and business stakeholders to understand requirements
  • Drive continuous improvement initiatives within the data engineering team
  • Required Qualifications

    Experience & Education

  • 8-12 years of experience in data engineering or related roles
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field (or equivalent experience)
  • Proven track record of building enterprise-scale data platforms
  • Experience in building intelligent AI agents and RAG-based applications along with good exposure to Prompt engineering
  • Expertise in implementing and optimizations with Databases such as SQL Server, Postgres SQL, Clickhouse etc.,
  • Core Technical Skills

    Must Have :

  • Databricks / Delta Lake : Extensive hands-on experience building data solutions on Databricks platform using Delta Lake for lakehouse architecture
  • Data Foundation Layer Expertise : Deep understanding and practical implementation of :
  • o Data storage architectures (data lakes, warehouses, lakehouse)

    o Data pipeline development and orchestration

    o Data integration patterns and frameworks

    o Data modeling techniques and best practices

  • Programming : Strong proficiency in Python and SQL
  • Cloud Platforms : Experience with Azure (or comparable)
  • Big Data Technologies : Spark, Kafka, or similar distributed processing frameworks
  • AI & Modern Tools

  • Working knowledge of AI tools and their integration with data platforms
  • Experience supporting ML / AI workflows and feature engineering pipelines
  • Soft Skills

  • Self-Starter : Ability to work independently, take initiative, and drive projects to completion
  • Leadership : Proven ability to guide and mentor team members
  • Communication : Excellent verbal and written communication skills to collaborate with technical and non-technical stakeholders
  • Problem-Solving : Strong analytical and troubleshooting abilities
  • Adaptability : Comfortable working in fast-paced environments with evolving requirements
  • Create a job alert for this search

    Senior Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechBengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AvathonBengaluru, Karnataka, India
    AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivehosur, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.Bengaluru, Karnataka, India
    Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues. Work with business to understand the need in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataWeaveBengaluru, Karnataka, India
    APIs powering dashboards and integrations.Collaborate with cross-functional teams in a.Elasticsearch, Cassandra, Solr.Good communication and problem-solving skills. Mentorship, learning opportunitie...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Societe Generale Global Solution CentreBengaluru, Karnataka, India
    With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors / inspectors with high-qua...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladebangalore, karnataka, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ValueLabsBengaluru, Karnataka, India
    With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries. Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cohosur, tamil nadu, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labshosur, tamil nadu, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiahosur, tamil nadu, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncBangalore, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesBangalore Urban, Karnataka, India
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekbangalore district, karnataka, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIhosur, tamil nadu, in
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Inchosur, tamil nadu, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MeghGen TechnologiesBengaluru, Karnataka, India
    MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions t...Show moreLast updated: 1 day ago