Talent.com
This job offer is not available in your country.
Principal Software Engineer - Data Management

Principal Software Engineer - Data Management

ZoominfoBangalore
30+ days ago
Job description

As a Principal Software Engineer in our Data Platform infrastructure team, you'll have a key role in building and designing the strategy of our Enterprise Data Engineering group.

Responsibilities :

  • Design and build a highly scalable data platform to support data pipelines for diversified and complex data flows.
  • Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and POC activities.
  • Deliver scalable, reliable, and reusable data solutions.
  • Leading, building, and continuously improving our data gathering, modeling, reporting capabilities, and self-service data platforms.
  • Working closely with Data Engineers, Data Analysts, Data Scientists, Product Owners, and Domain Experts to identify data needs.
  • Develop processes and tools to monitor, analyze, maintain, and improve data operations, performance, and usability.

Requirements :

  • Relevant Bachelor's degree or other equivalent Software Engineering background.
  • 12+ years of experience as an infrastructure / data platform / big data software engineer.
  • Experience with AWS / GCP cloud services such as GCS / S3 Lambda / Cloud Function,
  • EMR / Dataproc, Glue / Dataflow, Athena.

  • IaC design and hands-on experience.
  • Familiarity with designing CI / CD pipelines with Jenkins, Github Actions, or similar tools.
  • Experience in designing, building, and maintaining enterprise systems in a big data environment on the public cloud.
  • Strong SQL abilities and hands-on experience with SQL, performing analysis and performance optimizations.
  • Hands-on experience in Python or an equivalent programming language.
  • Experience with administering data warehouse solutions (like BigQuery / Redshift / Snowflake).
  • Experience with data modeling, data catalog concepts, data formats, data pipelines / ETL
  • design, implementation, and maintenance.

  • Experience with Airflow and DBT - advantage
  • Experience with Kubernetes using GKE or EKS - advantage.
  • Experience with development practices - Agile, TDD - an advantage.
  • Mandate Skills : SQL, CICD, Terraform, IAC, Python, GCP / AWS, Jenkins, Airflow.
  • (ref : hirist.tech)

    Create a job alert for this search

    Principal Software Engineer • Bangalore

    Related jobs
    • Promoted
    Principal Engineer

    Principal Engineer

    RecroBengaluru, Karnataka, India
    Essential duties / responsibilities : .Investigate, troubleshoot, and resolve software issues to ensure system stability and reliability. Maintain and enhance existing applications by optimizing perform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 25 days ago
    • Promoted
    Principal Backend Engineer, Infrastructure

    Principal Backend Engineer, Infrastructure

    Pebblehosur, tamil nadu, in
    We’re looking for a highly skilled.Platform Engineering team and help us design, build, and operate large-scale, high-performance, cloud-native infrastructure systems. Build internal platform servic...Show moreLast updated: 26 days ago
    • Promoted
    Algonomy - Lead / Principal Software Engineer - Data Management

    Algonomy - Lead / Principal Software Engineer - Data Management

    AlgonomyBangalore
    Designation : Lead / Principal Software Engineer.At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities ...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Principal Engineer

    Principal Engineer

    CoffeeBeansbangalore, karnataka, in
    CoffeeBeans Consulting is a tech consulting firm focused on making organizations.We are looking for a Principal Engineer who can design and implement complex solutions that are scalable, future-pro...Show moreLast updated: 8 hours ago
    • Promoted
    Principal Engineer, Software - Cloud Infrastructure [T500-20363]

    Principal Engineer, Software - Cloud Infrastructure [T500-20363]

    ANSRhosur, tamil nadu, in
    ANSR is hiring for one of its clients.NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flags...Show moreLast updated: 8 days ago
    • Promoted
    Principal Engineer, Agent Platform

    Principal Engineer, Agent Platform

    MightyBothosur, tamil nadu, in
    Join our team as a Principal Engineer, where we're focused on graduating AI from interesting demos to indispensable products. You will architect and build the core distributed systems that provide t...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    PriceEasy AIBengaluru, Karnataka, India
    Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.Cloudhosur, tamil nadu, in
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    Aayshosur, tamil nadu, in
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Inchosur, tamil nadu, in
    Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    XebiaBengaluru, IN
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 22 days ago
    • Promoted
    Principal - Go +Control Plane / Data plane

    Principal - Go +Control Plane / Data plane

    Tata Communicationshosur, tamil nadu, in
    We are seeking a talented and passionate Senior Backend Engineer to join our Control Plane team.The control plane is the intelligent core of our entire platform—the distributed brain responsible fo...Show moreLast updated: 8 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago