Talent.com
Cognite - Senior Software Engineer - Data Platform

Cognite - Senior Software Engineer - Data Platform

CogniteBangalore
3 days ago
Job description

About Cognite :

Cognite is revolutionizing industrial data management through our flagship product Cognite Data Fusion, a state-of-the-art SaaS platform that transforms how industrial companies leverage their data.

Were seeking a Senior Data Platform Engineer who excels at building high-performance distributed systems and thrives in a fast-paced, startup-style environment. Youll work on cutting-edge data infrastructure challenges that directly impact how Fortune 500 industrial companies manage their most critical operational data.

Key Responsibilities :

1. High-Performance Data Systems :

  • Design and implement scalable data processing pipelines using Apache Spark, Flink, and Kafka for terabyte-scale datasets.
  • Build efficient APIs and backend services supporting thousands of concurrent users with sub-second latency.
  • Optimize data storage and retrieval for time-series, sensor, and operational datasets.
  • Implement advanced caching strategies using Redis and in-memory data structures.

2. Distributed Processing Excellence :

  • Engineer optimized Spark applications with deep knowledge of the Catalyst optimizer and partitioning strategies.
  • Develop real-time streaming solutions processing millions of events per second using Kafka and Flink.
  • Design efficient data lake architectures on S3 / GCS using formats like Parquet and ORC.
  • Implement query optimization for OLAP datastores such as ClickHouse, Pinot, or Druid.
  • 3. Scalability & Performance :

  • Scale systems to 10K+ QPS while maintaining high availability and data consistency.
  • Tune JVM performance through garbage collection and memory optimization.
  • Establish comprehensive monitoring using Prometheus, Grafana, and distributed tracing.
  • Design fault-tolerant architectures with circuit breakers and retry mechanisms.
  • 4. Technical Innovation :

  • Contribute to open-source projects within the big data ecosystem (Spark, Kafka, Airflow).
  • Research and prototype emerging technologies for industrial data challenges.
  • Collaborate with product teams to deliver scalable and reliable technical solutions.
  • Participate in architecture reviews and technical design discussions.
  • Requirements :

    1. Distributed Systems Experience (4- 6 years) :

  • Proven production experience with Spark (building and optimizing large-scale applications).
  • Strong proficiency with Kafka, Flink, or Spark Streaming for real-time data processing.
  • Expertise in JVM languages (Java, Scala, or Kotlin) with performance tuning experience.
  • 2. Data Platform Foundations (3+ years) :

  • Hands-on experience with data lakes, columnar formats, and table formats (Iceberg, Delta Lake).
  • Worked with OLAP query engines like Presto / Trino, ClickHouse, or Pinot.
  • Built robust ETL / ELT pipelines using Airflow, DBT, or custom frameworks.
  • Technical Depth Indicators :

  • Delivered measurable performance improvements (2x+ throughput gains).
  • Optimized resource utilization and cost efficiency.
  • Designed thread-safe, high-concurrency data processing systems.
  • Implemented data quality frameworks and schema evolution management.
  • Designed efficient schemas for analytical workloads.
  • Collaboration & Growth :

  • Worked cross-functionally with PMs, ML engineers, and data scientists.
  • Maintained high code quality through thoughtful reviews and documentation.
  • Adapted quickly to new tools and frameworks.
  • Demonstrated systematic debugging and problem-solving in distributed systems.
  • Startup Mindset :

  • Delivered high-quality features under tight deadlines.
  • Balanced technical debt, speed, and system reliability.
  • Took end-to-end ownership from design to production.
  • Thrived amid evolving requirements and ambiguity.
  • Made customer-centric technical decisions.
  • Bonus Points :

  • Contributions to Apache open-source projects (Spark, Kafka, Airflow).
  • Public speaking or technical blogging experience.
  • Industrial domain knowledge (IoT, manufacturing, operational systems).
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Engineer Data • Bangalore

    Related jobs
    • Promoted
    SENIOR AWS CLOUD ENGINEER

    SENIOR AWS CLOUD ENGINEER

    CloudZeniaBengaluru, Karnataka, India
    Please fill the below Google Form to get the interview process started : .FAIpQLScx23dmwM6VcPlLTbO0UiVaRWMgK_H0vgluUSYtRaIk0herxA / viewform. We’re hiring a Cloud Engineer (AWS) to design, build, and ma...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineer - Digital Assets (Wholesale Banking)

    Senior Engineer - Digital Assets (Wholesale Banking)

    Flyers Softhosur, tamil nadu, in
    Cloud (AWS / Azure / GCP), Enterprise Architecture (TOGAF), Security (CISSP / CISM), Blockchain / DLT (Hyperledger, Corda, CBP), Agile (PMI‑ACP / Scrum). Deep knowledge of DLT platforms and smart contracts; e...Show moreLast updated: 1 day ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    CogniteBengaluru, Karnataka, India
    Cognite is revolutionising industrial data management through our flagship product, Cognite Data Fusion - a state-of-the-art SaaS platform that transforms how industrial companies leverage their da...Show moreLast updated: 24 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Evlvhosur, tamil nadu, in
    Sector : IT & Services Consulting.Location : Permanent Work From Home (Anywhere in India).Duration : 1-Year - Renewable Contract. Working Hours : Monday to Friday, Eastern Standard Time Zone.Our client ...Show moreLast updated: 30+ days ago
    • Promoted
    Cognite - Principal Engineer - Data Transfromation

    Cognite - Principal Engineer - Data Transfromation

    CogniteBangalore
    Description : About Cognite : Embark on a transformative journey with Cognite, a global SaaS forerunner in leveraging AI and data to unravel comp...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Senior Platform Engineer

    Senior Platform Engineer

    Vista Applied Solutions Group Inchosur, tamil nadu, in
    Client is looking for Senior Platform Engineer and this is remote position from India.Design, build, and manage scalable Kubernetes platforms and automation using Terraform.Support GitOps workflows...Show moreLast updated: 9 hours ago
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Kanerika Inchosur, tamil nadu, in
    We are seeking an experienced Senior AI Engineer with 3+years of experience to join our dynamic team, driving innovation in AI-driven solutions with a global impact. This role is specifically tailor...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    DiligentBengaluru, Karnataka, India
    As a Senior Software Engineer at Diligent, you’ll be hands-on in shaping the future of our platform by designing and delivering secure, scalable, and high-performing microservices that power our Sa...Show moreLast updated: 2 days ago
    • Promoted
    Cognite - Senior Data Platform Engineer

    Cognite - Senior Data Platform Engineer

    CogniteBangalore
    Job Description : Function : Software Engineering Backend Development SparkSpark StreamingShow moreLast updated: 29 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    ValueLabsBengaluru, Republic Of India, IN
    We’re Hiring : Senior Technology Engineer – DevOps & Big Data.Senior Technology Engineer (STE).Build robust CI / CD pipelines using Jenkins & GitOps. Deploy applications using Kubernetes & OpenShift fo...Show moreLast updated: 23 days ago
    • Promoted
    Senior Staff Software Engineer - Platform

    Senior Staff Software Engineer - Platform

    CoinbaseBangalore, IN
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiahosur, tamil nadu, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 22 days ago
    • Promoted
    Senior Software Engineer, Voice Platform

    Senior Software Engineer, Voice Platform

    SprinklrBengaluru, Republic Of India, IN
    With advanced AI, Sprinklr's unified customer experience management (Unified-CXM) platform helps companies deliver human experiences to every customer, every time, across any modern channel.Headqua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekhosur, tamil nadu, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    CogniteBengaluru, Republic Of India, IN
    Cognite is revolutionising industrial data management through our flagship product, Cognite Data Fusion - a state-of-the-art SaaS platform that transforms how industrial companies leverage their da...Show moreLast updated: 23 days ago
    • Promoted
    Senior Aws Cloud Engineer

    Senior Aws Cloud Engineer

    CloudZeniaBengaluru, Republic Of India, IN
    Please fill the below Google Form to get the interview process started : .Com / forms / d / e / 1FAIpQLScx23dmwM6VcPlLTbO0UiVaRWMgK_H0vgluUSYtRaIk0herxA / viewform. We’re hiring a Cloud Engineer (AWS) to design...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsBengaluru, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Grizmo LabsBengaluru, Republic Of India, IN
    Design, build, and maintain scalable data platforms and pipelines to support the needs of the business.Ensure data quality and accuracy by implementing data validation and testing processes.Partici...Show moreLast updated: 23 days ago