Talent.com
Staff Engineer, Data Platform

Staff Engineer, Data Platform

ConfidentialBengaluru / Bangalore, Chennai
30+ days ago
Job description

The Data Platform team is uniquely positioned at the intersection of security, big data and cloud computing. We are responsible for providing ultra low-latency access to global security insights and intelligence data to our customers, and enabling them to act in near real-time. We re looking for a seasoned engineer to help us build next-generation data export pipelines that provide near real-time streaming of security insights and intelligence data using open source messaging and RESTful APIs that allow programmatic access to the data.

  • You will be part of a growing team of renowned industry experts in the exciting space of Data and Cloud Analytics
  • Your contributions will have a major impact on our global customer-base and across the industry through our market-leading products
  • You will solve complex, interesting challenges, and improve the depth and breadth of your technical and business skills.

What you will be doing

  • Building next generation data streaming service to provide near real-time streaming of security insights and intelligence data
  • Architecting highly scalable data systems and solving real-time stream challenges at scale.
  • Partnering with industry experts in security and big data, product and engineering teams to conceptualize, design and build innovative solutions for hard problems on behalf of our customers.
  • Evaluating open source technologies to find the best fit for our needs and also contributing to some of them!
  • Participating in the development of related automated test infrastructure and CI / CD integration.
  • Helping other teams architect their systems on top of the data platform and influencing their system design.
  • This is a great opportunity to work with smart people in a fun and collaborative environment.
  • Required skills and experience

  • 8+ years of industry experience building highly scalable distributed Data systems
  • Programming experience in Python, Java or Golang
  • Excellent data structure and algorithm skills
  • Proven good development practices like automated testing, measuring code coverage.
  • Experience with Kubernetes, Docker, Helm etc
  • Experience with distributed datastores like Druid, Mongo, Cassandra, BigQuery or similar
  • Experience building CI / CD pipelines is a plus.
  • Excellent written and verbal communication skills.
  • Flexible to work and collaborate with cross-timezone teams.
  • Bonus points for contributions to the open source community.
  • Education

  • BSCS or equivalent required, MSCS or equivalent strongly preferred
  • Skills Required

    Cloud Computing, Cloud Security, Cassandra, Data Security, Python

    Create a job alert for this search

    Staff Engineer Data • Bengaluru / Bangalore, Chennai

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS is hiring for GCP data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Bengaluru / Chennai / Gurgaon. Skills Required - GCP BigQuery, Python.Hands-on experience in the ...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Chennai, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 8 days ago
    • Promoted
    Staff Engineer

    Staff Engineer

    CodewallaChennai, Tamil Nadu, India
    Codewalla is a New York–based product studio with engineering teams in India.Since 2005, we’ve built innovative products that scale. We work at the intersection of design, engineering, and AI develo...Show moreLast updated: 30+ days ago
    Data Platform Engineer

    Data Platform Engineer

    InvokhrChennai, Tamil Nadu, India
    Quick Apply
    Must be proficient in the major languages such as Scala, Spark, and Kafka (any variant).Write elegant and maintainable code, and be comfortable with picking up new technologies.Proficient in workin...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Staff Engineer

    Staff Engineer

    Randstad DigitalChennai, Tamil Nadu, India
    Candidates official notice period exceeding 60 days and candidates doing offer shopping need not to apply Location-Bangalore,Pune Has to be available for Face to face interview for final round of...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadychennai, India
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KaarTechChennai, Tamil Nadu, India
    Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs. Data Integration : Integrate data from multiple sources and ens...Show moreLast updated: 24 days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    JMAN GroupChennai, Tamil Nadu, India
    About the Company JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value usin...Show moreLast updated: 9 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticschennai, tamil nadu, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cleantech Industry ResourcesChennai, Tamil Nadu, India
    Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - HR Data Platform

    Data Engineer - HR Data Platform

    GlencoreChennai, Tamil Nadu, India
    We are seeking a motivated Data Engineer to join our HR team to drive the evolution of our HR Data Platform.You will work across a diverse HRIS landscape, integrating data from multiple HR and payr...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseChennai, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.Chennai, IN
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 5 days ago
    • Promoted
    Staff / Senior Data Engineer

    Staff / Senior Data Engineer

    HG Insightsmount, India
    At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 9 days ago
    • Promoted
    Staff Engineer, Data Engineering

    Staff Engineer, Data Engineering

    ConfidentialBengaluru / Bangalore, Chennai
    The Data Engineering team builds and optimizes systems spanning data ingestion, processing, storage optimization and more. We work closely with engineers and the product team to build highly scalabl...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XANDER CONSULTING AND ADVISORY PRIVATE LIMITEDChennai
    Description : - Design, develop, and maintain scalable data pipelines using Azure Databricks, Apache Spark, and Delta Lake. Implement data ingestion, transformation, ...Show moreLast updated: 2 days ago