Staff Engineer, Data Platform

ConfidentialMumbai, Kolkata, Delhi

30+ days ago

Job description

The Data Platform team is uniquely positioned at the intersection of security, big data and cloud computing. We are responsible for providing ultra low-latency access to global security insights and intelligence data to our customers, and enabling them to act in near real-time. We re looking for a seasoned engineer to help us build next-generation data export pipelines that provide near real-time streaming of security insights and intelligence data using open source messaging and RESTful APIs that allow programmatic access to the data.

You will be part of a growing team of renowned industry experts in the exciting space of Data and Cloud Analytics
Your contributions will have a major impact on our global customer-base and across the industry through our market-leading products
You will solve complex, interesting challenges, and improve the depth and breadth of your technical and business skills.

What you will be doing

Building next generation data streaming service to provide near real-time streaming of security insights and intelligence data

Architecting highly scalable data systems and solving real-time stream challenges at scale.

Partnering with industry experts in security and big data, product and engineering teams to conceptualize, design and build innovative solutions for hard problems on behalf of our customers.

Evaluating open source technologies to find the best fit for our needs and also contributing to some of them!

Participating in the development of related automated test infrastructure and CI / CD integration.

Helping other teams architect their systems on top of the data platform and influencing their system design.

This is a great opportunity to work with smart people in a fun and collaborative environment.

Required skills and experience

8+ years of industry experience building highly scalable distributed Data systems

Programming experience in Python, Java or Golang

Excellent data structure and algorithm skills

Proven good development practices like automated testing, measuring code coverage.

Experience with Kubernetes, Docker, Helm etc

Experience with distributed datastores like Druid, Mongo, Cassandra, BigQuery or similar

Experience building CI / CD pipelines is a plus.

Excellent written and verbal communication skills.

Flexible to work and collaborate with cross-timezone teams.

Bonus points for contributions to the open source community.

Education

BSCS or equivalent required, MSCS or equivalent strongly preferred

Skills Required

Cloud Computing, Cloud Security, Cassandra, Data Security, Python

Create a job alert for this search

Staff Engineer Data • Mumbai, Kolkata, Delhi

Related jobs

Promoted

Data Engineer – Azure & AWS

Yoda TechKolkata, IN

We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 12 days ago

Promoted

Data Engineer with Snowflake Experience- Contract

Gravity Infosolutions, Inc.Kolkata, IN

Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 14 days ago

Promoted

Snowflake Data Engineer

Newpage SolutionsKolkata, IN

Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladekolkata, west bengal, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Sundewwest bengal, west bengal, in

We are looking for a Data Engineer with strong Databricks expertise to join our team.This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing l...Show moreLast updated: 3 days ago

Promoted

Data Engineer

Insight GlobalKolkata, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Randstad EnterpriseKolkata, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzoneKolkata, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 3 days ago

Promoted

Data Engineer

RecroKolkata, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 CompanyKolkata, IN

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIKolkata, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

CozzeraKolkata, IN

Senior Data Engineer – AI / ML & Cloud.Hybrid (1–2 days / week at any location – Noida, Gurgaon, Pune, Chennai, Bangalore, Hyderabad). We are looking for a highly skilled.AI / ML and cloud data ecosystems...Show moreLast updated: 30+ days ago

Promoted

Senior Snowflake Data Engineer

iVoyantKolkata, IN

One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 3 days ago

Promoted

AWS Data Engineer

TerraGiGKolkata, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 14 days ago

Promoted

Data Engineer II

ClearDemandKolkata, IN

Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 3 days ago

Promoted

Data Engineer

IntraEdgeKolkata, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago

Promoted

Sr Data Engineer

Mitchell Martin Inc.Kolkata, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 17 days ago

Promoted

Data Engineer

AAA GlobalKolkata, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 25 days ago