Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes
Contribute to the design and documentation of our data lake platform
Partner with Sr staff on the development and maintenance of data governance policies and procedures that ensure data quality, accuracy, consistency, and privacy.
Mentor other data engineers, providing technical guidance, and ensuring that team members have the necessary skills and resources to perform their duties.
Conduct code and design reviews with junior and peer developers
Write clean code to develop data pipelines and necessary infrastructure as code
Aid in setting coding standards for team members to follow
Partner with cross functional teams to understand requirements and effectively design appropriate solutions.
Monitor and troubleshoot performance, scalability, and security issues, making improvements as needed
Aid in determining and implementing KPIs for performance and stability of platform
Participate in the review of new technologies and tools for our data teams
Partner with engineering and other cross functional teams to collect and implement technical and design requirements
Communicate effectively with technical and non-technical team members to ensure alignment and successful execution of projects.
Participate in cross-functional initiatives, promoting a culture of data-driven decision-making and continuous improvement.
Participate in an on call rotation.
Job Requirement :
8 years of related experience; or 6 years and an advanced degree
Bachelors degree in engineering, computer science, math, data engineering or another related field or equivalent work experience
Experience in the development of modern data architecture, analytics, data governance, AI / ML, or related areas.
Strong Experience with AWS big data technologies including EMR, Glue, S3, EKS, Lambda, Athena, RDS, MKS / Kafka / Kinesis
Expertise with relational and NoSQL databases such as PostgresQL, Cassandra, DynamoDB, MongoDb etc and data modeling principles
Knowledge of data pipeline tools and workflow engines, e.g. Apache Airflow and Spark.
Experience with DevOps, including CI / CD pipelines, containerized deployment / Kubernetes, and infrastructure-as-code / AWS Cloud Formation / Terraform.
Successfully contributes to the entire development lifecycle of teams products
Exposure to secure coding practices, access controls, authentication, and audit. AWS Lake formation preferred.
Strong experience with SQL (SQL Server, Postgres) and Python, Scala
Identify opportunities for process improvement as well as efficiency in solutions
Demonstrated ability to mentor junior team members
Excellent analytical and time management skills, with a proven ability to deliver value independently
Strong written and verbal communication skills, with demonstrated experience providing technical input to technical and non-technical stakeholders
Ability to participate in on-call rotation
Preferred :
FinTech industry experience
Understanding of MPP Data Warehouse (Redshift, Greenplum)
Experience with Graph database
Create a job alert for this search
Staff Engineer Data • Gurgaon, India
Related jobs
Promoted
Data Engineer
Jaipur RugsGhaziabad, IN
Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets.
It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 14 days ago
Promoted
Senior AWS Data Engineer
CYAN360Delhi, IN
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
HealthyMe AIDelhi, IN
We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 26 days ago
Promoted
AWS Data Engineer
TerraGiGDelhi, IN
Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 8 days ago
Promoted
Senior Data Engineer
SAIVA AIDelhi, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
Promoted
Freelance Data Engineer
upGradDelhi, IN
We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 16 days ago
Promoted
Data Engineer
AS Technology CorporationNoida, Uttar Pradesh, India
The ideal candidate will have strong hands-on experience in.GitHub-based development workflows.Apache Spark (Batch & Streaming).Show moreLast updated: 15 days ago
Promoted
AI / ML & Data Engineer
Mindfire SolutionsDelhi, IN
We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 9 days ago
Promoted
Python AWS Data Engineer
Digitrix Software LLPDelhi, IN
Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Randstad EnterpriseDelhi, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
IntraEdgeDelhi, IN
The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
AAA GlobalDelhi, IN
Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 18 days ago
Promoted
Sr Data Engineer
Mitchell Martin Inc.Delhi, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 10 days ago
Promoted
Data Engineer
VeraxionDelhi, IN
Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 8 days ago
Promoted
Senior Data Engineer
USEReadyDelhi, IN
Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment.
In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
ACL DigitalDelhi, IN
Grab the excellent opportunity with our company.Notice Period : Immediate to 15days.Location : Bangalore / Hyderabad / Pune / Chennai / Noida / Ahmedabad.
Years in Data Engineering with GCP.Interested people ca...Show moreLast updated: 10 days ago
Promoted
Data Engineer
RevXDelhi, IN
RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Response InformaticsDelhi, IN
We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 18 days ago