This job offer is not available in your country.

Senior Big Data Engineer - Scala / Python

huns info pvt ltdDelhi, IN

30+ days ago

Job description

Senior Data :

Skilled and experienced Sr. Data Engineer with proven experience in Spark, Kafka, Hadoop, Data Management.

Skills :

Proficiency in programming languages Scala, Java, Python.

Experience with design and development of ELT workflows and data pipelines for high-volume data systems e.g. Datastage, Informatica, Talend, etc.

Experience in Data Engineering and implementation of Real-time data processing pipelines using Kafka, Kafka Streams and Spark Streams

Good analytical skills with excellent knowledge of SQL, data management and relational databases like PostgreSQL, Oracle, MySQL.

Experience working with Big Data Tools / Technologies and DataLakes Knowledge / Experience working with In-memory / NoSQL databases - Redis, HBase, Cassandra, CouchBase, CouchDB

Knowledge / experience with Apache Nifi / Airflow for Data Pipelines Orchestrations.

Proven expertise with linux administration and unix scripting for the automation of tasks, Experience of building CI / CD tools (Jenkins).

AI and Machine Learning knowledge, Database Administration, Big Data Storage, Data Analytics and Feature Engineering, ELK Stack, FLink

Familiar with cloud platforms like AWS, Google Cloud, or Microsoft Azur.

(ref : hirist.tech)

Create a job alert for this search

Senior Data Engineer • Delhi, IN

Related jobs

Promoted

Senior Data Engineer

EXLDelhi, IN

We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 26 days ago

Promoted

Senior Data Engineer

EvolentDelhi, IN

Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

CESDelhi, IN

As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

The Mastermind GroupDelhi, IN

Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 CompanyDelhi, IN

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer

SAIVA AIDelhi, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

Otomeyt AIGhaziabad, IN

We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer

DhurinGreater Delhi Area, India

Dhurin is a fastgrowing data science firm serving financial services industry.We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collection...Show moreLast updated: 27 days ago

Promoted

Senior Data Engineer

HealthyMe AiDelhi, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 26 days ago

Promoted

Senior Cloud Engineer AWS

Matrix USADelhi, IN

We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 5 days ago

Promoted

Senior Data Engineer

DexianDelhi, IN

We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract. Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 26 days ago

Promoted

Data Engineer

Manuh TechnologiesDelhi, IN

Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

InfogainDelhi, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

DeltacubesGhaziabad, IN

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago

Promoted

Data Engineer

HISH IT SERVICESDelhi, IN

Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 7 days ago

Promoted

Senior Big Data Engineer

VeltrisDelhi, IN

Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago

Promoted

Data Engineer

Innodata Inc.Delhi, IN

CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago

Promoted

Senior Data Engineer

BrightEdgeDelhi, IN

BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer

Net Zero InsightsDelhi, IN

Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 21 hours ago

Promoted

Backend and Data Pipeline Engineer

JRD SystemsDelhi, IN

Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 5 days ago