Design, build, and maintain robust data pipelines (batch or streaming) that process and transform data from diverse sources.
Ensure data quality, reliability, and availability across the pipeline lifecycle.
Collaborate with product managers, architects, and engineering leads to define technical strategy.
Participate in code reviews, testing, and deployment processes to maintain high standards.
Own smaller components of the data platform or pipelines and take end-to-end responsibility.
Continuously identify and resolve performance bottlenecks in data pipelines.
Take initiatives, and show the drive to pick up new stuff proactively, and work as a Senior Individual contributor on the multiple products and features we have.
Required qualifications :
5 to 7 years of experience in Big Data or data engineering roles.
JVM based languages like Java or Scala are preferred. For someone having solid Big Data experience, Python would also be OK.
Proven and demonstrated experience working with distributed Big Data tools and processing frameworks like Apache Spark or equivalent (for processing), Kafka or Flink (for streaming), and Airflow or equivalent (for orchestration).
Familiarity with cloud platforms (e.g., AWS, GCP, or Azure), including services like S3, Glue, BigQuery, or EMR.
Ability to write clean, efficient, and maintainable code.
Good understanding of data structures, algorithms, and object-oriented programming.
(ref : hirist.tech)
Create a job alert for this search
Big Data Engineer • Pune
Related jobs
Promoted
Big Data Engineer - Spark / Hadoop
WorkiFicientPune
Roles and Responsibility : - Collaborate closely with Product Management and Engineering leadership to devise and build ...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
Otomeyt AIPune, IN
We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
Promoted
Senior Data Engineer
DeltacubesPune, IN
Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
Promoted
Data Engineer
ACL Digitalpune, maharashtra, in
Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable.
Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Alp Consulting Ltd.pune, maharashtra, in
Data Software Engineer - Spark, Python, (Azure Databricks ).Years of in Big Data & Data related technology experience.Expert level understanding of distributed computing principles.Expert level kno...Show moreLast updated: 19 days ago
Promoted
New!
Senior Data Engineer
Hireologistpune, maharashtra, in
You’ll be working closely with product managers, architects, and engineering leads to define technical strategies and ensure the availability, reliability, and quality of data across the organizati...Show moreLast updated: 9 hours ago
Promoted
Big Data Engineer
WorkiFicientPune
To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer - Apache Spark
Right Move Staffing Solutions Private LimitedPune
Job Summary : We are looking for a highly skilled and experienced Senior Data Engineer to join our data team.The ideal candidate will have over 4 years of experience ...Show moreLast updated: 30+ days ago
Promoted
Senior Big Data Engineer
VeltrisPune, IN
Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 15 days ago
Promoted
Big Data Developer
USTpune, maharashtra, in
The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 5 days ago
Promoted
Big Data Engineer - Apache Spark
Merito.aiPune
Job Description : We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets ...Show moreLast updated: 30+ days ago
Promoted
New!
Data Engineer
TechVeritopune, maharashtra, in
You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights.
The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 17 hours ago
Promoted
GCP Big Data Engineer
Talentmaticspune, maharashtra, in
The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 5 days ago
Promoted
Big Data Engineer - Spark / Scala
Leinex ConsultingPune
Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 7 days ago
Promoted
Lead Big Data Engineer
QualysPune, Maharashtra, India
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.We are seeking a talented Lead Big Data Engineer to deliver roadmap features of ...Show moreLast updated: 16 days ago
Promoted
Data Engineer
Otomeyt AIPune, IN
We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
Promoted
New!
Data Engineer - Pyspark
Tata Consultancy Servicespune, maharashtra, in
Job Title : - Data Engineer - Pyspark.Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL.
Good Spark, Pyspark,Big Data experience.Spark UI / Optimization / debugging ...Show moreLast updated: 13 hours ago
Promoted
Lead Big Data Engineer - Spark
QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 15 days ago