Talent.com
This job offer is not available in your country.
Big Data Developer - Hadoop / Hive / Python

Big Data Developer - Hadoop / Hive / Python

AGILE TECHNOLOGY SOLUTIONSPune
30+ days ago
Job description

Role Overview :

We are looking for a skilled and experienced Big Data Developer to join our data engineering team.

The ideal candidate will have a strong foundation in Big Data technologies and a proven track record of building scalable and efficient data pipelines.

You will play a critical role in enabling data-driven decision-making across the Responsibilities :

  • Design, develop, and optimize big data pipelines using tools and technologies from the Hadoop ecosystem.
  • Work with large datasets to extract, transform, and load (ETL) data for analytical and operational purposes.
  • Build scalable data ingestion frameworks for real-time and batch processing.
  • Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver high-quality solutions.
  • Ensure data quality, governance, and compliance standards are maintained.
  • Monitor and troubleshoot big data infrastructure and performance issues.
  • Document design decisions, processes, and technical Technical Skills :
  • Strong experience with Big Data technologies : Hadoop, Spark, Hive, HBase, Pig, Sqoop
  • Hands-on experience with data processing frameworks like : Apache Spark (RDD / DataFrame / SQL APIs), Kafka, Flink
  • Proficiency in programming languages such as : Java, Scala, Python
  • Strong knowledge of SQL and NoSQL databases (e.g., MongoDB, Cassandra).
  • Experience in developing and managing data workflows using Apache Airflow, Oozie, or similar tools.
  • Familiarity with cloud platforms (AWS / Azure / GCP) and cloud-native big data services (e.g., EMR, Databricks, BigQuery).
  • Knowledge of CI / CD pipelines, version control tools like Git, and DevOps practices is a plus.
  • Experience in data modeling, data governance, and performance :
  • Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
  • 5 to 8 years of experience in Big Data development and data engineering roles.
  • Strong analytical, problem-solving, and communication skills.
  • Ability to work in a collaborative, Agile / Scrum environment

ref : hirist.tech)

Create a job alert for this search

Big Data Developer • Pune

Related jobs
  • Promoted
Lead Big Data Developer - Hadoop / Spark

Lead Big Data Developer - Hadoop / Spark

RecroPune
To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build t...Show moreLast updated: 30+ days ago
Python,Pyspark

Python,Pyspark

N Consulting LtdPimpri-Chinchwad, Pune Division, India
Quick Apply
We are Hiring ! Immedidate joiners!.We are looking for Immediate joiners for the below position ,.Notice period- Immediate joiner. Location- Pune & Hyderabad.We assure our best service alw...Show moreLast updated: 30+ days ago
Senior Big Data Developer (Informatica, Hive, Spark, SQL)

Senior Big Data Developer (Informatica, Hive, Spark, SQL)

SYNECHRONINDIA
Informatica, Big Data Technologies (Hive, Spark), SQL and NoSQL databases, Oozie Scheduling, Linux OS and Shell Scripting & Agile, DevOps, CI / CD (GitHub, Jenkins). We are looking for candidates who ...Show moreLast updated: 30+ days ago
Lead Data Engineer (Big Data, Hadoop, Hive, Python, Spark) - Assistant Vice President - C12 - Pune

Lead Data Engineer (Big Data, Hadoop, Hive, Python, Spark) - Assistant Vice President - C12 - Pune

12542 Citicorp Services India Private LimitedPune Maharashtra India
Bank’s regulatory requirements and data driven decision making.A Data Engineer will serve as an example to other team members, work closely with customers, and remove or escalate roadblocks.By appl...Show moreLast updated: 13 days ago
  • Promoted
Big Data Developer

Big Data Developer

VirtusaPune, IN
We are seeking a skilled Big Data Engineer with 6+ years of experience to join our dynamic team.The ideal candidate will have a strong understanding of the Big Data and Spark ecosystem and will be ...Show moreLast updated: 24 days ago
  • Promoted
Bridgenext - Big Data Developer - Python

Bridgenext - Big Data Developer - Python

BridgenextPune
Bridgenext : Bridgenext is a global digital consultancy that helps clients innovate with intention and realize their digital aspirations by creating digital products...Show moreLast updated: 19 days ago
  • Promoted
Senior Data Engineer [Immediate joiners only]

Senior Data Engineer [Immediate joiners only]

LuxoftPune, IN
As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consu...Show moreLast updated: 30+ days ago
  • Promoted
Big Data Engineer - Hadoop / Hive

Big Data Engineer - Hadoop / Hive

D2N SolutionsPune
As discussed please find JD and below details.Location : : 5+ Yrs Mandate Skills : Hadoop,...Show moreLast updated: 30+ days ago
Scala Developer

Scala Developer

Tata Consultancy ServicesPune, Maharashtra, India
Required Technical Skill Set - Spark / Scala / Unix.Desired Experience Range -5-8 years.Location of Requirement - Pune.Desired Competencies (Technical / Behavioral Competency). Ideally should not be more ...Show moreLast updated: 13 days ago
  • Promoted
Lead Big Data Engineer - Apache Spark / Hadoop

Lead Big Data Engineer - Apache Spark / Hadoop

Racrosoft TechnologiesPune
We are looking for a Senior Big Data Engineer to join our team in building and managing high-performance Big Data pipelines. You will work with large-scale structured datasets, develop distributed d...Show moreLast updated: 30+ days ago
Big Data Developer

Big Data Developer

Talent WorxPune, MH, IN
Quick Apply
We’re hiring for one of the world’s leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organiz...Show moreLast updated: 30+ days ago
  • Promoted
PySpark Developers

PySpark Developers

LTIMindtreePune, Maharashtra, India
Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Python).A good professional experience in Bigdata PySpark HIVE Hadoop PLSQL. Good knowledge of AWS and Snowflake.Good understanding of CICD and sys...Show moreLast updated: 30+ days ago
  • New!
Pentaho Developer, Associate

Pentaho Developer, Associate

E902 DWS India Private Limited, Maharashtra BranchBusiness Bay, Pune
Developer with atleast 10 years of experience.Experience in developing and deploying Pentaho based applications.Need to work on Data Integration project. Mostly batch oriented using Pentaho 9.Pentah...Show moreLast updated: less than 1 hour ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

DautomPune, IN
Java, MapReduce, Hive, and Spark jobs.HDFS, Pig, Hive, HBase, Sqoop, Flume.Analyze source data integrity and ensure accurate data ingestion. Build dashboards and BI solutions using best practices.Co...Show moreLast updated: 2 days ago
Senior Dotnet Developer

Senior Dotnet Developer

Impetus Career ConsultantsPune, Maharashtra, India
NET Developer for product based company.Bachelor’s Degree in Computer Science or experience through higher education.Data Engineering and / or Software Engineering. Knowledge of big data technologies ...Show moreLast updated: 2 days ago
  • Promoted
Data Engineer - ETL / Python / Hadoop

Data Engineer - ETL / Python / Hadoop

NCSI Technologies (India) Private LimitedPune
Job Description : We are seeking an experienced and driven Data Engineer to join our data engineering team in Pune.This role is ideal for p...Show moreLast updated: 26 days ago
  • Promoted
Qualys - Lead Big Data Engineer - Hadoop / Spark

Qualys - Lead Big Data Engineer - Hadoop / Spark

QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! Description : < / p&g...Show moreLast updated: 29 days ago
  • Promoted
Redian Software - Data Engineers - Python / ETL

Redian Software - Data Engineers - Python / ETL

Redian Software GlobalPune
Role : Data Engineers (510 Years of Experience) Experience : 510 years Location : Gurgaon, Pune, Bangalore,...Show moreLast updated: 25 days ago