Talent.com
Big Data Developer
Big Data Developerairtel • Pune, Maharashtra, India
Big Data Developer

Big Data Developer

airtel • Pune, Maharashtra, India
20 days ago
Job description

Job Title : Big Data Developer (Manager)

Location : Pune

Experience : 3-5 years

Job Description :

Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.

Key Responsibilities :

  • Design, develop, and maintain big data solutions using Java and Apache Spark.
  • Develop and manage APIs for data ingestion, processing, and extraction.
  • Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions.
  • Optimize and tune big data workflows for performance and scalability.
  • Implement data engineering best practices to ensure data quality, integrity, and security.
  • Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed.
  • Troubleshoot and resolve issues related to data processing and workflows.
  • Stay updated with the latest trends and advancements in big data technologies and tools.

Required Qualifications :

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 4-8 years of experience in big data development and data engineering.
  • Proficiency in Java and experience with Apache Spark.
  • Experience in API development and integration.
  • Strong understanding of data engineering principles and big data concepts.
  • Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka.
  • Experience with SQL and NoSQL databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with cloud platforms such as, Spark, Data / Delta lakes, Modern Data stack.
  • Knowledge of containerization technologies like Docker and Kubernetes.
  • Experience with continuous integration and continuous deployment (CI / CD) pipelines.
  • Familiarity with machine learning frameworks and libraries.
  • Benefits :

  • Competitive salary and benefits package.
  • Opportunity to work with cutting-edge technologies in a dynamic and collaborative environment.
  • Professional growth and development opportunities.
  • Create a job alert for this search

    Big Data Developer • Pune, Maharashtra, India

    Related jobs
    Big Data Developer

    Big Data Developer

    UST • Pune, Maharashtra, India
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show more
    Last updated: 30+ days ago • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Title : Senior Data Engineer Experience : 6+ Years We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, ...Show more
    Last updated: 29 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • pune, maharashtra, in
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Pune, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy Services • Pune, Maharashtra, India
    Role : Big Data Streaming Ingestion Developer.Required Technical Skill Set : Hortonworks suite of tools including Kafka, Scala, Hbase and Phoenix. Location of Requirement : Chennai / Mumbai / Pune.Hands on...Show more
    Last updated: 30+ days ago • Promoted
    Senior Bigdata Developer_ Exp : 6+ Years

    Senior Bigdata Developer_ Exp : 6+ Years

    Atyeti Inc • pune, maharashtra, in
    Analyze, organize and process raw data using Bigdata technologies and Scala.Perform data validation, cleaning and transformation using big data technologies, Spark and Scala.Ingest and manage data ...Show more
    Last updated: 19 hours ago • Promoted • New!
    Big Data Specialist

    Big Data Specialist

    Atomic North • Pune, Maharashtra, India
    Long term onsite to Abu Dhabi • •.We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, d...Show more
    Last updated: 11 days ago • Promoted
    5676 - Data Engineer

    5676 - Data Engineer

    EXL • Pune, Maharashtra, India
    Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Synechron • Pune, Maharashtra, India
    We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines cre...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Confidential • Pune
    We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team.The ideal candidate should be able to design, develop, and maintain complex big data solutions that mee...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Populace World Solutions • Pune
    Description : Big Data Developer Location : Pune, India Experience : 7+ Years Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Pune, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 1 day ago • Promoted
    Big Data Platforms Developer

    Big Data Platforms Developer

    Confidential • Pune
    Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills. Do impact analysis and come up with estimates.Take responsibility for e...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 17 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • pune, maharashtra, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 19 hours ago • Promoted • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connections • Pune, Maharashtra, India
    Role - Snowflake Data Engineer Experience - 8 to 10 years Work Mode - Remote Required Notice Period - Immediate Joiner Must Have 8 to 10 years of overall experience Python (Numpy, Pandas), SQL, Sn...Show more
    Last updated: 11 days ago • Promoted
    Big Data Developer - Spark / Hadoop

    Big Data Developer - Spark / Hadoop

    Hashone Careers • Pune
    Job Description : Experience - 5 to 8 yrs Mode of Working : Hybrid (3 days WFO, 2 days WFH) Location : Bangalore / Pune / Hy...Show more
    Last updated: 30+ days ago • Promoted
    Senior Hadoop Developer

    Senior Hadoop Developer

    Information Tech Consultants • pune, maharashtra, in
    UK (Relocation Required - Sponsorship will be provided).Bachelors in Science (IT / Computer Science / Engineer).Scala / Hadoop / Big Data Developer. The role will focus on building and enhancing data-driv...Show more
    Last updated: 3 days ago • Promoted