Talent.com
Big Data Developer
Big Data DeveloperBrillio • Bengaluru, Karnataka, India
Big Data Developer

Big Data Developer

Brillio • Bengaluru, Karnataka, India
1 day ago
Job description

Min 5 years of Exp

Key Responsibilities

  • Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
  • Implement data ETL processes for batch and streaming analytics requirements.
  • Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
  • Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
  • Ensure data security, integrity, and compliance throughout the infrastructure.
  • Maintain documentation and contribute to architecture reviews.
  • Participate in incident response and operational excellence initiatives for the data warehouse.
  • Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.

Required Skills and Experience

  • Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL.
  • Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
  • Proven ability to design and implement automated data pipelines and materialized views.
  • Proficiency in Python, Unix or similar languages.
  • Good understanding of SQL oracle, SQL server or similar languages.
  • Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions).
  • Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code.
  • 5+ years of directly applicable experience
  • BS in Computer Science, Engineering, or equivalent experience.
  • Create a job alert for this search

    Big Data Developer • Bengaluru, Karnataka, India

    Related jobs
    Big Data Developer

    Big Data Developer

    UST • Bengaluru, Karnataka, India
    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies.The ideal candidate should demonstrate a deep understanding of big data concepts, programming fund...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer(Hadoop)

    Big Data Developer(Hadoop)

    Tata Consultancy Services • Bengaluru, Karnataka, India
    TCS is conducting weekday Virtual Drive for Big Data Developer.Date of Interview : 13th Nov, 2025.Mode of Interview : Virtual Mode( Teams, Cisco, Webex). Software developer with hands-on experience on...Show more
    Last updated: 17 days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    Impetus • Bengaluru, Republic Of India, IN
    We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune ...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy Services • Bengaluru, India
    Greetings from TATA Consultancy Services.Skill : Exp range : 5 yrs to 11 yrs.Interview mode : Face to Face Interview.Pls find the Job Description below. Experience in Hadoop Scala, Pyspark, Hive, Sp...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Confidential • Bengaluru / Bangalore
    Design, develop, and implement highly scalable and distributed big data.Hadoop ecosystem technologies such as HBase, Hive, Kudu, and. Architect HBase schemas and data models to accommodate evolving ...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Talent Worx • Bengaluru, KA, IN
    Quick Apply
    We’re hiring for one of the world’s leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organiz...Show more
    Last updated: 30+ days ago
    Big Data Developer (Weekday Virtual Drive On 21st Nov, 2025)

    Big Data Developer (Weekday Virtual Drive On 21st Nov, 2025)

    Tata Consultancy Services • Bengaluru, India
    Greetings From Tata Consultancy Services!!!.Role : Big Data Developer (Hive, Pyspark).Years of Experience : 6 to 10 yrs.Location : Chennai, Hyderabad, Bengaluru, Pune. Date of Interview : 21st Nov 2025....Show more
    Last updated: 9 days ago • Promoted
    Data Engineer (Big Data)

    Data Engineer (Big Data)

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    Desired Skills -Technical / Behavioral.Extensive experience in Bigdata Projects particularly Data Ingestion and Transformation Projects. Total experience of 6 Years or Above with relevant Experience a...Show more
    Last updated: 4 days ago • Promoted
    Big Data Engineer (Scala / Quantexa)

    Big Data Engineer (Scala / Quantexa)

    LTIMindtree • Bengaluru, Republic Of India, IN
    Secondary skill : Apache Hive, HDFS, Oozie, Impala, Parquet.Location : Chennai / Mumbai / Pune / Bengaluru.Show more
    Last updated: 21 days ago • Promoted
    Gcp Big Data Developer

    Gcp Big Data Developer

    Impetus • Bengaluru, Republic Of India, IN
    Must have : Bigdata, GCP, Dataproc, Dataflow, SQL, Spark.Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub...Show more
    Last updated: 15 days ago • Promoted
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Location : Bengaluru,Chennai,Hyderabad.Date of Interview : 6th Nov, 2025. Mode of Interview : Virtual Drive( Cisco or WebEx).Hands-on ...Show more
    Last updated: 22 days ago • Promoted
    Big Data Engineer (GCP)

    Big Data Engineer (GCP)

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    Required Technical Skill Set • •.Big Data,Pyspark, Google Cloud, Airflow, Scala.Bangalore - TCS Bangalore Global axis (walk-in Drive). Min 8+ years experience in BigData, Spark and Scala.Experience in...Show more
    Last updated: 22 days ago • Promoted
    Senior Bigdata Developer_ Exp : 6+ Years

    Senior Bigdata Developer_ Exp : 6+ Years

    Atyeti Inc • bangalore, karnataka, in
    Analyze, organize and process raw data using Bigdata technologies and Scala.Perform data validation, cleaning and transformation using big data technologies, Spark and Scala.Ingest and manage data ...Show more
    Last updated: 2 days ago • Promoted
    Engineer (Devops & Big Data)

    Engineer (Devops & Big Data)

    AMISEQ • bangalore, karnataka, in
    You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization. You'll partner with vendors and the i...Show more
    Last updated: 21 days ago • Promoted
    GCP Big Data Developer

    GCP Big Data Developer

    Impetus • Bengaluru, India
    Must have : Bigdata, GCP, Dataproc, Dataflow, SQL, Spark.Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub...Show more
    Last updated: 13 days ago • Promoted
    Big Data Developers / Lead

    Big Data Developers / Lead

    Confidential • Bengaluru / Bangalore
    Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show more
    Last updated: 15 days ago • Promoted
    BigQuery Data Developer

    BigQuery Data Developer

    UST • Bengaluru, Republic Of India, IN
    UST is looking for a Developer with atleast 5 years of exp.NP : Immediate to 30 days only.Location : Bangalore, Pune, Hyderabad. Interested candidate can share your updated CV to bhoopathyraja.Python...Show more
    Last updated: 22 days ago • Promoted
    Big Data Developer (Hive, Pyspark)

    Big Data Developer (Hive, Pyspark)

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex). Hands-on experience of Hadoop, Python, PySpark,...Show more
    Last updated: 21 days ago • Promoted