Big Data DeveloperBrillio • Bengaluru, Karnataka, India
Big Data Developer
Brillio • Bengaluru, Karnataka, India
14 hours ago
Job descriptionProficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL. Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies. Proven ability to design and implement automated data pipelines and materialized views. Proficiency in Python, Unix or similar languages. Good understanding of SQL oracle, SQL server or similar languages. Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions). Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code. 5+ years of directly applicable experience BS in Computer Science, Engineering, or equivalent experience.
Min 5 years of Exp
Key Responsibilities
- Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
- Implement data ETL processes for batch and streaming analytics requirements.
- Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
- Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
- Ensure data security, integrity, and compliance throughout the infrastructure.
- Maintain documentation and contribute to architecture reviews.
- Participate in incident response and operational excellence initiatives for the data warehouse.
- Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.
Required Skills and Experience
Create a job alert for this search
Big Data Developer • Bengaluru, Karnataka, India
Related jobs
Big Data Developer(Hadoop)
Tata Consultancy Services • Bengaluru, Karnataka, India
TCS is conducting weekday Virtual Drive for Big Data Developer.Date of Interview : 13th Nov, 2025.Mode of Interview : Virtual Mode( Teams, Cisco, Webex).
Software developer with hands-on experience on...Show more
Last updated: 16 days ago • Promoted
Big Data Developer (Weekday Virtual Drive On 21st Nov, 2025)
Tata Consultancy Services • Bengaluru, Karnataka, India
Greetings From Tata Consultancy Services!!!.Role : Big Data Developer (Hive, Pyspark).Years of Experience : 6 to 10 yrs.Location : Chennai, Hyderabad, Bengaluru, Pune.
Date of Interview : 21st Nov 2025....Show more
Last updated: 9 days ago • Promoted
Senior Hadoop Developer
Information Tech Consultants • hosur, tamil nadu, in
UK (Relocation Required - Sponsorship will be provided).Bachelors in Science (IT / Computer Science / Engineer).Scala / Hadoop / Big Data Developer.
The role will focus on building and enhancing data-driv...Show more
Last updated: 4 days ago • Promoted
Data Engineer
HCLTech • Greater Bengaluru Area, India
F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show more
Last updated: 30+ days ago • Promoted
Big Data Developer
Tata Consultancy Services • Bengaluru, Karnataka, India
Desired Skills -Technical / Behavioral.Extensive experience in Bigdata Projects particularly Data Ingestion and Transformation Projects.
Total experience of 6 Years or Above with relevant Experience a...Show more
Last updated: 30+ days ago • Promoted
Data Bricks Engineer
Relevance Lab • Greater Bengaluru Area, India
SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show more
Last updated: 3 days ago • Promoted
GCP Big Data Developer
Impetus • Bengaluru, Karnataka, India
Must have : Bigdata, GCP, Dataproc, Dataflow, SQL, Spark.Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub...Show more
Last updated: 14 days ago • Promoted
Data Engineer
VIDA Digital Identity • Greater Bengaluru Area, India
At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
Last updated: 3 days ago • Promoted
Senior Bigdata Developer_ Exp : 6+ Years
Atyeti Inc • bangalore, karnataka, in
Analyze, organize and process raw data using Bigdata technologies and Scala.Perform data validation, cleaning and transformation using big data technologies, Spark and Scala.Ingest and manage data ...Show more
Last updated: 1 day ago • Promoted
Big Data Developer - Scala / Spark
Xebia • Bengaluru, Karnataka, India
Job Title : Big Data Developer - Spark / Scala.Notice Period : immediate - 15 days.Position Overview : We are looking for Scala / Spark developers with strong expertise on Python / Hadoop and Azure clo...Show more
Last updated: 9 days ago • Promoted
Lead Data Engineer
Algonomy • Greater Bengaluru Area, India
Lead / Principal Software Engineer.At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will cons...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Live Connections • hosur, tamil nadu, in
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer(Big Data)
Andor Tech • Bengaluru, Karnataka, India
If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC.
Work on cutting-edge big data solutions f...Show more
Last updated: 21 days ago • Promoted
Senior Data Engineer
Arcana • Greater Bengaluru Area, India
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
Last updated: 3 days ago • Promoted
Data Catalog Developer
Tata Consultancy Services • Greater Bengaluru Area, India
Job Title : Data Catalog Developer.Required Skillset : Informatica IDMC – CDGC (Cloud Data Governance & Catalog), Metadata Harvesting, Lineage.
Hands-on expertise in Informatica IDMC – CDGC.Experience...Show more
Last updated: 3 days ago • Promoted
Big Data Developer (Hive, Pyspark)
Tata Consultancy Services • bangalore district, karnataka, in
Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex).
Hands-on experience of Hadoop, Python, PySpark,...Show more
Last updated: 21 days ago • Promoted
Big Data Developer(Hive, Pyspark)
Tata Consultancy Services • Bengaluru, Karnataka, India
Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Location : Bengaluru,Chennai,Hyderabad.Date of Interview : 6th Nov, 2025.
Mode of Interview : Virtual Drive( Cisco or WebEx).Hands-on ...Show more
Last updated: 29 days ago • Promoted
Data Engineer
Grassdoor • hosur, tamil nadu, in
At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Center which provides seamless, technology-driven solutions.Our platform is built to ...Show more
Last updated: 10 hours ago • Promoted • New!