Big Data Engineer / / 6y

ConfidentialHyderabad / Secunderabad, Telangana, India

4 days ago

Job description

JOB RESPONSIBILITY

Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)
Write SQL queries to validate the dashboard output
Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract / manipulate data for variance testing.
Performing code reviews and pair programming
Supporting and enhancing current applications
Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications.

QUALIFICATION

B.Tech / B.E / MCA

EXPERIENCE

6+ year's experience in AWS Services : RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

6+ year's experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch

6+ year's experience with Spark programming paradigms (batch and stream-processing)

6+ year's experience in Java, Scala. Familiarity with a scripting language like Python as well as Unix / Linux shells

6+ year's experience with Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

SKILLS AND COMPETENCIES

Profound understanding of Big Data core concepts and technologies – Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).

Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

Programming experience with Python / Scala, Shell scripting.

Experience with DevOps and Continuous Integration / Delivery (CI / CD) concepts and tools such as Bitbucket and Bamboo.

Good understanding of business and operational processes.

Capable of Problem / issue resolution, capable of thinking out of the box.

Skills Required

Java, Spark Streaming, Aws Lambda, Unix, Aws Services, Rds, Scala, AWS Glue, Apache Spark, Kafka, Sql, Nosql, Hive, Linux, Bitbucket, Mysql, Elasticsearch, Postgres, Bamboo, Python

Create a job alert for this search

Big Data Engineer • Hyderabad / Secunderabad, Telangana, India

Related jobs

Promoted

Senior Data Engineer

Experianhyderabad, telangana, in

Experian Consumer Services – Careers That Define “What’s the Next Big (Data) Thing” for Consumers?.What could be more exciting – personally and professionally – than being part of a “disruptive” bu...Show moreLast updated: 30+ days ago

Promoted
New!

Big Data Engineer

LiveRampHyderabad, Republic Of India, IN

LiveRamp is the data collaboration platform of choice for the world’s most innovative companies.A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is sett...Show moreLast updated: 22 hours ago

Promoted

Big Data Engineer

Tata Consultancy ServicessHyderabad, Republic Of India, IN

TCS is hiring for Hadoop Developer.Bengaluru / Chennai / Hyderabad / Indore / Mumbai / Ahmedabad.Required Technical Skill Set : -. Extensive experience and hands on implementation experience with Spark, Scala,...Show moreLast updated: 14 days ago

Promoted

Big Data Engineer - Scala / PySpark

Sheryl strategic solutions Pvt. LTD.Hyderabad

Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duratio...Show moreLast updated: 30+ days ago

Promoted

Big Data Systems Engineer

Tata Consultancy ServicesHyderabad, Republic Of India, IN

Big Data Support Engineer / Hadoop Support Engineer.Bigdata Hadoop Platform -Cloudera, Sqoop, hive, spark, oozie and Flume- Cloudera (CDH). Must Have Technical Qualifications : .Sqoop, hive, spark, oo...Show moreLast updated: 30+ days ago

Promoted

Big Data Support Engineer

Tata Consultancy ServicesHyderabad, Telangana, India

Greetings from TCS! TCS is hiring for Big Data Support Engineer / Hadoop Support Engineer Desired Experience : 4 to 10 Years Job Location : Hyderabad Require skillset : Bigdata Hadoop Platform -Cl...Show moreLast updated: 30+ days ago

Promoted

Big Data Engineer - Hadoop / Spark

ImpacteersHydrebad

Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago

Promoted

Estuate - GCP Data Engineer - Big Data

Estuate Software Pvt LtdHyderabad

Job Title : Data Engineer / Integration Engineer Job Summary : We are seeking a highly skilled Data Engineer / Integration Engineer to join our team.The i...Show moreLast updated: 30+ days ago

Promoted

Big Data Engineer - GCP

Tata Consultancy ServicesHyderabad, Republic Of India, IN

Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Mandatory to have knowledge of Big Data A...Show moreLast updated: 22 days ago

Promoted

Senior Engineer, Big Data Engineer

ConfidentialHyderabad / Secunderabad, Telangana

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and dig...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladehyderabad, telangana, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India

Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer

SGS & Cosecunderabad, telangana, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 21 hours ago

Promoted

Big Data Engineer

Alef EducationHyderabad, IN

Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience.What started in 2016 as a small pilot programme in Abu Dhabi has evolved into o...Show moreLast updated: 20 days ago

Promoted

Big Data Engineer

ConfidentialHyderabad / Secunderabad, Telangana

Our data engineering team is building and maintaining mission-critical data infrastructure to power business intelligence and analytics capabilities. This involves developing robust data pipelines, ...Show moreLast updated: 30+ days ago

Promoted

Softility - Big Data Engineer - Apache Spark

SoftilityHyderabad

Big Data Engineer : - Design, build, and optimize robust and scalable data pipelines for both batch and real-time data i...Show moreLast updated: 30+ days ago

Promoted

Big Data Engineer

Tata Consultancy ServicesHyderabad, Republic Of India, IN

We are looking for an Hadoop Developers with 4 to 9 Years of relevant hands-on experience in Hadoop Developer.Desired Competencies (Technical / Behavioral Competency). Bigdata Hadoop Development exper...Show moreLast updated: 30+ days ago

Big Data Engineer

RiskInsight Consulting Pvt LtdHyderabad, TS, IN

Quick Apply

Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, trans...Show moreLast updated: 30+ days ago