data engineer || 4-9 || Contract || Hyderabad

About Client :

Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation. It partners with major firms in banking, healthcare, telecom, and media.

Our Client is known for combining deep industry expertise with agile development practices, enabling scalable and cost-effective digital transformation. The company operates in over 50 locations across more than 25 countries, has delivery centers in Asia, Europe, and North America and is backed by Baring Private Equity Asia.

Job Title : Data Engineer

Experience Level : 4-9 Years

Job Location : Hyderabad

Budget : 16 LPA

Job Type : Contract

Work Mode : Hybrid

Notice Period : Immediate Joiners

Job Description :

mandatory skills are Spark , Hive ,SQL and Hadoop technologies

Roles & Responsibilities :

1.Create Scala / Spark / Pyspark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API.

2. Work closely with Business Analysts team to review the test results and obtain sign off

3. Prepare necessary design / operations documentation for future usage Perform peers

4. Code quality review and be gatekeeper for quality checks Hands-on coding, usually in a pair programming environment

5. Working in highly collaborative teams and building quality code

6. The candidate must exhibit a good understanding of data structures, data manipulation, distributed processing, application development, and automation.

7. Familiar with Oracle, Spark streaming, Kafka, ML.

8.To develop an application by using Hadoop tech stack and delivered effectively, efficiently, on-time, in-specification and in a cost-effective manner.

9.Ensure smooth production deployments as per plan and post-production deployment verification.

10. This Hadoop Developer will play a hands-on role to develop quality applications within the desired timeframes and resolving team queries.

11. Requirements Hadoop data engineer with total (4 - 6 years) of experience and should have strong experience in Hadoop, Spark, Scala, Java, Hive, Impala, CI / CD, Git, Jenkins, Agile Methodologies, DevOps, Cloudera Distribution. Strong Knowledge in data warehousing Methodology