Talent.com
No longer accepting applications
Senior Big Data Engineer

Senior Big Data Engineer

People Prime WorldwideJaipur, IN
7 days ago
Job description

About the Company

Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.

Title : Senior Data Engineer

Location : Hyderabad,Chennai

Experience : 6 - 12 years

Employment Type : Permanent

Notice Period : Immediate Joiners

Key Responsibilities :

  • Big Data Processing :
  • Design, develop, and maintain scalable ETL / ELT pipelines using PySpark , Scala , or Java .
  • Implement data transformation workflows to ensure clean and reliable datasets.
  • Cloud Integration :
  • Work extensively with AWS services such as EMR , S3 , Glue , Lambda , Redshift , DynamoDB , and RDS to build and manage data solutions.
  • Data Modeling & Optimization :
  • Develop and optimize data models in Hadoop and Spark environments.
  • Ensure performance tuning and cost optimization of cloud-based data platforms.
  • Data Ingestion & Integration :
  • Ingest data from various sources including APIs, RDBMS, and NoSQL databases.
  • Implement data pipelines for batch and real-time processing.
  • Collaboration & Documentation :
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Document data models, transformation logic, and technical specifications.
  • Automation & Monitoring :
  • Automate data workflows and ensure data pipelines are reliable, scalable, and error-free.
  • Implement data monitoring, logging, and alerting to ensure pipeline reliability.

Required Skills & Qualifications :

  • Technical Expertise :
  • 6–12 years of experience in Big Data engineering with strong hands-on experience in AWS , PySpark , Scala , or Java .
  • Proficiency in SQL and experience with Hadoop ecosystem components like Hive , HDFS , and Kafka .
  • Cloud Services :
  • Extensive experience with AWS services such as EMR , S3 , Glue , Lambda , Redshift , DynamoDB , and RDS .
  • Data Engineering Tools :
  • Familiarity with data orchestration tools like Apache Airflow or Oozie .
  • Experience with containerization technologies like Docker and Kubernetes is a plus.
  • Soft Skills :
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and in a team-oriented environment.

    • Preferred Skills (Good to Have) :

  • Certifications : AWS Certified Solutions Architect , AWS Certified Big Data – Specialty , or Cloudera Certified Associate (CCA) .
  • Experience with CI / CD pipelines using tools like Jenkins or GitLab .
  • Knowledge of data warehousing concepts and experience with platforms like Redshift or Snowflake .
  • Familiarity with streaming technologies such as Apache Kafka or Kinesis .
    • Create a job alert for this search

    Senior Data Engineer • Jaipur, IN