Talent.com
This job offer is not available in your country.
Senior Data Engineer – Big Data & AWS (Python + PySpark)

Senior Data Engineer – Big Data & AWS (Python + PySpark)

CoforgeHyderabad, Telangana, India
1 day ago
Job description

We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.

Job Location : Greater Noida & Hyderabad Only.

Experience : 5 to 7 Years

Employment Type : Full-Time

Send your updated CV to Gaurav.2.Kumar@coforge.com

For queries, WhatsApp : 9667427662

If you are a data enthusiast with a passion for building scalable, high-performance data solutions, consider joining us.

This role offers the opportunity to work with cutting-edge technologies in a collaborative and innovative environment.

Key Responsibilities :

  • Design and develop high-volume, mission-critical data engineering solutions.
  • Enhance applications to meet business and audit requirements.
  • Optimize Spark jobs for large-scale data processing.
  • Collaborate with onshore and offshore teams to ensure platform availability.
  • Participate in the full development lifecycle : coding, testing, and release.
  • Support weekend release activities and resolve application issues.

Must-Have Skills :

  • Strong hands-on experience with Python and PySpark.
  • Proficiency in Spark DataFrames, Jupyter Notebook, and PyCharm.
  • Experience with AWS services : EMR, Athena, Glue, Lambda, EC2, S3, SNS.
  • Familiarity with ETL processes, handling various file formats (CSV, JSON, XML, etc.).
  • Knowledge of data warehousing concepts and columnar storage formats (Parquet, Avro, ORC).
  • Version control using Git and CI / CD with Jenkins.
  • Awareness of DevOps and automated release pipelines.
  • Good to Have :

  • Experience with AWS databases (Aurora, RDS, Redshift, DynamoDB).
  • Exposure to BFSI domain and API Gateway platforms.
  • Knowledge of front-end frameworks.
  • Experience working with US clients.
  • Create a job alert for this search

    Big Data Engineer • Hyderabad, Telangana, India