We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.
Job Location : Greater Noida & Hyderabad Only.
Experience : 5 to 7 Years
Employment Type : Full-Time
Send your updated CV to Gaurav.2.Kumar@coforge.com
For queries, WhatsApp : 9667427662
If you are a data enthusiast with a passion for building scalable, high-performance data solutions, consider joining us.
This role offers the opportunity to work with cutting-edge technologies in a collaborative and innovative environment.
Key Responsibilities :
- Design and develop high-volume, mission-critical data engineering solutions.
- Enhance applications to meet business and audit requirements.
- Optimize Spark jobs for large-scale data processing.
- Collaborate with onshore and offshore teams to ensure platform availability.
- Participate in the full development lifecycle : coding, testing, and release.
- Support weekend release activities and resolve application issues.
Must-Have Skills :
Strong hands-on experience with Python and PySpark.Proficiency in Spark DataFrames, Jupyter Notebook, and PyCharm.Experience with AWS services : EMR, Athena, Glue, Lambda, EC2, S3, SNS.Familiarity with ETL processes, handling various file formats (CSV, JSON, XML, etc.).Knowledge of data warehousing concepts and columnar storage formats (Parquet, Avro, ORC).Version control using Git and CI / CD with Jenkins.Awareness of DevOps and automated release pipelines.Good to Have :
Experience with AWS databases (Aurora, RDS, Redshift, DynamoDB).Exposure to BFSI domain and API Gateway platforms.Knowledge of front-end frameworks.Experience working with US clients.