Talent.com
This job offer is not available in your country.
Cloud Data Engineer

Cloud Data Engineer

PwC IndiaGurugram, Haryana, India
13 days ago
Job description
  • Location- Gurugram, Mumbai, Pune & Bangalore
  • Years of experience - 3- 8years
  • We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Azure, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions.

    Key Responsibilities :

    • Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS, Azure, Databricks.
    • Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data processing capabilities :
    • AWS : Glue, Athena, Lambda, Redshift, Step Functions, DynamoDB, SNS.
    • Azure : Data Factory, Synapse Analytics, Functions, Cosmos DB, Event Grid, Logic Apps, Service Bus.
    • Optimize Spark job performance to ensure high efficiency and reliability.
    • Stay proactive in learning and implementing new technologies to improve data processing frameworks.
    • Collaborate with cross-functional teams to deliver robust data solutions. - Work on Spark Streaming for real-time data processing as necessary.
    • Qualifications :

    • 3-8 years of experience in data engineering with a strong focus on cloud environments.
    • Proficiency in PySpark or Spark is mandatory.
    • Proven experience with data ingestion, transformation, and data warehousing.
    • In-depth knowledge and hands-on experience with cloud services(AWS / Azure) :
    • Demonstrated ability in performance optimization of Spark jobs.
    • Strong problem-solving skills and the ability to work independently as well as in a team.
    • Cloud Certification (AWS, Azure) is a plus.
    • Familiarity with Spark Streaming is a bonus.
    • Apply with your details at below link https : / / forms.office.com / r / mtWD1WL6Rt

    Create a job alert for this search

    Cloud Data Engineer • Gurugram, Haryana, India