Talent.com
This job offer is not available in your country.
Data Engineer - Python / PySpark

Data Engineer - Python / PySpark

Hire AlphaHyderabad
30+ days ago
Job description

Primary Skills :

  • Strong in Python Programming, Pyspark queries, AWS, GIS, Palantir Foundry.
  • PySpark queries MUST.

Experience : 15+ Years.

Location : Hyderabad (5 days a week Work from Office).

Responsibilities :

  • Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
  • Collaborate with product and technology teams to design and validate the capabilities of the data platform.
  • Identify, design, and implement process improvements : automating manual processes, optimizing for usability, re-designing for greater scalability.
  • Provide technical support and usage guidance to the users of our platforms services.
  • Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

    • Qualifications :

  • Experience building and optimizing data pipelines in a distributed environment.
  • Experience supporting and working with cross-functional teams.
  • Proficiency working in Linux environment.
  • 4+ years of advanced working knowledge of SQL, Python, and PySpark.
  • Knowledge on Palantir.
  • Experience using tools such as : Git / Bitbucket, Jenkins / Code Build, Code Pipeline.
  • Experience with platform monitoring and alerts tools.

    • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Hyderabad