Talent.com
No longer accepting applications
Principal Data Engineer Python / PySpark

Principal Data Engineer Python / PySpark

CoforgeHyderabad, Republic Of India, IN
30+ days ago
Job description

We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.

Job Location : Greater Noida & Hyderabad Only.

Experience : 5 to 7 Years

Employment Type : Full-Time

Send your updated CV to gaurav.2.kumar@coforge.com

For queries, WhatsApp : 9667427662

If you are a data enthusiast with a passion for building scalable, high-performance data solutions, consider joining us.

This role offers the opportunity to work with cutting-edge technologies in a collaborative and innovative environment.

Key Responsibilities :

  • Design and develop high-volume, mission-critical data engineering solutions.
  • Enhance applications to meet business and audit requirements.
  • Optimize Spark jobs for large-scale data processing.
  • Collaborate with onshore and offshore teams to ensure platform availability.
  • Participate in the full development lifecycle : coding, testing, and release.
  • Support weekend release activities and resolve application issues.

Must-Have Skills :

  • Strong hands-on experience with Python and PySpark.
  • Proficiency in Spark DataFrames, Jupyter Notebook, and PyCharm.
  • Experience with AWS services : EMR, Athena, Glue, Lambda, EC2, S3, SNS.
  • Familiarity with ETL processes, handling various file formats (CSV, JSON, XML, etc.).
  • Knowledge of data warehousing concepts and columnar storage formats (Parquet, Avro, ORC).
  • Version control using Git and CI / CD with Jenkins.
  • Awareness of DevOps and automated release pipelines.
  • Good to Have :

  • Experience with AWS databases (Aurora, RDS, Redshift, DynamoDB).
  • Exposure to BFSI domain and API Gateway platforms.
  • Knowledge of front-end frameworks.
  • Experience working with US clients.
  • Create a job alert for this search

    Principal Engineer Data • Hyderabad, Republic Of India, IN

    Related jobs
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGHyderabad, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer (AWS,Python, Spark / databricks, SQL)

    Senior Data Engineer (AWS,Python, Spark / databricks, SQL)

    SID Information TechnologiesHyderabad, Telangana, India
    Role : Senior Data Engineer (Python, Spark / Databricks, SQL, AWS) Experience : 6–12 years Location : Hyderabad Work Mode : Hybrid (3 days / week in-office) Join Time : Immediate Must-Have Technical Sk...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer - Python / Spark

    Data Engineer - Python / Spark

    VariteHyderabad
    About The Job : - Develops technical tools and programming to cleanse, organize and transform data and to maintain, protect and update data structures and integrity ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Analytics Engineer - Python Programming

    Data Analytics Engineer - Python Programming

    Placewell HRD ConsultantsHyderabad
    Job Description : As an Algorithm / Data Analytics Engineer, you will lead the effort to design, build, and configure applications, acting as...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Python / PySpark

    Big Data Engineer - Python / PySpark

    People Prime World WideHyderabad
    Key Responsibilities : - Design, develop, and maintain scalable ETL / ELT pipelines using Python and PySpark.Work with large-scale datasets across di...Show moreLast updated: 30+ days ago
    • Promoted
    Saras Analytics - Senior Data Engineer - Python

    Saras Analytics - Senior Data Engineer - Python

    SARAS SOLUTIONS INDIA PRIVATE LIMITEDHyderabad
    The Role : We are seeking a seasoned and proficient Senior Python Data Engineer with substantial experience in cloud technologi...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer - Python / AWS

    Lead Data Engineer - Python / AWS

    Zorba Consulting India Pvt. Ltd.Hyderabad
    Description : Primary Job Title : Data Engineering Lead.About The Opportunity : We are seeking a highly skilled Lead Data Engineer with...Show moreLast updated: 9 days ago
    • Promoted
    Lead Data Engineer / Engineering Manager - Python / Scala

    Lead Data Engineer / Engineering Manager - Python / Scala

    InfoslabHyderabad
    Location : Hyderabad (Hybrid) Experience : 10+ years Employment Type : Full-Time Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ValueLabsHyderabad, Republic Of India, IN
    As a Senior Data Engineer, you will be the lead architect and builder of the data backbone for our entire next-generation digital asset platform. Embedded within our "Agentic AI & Automation" squad,...Show moreLast updated: 9 days ago
    • Promoted
    Big Data Engineer - Python / SQL / ETL

    Big Data Engineer - Python / SQL / ETL

    CURATALHyderabad
    Key Responsibilities : - Design, develop, and support robust ETL pipelines to extract, transform, and load data into analytical products that driv...Show moreLast updated: 30+ days ago
    • Promoted
    PySpark & ETL Data Engineer

    PySpark & ETL Data Engineer

    CirrusLabsHyderabad, Telangana, India
    Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our custome...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsHyderabad, Telangana, India
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer – Databricks Platform

    Data Engineer – Databricks Platform

    Amicon Hub ServicesHyderabad, Telangana, India
    Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show moreLast updated: 10 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ValueMomentumHyderabad, Republic Of India, IN
    We are seeking a Senior Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volum...Show moreLast updated: 13 days ago
    • Promoted
    Principal Data Engineer - Python / SQL / ETL

    Principal Data Engineer - Python / SQL / ETL

    Response Informatics LimitedHyderabad
    Key Responsibilities : - Architect and build scalable, high-performance data pipelines and infrastructure.Provide techn...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticssecunderabad, telangana, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer III - Python / PySpark

    Data Engineer III - Python / PySpark

    HyrEzy Talent SolutionsHyderabad
    About Company : We are a next-generation AI and Cloud Transformation company driving innovation at the intersection of technology and bus...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - SQL / Python

    Big Data Engineer - SQL / Python

    ANB IT Solutions Pvt LtdHyderabad
    Job Description : - Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pi...Show moreLast updated: 30+ days ago