Talent.com
Coditas - Senior Data Engineer - Python
Coditas - Senior Data Engineer - PythonCoditas Technologies Pvt. Ltd. • Pune
Coditas - Senior Data Engineer - Python

Coditas - Senior Data Engineer - Python

Coditas Technologies Pvt. Ltd. • Pune
30+ days ago
Job description

Roles and Responsibilities :

  • Understand Business requirements and implement scalable solutions.
  • Translate complex technical and functional requirements into detailed designs.
  • Develop a highly scalable, reliable, and high-performance data processing pipeline to.
  • Extract, transform and load data from various systems to the Enterprise Data warehouse / Data Lake / Data Mesh.
  • Provide research, high-level design and estimates for data transformation and data integration from source applications to end-use.
  • Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.
  • Develop comprehensive data products and implement them on cloud or in-house servers for production use.

Technical Skills :

  • Minimum 6-10 years of progressive experience building solutions in Big Data environments.
  • Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement.
  • Hands-on experience of Apache Spark with Python for batch and stream processing.
  • Should have knowledge of experience in batch and stream data processing.
  • Exposure working on projects across multiple domains.
  • Strong hands on capabilities on SQL and NoSQL technologies.
  • Minimum 3+ years of experience with AWS services like S3, DMS, Redshift, Glue, Lambda, Kinesis, MSK etc. is must have or similar services of either Azure / GCP.
  • Strong analytical / quantitative skills and comfortable working with huge sets of data.
  • Excellent written and verbal communication skills.
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer Python • Pune

    Related jobs
    Lead / Senior Engineer - Python

    Lead / Senior Engineer - Python

    TESTQ Technologies Limited • Pune
    About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Pune, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 14 days ago • Promoted
    Capco - Senior Data Engineer - Python / Snowflake

    Capco - Senior Data Engineer - Python / Snowflake

    Capco Technologies Pvt Ltd • Pune
    Job Summary : We are seeking a highly experienced Senior Data Engineer with 9+ years of experience, specializing in building advanced Data Engineering solutions on t...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 13 days ago • Promoted
    Rapid7 - Senior Software Engineer - Python

    Rapid7 - Senior Software Engineer - Python

    Rapid7 • Pune
    About the Role : The Senior Software Engineer on the Vulnerability Coverage team will play a pivotal role in expanding the Rapi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • Pune, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python & Cloud Engineer - CI / CD Pipeline

    Senior Python & Cloud Engineer - CI / CD Pipeline

    Web Idea Solution LLP • Pune
    Description : Job Title : Senior Python & Cloud Engineer Experience : 5-8 years &l...Show more
    Last updated: 30+ days ago • Promoted
    Python Data Engineer

    Python Data Engineer

    Synechron • Pune, Maharashtra, India
    Looking for immediate to 30 days' joiners.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative techn...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Pune, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    vConstruct Private Limited • Pune, Maharashtra, India
    Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    InfoCepts • Pune, India
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer - Python / Scala

    Senior Data Engineer - Python / Scala

    hirezy.ai • Pune
    Job Responsibilities : As a Senior Data Engineer, your responsibilities will include : - Designing, developing, optimizing, and maintaining dat...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Populace World Solutions • Pune
    Description : Location : Pune (Kharadi), India Experience : 8+ Years About the Role : Show more
    Last updated: 30+ days ago • Promoted
    Senior MLOps Engineer - Python

    Senior MLOps Engineer - Python

    AI Start Up • Pune
    Description : - Manage and optimize Databricks platform (Workspaces, Jobs, Unity Catalog, Delta Lake) - Implement the whole ML lifecycle : model...Show more
    Last updated: 7 days ago • Promoted