Talent.com
This job offer is not available in your country.
Zinnia - Data Engineer III - Python / SQL

Zinnia - Data Engineer III - Python / SQL

ZinniaPune
14 days ago
Job description

Who You Are :

As a seasoned Data Engineer specializing in data engineering, you bring extensive expertise in optimizing data workflows using various database tools like Oracle, BigQuery, and SQL Server.

You possess a deep understanding of ELT / ETL processes, data integration, and have a strong command of Python for data manipulation and automation tasks.

You will possess advanced expertise in working with data platforms like Google Big Query, DBT, Python, and Airflow.

Responsible for designing and maintaining scalable ETL pipelines, optimizing complex data systems, and ensuring smooth data flow across different platforms.

As a Senior Data Engineer, you will also be required to work collaboratively in a team and contribute to building data infrastructure that drives business insights.

What Youll Do :

  • Design, develop, and optimize complex ETL pipelines that integrate large data sets from various sources.
  • Build and maintain high-performance data models using Google BigQuery and DBT for data transformation.
  • Develop Python scripts for data ingestion, transformation, and automation.
  • Implement and manage data workflows using Apache Airflow for scheduling and orchestration.
  • Collaborate with data scientists, analysts, and other stakeholders to ensure data availability, reliability, and performance.
  • Troubleshoot and optimize data systems, identifying issues and resolving them proactively.
  • Work on cloud-based platforms, particularly AWS, to leverage scalability and storage options for data pipelines.
  • Ensure data integrity, consistency, and security across systems.
  • Take ownership of end-to-end data engineering tasks while mentoring junior team members.
  • Continuously improve processes and technologies for more efficient data processing and delivery.
  • Act as a key contributor to developing and supporting complex data architectures.

What Youll Need :

  • Bachelors degree in computer science, Information Technology, or a related field.
  • 4+ years of hands-on experience in Data Engineering or related fields, with a strong background in building and optimizing data pipelines.
  • Strong proficiency in Google Big Query, including designing and optimizing queries or other equivalent Datawarehouse (Snowflake).
  • Knowledge of dbt for data transformation and model management.
  • Proficiency in Python for data engineering tasks, including scripting, data manipulation, and automation.
  • Solid experience with Apache Airflow for workflow orchestration and task automation.
  • Extensive experience in building and maintaining ETL pipelines.
  • Familiarity with cloud platforms, particularly AWS (Amazon Web Services), including tools like S3, Lambda, Redshift, or Glue.
  • Excellent problem-solving and troubleshooting abilities.
  • Strong communication and collaboration skills with the ability to work effectively in a team environment.
  • Self-motivated, detail-oriented, and able to work with minimal supervision.
  • Ability to manage multiple priorities and deadlines in a fast-paced environment.
  • Experience with other cloud platforms (e.g., AWS, Azure) is a plus.
  • Knowledge of data warehousing best practices and architecture.
  • WHATS IN IT FOR YOU?

    At Zinnia, you collaborate with smart, creative professionals who are dedicated to delivering cutting-edge technologies, deeper data insights, and enhanced services to transform how insurance is done.

    Apply by completing the online application on the careers section of our website.

    We are an Equal Opportunity employer committed to a diverse workforce.

    We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability.

    (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer Iii • Pune

    Related jobs
    • Promoted
    Lead Aws Data Engineer

    Lead Aws Data Engineer

    ACL DigitalPune, Maharashtra, India
    Multi-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling. Knowledge of columnar and NoSQL databases, pre...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicespune, maharashtra, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    TripleLift - Senior Data Engineer - Python / SQL

    TripleLift - Senior Data Engineer - Python / SQL

    TripleLiftPune
    About TripleLift : We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionab...Show moreLast updated: 30+ days ago
    • Promoted
    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent HealthPune
    Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 22 days ago
    • Promoted
    PySpark Databricks Engineer - SQL / Azure

    PySpark Databricks Engineer - SQL / Azure

    Confidential CompanyPune
    Primary Tech skills : AZURE ,Databricks ,Pyspark, SQL Secondary Tech skills : ADF, Synapse Job Description : Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Pune, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionpune, maharashtra, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ACL DigitalPune, Maharashtra, India
    Experience : - 10 years to 13 years.Location : Pune,Bangalore,Chennai.Notice Period : - Immediate Joiner only.Experience in Python & pyspark. Experience in ETL Development, ETL pipeline.Experience in Dat...Show moreLast updated: 7 days ago
    • Promoted
    Celebal Technologies - Data Engineer - Python / SQL

    Celebal Technologies - Data Engineer - Python / SQL

    Celebal TechnologiesPune
    Responsibilities : Platform Expertise : - Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platfo...Show moreLast updated: 5 days ago
    • Promoted
    Intellias - Senior Data Engineer - Python Programming

    Intellias - Senior Data Engineer - Python Programming

    IntelliasPune
    Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 21 days ago
    • Promoted
    OpenGov - Data Solutions Engineer III - ETL / Python

    OpenGov - Data Solutions Engineer III - ETL / Python

    OpengovPune
    OpenGov is the leader in AI and ERP solutions for local and state governments in the U.More than 2,000 cities, counties, state agencies, school districts, and special districts rely on th...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalpune, maharashtra, in
    Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    VIPANY GLOBAL SOLUTIONS PRIVATE LIMITEDPune
    Responsibilities for Data Engineer : - Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet function...Show moreLast updated: 21 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    AscendionPune, Maharashtra, India
    Job Title : Senior Data Engineer.Location : Gurgaon / Pune / Bangalore.Skills : PySpark, SQL, Databricks, AWS.The ideal candidates should have hands-on expertise in building. Databricks and AWS, along w...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer - Pyspark

    Data Engineer - Pyspark

    Tata Consultancy Servicespune, maharashtra, in
    Job Title : - Data Engineer - Pyspark.Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL. Good Spark, Pyspark,Big Data experience.Spark UI / Optimization / debugging ...Show moreLast updated: 13 hours ago
    • Promoted
    Lead Cloud Data Engineer - PySpark / SQL

    Lead Cloud Data Engineer - PySpark / SQL

    upGradPune
    About the Job : We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.Work with Databricks platform using Spark for big data processing and an...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / SQL / ETL

    Data Engineer - Python / SQL / ETL

    Cognitive Stars India Pvt. Ltd.Pune
    Job Title : Data Engineer Experience : 2 4 years Key Responsibilities : - Archite...Show moreLast updated: 30+ days ago