Talent.com
This job offer is not available in your country.
Data Engineer - Python / SQL

Data Engineer - Python / SQL

VIPANY GLOBAL SOLUTIONS PRIVATE LIMITEDPune
21 days ago
Job description

Responsibilities for Data Engineer :

  • Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements using Python and SQL / AWS / Snowflakes.
  • Identify, design, and implement internal process improvements through : automating manual processes using Python, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL / AWS / Snowflakes technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications for Data Engineer :

  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Desired Skillset :

  • 3+ years of experience in a Python Scripting and Data specific role, with a Bachelor degree.
  • Experience with data processing and cleaning libraries e.g. Pandas, numpy, etc., web scraping / web crawling for automation of processes, API's and how they work.
  • Debugging code if it fails and find the solution. Should have basic knowledge of SQL server job activity monitoring and of Snowflake.
  • Experience with relational SQL and NoSQL databases, including PostgreSQL and Cassandra.
  • Experience with most or all the following cloud services : AWS, Azure, Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Pune

    Related jobs
    • Promoted
    Lead Aws Data Engineer

    Lead Aws Data Engineer

    ACL DigitalPune, Maharashtra, India
    Multi-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling. Knowledge of columnar and NoSQL databases, pre...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    TripleLift - Senior Data Engineer - Python / SQL

    TripleLift - Senior Data Engineer - Python / SQL

    TripleLiftPune
    About TripleLift : We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionab...Show moreLast updated: 30+ days ago
    • Promoted
    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent HealthPune
    Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 22 days ago
    • Promoted
    Zinnia - Data Engineer III - Python / SQL

    Zinnia - Data Engineer III - Python / SQL

    ZinniaPune
    Who You Are : As a seasoned Data Engineer specializing in data engineering, you bring extensive expertise in optimizing data workflows using various database tools l...Show moreLast updated: 14 days ago
    • Promoted
    AWS Data Engineer - Python / SQL / ETL

    AWS Data Engineer - Python / SQL / ETL

    DeqodePune
    Profile : AWS Data Engineer Mandate Skills : AWS + Databricks + Pyspark + SQL role Location : Bangalore ...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Pune, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Celebal Technologies - Data Engineer - Python / SQL

    Celebal Technologies - Data Engineer - Python / SQL

    Celebal TechnologiesPune
    Responsibilities : Platform Expertise : - Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platfo...Show moreLast updated: 5 days ago
    • Promoted
    Big Data Engineer - PySpark / SQL

    Big Data Engineer - PySpark / SQL

    PRONEXUS CONSULTING PRIVATE LIMITEDPune
    About the Role : We are seeking a highly skilled Senior Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines and platforms.T...Show moreLast updated: 14 days ago
    • Promoted
    Intellias - Senior Data Engineer - Python Programming

    Intellias - Senior Data Engineer - Python Programming

    IntelliasPune
    Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalpune, maharashtra, in
    Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    GCP Data Engineer - Python / SQL

    GCP Data Engineer - Python / SQL

    Cling Multi SolutionsPune
    Role : GCP Data Engineer Work Location : Pune, look for local candidates if possible Work Mode : Hybrid &...Show moreLast updated: 10 hours ago
    • Promoted
    Big Data Engineer - SQL / Python

    Big Data Engineer - SQL / Python

    ANB IT Solutions Pvt LtdPune
    Job Description : - Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pi...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionPune, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesPune, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ACL Digitalpune, maharashtra, in
    Experience : - 10 years to 13 years.Location : Pune,Bangalore,Chennai.Notice Period : - Immediate Joiner only.Experience in Python & pyspark. Experience in ETL Development, ETL pipeline.Experience in Dat...Show moreLast updated: 8 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    AscendionPune, Maharashtra, India
    Job Title : Senior Data Engineer.Location : Gurgaon / Pune / Bangalore.Skills : PySpark, SQL, Databricks, AWS.The ideal candidates should have hands-on expertise in building. Databricks and AWS, along w...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer - Pyspark

    Data Engineer - Pyspark

    Tata Consultancy Servicespune, maharashtra, in
    Job Title : - Data Engineer - Pyspark.Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL. Good Spark, Pyspark,Big Data experience.Spark UI / Optimization / debugging ...Show moreLast updated: 13 hours ago