Talent.com
This job offer is not available in your country.
Data Engineer - SQL / PySpark

Data Engineer - SQL / PySpark

SentinentGeeks Software & Consultancy Pvt LtdKolkata
30+ days ago
Job description

Role Description

This is a full-time role for a Data Engineer.

The Data Engineer will design, develop, and maintain data architecture, including databases and large-scale data processing systems.

Day-to-day tasks will include ETL development, data integration, performance tuning, ensuring data quality and integrity, and creating data pipelines.

The role also involves collaboration with other teams to support data needs and implementing real-time data streaming solutions.

Requirements :

  • 4+ years of experience in data engineering or platform reliability roles.
  • Strong hands-on experience with Azure Databricks, SQL, PySpark, and Delta Lake.
  • Proven experience in building and maintaining production-grade data pipelines in cloud environments.
  • Familiarity with Medallion Architecture and modern data engineering patterns.
  • Experience implementing data testing validation rules, and monitoring tools to maintain data quality.
  • Experience with orchestration tools like Azure Data Factory, Airflow, or dbt Cloud.
  • Exposure to data governance, privacy, and compliance practices in fintech or regulated industries.
  • Familiarity with CI / CD for data pipelines and infrastructure-as-code.

Key Responsibilities :

  • Own and operate the data platforms and day-to-day functions with a focus on 99%+ uptime and reliability.
  • Build, monitor, and maintain data pipelines across bronze, silver, and gold layers using Azure Databricks, SQL, and PySpark.
  • Implement and manage data testing and data quality frameworks to ensure trust and consistency in key datasets.
  • Set up and maintain alerting, observability, and logging for data jobs and platform performance.
  • Collaborate with stakeholders to understand data requirements and ensure data is delivered clean, complete, and on time.
  • Drive root cause analysis and resolution for data issues, focusing on continuous improvement and automation
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Kolkata

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Kolkata, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalkolkata, west bengal, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKolkata, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritokolkata, west bengal, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 20 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKolkata, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIKolkata, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalKolkata, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekKolkata, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHkolkata, west bengal, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKolkata, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKolkata, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionskolkata, west bengal, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesKolkata, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIKolkata, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionKolkata, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKolkata, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks SQL Engineer with Commercial Pharma

    Databricks SQL Engineer with Commercial Pharma

    KeasisKolkata, IN
    Job Title : Databricks SQL Engineer with Commercial Pharma.We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL.The ideal candidate will ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESKolkata, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKolkata, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Kolkata

    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Kolkata

    Tata Consultancy Serviceskolkata, west bengal, in
    Job Title : AWS Senior Data Engineer with Pyspark, AWS, Glue.PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing. Hadoop, Teradata Background, IaC[Cloud Fo...Show moreLast updated: 20 hours ago