Talent.com
This job offer is not available in your country.
Colan Infotech - Azure Data Engineer - Python / PySpark

Colan Infotech - Azure Data Engineer - Python / PySpark

Colan Infotech Pvt LtdChennai
12 days ago
Job description

Azure Data Engineer

Location : Chennai / Bangalore (Work from Office only)

Experience : 3-5 Years

Job Type : Full-time

Job Overview :

Greetings from Colan Infotech! We are urgently hiring a skilled Azure Data Engineer to join our team. With 3-5 years of experience, you'll be instrumental in designing, developing, and maintaining scalable and efficient data pipelines within the Azure ecosystem. Your expertise in Python, PySpark / Scala Spark, Azure Data Factory, and Azure Databricks will be crucial in building robust data solutions that support our analytical and business needs.

Responsibilities :

  • Design, develop, and maintain scalable data pipelines using PySpark / Scala Spark, Azure Databricks, Python, and SQL.
  • Demonstrate strong programming skills, with the ability to write optimized, reusable, and high-quality code for data processing and transformation.
  • Optimize SQL queries for efficient data extraction, manipulation, and loading, particularly within Azure SQL Database and Azure Synapse Analytics.
  • Implement and manage ETL processes using Azure Data Factory, ensuring reliable data ingestion and transformation.
  • Exhibit expertise in Azure Databricks, including efficient workflow management, data exploration, and leveraging its capabilities for large-scale data processing.
  • Collaborate effectively with cross-functional teams to deeply understand business requirements and translate them into technical data solutions.
  • Implement best practices for data pipeline optimization, ETL processes, and query performance tuning.
  • Create and maintain comprehensive documentation for all designed data pipelines and workflows.
  • Troubleshoot and resolve complex issues in data pipelines promptly, ensuring minimal downtime and data integrity.

Required Skills :

  • 3-5 years of experience as an Azure Data Engineer.
  • Strong proficiency in PySpark / Scala Spark and Python programming.
  • Hands-on expertise with Azure Data Factory (ADF) for ETL / ELT pipeline orchestration.
  • Extensive experience with Azure Databricks for data processing and analytics.
  • Proficiency in SQL, with experience working with Azure SQL Database and Azure Synapse Analytics.
  • Solid understanding and practical experience with ETL concepts and methodologies.
  • Ability to write optimized, reusable, and high-quality code.
  • Strong problem-solving and debugging skills for data pipelines.
  • Excellent collaboration and communication skills to work with cross-functional teams.
  • ref : hirist.tech)

    Create a job alert for this search

    Azure Data Engineer • Chennai

    Related jobs
    • Promoted
    Azure Data Engineer - PySpark / Scala

    Azure Data Engineer - PySpark / Scala

    Gig ConsultantsChennai
    Must-have skills : - Cloud certified in one of these categories - Azure Data Engineer ...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer - Python / Spark

    Data Engineer - Python / Spark

    Brace Infotech Private LimitedChennai
    Role : Data Engineer (Pyspark or Python + Spark) Key Skills : Pyspark, Spark, SQL Advanced, Hive, Unix Shell Scripting ...Show moreLast updated: 28 days ago
    • Promoted
    AWS Data Engineer - ETL / PySpark / Python

    AWS Data Engineer - ETL / PySpark / Python

    ChangeleadersChennai
    Position : AWS Data Engineer Experience : 5+ Yrs Location : Bangalore, Hyderabad, Chennai, Pune, Gurgaon <...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    AceNetChennai
    About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology co...Show moreLast updated: 28 days ago
    • Promoted
    Azure Databricks Engineer - Python / PySpark

    Azure Databricks Engineer - Python / PySpark

    optimum solutionsChennai
    We are seeking a skilled and experienced Azure Databricks Engineer to join our growing data engineering team.The ideal candidate will have deep hands-on expertise in building scalable data pipeline...Show moreLast updated: 4 days ago
    • Promoted
    Big Data Engineer - Python / PySpark

    Big Data Engineer - Python / PySpark

    DexianChennai
    Job Description : We are intending to hire Data engineer to handle day-to-day activities involving data ingestion from multiple source loca...Show moreLast updated: 15 days ago
    Data Engineer - Azure Databricks, Pyspark, Python, Airflow

    Data Engineer - Azure Databricks, Pyspark, Python, Airflow

    NielsenIQChennai, Tamil Nadu, India
    Junior Data Engineer - Azure Databricks, Pyspark, Python, Airflow __Chennai / Pune India (1- 2 years exp only) .YOU’LL BUILD TECH THAT EMPOWERS GLOBAL BUSINESSES .Our Connect Technology tea...Show moreLast updated: 7 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    RandomTreesChennai, IN
    We are seeking a skilled and experienced.The ideal candidate will have a strong background in building and optimizing data pipelines and data sets, utilizing Azure Data Factory, Databricks, PySpark...Show moreLast updated: 26 days ago
    Azure Data Engineer

    Azure Data Engineer

    Colan Infotech Private LimitedChennai, Tamil Nadu, India
    Greetings from Colan Infotech!!.We are hiring Azure Data Engineer urgent basis.Job Location - Chennai / Bangalore (WFO only). Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory.S...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer - Python / PySpark

    Senior Data Engineer - Python / PySpark

    Vtricks TechnologiesChennai
    Job Title : Senior Data Engineer - Azure | ADF | Databricks | PySpark | AWS Location : Bangalore, Hyderabad, Chennai (Hybrid Mode) Experience Required : 5+...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer - Python / SQL

    Azure Data Engineer - Python / SQL

    ResourcetreeChennai
    Years of Experience : 5 Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team!...Show moreLast updated: 30+ days ago
    • Promoted
    CDM Smith - Senior Data Engineer - Python / PySpark

    CDM Smith - Senior Data Engineer - Python / PySpark

    CDM SMITH GLOBAL SERVICES INDIA LLPChennai
    Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Databricks to join our Digital Capital tea...Show moreLast updated: 17 days ago
    • Promoted
    Azure Fabric Engineer - PySpark / SQL

    Azure Fabric Engineer - PySpark / SQL

    Qode.worldChennai
    Job Title : Azure Fabric : Mumbai, Chennai, Bangalore : 6 - 10 : High-Priority Description : We are urgently hiring a highly ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Databricks)

    Data Engineer (Databricks)

    Marx Enterprise Transformation ArchitectureChennai, IN
    Azure Data Engineer – Databricks & Data Fabric.Data Engineering, 3+ years on Azure stack.The ideal candidate will be responsible for building modern data pipelines, optimizing data flows, and enabl...Show moreLast updated: 11 days ago
    Data Engineer – MS Fabric

    Data Engineer – MS Fabric

    Excelencia iTech Consulting Pvt LtdChennai, TN, in
    Quick Apply
    Job Title : Data Engineer – MS Fabric.Delta Lake, OneLake, Lakehouses.Python, PySpark, Spark SQL, T-SQL.Data Pipelines & Real-Time Analytics. Design, build, and optimize data pipelines using Micr...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    sphere ITChennai
    Responsibilities : - Ability to write clean, maintainable, and robust code in Python - Understanding and expertise of software engineeri...Show moreLast updated: 21 days ago
    • Promoted
    Azure Data Engineer - PySpark / DataLake

    Azure Data Engineer - PySpark / DataLake

    SSIChennai
    Responsibilities : - Proficiency in Azure Data Factory, Azure Databricks (including Spark and Delta Lake), and other Azure data services.Strong pro...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS present an excellent opportunity for Data Engineer.Experience required : 5-12 yrs.Skills : Apache Spark, Python, PySpark, Java, GCP BQ,BIG Data, Python, SQL, PySpark GCP.Walk in Interview date : ...Show moreLast updated: 13 days ago