Talent.com
Senior Azure / SQL Developer - Big Data / PySpark

Senior Azure / SQL Developer - Big Data / PySpark

Lancesoft India Pvt LtdChennai
23 hours ago
Job description

Description : Position Overview

As a Senior Azure / SQL Developer, you will be responsible for the end-to-end development, deployment, and maintenance of robust data solutions.

This includes advanced SQL development, designing ETL / ELT workflows using SSIS and PySpark, and leveraging the full capabilities of the Azure Data stack within a DevOps methodology.

We are looking for an experienced professional ready to hit the ground running and drive performance in our data environment.

Key Responsibilities :

  • Azure Data Development : Design and implement scalable data solutions utilizing core Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure SQL Database).
  • Advanced SQL Development : Write complex, highly optimized SQL queries, stored procedures, functions, and views to support business intelligence and application needs within high-transaction environments.
  • ETL / ELT Pipeline Construction : Develop, deploy, and manage Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes using SQL Server Integration Services (SSIS) for robust data movement and transformation.
  • Big Data Processing : Utilize PySpark for scalable data processing, transformation, and analysis, focusing on handling large volumes of data efficiently within Spark environments (e.g., Azure Databricks, Azure Synapse Spark Pools).
  • Development Tools : Leverage Visual Studio for developing and managing SQL projects, SSIS packages, and integrated cloud development tasks.
  • DevOps Integration : Implement and maintain Continuous Integration / Continuous Deployment (CI / CD) pipelines using DevOps practices (e.g., Azure DevOps, Git) for automated testing, deployment, and infrastructure management.

Essential Technical Skills (Mandatory) :

  • The essential mandatory technical skills for this role are comprehensive and span the modern data landscape.
  • Candidates must possess expertise in Cloud technologies, specifically with Azure Data Services (including Azure Data Factory and Azure SQL).
  • Foundational knowledge includes advanced Database skills encompassing complex SQL development, expert query optimization, and T-SQL.
  • For data ingestion and transformation, proficiency in ETL tools, particularly SSIS (design, deployment, and configuration), is required.
  • The role also demands Big Data processing capabilities using PySpark for efficient data manipulation, transformation, and performance tuning with DataFrames.
  • Development work requires familiarity with the Development IDE Visual Studio for managing SQL and SSIS projects.
  • Finally, a strong understanding of Automation and modern DevOps principles (CI / CD, Version Control) is mandatory for streamlined deployment and maintenance.
  • Candidate Profile :

  • Experience : 58 years of professional experience, with a significant portion of that time focused on the mandatory skills listed above.
  • Availability : Immediate joiners only are strongly preferred, demonstrating readiness to integrate quickly into our team.
  • Analytical Skills : Proven ability to analyze complex business requirements and translate them into efficient, technical data solutions.
  • Teamwork : Excellent collaboration skills, capable of working independently and as part of an agile development team
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Developer • Chennai

    Related jobs
    • Promoted
    Big Data Developer

    Big Data Developer

    BayOne SolutionsChennai, IN
    We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 10 days ago
    • Promoted
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 25th Oct, 2025.Mode of Interview : Virtual Drive( Cisco or WebEx). Hands-on experience of Hadoop, Python, PySpark...Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    TCS presents an excellent Opportunity For "Azure Data Engineer" Role.Azure Databricks - Basic understanding of ADB.ADF - Basic understanding of pipeline and all the activities associated within pip...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioChennai, IN
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 17 hours ago
    • Promoted
    Senior Data Engineer - Azure Platform

    Senior Data Engineer - Azure Platform

    Resource Tree Global ServicesChennai
    Job Name : Senior Data Engineer Azure Years of Experience : 5 Job Description : We are look...Show moreLast updated: 30+ days ago
    • Promoted
    Infocepts - Data Architect - SQL / Python

    Infocepts - Data Architect - SQL / Python

    InfoCepts Technologies Pvt. Ltd.Chennai
    Description : Position : Data Architect (Databricks, Snowflake).Location : Nagpur, Pune, Chennai, Bangalore.Type of Empl...Show moreLast updated: 17 days ago
    • Promoted
    bigdata,azure databricks

    bigdata,azure databricks

    ConfidentialPune, Chennai
    Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment. Participate in design and implementation of the analytics arch...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Architect Lead

    Azure Data Architect Lead

    ITC Infotechmount, India
    Hi, We are looking for Azure Data Architect.Interested can send their profiles to mentioning Current CTC, Expected CTC, Notice period to join. Experience in Order to Cash Process (O2C), Oracle.Wor...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Azure Data Engineer (8+ Yrs)

    Senior Azure Data Engineer (8+ Yrs)

    Delphi Consulting Middle EastChennai, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 2 days ago
    • Promoted
    Big Data Engineer - SQL / Python

    Big Data Engineer - SQL / Python

    ANB IT Solutions Pvt LtdChennai
    Job Description : - Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pi...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer - Python / SQL

    Azure Data Engineer - Python / SQL

    ResourcetreeChennai
    Years of Experience : 5 Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team!...Show moreLast updated: 30+ days ago
    • Promoted
    Xebia - Senior Azure Data Engineer

    Xebia - Senior Azure Data Engineer

    Xebia IT Architects India Pvt LtdChennai
    Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show moreLast updated: 18 days ago
    • Promoted
    Big Data Developer (Chennai / Gurgaon)

    Big Data Developer (Chennai / Gurgaon)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    HDFS, Unix Script, Autosys ,Hive.Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive. Theortical knowledge and POC alone will not suffice.Good knowledge in Soft...Show moreLast updated: 11 days ago
    • Promoted
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    We await your innovation at TCS : Hiring |Azure Senior Data Engineers|.Required Experience : 5-10 years.Data Pipeline Development : Design, build, and optimize scalable data pipelines using Azure Data...Show moreLast updated: 4 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Role : Lead / Architect Required Technical Skill Set : Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing Desired Experience Range : 4 to10 Years Location : Chennai and Bengaluru Must-Have...Show moreLast updated: 30+ days ago
    • Promoted
    Lead / Senior Database Developer (SQL, NO SQL & Cloud Native DB) for our client in Chennai

    Lead / Senior Database Developer (SQL, NO SQL & Cloud Native DB) for our client in Chennai

    Optimum Solutions Pte LtdChennai, Tamil Nadu, India
    DynamoDB, CosmosDB, Amazon RDS, Aurora).Strong problem-solving, analytical, and performance-tuning skills.Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer - SQL

    Senior Data Engineer - SQL

    CareerzgraphChennai
    Immediate Joiners / Early Joiners - 10-15 Days Time For Chennai Location : Pallavaram, Chennai ( Work from Office<...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    PL / SQL Developer

    PL / SQL Developer

    Datacore TechnologiesChennai, Tamil Nadu, India
    Job Description : Key responsibilities Python experience with more than 6 years of experience in developing python applications, with working experience in database connectivity, multi-threading a...Show moreLast updated: 8 hours ago