Talent.com
No longer accepting applications
Azure Data Engineer

Azure Data Engineer

Rainier Softech Solutions Pvt Ltdsrikakulam, India
2 days ago
Job description

Sr. Data Engineer (Databricks)

About the Role

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here.

Core Qualifications :

  • Bachelor’s degree in computer science, Engineering, or a related field
  • 7+ years of experience in software / data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI / ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others

Key Responsibilities :

  • The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services
  • This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability
  • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
  • Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights
  • Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Build ETL / ELT workflows with AWS and Azure Services
  • Optimize Spark jobs for both performance and cost within the customer’s cloud infrastructure
  • Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
  • Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain
  • Implement CI / CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins
  • Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation
  • Troubleshoot and maintain production data pipelines
  • Provide mentorship and share best practices with both internal and customer teams
  • Create a job alert for this search

    Azure Data Engineer • srikakulam, India

    Related jobs
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesSrikakulam, Andhra Pradesh, India
    Greetings from TCS! Job Title : Azure Data Engineer Required Skillset : Azure Databricks, Pyspark, SQL, ADF, Data Lake Location : Kolkata Experience Range : 4-6 years Job Description Must-Have • • Azur...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systemssrikakulam, andhra pradesh, in
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NexionPro Servicessrikakulam, andhra pradesh, in
    PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    Sigmoidsrikakulam, andhra pradesh, in
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careerssrikakulam, andhra pradesh, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicessrikakulam, andhra pradesh, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 25 days ago
    • Promoted
    • New!
    Databricks Engineer

    Databricks Engineer

    TTC Groupsrikakulam, andhra pradesh, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    GSPANN Technologies, Incsrikakulam, andhra pradesh, in
    Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in Indiasrikakulam, andhra pradesh, in
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 12 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.srikakulam, andhra pradesh, in
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltdsrikakulam, andhra pradesh, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 12 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBendersrikakulam, India
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy ServicesSrikakulam, Andhra Pradesh, India
    Greetings from TCS! Job Title : Senior Azure Data Engineer Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Location : Gurugram Experience...Show moreLast updated: 7 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    People Prime Worldwidesrikakulam, andhra pradesh, in
    Azure Data Lake Storage (Gen1 / Gen2).Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careerssrikakulam, andhra pradesh, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Capgemini Inventsrikakulam, andhra pradesh, in
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 12 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech Mahindrasrikakulam, andhra pradesh, in
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Azure Databricks Specialist

    Azure Databricks Specialist

    KPI Partnerssrikakulam, andhra pradesh, in
    KPI Partners are seeking highly skilled and experienced Senior Data Engineers to join our dynamic team at KPI, working on challenging and multi-year data transformation projects for our clients.Thi...Show moreLast updated: 12 hours ago