Talent.com
This job offer is not available in your country.
Neev Systems - Azure Databricks Engineer

Neev Systems - Azure Databricks Engineer

Neev Systems Private LimitedHyderabad
7 days ago
Job description

Description :

Azure Data Bricks + SQL. Azure Data Bricks + SQL. by HR Neev Systems.

Experience : 5 + Years.

Location : Description :

We are seeking an experienced Azure Databricks + SQL Developer / Big Data Engineer to design, develop, and maintain scalable data solutions on Azure. The role will focus on building efficient ETL / ELT pipelines, optimizing SQL queries, and leveraging Databricks and other Azure services for advanced data processing, analytics, and data platform engineering. The ideal candidate will have a strong background in both traditional SQL development and modern big data technologies on Azure.

Key Responsibilities :

  • Develop, maintain, and optimize ETL / ELT pipelines using Azure Databricks (PySpark / Spark SQL).
  • Write and optimize complex SQL queries, stored procedures, triggers, and functions in

Microsoft SQL Server.

  • Design and build scalable, metadata-driven ingestion pipelines for both batch and streaming datasets.
  • Perform data integration and harmonization across multiple structured and unstructured data sources.
  • Implement orchestration, scheduling, exception handling, and log monitoring for robust pipeline management.
  • Collaborate with peers to evaluate and select appropriate tech stack and tools.
  • Work closely with business, consulting, data science, and application development teams to
  • deliver analytical solutions within timelines.

  • Support performance tuning, troubleshooting, and debugging of Databricks jobs and SQL queries.
  • Work with other Azure services such as Azure Data Factory, Azure Data Lake, Synapse
  • Analytics, Event Hub, Cosmos DB, Streaming Analytics, and Purview when required.

  • Support BI and Data Science teams in consuming data securely and in compliance with
  • governance Skills & Experience :

  • 5 - 9 years of overall IT experience with at least 4+ years in Big Data Engineering on Microsoft
  • Azure.

  • Proficiency in Microsoft SQL Server (T-SQL) stored procedures, indexing, optimization, and performance tuning.
  • Strong experience with Azure Data Factory (ADF), Databricks, ADLS, PySpark, and Azure SQL Database.
  • Working knowledge of Azure Synapse Analytics, Event Hub, Streaming Analytics, Cosmos DB,
  • and Purview.

  • Proficiency in SQL, Python, and either Scala or Java with debugging and performance
  • optimization skills.

  • Hands-on experience with big data technologies such as Hadoop, Spark, Airflow, NiFi, Kafka,
  • Hive, Neo4J, and Elastic Search.

  • Strong understanding of file formats such as Delta Lake, Avro, Parquet, JSON, and CSV.
  • Solid background in data modeling, data transformation, and data governance best practices.
  • Experience designing and building REST APIs with practical exposure to Data Lake or
  • Lakehouse projects.

  • Ability to work with large and complex datasets, ensuring data quality, governance, and
  • security standards.

  • Certifications such as DP-203 : Data Engineering on Microsoft Azure or Databricks Certified
  • Developer (DE) are a plus.

    (ref : hirist.tech)

    Create a job alert for this search

    Azure Engineer • Hyderabad

    Related jobs
    • Promoted
    Senior Azure Devops Engineer

    Senior Azure Devops Engineer

    CirrusLabsHyderabad, Telangana, India
    Design, implement, and optimize CI / CD pipelines within Azure DevOps.Develop Infrastructure as Code (IaC) solutions using ARM templates, Terraform, Bicep, or JSON. Automate provisioning and configura...Show moreLast updated: 2 days ago
    • Promoted
    Senior Devops Engineer - Azure

    Senior Devops Engineer - Azure

    KantarHyderabad, Telangana, India
    Responsible for designing, building, and optimizing the automation processes for provisioning infrastructure and applications – via infrastructure-as-code. Standardize and streamline build and relea...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    HireIT ConsultantsHyderabad
    Job Description : We are seeking a skilled and dynamic Azure Data Engineer to join our growing data engineering team.The ideal candidate will have a strong background...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy ServicesGreater Hyderabad Area, India
    Required Technical Skill Set : Azure Databricks using Scala, PySpark.Location : Hyderabad, Noida, Chennai & Mumbai.What skills / attributes are a must have (Please be detailed as to number of years o...Show moreLast updated: 10 days ago
    • Promoted
    Azure data engineer

    Azure data engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Greetings from TATA Consultancy Services.Azure data engineer (Pyspark , databricks , adf).Hyderabad, Kolkata, Bangalore, Pune, Chennai, Delhi. Pls find the Job Description below.Experience in Pyspar...Show moreLast updated: 12 days ago
    • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    Texplorers IncHyderabad
    DevOps Engineer - Data solutions Your Mission : We're building something solid - and we're nearly there.Our team has b...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Azure Data Factory + Azure Databricks.Desired Experience Range - 8 TO 12 years.Mumbai, Bangalore, Hyderabad, Chennai, Gurgaon, Pune. Desired Competencies (Technical / Behavioral Competency).Azure Data...Show moreLast updated: 30+ days ago
    • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    Rrootshell Technologiiss Pvt Ltdhyderabad, telangana, in
    Hope you are doing well & Safe!.Rrootshell Technologiiss Pvt Ltd.We are HIRING & URGENT Requirement for.This is for FULL -TIME role and Remote Work Opportunity. Shift Timings - (Rotational shift – m...Show moreLast updated: 10 days ago
    • Promoted
    Xebia - Senior Azure Data Engineer

    Xebia - Senior Azure Data Engineer

    Xebia IT Architects India Pvt LtdHyderabad
    Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show moreLast updated: 9 days ago
    • Promoted
    Azure DevOps Engineer - IAC Terraform

    Azure DevOps Engineer - IAC Terraform

    Shvintech India LLPHyderabad
    Position : Azure Devops Location Hyderabad Experience : 4+yrs Qualification&...Show moreLast updated: 30+ days ago
    • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    thinkbridgesecunderabad, telangana, in
    We are seeking a highly skilled and experienced Senior DevOps Engineer (Azure) to join our team.In this role, you will be responsible for designing, implementing, and managing our infrastructure an...Show moreLast updated: 8 days ago
    • Promoted
    Azure Engineer -.Net Frameworks

    Azure Engineer -.Net Frameworks

    TeamWare SolutionsHyderabad
    Role Summary : We are seeking a highly skilled Senior Azure &.NET Engineer to lead our Azure-based cloud transformation initiatives. The ideal candidate will have ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    GreatHR SolutionsHyderabad, IN
    Position : Azure DevOps Engineer.Experienced professionals with deep domain knowledge.Expected to lead modules or workstreams, ensure high-quality delivery, and act as subject matter experts.They ar...Show moreLast updated: 1 day ago
    • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    TechMantra GlobalHyderabad
    Role : Azure Databricks.Location : Any Hyderabad, Chennai , Bangalore , Pune , Noida, Gurgaon are preferred.Skills : Azure, Notebooks, Spark-Scala, Bigdata, Cloudera P...Show moreLast updated: 17 days ago
    • Promoted
    Senior Azure Data Engineer (Snowflake and ADF)

    Senior Azure Data Engineer (Snowflake and ADF)

    CoforgeHyderabad, India
    We are Hiring : Senior Azure Data Engineer (Snowflake and ADF) at Coforge Ltd.Job Location : Greater Noida, Pune & Hyderabad Only. Experience Required : 5 to 7 Years.Senior Azure Data Engineer to jo...Show moreLast updated: 2 days ago
    • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    Persistent SystemsHyderabad, Telangana, India
    We are seeking a highly analytical and detail-oriented Azure Devops Engineer.Job Type : Full Time Employment.Strong developer background with proficiency in programming languages such as C#, Java, D...Show moreLast updated: 16 days ago
    • Promoted
    Azure Devops Engineer

    Azure Devops Engineer

    CirrusLabsHyderabad, India
    Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our custome...Show moreLast updated: 9 days ago
    • Promoted
    Azure Devops Engineer

    Azure Devops Engineer

    Tata Consultancy Serviceshyderabad, telangana, in
    The ideal candidate is a proactive self-starter who thrives in a fast-paced environment and is committed to optimizing software development pipelines and cloud infrastructure.You will play a pivota...Show moreLast updated: 30+ days ago