Azure Big data Engineer
ConfidentialHyderabad / Secunderabad, Telangana, Bengaluru / Bangalore30+ days ago
Job descriptionOverall 4 8 years of experience with a minimum 4+ years of relevant professional work experience with Azure Synapse and Azure Databricks ETL Consultant - Databricks / ADF / Synapse, building common logging mechanism for all ETL processes, Build the ingestion process for fact data tables, Building the pipeline temporary pipeline to load data into on premise, Prepare the flow diagram covering it up all required ETLs Prepare folder design document Netezza Box Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Work together with data analysts to understand the needs for data and create effective data workflows. Create and maintain data storage solutions including Azure Databricks, Azure Functions, Azure Data Lake, Azure Synapse, Azure Integration Services, Azure API Management, CI / CD and PowerShell Scripts, ADF, ETL Pipelines, Unity Catalog, Azure SQL Database, SQL Coding, Azure SQL Database, Azure Data Lake. Utilizing Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations using ADF pipelines. Hands-On Experience working on Data Bricks for implementing Transformations and Delta Lake. Hands-On Experience working on Serverless SQL Pool, Dedicated SQL Pool. Use ADF pipelines to orchestrate the end to end data transformation including the execution of DataBricks notebooks. Should have experience working on Medallion Architecture Experience working on CI / CD pipelines using Azure DevOps Attaching both ADF and ADB to DevOps Creating and managing Azure infrastructure across the landscape using Bicep Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Good to have exposure on Power BI, Power Automate Good to have knowledge on Azure fundamentals.
Desirable skills
- Good ability to anticipate issues and formulate remedial actions
- Sound interpersonal and team working skills
- Sound Knowledge of unit testing methodologies and frameworks
- Should be able to work independently
- Good communication skills
Skills Required
Sql Database, Azure Data Lake
Create a job alert for this search
Azure Data Engineer • Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
Related jobs
![▷ [High Salary] Senior Azure Data Engineer](https://cdn-logos.talent.com/v1/logo/image?feedcode=attb-in&company_name=Programmers.io)
- Promoted
Senior Azure Data Engineer
Programmers.ioHyderabad, Telangana, India Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
- Promoted
Azure Engineer
BigHammer.aiHyderabad, Telangana, India As a key technical leader, you will set the direction for cloud architecture, scalability, and security, while also mentoring engineering teams and partnering with stakeholders to deliver high-impa...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer
Saransh IncHyderabad, Telangana, India Data Engineer (Contract-to-Hire | Remote) Experience Level : 6+ Years Location : Remote Contract Type : Full-Time / Fixed-Term Contract (12 months, extendable based on performance) Notice : Immedia...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer – Big Data & AWS (Python + PySpark)
CoforgeHyderabad, India We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.Job Location : Greater Noida & Hyderabad Only.
If you are a data enthusiast with a passion fo...Show moreLast updated: 25 days ago
- Promoted
Azure data engineer
Tata Consultancy ServicesHyderabad, Telangana, India Greetings from TATA Consultancy Services.Azure data engineer (Pyspark , databricks , adf).Hyderabad, Kolkata, Bangalore, Pune, Chennai, Delhi.
Pls find the Job Description below.Experience in Pyspar...Show moreLast updated: 27 days ago
- Promoted
Big Data Engineer - Hadoop / Spark
ImpacteersHydrebad Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago
- Promoted
Snowflake Data Engineer
Tata Consultancy ServicesHyderabad, Telangana, India Minimum of 3+ years of working experience with.Datawarehouse and data lake service.Obvious track record of designing and implementing.
Exposed to ETL / ELT and governance tools (incl.Experience within...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer
Tata Consultancy ServicesHyderabad, Telangana, India Azure Data Factory + Azure Databricks.Desired Experience Range - 8 TO 12 years.Mumbai, Bangalore, Hyderabad, Chennai, Gurgaon, Pune.
Desired Competencies (Technical / Behavioral Competency).Azure Data...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RecroHyderabad, Telangana, India Key Responsibilities : Configure, deploy, and maintain Quantexa software on cloud platforms such as AWS, Azure, or Google Cloud.
Design, implement, and optimize data pipelines and integ...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer - Snowflake / AWS
ResourcetreeHyderabad About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 23 days ago
- Promoted
Data Engineer - Azure Cloud
Texplorers IncHyderabad Data Engineer Job Description : Job Location : Hyderabad We are seeking a hands-on Data Engineer with a s...Show moreLast updated: 30+ days ago
- Promoted
Senior AWS Data Engineer
CYAN360Hyderabad, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Xebia - Senior Azure Data Engineer
Xebia IT Architects India Pvt LtdHyderabad Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show moreLast updated: 24 days ago
- Promoted
- New!
▷ [High Salary] Senior Azure Data Engineer
Programmers.ioHyderabad, Telangana, India Job Title : Senior Azure Data Engineer Job Location : Remote Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.Shift Timings : Gener...Show moreLast updated: 7 hours ago
- Promoted
Data Engineer- Snowflake
Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 30+ days ago
- Promoted
Senior Azure Data Engineer (Snowflake and ADF)
CoforgeHyderabad, India We are Hiring : Senior Azure Data Engineer (Snowflake and ADF) at Coforge Ltd.Job Location : Greater Noida, Pune & Hyderabad Only.
Experience Required : 5 to 7 Years.Senior Azure Data Engineer to join ...Show moreLast updated: 17 days ago
- Promoted
Azure Databricks Engineer
TechMantra GlobalHyderabad Role : Azure Databricks.Location : Any Hyderabad, Chennai , Bangalore , Pune , Noida, Gurgaon are preferred.Skills : Azure, Notebooks, Spark-Scala, Bigdata, Cloudera P...Show moreLast updated: 30+ days ago
- Promoted
AWS Senior Data Engineer
Tata Consultancy ServicesHyderabad, Telangana, India Snowflake, dbt, Snowpipe, AWS services : AWS Lambda, Managed Airflow (MWAA),.Interview Date : Weekend InPerson Drive 18-Oct-25.
Experience Range : 10 to 15 yrs.Location of Requirement- Hyderabad.Follow...Show moreLast updated: 17 days ago