Overall 10 years of experience in Industry including 6+Years of experience as developer using Databricks / Spark Ecosystems.
Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL.
Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Manage Clusters In Databricks, Managing the Machine Learning Lifecycle
Hands on experience Data extraction(extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load)
TECHNICAL SKILLS
Spark Data Frame API
Python for Data Science
Spark Programming
SQL for Data Analysis
Simplify Data analysis With Python
Manage Clusters Databricks
Databrick Administration
Data Extraction and Transformation and Load
Implementing Partitioning and Programming with MapReduce
Setting up Azure Databricks Account
Linux Command
What you'll be doing :
Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into the customer usage patterns.
Extract Transform and Load data from sources Systems to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks
Develop Spark applications using pyspark and spark SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data uncover insight into the customer usage patterns
Hands on experience on developing SQL Scripts for automation
R esponsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster
Ability to apply the spark DataFrame API to complete Data manipulation within spark session
Good understanding of Spark Architecture including spark core, spark SQL , DataFrame, Spark streaming, Driver Node, Worker Node, Stages, Executors and Tasks, Deployment modes, the Execution hierarchy, fault tolerance, and collection
Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
Contribute to the growth of the Microsoft Azure practice by helping with solutioning for prospects
Problem-solving skills along with good interpersonal & communication skills
Self-starter who can pick up any other relevant Azure Services in the Analytics space
Location :
IN-KA-Bangalore, India (SKAV Seethalakshmi) GESC
Time Type : Full time
Job Category :
Information Technology
Create a job alert for this search
Engineer • Vijayanagar, Karnataka, India
Related jobs
Promoted
Visionet Systems - BI Reporting Support Lead - Qlik Sense / View
Visionet Systems Private Limited.Bangalore
Key Responsibilities : - Lead and support enterprise BI reporting platforms including Qlik Sense, QlikView, and Tableau dashboards.
Manage a 24x7 support environment w...Show moreLast updated: 30+ days ago
Promoted
Reporting Analyst
Korn FerryBengaluru, Karnataka, India
We are looking for a detail-oriented.The ideal candidate will have expertise in.This role requires someone who is highly analytical, has strong stakeholder management skills, and thrives in a.Devel...Show moreLast updated: 6 days ago
Senior Manager - Reporting and BI
DataZymes Analytics Pvt. Ltd.Bangalore, KA, in
Quick Apply
Team Leadership & Development : .Lead, mentor, and manage a team of analysts, BI developers, and reporting specialists.Foster a high-performance culture and support professional growth within the...Show moreLast updated: 19 days ago
Promoted
Senior Power BI Engineer
VSHR UNNATI LLPBangalore
We are seeking an experienced Senior PowerBI Engineer to design, develop, and maintain advanced business intelligence solutions.
The ideal candidate will have extensive expertise in PowerBI, data vi...Show moreLast updated: 2 days ago
Promoted
Business Intelligence Lead - DAX Power BI
Talent SocioBangalore
Responsibilities : - Lead, mentor, and grow a team of Data Analysts and Power BI Developers.Set clear performance metrics and foster a culture of i...Show moreLast updated: 30+ days ago
Promoted
Power BI Developer - Data Analytics
Live ConnectionsBangalore
Role : PowerBI Report Developer Are you a data-driven professional with strong skills in PowerBI, analytics, and reporting? Join our Cor...Show moreLast updated: 24 days ago
Promoted
Azure BI and Data Engineer with Fabric and Power BI
HTC Global ServicesBangalore, IN
The Senior Business Intelligence (BI) & Data Engineer is responsible for the design, development, and delivery of business intelligence and data solutions.
This role ensures robust data architecture...Show moreLast updated: 26 days ago
Promoted
ETL / Business Intelligence Developer - Power BI
TeamWare SolutionsBangalore
Location : Bangalore - Work from office Notice Period : Immediate to Serving notice period only.We are seeking a highly skilled and experienced ETL...Show moreLast updated: 30+ days ago
Promoted
Senior Power BI Engineer
East VantageBangalore
Position : Senior PowerBI Engineer Location : Bangalore, India Job Type : Full-time &...Show moreLast updated: 2 days ago
Promoted
Data Steward - SQL / Power BI
Indpro.ioBangalore
Job Title : Data Steward Experience : 2 - 5 Years Industry : Banking / Financial the Role : < / ...Show moreLast updated: 24 days ago
Promoted
Thoucentric - BI Architect - Generative AI
Thoucentric Technology Pvt. Ltd.Bangalore
Job Type : To be filled by the operations team (Value from feed- Full time ) Industry : To be filled by the operations team (default is set as IT) ...Show moreLast updated: 30+ days ago
Promoted
Power BI & SQL Engineer
BACKFILLS HUMAN RESOURCESBangalore
Lead Power BI Architect Role Overview : We're looking for a highly skilled and experienced Power BI Architect to lead the...Show moreLast updated: 30+ days ago
Promoted
Reporting Leader (Big Data / MES)
Tata ElectronicsKolar, Karnataka, India
Power BI, Tableau, and Grafana.Deliver multiple output format reports meeting OSAT customer needs.Develop portals for internal and external users to access reports with right level of access contro...Show moreLast updated: 11 days ago
Promoted
New!
Infiniti Research - BI Consultant - Data Analytics
Infiniti ResearchBangalore
Key Responsibilities : - Serve as a trusted BI consultant to clients by understanding business requirements and developing innovative visualizatio...Show moreLast updated: 16 hours ago
Promoted
YASH Technologies - Senior Power BI Developer- Report & Dashboard Design
YASH TechnologiesBangalore
Senior Power BI developer Skills Required : - Power BI.Job Description : ...Show moreLast updated: 30+ days ago
Promoted
Domo BI - Analyst
EXLBengaluru, IN
We are looking for a talented Data Engineer with expertise in SAS and Google Cloud Platform (GCP) to join our team.The ideal candidate will have a strong background in the Credit Risk domain and wi...Show moreLast updated: 30+ days ago
Promoted
Power BI & SSAS Developer - DAX Power BI / SQL / ETL
bixware technologies pvt ltdBangalore
Position : Power BI & SSAS Developer Location : Bangalore (Onsite) Experience : 3+ Years &...Show moreLast updated: 13 days ago
Promoted
Associate Engineer III - Power BI [T500-20320]
lululemonBengaluru, Karnataka, India
Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well.We owe our success...Show moreLast updated: 11 days ago
Promoted
Sigmoid Analytics - Analytics Director - BI Solutions
ASTAR DATA LLPBangalore
Job Description : This role will be a leadership position in the data science group at Sigmoid.An ideal person will come from a services in...Show moreLast updated: 17 days ago
Promoted
Analytics Manager - SQL / Power BI
Talent SocioBangalore
About the Role : We are seeking an experienced BI / Analytics Manager with strong expertise in SQL and Power BI to lead our business intelligence initiatives.The ideal ...Show moreLast updated: 8 days ago