Solid Hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have
Solid Hands-on experience with Delta Lake House with Delta tables - Must have
Solid Hands-on experience with Data warehousing - Must have
Solid Hands-on experience with Azure Data Factory - Must have
CI / CD Pipelines Integrations - Must have
10+ Years of experience with Data Project
London Insurance market data experience
Responsibilities :
Hand-on experience in Azure dataplatform architecture and developing data engineering pipelines
Experience in working with both SQLand NoSQL databases.
Hand-on experience in developingdata solutions using Azure Data platform tools( Azure data lake gen2,Azure Sql,Azure Data Factory , Mapping Dataflows , Azure Databricks , logic app, AzureSynapse ,Azure Analysis Services and Azure Functions).
Strong knowledge and experience indata lake and delta lake-based data platform development using Azure Databricksand Azure Synapse Analytics .
Strong experience with at least oneof the programming languages : Python, PySpark, Scala, R.
Able to develop CI / CD pipelines forautomated build and deploy
Should be able to contribute totechnical solutions and must be able to translate functional / technical intocode, unit test and deliver to customer
Experience with different databasetechnologies (., SQL database(s), Azure SQL)
Strong Analytical &problem-solving skills
Development, code review, unittesting,
Participation in Agileceremonies
Good communication skill
Insurance knowledge will be addedadvantage
Create a job alert for this search
Big Data Lead • Chennai, Tamil Nadu, India
Related jobs
Promoted
New!
Big Data Lead
VirtusaChennai, Tamil Nadu, India
Big Data Lead - CREQ Description Job Description : .Data Applications using Spark, Sqoop and Hive.Strong knowledge of working with large data sets and high-capacity big data processing platform.Stro...Show moreLast updated: 14 hours ago
Promoted
New!
Big Data Spark Development Vice President
CitiChennai, Tamil Nadu, India
We are seeking a Software / Application Dev Lead Analyst for Global Data Platform team.The successful candidate will interact with development, testing, and production support teams, as well as other...Show moreLast updated: 14 hours ago
Promoted
New!
Big Data Architect / Sr Consultant
Anicalls (Pty) LtdChennai, Tamil Nadu, India
Robust Business Intelligence development experience.Experience with AWS BI Services (QuickSight, EMR, Glue, etc.Aurora, Spark, and MySQL Experience is a Plus.Show moreLast updated: 14 hours ago
Promoted
New!
Senior Big Data Hadoop Engineer
Anicalls (Pty) LtdChennai, Tamil Nadu, India
Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 14 hours ago
Promoted
New!
Cloudera Hadoop Big data
Anicalls (Pty) LtdChennai, Tamil Nadu, India
Experience with Hadoop and the HDFS Ecosystem.Strong Experience with Apache Spark, Storm, Kafka is a must.Experience with Python, R, Pig, Hive, Kafka, Knox, Tomcat and Ambari.A minimum of 4 years w...Show moreLast updated: 14 hours ago
Promoted
New!
Sr. Big Data Engineer
Anicalls (Pty) LtdChennai, Tamil Nadu, India
Superior oral, and written communication skills, as well as the willingness to collaborate across teams of internal and external technical staff, business analysts, software support, and operations...Show moreLast updated: 14 hours ago
Promoted
New!
Big Data Engineer
RiskInsight Consulting Pvt LtdChennai, Tamil Nadu, India
Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, trans...Show moreLast updated: 14 hours ago
Promoted
New!
Lead Big Data Software Engineer
EpamChennai, Tamil Nadu, India
EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 14 hours ago
Promoted
New!
Hadoop Big data engineer
Anicalls (Pty) LtdChennai, Tamil Nadu, India
As an individual contributor, design modules, apply creative problem-solving using tools and technologies.As individual contributor code and test modules.
Interact and collaborate directly with soft...Show moreLast updated: 14 hours ago
Promoted
New!
Lead Data Engineer
Cynosure Corporate SolutionsChennai, Tamil Nadu, India
We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions.The role requires str...Show moreLast updated: 14 hours ago
Promoted
New!
Big Data Engineer
Hexaware TechnologiesChennai, Tamil Nadu, India
Hands on experience working in a public cloud environment and on-prem infrastructure.Specialty on Columnar Databases like.
AWS cloud infrastructure services (Redshift, S3, Lambda).Experience with a ...Show moreLast updated: 14 hours ago
Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 18 days ago
Promoted
New!
Senior Data Engineer (Data Lake)
Anicalls (Pty) LtdChennai, Tamil Nadu, India
Consult with business stakeholders and translate their requirements into analytics and reports on the data lake.Design and implement a data catalog that democratizes data access in a secure way.Dev...Show moreLast updated: 14 hours ago
Promoted
New!
IoT Cloud Data lead
Anicalls (Pty) LtdChennai, Tamil Nadu, India
Experience with Data ingestion patterns.Strong data engineering and consulting experience.Experience with Analytics strategies of IoT data in the cloud.
Knowledge of emerging technologies in Cloud (...Show moreLast updated: 14 hours ago
Promoted
New!
Big Data BI analyst lead
Anicalls (Pty) LtdChennai, Tamil Nadu, India
SQL Server 2014 / 16, Good SQL & ETL skills.Big data skills – Any skills like ADF, Databricks, Spark, Scala,.Ability to make business conclusions from data, connect scenarios & provide solutions.Prio...Show moreLast updated: 14 hours ago
Promoted
New!
Lead - Data Analytics
FreshworksChennai, Tamil Nadu, India
Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives.
To create a better experience for their customers and employees.Softw...Show moreLast updated: 14 hours ago
Promoted
New!
Big Data Lead Engineer — Hadoop, Spark & GCP (BigQuery / DataProc) with Java & Python Expertise
SynechronTaramani, Tamil Nadu, India
Synechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions.
This full-time leadership role involves guiding a team of d...Show moreLast updated: 14 hours ago