Sr.Azure Data EngineerPersistent Systems • Thrissur, IN

No longer accepting applications

Sr.Azure Data Engineer

Persistent Systems • Thrissur, IN

7 days ago

Job description

About Position :

We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.

Role : Sr. Azure Data Engineer
Location : Pune / Bangalore
Experience : 5 to 8 years
Job Type : Full Time Employment

What You'll Do :

Design and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies.

Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows.

Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage.

Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes.

Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables.

Monitor pipeline performance, troubleshoot issues, and provide regular status updates.

Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort.

Expertise You'll Bring :

Around 5 to 8 years of experience in Databricks and Azure cloud Data migration

Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta lake) on MS Fabric or Databricks.

Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management.

Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications.

Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.

Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.

Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation.

Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Data Engineer • Thrissur, IN

Related jobs

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • Thrissur, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 7 days ago • Promoted

Data Engineer

Digitalzone • Thrissur, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 21 days ago • Promoted

Data Engineer

Grassdoor • Palakkad, IN

At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Center which provides seamless, technology-driven solutions.Our platform is built to ...Show more

Last updated: 11 hours ago • Promoted • New!

Senior Data Engineer

VRIZE • Malappuram, IN

Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more

Last updated: 11 hours ago • Promoted • New!

AWS Data Engineer

Vista Applied Solutions Group Inc • Thrissur, IN

Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more

Last updated: 7 days ago • Promoted

Senior Snowflake Data Engineer

Luxoft • thrissur, kerala, in

We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more

Last updated: 1 day ago • Promoted

Senior Data Engineer

Donyati • Palakkad, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more

Last updated: 7 days ago • Promoted

Senior Data Engineer

SAIVA AI • Palakkad, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Insight Global • Malappuram, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Tata Consultancy Services • Thrissur, IN

Role : Databricks Senior Developer.Required Technical Skill Set : Databricks, Spark and Data Migration experience.Desired Competencies (Technical / Behavioral Competency). Databricks, Spark and Data M...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Recro • Malappuram, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Mindlance • Malappuram, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more

Last updated: 5 days ago • Promoted

Data Engineer

BayOne Solutions • Palakkad, IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

System Soft Technologies • Thrissur, IN

Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more

Last updated: 1 day ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Malappuram, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 13 days ago • Promoted

Data Engineer

MyData Insights Pvt Ltd • Palakkad, IN

The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more

Last updated: 5 days ago • Promoted

Senior Data Engineer

DataOrbit AI • Malappuram, IN

DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more

Last updated: 2 days ago • Promoted

Azure Data Services Engineer - MS Fabric - Contract

Gravity Infosolutions, Inc. • Palakkad, IN

Position : Azure Data Engineer – Microsoft Fabric.We are looking for an experienced.The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and busi...Show more

Last updated: 21 days ago • Promoted