Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

ALIQAN TechnologiesPune, Maharashtra, India
14 hours ago
Job description

Job Responsibilities :

Responsible for designing, developing, and maintaining data pipelines and ETL processes

using Databricks and Azure Data Factory.

Good experience in using SQL, Python and Spark within Databricks notebooks for data

processing and transformations.

Integrate and orchestrate data from various sources, ensuring data quality and accuracy.

Build reusable rules for Data Quality and required transformations.

Optimize, monitor data pipelines for performance and scalability and debug in case of issues.

Proficiency in Databricks, Azure Data Factory, Python, SQL is must.

Familiarity with ETL principles, data warehousing, and big data technologies.

Evaluate and define technical specs using BRD for BI and DW solutions.

Build conceptual and logical models based on the functional flow of business in scalable way.

Work with Business functions / leadership and Application SMEs to understand the

requirement and analysing the source to fulfil the requirements.

Be compliant to data quality, governance, compliance, and other legal requirements.

Act as key P.O.C between data analyst, data scientists, and the business / application teams.

Must have Azure Databricks experience & Data Integrations.

Good work experience on Data bricks, ADF, and other Azure and Databricks objects.

Experience on creating frameworks towards building the optimized data pipelines is a must.

Working knowledge of different self-hosted and other runtimes along with SSIS.

Strong work experience of SQL, Scala, Python and Spark.

Performance Tuning of Spark SQL running on DELTA LAKE storage and Strong Knowledge on

Databricks and Cluster Configurations.

Working knowledge of Data Warehousing, Modelling, Data Validation, Data Migration.

Documentation of all project resources and follow best practices for development.

Knowledge of front-end tools like Qlik Sense, MS PBI

Minimum bachelors degree in computer science or related field is required.

Strong problem-solving skills, good communication abilities and go-getter attitude.

Create a job alert for this search

Data Engineer • Pune, Maharashtra, India

Related jobs
  • Promoted
  • New!
Data Engineer

Data Engineer

Cummins Inc.Pune, Maharashtra, India
Supports, develops and maintains a data and analytics platform.Effectively and efficiently process, store and make data available to analysts and other consumers. Works with the Business and IT team...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

Orion InnovationPune, Maharashtra, India
Orion Innovation is a premier, award-winning, global business and technology services firm.Orion delivers game-changing business transformation and product development rooted in digital strategy, e...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

AccenturePune, Maharashtra, India
Design, develop and maintain data solutions for data generation, collection, and processing.Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to ...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer-AWS

Data Engineer-AWS

Crazy SolutionsPune, Maharashtra, India
Design, develop, and maintain scalable and efficient data pipelines using industry-standard tools and technologies.Design, implement, and optimize complex SQL queries to extract, transform, and loa...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

Artefactmaharashtra, india, Maharashtra, India
Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire ...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

FractalPune, Maharashtra, India
It's fun to work in a company where people truly BELIEVE in what they are doing!.If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using ...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

Northern Trust CorporationPune, Maharashtra, India
Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative f...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

Screen Magic Mobile Media Pvt LtdPune, Maharashtra, India
Job Title : Data Engineer – Workflow Automation & Analytics.We are seeking a technically strong and highly analytical Data Engineer to join our onsite team. This role demands hands-on expertise in wo...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Lead Data Engineer

Lead Data Engineer

EpamPune, Maharashtra, India
EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

WissenPune, Maharashtra, India
Wissen Technology is Hiring for.At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

SnowflakePune, Maharashtra, India
Data Infrastructure & Pipeline Development.Design, build, and launch production-ready data models and data pipelines that scale effectively. Implement enterprise-grade data governance frameworks and...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer - AS

Data Engineer - AS

Deutsche BankPune, Maharashtra, India
Role is an Data Engineer to manage the databases / data warehouses / data marts within the Asset Management Fund Accounting / Investment Business. Has good understanding of Bafin / FCA / BundesBank regulator...Show moreLast updated: 15 hours ago
  • Promoted
  • New!
Snowflake Data Engineer

Snowflake Data Engineer

Saaki Argus & Averil ConsultingPune, Maharashtra, India
AI-driven Digital Engineering company.In this role, you will design and implement cutting-edge data platforms, leveraging. AI and business intelligence needs.Architect, develop, and maintain efficie...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

The Lubrizol CorporationPune, Maharashtra, India
We value diversity in professional backgrounds and life experiences.By enabling a consistent, unbiased, and transparent recruitment process, Lubrizol seeks to create a positive experience for candi...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

HARMAN InternationalPune, Maharashtra, India
HARMAN’s engineers and designers are creative, purposeful and agile.As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the c...Show moreLast updated: 15 hours ago
  • Promoted
  • New!
AWS Data Engineer

AWS Data Engineer

Techno WisePune, Maharashtra, India
Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics re...Show moreLast updated: 15 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

NetlinkPune, Maharashtra, India
Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.Work closely with data scientists, analysts, and other engineers to ensure smooth da...Show moreLast updated: 14 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

Talent WorxPune, Maharashtra, India
We are looking for an experienced and talented Data Engineer- Databricks to join our growing data engineering team.Role : Data Engineer- Databricks. Job Type : Full Time Employment.Design and maintain...Show moreLast updated: 14 hours ago