Data Engineer - Business IntelligenceAVE QUEST • Noida

Data Engineer - Business Intelligence

AVE QUEST • Noida

30+ days ago

Job description

Description :

In this role, we are seeking a data engineer to design, implement, and optimize cloud-based

data pipelines using Microsoft Azure services including ADF, Synapse, and :

Collaborate with our business analytics and data science teams, gathering requirements and

delivering complete business intelligence solutions

Mentor junior software developers and build a strong team

Model data and metadata to support discovery, ad-hoc, and pre-built reporting

Design and implement data pipelines using Hadoop, Spark, and Azure services such as Blob Storage, SQL Database, Event Hubs, Data Factory, Synapse Analytics, and Databricks

Should be able to write Programs & Scripting, Strong in SQL, Proficiency in Python or Scala.

Experience with PowerShell or Azure CLI for automation is a plus

Partner with security, privacy, and legal teams to deliver solutions that comply with security and privacy policies

Own the design, development, and maintenance of datasets our business analytics teams will use to drive key business decisions

Develop and promote standard methodologies in data engineering, including scalability,

reusability, maintainability, and usability

Tune and ensure compute performance by optimizing queries, databases, files, tables, Ensure data and report service level agreements are met

Analyze and solve problems at their root, stepping back to understand the broader context

Own continuous engineering operational excellence of the datasets that drive key business decisions

Learn and understand a broad range of data resources and know when, how, and which to use and which not to use

Keep up to date with advances in big data technologies and run pilots to design the data

architecture to scale with increased data volume using Azure

Continually improve ongoing reporting and analysis processes, automating or simplifying

self-service support for datasets

Triage many possible courses of action in a high-ambiguity environment, making use of both

quantitative analysis and business we seek in you! : Qualifications / Skills :

Bachelors degree in computer science or related technical field

10+ years of experience in data architecture and business intelligence

5+ years of experience in developing solutions in distributed technologies such as Hadoop, Spark

Experience in delivering end-to-end solutions using Azure services Blob Storage, SQL Database, Event Hubs, Data Factory, Synapse Analytics, and HDInsight

Experience in programming using Python, Java, or Scala

Expert in data modeling, metadata management, and data quality

SQL performance tuning

Strong interpersonal and multitasking skills with the ability to balance competing priorities

Excellent communication (verbal and written) and interpersonal skills and an ability to effectively communicate with both business and technical teams

An ability to work in a fast-paced ambiguous environment where continuous innovation is occurring

Experience with a business intelligence reporting Qualifications / Skills :

Experience with Databricks for advanced analytics and data processing

Understanding of well-architected data pipeline designs

Expertise in monitoring and fault-tolerant pipeline designs

Knowledge of cluster configuration for optimal performance

Ability to create cost-optimal solutions

Experience in exploratory data analysis (dashboarding, plotting) using machine learning technologies and algorithms is desirable

Good knowledge of standard machine learning techniques (like regression, classification, anomaly detection, forecasting) by using standard machine learning libraries part of Spark, Python is desirable

Prior experience in gen AI and related tools and techniques (such as large language models, prompt engineering) is desirable

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Noida

Related jobs

Data Engineer (Pyspark)_ Investment Banking

Atyeti Inc • Delhi, India

Background : This position will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform at Bank. Build and maintain all facets of Data P...Show more

Last updated: 11 days ago • Promoted

Data Engineer

Technogen India Pvt. Ltd. • Delhi, India

The Impact : Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset. Executes and provides feedback for data modeling ...Show more

Last updated: 21 days ago • Promoted

AWS Data Engineer

ACL Digital • Delhi, India

We have urgent openings for AWS Data Engineer.We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and support of ETL / ELT pipelines in a cloud-b...Show more

Last updated: 9 days ago • Promoted

Data Engineer

Amicon Hub Services • Noida, Uttar Pradesh, India

Last updated: 15 days ago • Promoted

Business Intelligence Analyst

Brainware Ventures • delhi, delhi, in

We’re Hiring : BI Analyst (GTM / Sales Analytics).GTM event data (emails, calls, sequences, SMS, LinkedIn tasks, SDR activity, meetings, AI call outcomes) into dashboards that drive revenue for our ...Show more

Last updated: 1 day ago • Promoted

Data Engineer II - Power BI [T500-21406]

ADM • Delhi, India

About ADM : We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transformin...Show more

Last updated: 14 days ago • Promoted

Oracle Business Intelligence & Data Engineer

NAKS Digital Consulting • Delhi, India

Oracle Business Intelligence & Data Engineer Type : .Contract-based role for 1 year Experience : 3+years of experience in Oracle and Microsoft data integration and BI technologies.Location : Hyderabad...Show more

Last updated: 14 days ago • Promoted

AWS Data Engineer

Emids • Delhi, India

We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more

Last updated: 20 hours ago • Promoted • New!

AWS Data Engineer

LTIMindtree • Delhi, India

Greetings from LTIMindtree !!!.We are really impressed by your AWS experience.We are having multiple opportunities and projects which are based on AWS, Glue, Lamda. I’d love to tell you a little mor...Show more

Last updated: 2 days ago • Promoted

Data Engineer

Selector • Delhi, India

About Us Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimens...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Capgemini Invent • Delhi, India

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more

Last updated: 6 days ago • Promoted

Business Intelligence Analyst

Outsourced Pro Global • Delhi, India

We are seeking a detail-oriented and analytical Business Intelligence Analyst with at least 3 years of experience in transforming data into meaningful insights. The ideal candidate will have a stron...Show more

Last updated: 2 days ago • Promoted

Business Intelligence Engineer

Tata Consultancy Services • Delhi, India

Role • • : Business Intelligence Engineer Required Technical Skill Set : Business Intelligence Engineer Desired Experience Range : 7 - 10 yrs Notice Period : Immediate to 90Days only Location of Requirem...Show more

Last updated: 30+ days ago • Promoted

Business Intelligence Developer

InfoCepts • new delhi, delhi, in

Analytics Developer (Power BI).We are seeking a highly skilled and experienced Senior Power BI Developer with 7+ years of experience to join our analytics team. The ideal candidate will possess deep...Show more

Last updated: 13 days ago • Promoted

AWS Data Engineer

Ignisov Consulting Services • Delhi, India

Job Location : Bangalore (Work from Office).AWS Snowflake, Python, Pyspark.Support pipeline buildout, implementation, and RFC deployments for new business use cases - Assignment group / project repo s...Show more

Last updated: 2 days ago • Promoted

Data Engineer

Digitalzone • Ghaziabad, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 22 days ago • Promoted

Business Intelligence Developer

Insight Global • ghaziabad, uttar pradesh, in

Accepting immediate joiners only •.Implement automation scripts using.Collaborate cross-functionally to present data insights to stakeholders and support business objectives.Excellent communication ...Show more

Last updated: 18 days ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Ghaziabad, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 14 days ago • Promoted