Data Engineering Sr. Analyst

ConfidentialBengaluru / Bangalore

30+ days ago

Job description

Key Responsibilities :

Data Pipeline Development :

Design, develop, and implement scalable, efficient data pipelines to ingest, transform, and load data from various sources (e.g., databases, flat files, APIs, cloud services).

Work with ETL tools (e.g., Apache Spark , Talend , Informatica ) to extract, transform, and load data into the organization's data warehouse or data lake.

Optimize data pipelines for speed, scalability, and cost-efficiency, ensuring that they can handle large volumes of data.

Data Architecture & Design :

Collaborate with data architects and engineers to design and implement data storage solutions (e.g., data lakes , data warehouses , NoSQL databases ) that support business intelligence and data analytics.

Create and maintain data models , schemas , and data dictionaries to ensure data consistency and integrity across different systems.

Ensure the application of best practices for data governance , including data quality , metadata management , and data security .

Data Integration :

Integrate diverse datasets from internal and external sources (e.g., third-party APIs, cloud-based systems) into the data environment, ensuring compatibility and consistency.

Develop and maintain automated data integration workflows , ensuring smooth and reliable movement of data between systems.

Perform data cleansing and transformation to ensure high-quality data for reporting, analysis, and decision-making.

Big Data & Cloud Solutions :

Work with cloud data platforms (e.g., AWS Redshift , Azure Synapse Analytics , Google BigQuery ) to build scalable and efficient data storage solutions.

Implement big data technologies such as Hadoop , Spark , and Kafka to handle large datasets and enable real-time data processing.

Optimize and manage cloud-based data services for optimal performance, scalability, and cost-effectiveness.

Collaboration & Cross-functional Support :

Collaborate with data scientists, business analysts, and other stakeholders to understand their data requirements and deliver solutions that meet business needs.

Provide technical support to data analysts and data scientists, ensuring they have the data and tools needed to perform their tasks efficiently.

Work closely with stakeholders to translate business requirements into technical specifications and data solutions.

Data Quality & Performance Monitoring :

Monitor and maintain data pipeline performance, troubleshoot issues, and resolve any data quality issues to ensure high data accuracy and reliability.

Implement monitoring and alerting solutions to track pipeline performance and data quality, ensuring proactive issue resolution.

Conduct regular performance tuning and optimization of data systems and queries to enhance speed and efficiency.

Documentation & Reporting :

Create and maintain technical documentation for data pipelines, architecture, and processes, ensuring that they are clear, concise, and accessible to the team.

Develop reports and dashboards to communicate data quality, pipeline status, and other key metrics to stakeholders and management.

Ensure that all data work is thoroughly documented and adheres to compliance and data governance policies.

Required Qualifications :

Bachelor's degree in Computer Science , Engineering , Information Systems , or a related field.

3-5 years of experience in data engineering , data architecture , or related fields.

Proficiency in SQL , including the ability to write complex queries and optimize query performance.

Experience with ETL tools such as Apache Spark , Talend , Informatica , or custom ETL frameworks.

Strong knowledge of big data technologies like Hadoop , Kafka , Spark , or Flume .

Familiarity with cloud platforms such as AWS , Azure , or Google Cloud Platform , particularly for data storage and processing solutions.

Experience with data warehousing solutions such as Redshift , Snowflake , or BigQuery .

Understanding of data integration , data modeling , and data governance best practices.

Strong problem-solving skills with the ability to troubleshoot data issues and optimize systems for performance.

Skills Required

Apache Spark, Talend, Informatica, Api, Data Security

Create a job alert for this search

Sr Data Analyst • Bengaluru / Bangalore

Related jobs

Promoted

Sr Data Engineer

Accion LabsBengaluru, Karnataka, India

Data Engineer / Data Analyst (Hybrid Role).Data Analysis : Python, Pandas, NumPy, Strong SQL, EDA techniques, Data Visualization Tools, Statistical Knowledge. Data Engineering : SQL, ETL pipelines, Ai...Show moreLast updated: 27 days ago

Sr Analyst- Cloud Engineering

ScaleneWorksBengaluru, Karnataka, India

Quick Apply

Administration and troubleshooting of mixed environment (On-prem & Cloud (Azure / AWS).Responsible for handling escalated incidents and High Availability environment incident Management on UNIX P...Show moreLast updated: 30+ days ago

Promoted

Sr Analyst II Software Engineering

ConfidentialBengaluru / Bangalore

Develop and maintain backend services using.Java, Spring Boot, and Spring Framework.NoSQL / SQL databases, including schema design, performance tuning, and indexing strategies.Optimize application pe...Show moreLast updated: 30+ days ago

Promoted

Engineer II - Data Engineering [T500-20333]

lululemonbangalore, India

Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well.We owe our success...Show moreLast updated: 2 days ago

Promoted

Sr Advanced Data Analyst

ConfidentialBengaluru / Bangalore

Analyze large datasets and provide insights to improve operational efficiency.Develop and implement data analytics strategies to drive continuous improvement. Collaborate with cross-functional teams...Show moreLast updated: 30+ days ago

Sr Analyst- Software Engineering

ScaleneWorksBengaluru, Karnataka, India

Quick Apply

Codes, tests, debugs, implements, and documents programs.Assists in the modification of company products and / or customer / internal systems to meet the needs of the client and / or end-user.Gathers inf...Show moreLast updated: 30+ days ago

Promoted

Data Analyst

DIGITAL HARBOR, Inc.bangalore, karnataka, in

Know Your Customer’ (KYC) in its credit.Its oeuvre, for last 20 years, is marked with disruptive platforms and products that have transformed the way enterprises operate. Its current focus is on a f...Show moreLast updated: 30+ days ago

Promoted

Data Engineering Role

100x.inchosur, India

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 2 days ago

Promoted

Data Analyst

Anlage Infotech (India) P LtdBangalore Rural, Karnataka, India

We're Hiring for a leading Chemical Manufacturing company.Role : Assistant Manager – BI & Data Analysis.Below 8 yrs of exp, pls don't apply). Lead the design, development, and governance of enterpris...Show moreLast updated: 9 days ago

Promoted

Engineering Manager - Data Platform

Coinbasehosur, tamil nadu, in

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 2 days ago

Promoted

Data Engineering Azure databricks

EXLhosur, tamil nadu, in

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 24 days ago

Sr Analyst -Software Engineering

ScaleneWorksBengaluru, Karnataka, India

Quick Apply

Promoted

Engineering Data Analyst

ConfidentialBengaluru / Bangalore

Create and enforce Standard , Specific Design parts for effective data management.Formulate techniques for quality data collection to ensure adequacy, accuracy and legitimacy of data.Devise and imp...Show moreLast updated: 30+ days ago

Promoted

Senior Data Integration Engineer

Indsafrihosur, tamil nadu, in

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 8 days ago

Promoted

Sr. Data Analyst (Data Science)

ConfidentialBengaluru / Bangalore

Seeking a skilled Data Scientist with expertise in Natural Language Processing (NLP), Large Language Models (LLMs), Python, and AWS to develop, deploy, and optimize machine learning models for proc...Show moreLast updated: 30+ days ago

Promoted

Sr. Data Analyst

ConfidentialBengaluru / Bangalore

Minimum 3+ years of relevant work experience with a proven track record of designing, developing and deploying analytics solutions in commercial setting. Proficiency in Python & SQL (must) - 3+ yrs....Show moreLast updated: 30+ days ago

Promoted

Sr. Data Management Analyst

ConfidentialBengaluru / Bangalore

Oversee data model development projects from initiation to completion, ensuring successful execution.Define project requirements with cross-functional teams, and develop comprehensive project plans...Show moreLast updated: 30+ days ago

Data Engineering

Acesoft Labs India PvtBangalore, KA, India

Quick Apply

Job Summary (List Format) Engineer II, Technology | Data & Analytics - Design, build, and maintain scalable data pipelines to process structured, semi-str...Show moreLast updated: 3 days ago