This job offer is not available in your country.

Senior Data Engineer

ImpetusBengaluru, Karnataka, India

30+ days ago

Job description

Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune

Immediate Joiners are preferred.

Qualification

4 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
Good hands-on experience of python and Bash Scripts
Good understanding of SQL and data warehouse concepts
Strong analytical, problem-solving, data analysis and research skills
Demonstrable ability to think outside of the box and not be dependent on readily available tools
Excellent communication, presentation and interpersonal skills are a must
Hands-on experience with using Cloud Platform provided Big Data technologies
Orchestration with Airflow and Any job scheduler experience
Experience in migrating workload from on-premises to cloud and cloud to cloud migrations

Roles & Responsibilities

Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.

Perform integration testing of different created pipeline in Cloud env.

Provide estimates for development, testing & deployments on different env.

Participate in code peer reviews to ensure our applications comply with best practices.

Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.

Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.

Writes unit / integration tests, contributes to engineering wiki, and documents work.

Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

Works closely with a team of frontend and backend engineers, product managers, and analysts.

Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.

Designs data integrations and data quality framework.

Mandatory Skills - Any Cloud, Python Programming, SQL, Pyspark

Create a job alert for this search

Senior Data Engineer • Bengaluru, Karnataka, India

Related jobs

Promoted

Senior Data Engineer

BrightEdgeBengaluru, IN

BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

EXLBangalore, IN

We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago

Promoted

Senior Data Engineer

CESBangalore, IN

As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 5 days ago

Promoted

Senior Data Engineer

IGT Solutionshosur, tamil nadu, in

Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

Tredence Inc.Bengaluru, Karnataka, India

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies acros...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

CybleBengaluru, Karnataka, India

We are a fast-growing technology company building scalable, data-driven solutions across multiple domains.Our teams leverage modern pipelines, cloud-native infrastructure, and advanced analytics to...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Grid DynamicsBengaluru, Karnataka, India

Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

InfogainBengaluru, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Saras Analyticshosur, tamil nadu, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 24 days ago

Promoted

Senior Big Data Engineer

Veltrishosur, tamil nadu, in

Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago

Promoted

Senior Data Engineer

Otomeyt AIhosur, tamil nadu, in

We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer

DeltacubesBangalore, IN

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago

Promoted

Senior Data Engineer

Prudent Technologies and Consulting, Inc.bangalore district, karnataka, in

Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Recrobangalore, karnataka, in

Create and maintain optimal data pipeline architecture.Create and maintain events / streaming based architecture / design. Identify, design, and implement internal process improvements : automating manua...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SMC Squared IndiaBengaluru, Karnataka, India

This position is responsible for the design, development, and deployment of extraction, transformation, and load (ETL) processes and methodologies to satisfy corporate data movements across various...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIhosur, tamil nadu, in

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago

Promoted

Senior Data Engineer

Eagle Eye NetworksBengaluru, Karnataka, India

Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more efficient and...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

Publicis ProductionBengaluru, Karnataka, India

We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show moreLast updated: 20 days ago

Promoted

Senior Data Engineer

SG AnalyticsBengaluru, Karnataka, India

The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficie...Show moreLast updated: 5 days ago

Promoted

Senior Data Engineer

EvolentBengaluru, IN

Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago