This job offer is not available in your country.

Senior Data Engineer

ImpetusBangalore Urban, Karnataka, India

30+ days ago

Job description

Qualifications :

4-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
Good hands-on experience of python and Bash Scripts
Good understanding of SQL and data warehouse concepts
Strong analytical, problem-solving, data analysis and research skills
Demonstrable ability to think outside of the box and not be dependent on readily available tools
Excellent communication, presentation and interpersonal skills are a must

Good to have :

Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. IAM, Glue, EMR, RedShift, S3, Kinesis)

Orchestration with Airflow and Any job scheduler experience

Experience in migrating workload from on-premises to cloud and cloud to cloud migrations

Roles & Responsibilities

Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.

Perform integration testing of different created pipeline in AWS env.

Provide estimates for development, testing & deployments on different env.

Participate in code peer reviews to ensure our applications comply with best practices.

Create cost effective AWS pipeline with required AWS services i.e S3,IAM, Glue, EMR, Redshift etc.

Create a job alert for this search

Senior Data Engineer • Bangalore Urban, Karnataka, India

Related jobs

Promoted

Senior Data Engineer

Tredence Inc.Bengaluru, Karnataka, India

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies acros...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

CybleBengaluru, Karnataka, India

We are a fast-growing technology company building scalable, data-driven solutions across multiple domains.Our teams leverage modern pipelines, cloud-native infrastructure, and advanced analytics to...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

MastekBengaluru, Karnataka, India

Role : Data Engineer – Databricks.We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer

Grid DynamicsBengaluru, Karnataka, India

Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

InfogainBengaluru, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Senior Big Data Engineer

Veltrishosur, tamil nadu, in

Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago

Promoted

Senior Data Engineer

EXLBengaluru, IN

We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago

Promoted

Senior Data Engineer

Saras Analyticsbangalore, karnataka, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

Prudent Technologies and Consulting, Inc.bangalore, karnataka, in

Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Otomeyt AIhosur, tamil nadu, in

We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer

DeltacubesBangalore, IN

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago

Promoted

Senior Data Engineer

BrightEdgeBangalore, IN

BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Recrobangalore, karnataka, in

Create and maintain optimal data pipeline architecture.Create and maintain events / streaming based architecture / design. Identify, design, and implement internal process improvements : automating manua...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SMC Squared IndiaBengaluru, Karnataka, India

This position is responsible for the design, development, and deployment of extraction, transformation, and load (ETL) processes and methodologies to satisfy corporate data movements across various...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

CESBengaluru, IN

As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 5 days ago

Promoted

Senior Data Engineer

Eagle Eye NetworksBengaluru, Karnataka, India

Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more efficient and...Show moreLast updated: 7 days ago

Promoted

Senior Data Engineer

Publicis ProductionBengaluru, Karnataka, India

We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show moreLast updated: 20 days ago

Promoted
New!

Senior Data Engineer

Net Zero Insightshosur, tamil nadu, in

Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: less than 1 hour ago

Promoted

Senior Data Engineer

SG AnalyticsBengaluru, Karnataka, India

The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficie...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

EvolentBengaluru, IN

Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago