Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

Impetusbangalore, karnataka, in
30+ days ago
Job description

About the Organization-

Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.

Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100 enterprises, headquartered in Los Gatos, California, with development centers in NOIDA, Indore, Gurugram, Bengaluru, Pune, and Hyderabad with over 3000 global team members. We also have offices in Canada and Australia and collaborate with a number of established companies, including American Express, Bank of America, Capital One, Toyota, United Airlines, and Verizon.

Locations : Noida / Indore / Pune / Gurugram / Bengaluru

Job Overview :

We are seeking talented and experienced professionals in PySpark, Big Data technologies, and cloud solutions to join our team. The position spans across three levels : Engineer , Module Lead , and Lead Engineer . In these roles, you will be responsible for developing, optimizing, and managing ETL pipelines on cloud and on-premises environments using Big Data tools and AWS services. You will collaborate with cross-functional teams, ensuring that business requirements are met through efficient and scalable data solutions.

Key Responsibilities :

  • ETL Pipeline Development : Design and develop efficient ETL pipelines as per business requirements while adhering to development standards and best practices.
  • AWS Integration & Testing : Perform integration testing on AWS environments and ensure seamless data operations across platforms.
  • Estimation & Planning : Provide estimates for development, testing, and deployments across various environments.
  • Peer Reviews & Best Practices : Participate in code peer reviews, ensuring code quality, adherence to best practices, and promoting continuous improvement within the team.
  • Cost-Effective Solutions : Build and maintain cost-effective pipelines using AWS services like S3, IAM, Glue, EMR, Redshift, etc.
  • Cloud Migrations : Support and manage cloud migrations from on-premise to cloud or between cloud environments.
  • Orchestration & Scheduling : Manage job orchestration with tools like Airflow and any other relevant job scheduler.

Required Skills & Qualifications :

Experience :

  • Engineer Level : 2-5 years of experience with PySpark, Hadoop, Hive, and related Big Data technologies.
  • Module Lead Level : 4-6 years of experience with PySpark, Hadoop, Hive, and related Big Data technologies.
  • Lead Engineer Level : 5-7 years of experience with PySpark, Hadoop, Hive, and related Big Data technologies.
  • Technical Skills :

  • Hands-on experience with PySpark (DataFrame and SparkSQL) , Hadoop , and Hive .
  • Proficiency in Python and Bash scripting .
  • Solid understanding of SQL and data warehouse concepts .
  • Experience with AWS Big Data services (IAM, Glue, EMR, Redshift, S3, Kinesis) is a plus.
  • Experience with Orchestration tools (e.g., Airflow, job schedulers) is beneficial.
  • Analytical & Problem-Solving Skills :
  • Strong analytical, problem-solving, and data analysis skills.
  • Ability to think creatively and implement innovative solutions beyond readily available tools.
  • Communication & Interpersonal Skills :
  • Excellent communication, presentation, and interpersonal skills to collaborate with internal and external teams effectively.
  • Desired Skills & Experience :

  • Experience with migrating workloads between on-premise systems and cloud environments.
  • Familiarity with cloud-native technologies and platforms.
  • Knowledge of performance optimization techniques for distributed data processing.
  • For Quick Response- Interested Candidates can directly share their resume along with the details like Notice Period, Current CTC and Expected CTC at anubhav.pathania@impetus.com

    Create a job alert for this search

    Senior Data Engineer • bangalore, karnataka, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eagle Eye NetworksBengaluru, Karnataka, India
    Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more efficient and...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeBengaluru, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MastekBengaluru, Karnataka, India
    Role : Data Engineer – Databricks.We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticshosur, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesBengaluru, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 17 days ago
    • Promoted
    Senior Engineer Data [T500-20496]

    Senior Engineer Data [T500-20496]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc. Our well-known banners across the United Sta...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.bangalore, karnataka, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CybleBengaluru, Karnataka, India
    We are a fast-growing technology company building scalable, data-driven solutions across multiple domains.Our teams leverage modern pipelines, cloud-native infrastructure, and advanced analytics to...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RecroBengaluru, Karnataka, India
    Role - Data Engineer Experience - 3+ yrs Location - Bangalore Roles and Responsibilities : - Create and maintain optimal data pipeline architecture - Create and maintain events / streaming based a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainBangalore, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESBengaluru, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Grid DynamicsBengaluru, Karnataka, India
    Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.Bengaluru, Karnataka, India
    Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies acros...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SG AnalyticsBengaluru, Karnataka, India
    The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficie...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentBengaluru, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Publicis ProductionBengaluru, Karnataka, India
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show moreLast updated: 21 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iohosur, tamil nadu, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago