Talent.com
Senior Data Engineer

Senior Data Engineer

ArcanaGreater Bengaluru Area, India
Less than 1 hour ago
Job description

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your proficiency in developing and elevating compute and I / O-intensive applications but also ensures their peak performance and unwavering reliability.

Responsibilities :

  • Develop and implement real-time data ingestion and processing systems.
  • Design, build, and operationalize large-scale enterprise data solutions and applications.
  • Create and manage production data pipelines, from ingestion to consumption, within a big data architecture using PySpark.
  • Leverage expertise in Python, Airflow, SQL, and cloud platforms to build robust solutions (strong knowledge of these is essential).
  • Translate complex business challenges into scalable and efficient technical solutions.
  • Work collaboratively with a high-performing data engineering team, owning the full lifecycle of solution implementation.

Requirements :

  • Bachelor's Degree in Computer Science, Information Technology, or a similar discipline.
  • 3 - 8 years of professional experience in data engineering or related fields.
  • Proven experience with ETL processes, data integration, and handling large-scale datasets using PySpark.
  • Strong understanding of data engineering concepts like ETL, near / real-time streaming, data structures, and workflow management.
  • Experience with version control tools like Git / GitHub.
  • Proficiency in SQL and Data Warehouse concepts.
  • Experience working with SQL or NoSQL databases like Cassandra, MongoDB, or HBase.
  • Knowledge of AWS technologies such as EMR, RedShift, Kinesis, Lambda, Glue, S3 IAM, CloudWatch, and big data tools like Hadoop / EMR, Hive, and Sqoop.
  • Create a job alert for this search

    Senior Data Engineer • Greater Bengaluru Area, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaBengaluru, Karnataka, India
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ZluriBengaluru, Karnataka, India
    Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Identity Governance and Administration (IGA) platform that enables IT and security teams to discover identities and applicati...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechBengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CargillBengaluru, Karnataka, India
    The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasury-specific data solutions,...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VeraxionBengaluru, Karnataka, India
    We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Tumkur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasTumkur, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceTumkur, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Relevance LabBengaluru, Karnataka, India
    Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into robust logical and...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AITumkur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI SolutionsTumkur, IN
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL DigitalBengaluru, Karnataka, India
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer - Databricks

    Senior Data Engineer - Databricks

    Tredence Inc.Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CloudwickBengaluru, Karnataka, India
    The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data. The key focus of the position is to b...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Pretium Enterprise Services, IndiaBengaluru, Karnataka, India
    Would be a lead responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects is required. Would collaborate within Agile teams to ...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SutherlandBangalore Urban, Karnataka, India
    Location : Bangalore | Hyderabad | Chennai | Mumbai.If interested please reach out to me with your updated resume @Priti. We’re transforming how we work by harnessing the power of AI, data, and digit...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiTumkur, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansTumkur, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 10 days ago