Talent.com
Senior Data Engineer
Senior Data EngineerArcana • Greater Bengaluru Area, India
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

Arcana • Greater Bengaluru Area, India
7 days ago
Job description

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your proficiency in developing and elevating compute and I / O-intensive applications but also ensures their peak performance and unwavering reliability.

Responsibilities :

  • Develop and implement real-time data ingestion and processing systems.
  • Design, build, and operationalize large-scale enterprise data solutions and applications.
  • Create and manage production data pipelines, from ingestion to consumption, within a big data architecture using PySpark.
  • Leverage expertise in Python, Airflow, SQL, and cloud platforms to build robust solutions (strong knowledge of these is essential).
  • Translate complex business challenges into scalable and efficient technical solutions.
  • Work collaboratively with a high-performing data engineering team, owning the full lifecycle of solution implementation.

Requirements :

  • Bachelor's Degree in Computer Science, Information Technology, or a similar discipline.
  • 3 - 8 years of professional experience in data engineering or related fields.
  • Proven experience with ETL processes, data integration, and handling large-scale datasets using PySpark.
  • Strong understanding of data engineering concepts like ETL, near / real-time streaming, data structures, and workflow management.
  • Experience with version control tools like Git / GitHub.
  • Proficiency in SQL and Data Warehouse concepts.
  • Experience working with SQL or NoSQL databases like Cassandra, MongoDB, or HBase.
  • Knowledge of AWS technologies such as EMR, RedShift, Kinesis, Lambda, Glue, S3 IAM, CloudWatch, and big data tools like Hadoop / EMR, Hive, and Sqoop.
  • Create a job alert for this search

    Senior Data Engineer • Greater Bengaluru Area, India

    Related jobs
    Senior DAC Architect

    Senior DAC Architect

    Mulya Technologies • Greater Bengaluru Area, India
    About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET nodes, which enable differentiate...Show more
    Last updated: 30+ days ago • Promoted
    Senior / Principal Software Engineer

    Senior / Principal Software Engineer

    Oracle • Greater Bengaluru Area, India
    An Oracle Database High Availability (HA) team is responsible for designing, implementing, and managing solutions that ensure continuous operation and minimize downtime of Oracle databases.This tea...Show more
    Last updated: 8 days ago • Promoted
    Staff Engineer

    Staff Engineer

    MHP – A Porsche Company • Greater Bengaluru Area, India
    Job Title : Staff Engineer – Fullstack.Experience Required : Minimum 12+ years of professional experience.We are seeking an accomplished Staff Engineer with deep expertise in AWS serverless developme...Show more
    Last updated: 26 days ago • Promoted
    Senior Software Development Engineer

    Senior Software Development Engineer

    Trellix • Greater Bengaluru Area, India
    Trellix Intrusion Prevention System (IPS) is a scalable multiprocessor multithreaded platform that processes from 1Gbps to 300Gbps of traffic. Trellix India team drives the road-map covering physica...Show more
    Last updated: 20 days ago • Promoted
    Senior ADC Architect

    Senior ADC Architect

    Mulya Technologies • Greater Bengaluru Area, India
    About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET nodes, which enable differentiate...Show more
    Last updated: 30+ days ago • Promoted
    K2 Blackpearl developer

    K2 Blackpearl developer

    Brace Infotech Private Ltd • Greater Bengaluru Area, India
    Successfully implemented K2 projects in both developer and lead roles.Strong experience in analysis, design, and development of web / windows-based and n-tier applications across client and server en...Show more
    Last updated: 19 days ago • Promoted
    Principal Full-Stack Software Engineer - AI Applications

    Principal Full-Stack Software Engineer - AI Applications

    Mulya Technologies • Greater Bengaluru Area, India
    Principal Full-Stack Software Engineer - AI Applications.Founded in 2023,by Industry veterans HQ in California,US.We are revolutionizing sustainable AI compute through intuitive software with compo...Show more
    Last updated: 30+ days ago • Promoted
    Tech Lead / Senior Developer – Vision AI

    Tech Lead / Senior Developer – Vision AI

    Tata Electronics • Greater Bengaluru Area, India
    Tata Electronics (a wholly owned subsidiary of Tata Sons Pvt.India’s first AI-enabled state-of-the-art Semiconductor Foundry. This facility will produce chips for applications such as power manageme...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    super.money • Greater Bengaluru Area, India
    About the role - Software Development Engineer - 3.We are all set to take off now and have our eyes set to become the largest lending platform in the next 24 months. We are looking for world class t...Show more
    Last updated: 3 days ago • Promoted
    Data Power Developer

    Data Power Developer

    Brace Infotech Private Ltd • Greater Bengaluru Area, India
    We are seeking a highly motivated and experienced IBM DataPower Developer to join our.The ideal candidate will have at least 4 years of hands-on experience in. XI52 / IDG / X3 appliance or virtual).This...Show more
    Last updated: 26 days ago • Promoted
    GEN AI Sr. Developer

    GEN AI Sr. Developer

    Best Infosystems Ltd. • Greater Bengaluru Area, India
    Developer_Full-time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai. Gen Ai, Azure Open Ai, Python and which are mentions in cheat sheet.Senior ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Developer

    Azure Developer

    Tata Consultancy Services • Greater Bengaluru Area, India
    ADF, ADB, SQL, Pyspark, python.Deep Microsoft Azure product knowledge and understanding of product features, with exposure to other cloud solutions (Google, AWS) a plus. Proven track record in desig...Show more
    Last updated: 8 days ago • Promoted
    Senior Serdes Architect

    Senior Serdes Architect

    Mulya Technologies • Greater Bengaluru Area, India
    Senior SerDes Architect and Lead.About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sonata Software • Greater Bengaluru Area, India
    Location : Bangalore / Hyderabad.Python Developer, PySpark, Spark, Fast API, Cloud, SQL, Spark SQL,.Scala, CI / CD pipelines, Hadoop ecosystem. Good Communication and Interpersonal Skills.Please share t...Show more
    Last updated: 8 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    UsefulBI Corporation • Greater Bengaluru Area, India
    UsefulBI is a leading AI-driven data solutions provider specializing in.We help businesses turn complex data into actionable insights through our innovative products and services.We are looking for...Show more
    Last updated: 25 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sequoia • Greater Bengaluru Area, India
    For more than 23 years, people-driven companies have turned to Sequoia to grow their people advantage.We know that taking great care of people leads to better business outcomes.Helping our clients ...Show more
    Last updated: 11 days ago • Promoted
    Snowflake Developer

    Snowflake Developer

    Tata Consultancy Services • Greater Bengaluru Area, India
    Job Title : Snowflake Developer.Required Skillset : Snowflake architecture, Snowpipe, data cloning, and time travel, SQL, Data Modeling. Deep understanding of cloud data warehousing and expertise in d...Show more
    Last updated: 30+ days ago • Promoted
    Senior DevOps Engineer - Python -Java - TDD - CTC INR 50 L

    Senior DevOps Engineer - Python -Java - TDD - CTC INR 50 L

    CareerXperts Consulting • Greater Bengaluru Area, India
    We are looking for Senior DevOps Engineer with leading solution for personal finance management software organization.Someone who wants to help us redefine the way our customers approach personal f...Show more
    Last updated: 13 days ago • Promoted