Talent.com
Senior Data Engineer
Senior Data EngineerArcana • Greater Bengaluru Area, India
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

Arcana • Greater Bengaluru Area, India
7 days ago
Job description

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your proficiency in developing and elevating compute and I / O-intensive applications but also ensures their peak performance and unwavering reliability.

Responsibilities :

  • Develop and implement real-time data ingestion and processing systems.
  • Design, build, and operationalize large-scale enterprise data solutions and applications.
  • Create and manage production data pipelines, from ingestion to consumption, within a big data architecture using PySpark.
  • Leverage expertise in Python, Airflow, SQL, and cloud platforms to build robust solutions (strong knowledge of these is essential).
  • Translate complex business challenges into scalable and efficient technical solutions.
  • Work collaboratively with a high-performing data engineering team, owning the full lifecycle of solution implementation.

Requirements :

  • Bachelor's Degree in Computer Science, Information Technology, or a similar discipline.
  • 3 - 8 years of professional experience in data engineering or related fields.
  • Proven experience with ETL processes, data integration, and handling large-scale datasets using PySpark.
  • Strong understanding of data engineering concepts like ETL, near / real-time streaming, data structures, and workflow management.
  • Experience with version control tools like Git / GitHub.
  • Proficiency in SQL and Data Warehouse concepts.
  • Experience working with SQL or NoSQL databases like Cassandra, MongoDB, or HBase.
  • Knowledge of AWS technologies such as EMR, RedShift, Kinesis, Lambda, Glue, S3 IAM, CloudWatch, and big data tools like Hadoop / EMR, Hive, and Sqoop.
  • Create a job alert for this search

    Senior Data Engineer • Greater Bengaluru Area, India

    Related jobs
    Senior DAC Architect

    Senior DAC Architect

    Mulya Technologies • Greater Bengaluru Area, India
    About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET nodes, which enable differentiate...Show more
    Last updated: 30+ days ago • Promoted
    Staff Engineer

    Staff Engineer

    MHP – A Porsche Company • Greater Bengaluru Area, India
    Job Title : Staff Engineer – Fullstack.Experience Required : Minimum 12+ years of professional experience.We are seeking an accomplished Staff Engineer with deep expertise in AWS serverless developme...Show more
    Last updated: 25 days ago • Promoted
    Senior Software Development Engineer

    Senior Software Development Engineer

    Trellix • Greater Bengaluru Area, India
    Trellix Intrusion Prevention System (IPS) is a scalable multiprocessor multithreaded platform that processes from 1Gbps to 300Gbps of traffic. Trellix India team drives the road-map covering physica...Show more
    Last updated: 19 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Zingly.ai • Greater Bengaluru Area, India
    Help us reinvent conversations between people and brands.At Zingly, we’re not just building another chatbot—we’re building relationship tech. As a fast-moving, post-seed, pre-Series A startup, our m...Show more
    Last updated: 7 days ago • Promoted
    Senior Technical Recruiter

    Senior Technical Recruiter

    Arcana • Greater Bengaluru Area, India
    Join us at Arcana, where innovation meets impact.We’re building world-class technology teams from the ground up and are looking for passionate people who want to shape the future with us.At Arcana,...Show more
    Last updated: 4 days ago • Promoted
    Human Resources Associate

    Human Resources Associate

    Flexli • Greater Bengaluru Area, India
    Flexli, based in Bangalore, India, is a leading provider of cost-effective warehouse automation solutions.Dedicated to revolutionizing modern-day warehouses, Flexli specializes in high-quality auto...Show more
    Last updated: 1 day ago • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    Luxoft • Greater Bengaluru Area, India
    Our client, a leading manufacturer of high-end household appliances, is expanding into new smart product lines.As part of this strategic initiative, a large-scale global program is being implemente...Show more
    Last updated: 2 days ago • Promoted
    Senior / Principal Software Engineer

    Senior / Principal Software Engineer

    Oracle • Greater Bengaluru Area, India
    An Oracle Database High Availability (HA) team is responsible for designing, implementing, and managing solutions that ensure continuous operation and minimize downtime of Oracle databases.This tea...Show more
    Last updated: 6 days ago • Promoted
    Senior Executive Human Resources

    Senior Executive Human Resources

    Food Whisperer • Greater Bengaluru Area, India
    The Senior HR Recruiter will be responsible for driving end-to-end recruitment for GoKhana, ensuring timely hiring for Operations, Sales, Kitchen, and Support functions. This role requires strong so...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    super.money • Greater Bengaluru Area, India
    About the role - Software Development Engineer - 3.We are all set to take off now and have our eyes set to become the largest lending platform in the next 24 months. We are looking for world class t...Show more
    Last updated: 3 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sonata Software • Greater Bengaluru Area, India
    Location : Bangalore / Hyderabad.Python Developer, PySpark, Spark, Fast API, Cloud, SQL, Spark SQL,.Scala, CI / CD pipelines, Hadoop ecosystem. Good Communication and Interpersonal Skills.Please share t...Show more
    Last updated: 7 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sequoia • Greater Bengaluru Area, India
    For more than 23 years, people-driven companies have turned to Sequoia to grow their people advantage.We know that taking great care of people leads to better business outcomes.Helping our clients ...Show more
    Last updated: 10 days ago • Promoted
    Senior ADC Architect

    Senior ADC Architect

    Mulya Technologies • Greater Bengaluru Area, India
    About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET nodes, which enable differentiate...Show more
    Last updated: 30+ days ago • Promoted
    Senior Serdes Architect

    Senior Serdes Architect

    Mulya Technologies • Greater Bengaluru Area, India
    Senior SerDes Architect and Lead.About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET ...Show more
    Last updated: 30+ days ago • Promoted
    Principal Full-Stack Software Engineer - AI Applications

    Principal Full-Stack Software Engineer - AI Applications

    Mulya Technologies • Greater Bengaluru Area, India
    Principal Full-Stack Software Engineer - AI Applications.Founded in 2023,by Industry veterans HQ in California,US.We are revolutionizing sustainable AI compute through intuitive software with compo...Show more
    Last updated: 30+ days ago • Promoted
    Sr Technical Recruiter- ASIC

    Sr Technical Recruiter- ASIC

    Prodapt ASIC services (Formerly Innovative Logic) • Greater Bengaluru Area, India
    Prodapt is a global technology company and the largest specialized player in the Connectedness industry.As an AI-first strategic partner, Prodapt provides consulting, business transformation, and m...Show more
    Last updated: 30+ days ago • Promoted
    Snowflake Developer

    Snowflake Developer

    Tata Consultancy Services • Greater Bengaluru Area, India
    Job Title : Snowflake Developer.Required Skillset : Snowflake architecture, Snowpipe, data cloning, and time travel, SQL, Data Modeling. Deep understanding of cloud data warehousing and expertise in d...Show more
    Last updated: 30+ days ago • Promoted
    Azure Developer

    Azure Developer

    Tata Consultancy Services • Greater Bengaluru Area, India
    ADF, ADB, SQL, Pyspark, python.Deep Microsoft Azure product knowledge and understanding of product features, with exposure to other cloud solutions (Google, AWS) a plus. Proven track record in desig...Show more
    Last updated: 7 days ago • Promoted