Talent.com
Data Engineer
Data EngineerVeca Consulting Pvt Ltd • Bangalore (division)
Data Engineer

Data Engineer

Veca Consulting Pvt Ltd • Bangalore (division)
19 hours ago
Job description

Role Name : Data Engineer

Experience : 3+ Years

Location : Bangalore(No relocation)

Notice Period : 20-30 days(who are currently serving)

Mode : Hybrid

Type : Fulltime

Job Description :

As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.

Key Responsibilities

  • Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
  • Implement data ETL processes for batch and streaming analytics requirements.
  • Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
  • Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
  • Ensure data security, integrity, and compliance throughout the infrastructure.
  • Maintain documentation and contribute to architecture reviews.
  • Participate in incident response and operational excellence initiatives for the data warehouse.
  • Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.

Required Skills and Experience

  • Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL.
  • Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
  • Proven ability to design and implement automated data pipelines and materialized views.
  • Proficiency in Python, Unix or similar languages.
  • Good understanding of SQL oracle, SQL server or similar languages.
  • Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions).
  • Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code.
  • 5+ years of directly applicable experience
  • BS in Computer Science, Engineering, or equivalent experience.
  • Create a job alert for this search

    Data Engineer • Bangalore (division)

    Related jobs
    Data Engineer I [T500-21304]

    Data Engineer I [T500-21304]

    ADM • Bangalore (division)
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    HashedIn by Deloitte • Bangalore (division)
    Bengaluru, Kolkata, Hyderabad, Chennai, Gurgaon.Design, build, and optimize scalable data pipelines and ETL / ELT workflows using Spark (Scala / Python), SQL, and orchestration tools (e.Apache Airflow,...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Grid Dynamics • Bangalore (division)
    Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show more
    Last updated: 19 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    BLJ Tech Geeks • Bangalore (division)
    Notice Period - Serving only till 31st Dec not more than this.We are looking for a skilled and detail-oriented.You will be responsible for building and maintaining scalable data pipelines, optimizi...Show more
    Last updated: 19 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Synechron • Bangalore (division)
    We have immediate opportunity for.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...Show more
    Last updated: 9 hours ago • Promoted • New!
    Principal Data Engineer

    Principal Data Engineer

    PriceEasy AI • Bangalore (division)
    Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    AppsForBharat • Bangalore (division)
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show more
    Last updated: 27 days ago • Promoted
    Data Engineer

    Data Engineer

    Synechron • Bangalore (division)
    We have immediate opportunity for AWS data engineer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innova...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme Services • Bangalore (division)
    We are hiring sharp, hands-on Data Engineers to build scalable data solutions and drive performance across both traditional and cloud-based data platforms. Key Roles and Responsibilities.Strong comm...Show more
    Last updated: 1 day ago • Promoted
    Manager, Data Engineer

    Manager, Data Engineer

    Saks Global India • Bangalore (division)
    Data Engineer and Operations Lead.Saks Global is the largest multi-brand luxury retailer in the world, comprising Saks Fifth Avenue, Neiman Marcus, Bergdorf Goodman, Saks OFF 5TH, Last Call and Hor...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Sigmoid • Bangalore (division)
    We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.You will be responsible for designing, implementing, and maintaining data pipelines to support our organization&...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Engineer (AWS)

    Data Engineer (AWS)

    Sustainability Economics.ai • Bangalore (division)
    AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show more
    Last updated: 19 hours ago • Promoted • New!
    Data Bricks Engineer

    Data Bricks Engineer

    Relevance Lab • Bangalore (division)
    SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show more
    Last updated: 19 hours ago • Promoted • New!
    Data Engineer - Neo4j

    Data Engineer - Neo4j

    AMISEQ • Bangalore (division)
    Title : Data Engineer (Neo4j, JanusGraph).Neo4j, JanusGraph) and graph query languages - its must.Look for batch and real time streaming exp. Hadoop ecosystems such as Hive, Iceberg, Spark SQL.The Cl...Show more
    Last updated: 19 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    Emids • Bangalore (division)
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 19 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    SPIRO • Bangalore (division)
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    LTIMindtree • Bangalore (division)
    We are Hiring for "AWS Data Engineer" With "LTI Mindtree" FTE.AWS Glue, Python ,ETL , Aws S3 and services.Interested Candidate share CV On Neha.Show more
    Last updated: 27 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digital • Bangalore (division)
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilit...Show more
    Last updated: 19 hours ago • Promoted • New!