Talent.com
Data Engineer
Data EngineerVeca Consulting Pvt Ltd • baddi, himachal pradesh, in
No longer accepting applications
Data Engineer

Data Engineer

Veca Consulting Pvt Ltd • baddi, himachal pradesh, in
22 hours ago
Job description

Role Name : Data Engineer

Experience : 3+ Years

Location : Bangalore(No relocation)

Notice Period : 20-30 days(who are currently serving)

Mode : Hybrid

Type : Fulltime

Job Description :

As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.

Key Responsibilities

  • Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
  • Implement data ETL processes for batch and streaming analytics requirements.
  • Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
  • Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
  • Ensure data security, integrity, and compliance throughout the infrastructure.
  • Maintain documentation and contribute to architecture reviews.
  • Participate in incident response and operational excellence initiatives for the data warehouse.
  • Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.

Required Skills and Experience

  • Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL.
  • Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
  • Proven ability to design and implement automated data pipelines and materialized views.
  • Proficiency in Python, Unix or similar languages.
  • Good understanding of SQL oracle, SQL server or similar languages.
  • Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions).
  • Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code.
  • 5+ years of directly applicable experience
  • BS in Computer Science, Engineering, or equivalent experience.
  • Create a job alert for this search

    Data Engineer • baddi, himachal pradesh, in

    Related jobs
    Data Engineer

    Data Engineer

    Insight Global • panchkula, haryana, in
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • baddi, himachal pradesh, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • panchkula, haryana, in
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Insight Global • baddi, himachal pradesh, in
    The Senior Data Engineer is responsible for building and optimizing ETL / ELT pipelines that process terabytes of data daily across 186 data assets, implementing BigQuery datasets with enterprise-sca...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Veraxion • panchkula, haryana, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Sapphire Software Solutions Inc • baddi, himachal pradesh, in
    A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Dexian India • baddi, himachal pradesh, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • baddi, himachal pradesh, in
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Collabera • panchkula, haryana, in
    As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices.Your role involves creatin...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Straive • baddi, himachal pradesh, in
    Years of Experience- 6-9 years.Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains.Data Ana...Show more
    Last updated: 29 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • panchkula, haryana, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • panchkula, haryana, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • baddi, himachal pradesh, in
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • baddi, himachal pradesh, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analytics • panchkula, haryana, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 4 days ago • Promoted
    Google Looker Data Engineer

    Google Looker Data Engineer

    Insight Global • baddi, himachal pradesh, in
    We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • baddi, himachal pradesh, in
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    thinkbridge • panchkula, haryana, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show more
    Last updated: 30+ days ago • Promoted