Talent.com
Data Engineer

Data Engineer

VIDA Digital IdentityKarnataka, India
13 hours ago
Job description

At VIDA we’re building the future of digital identity. As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You’ll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection . We run on AWS and make extensive use of Scala Spark, dbt, and Terraform.

Responsibilities

  • Build and expose the data lake / lakehouse so teams can understand business and product performance and make better decisions.
  • Design and evolve a data platform that enables scientists and analysts to query, model, and ship features and product metrics.
  • Develop scalable and reliable batch and streaming pipelines that ingest from varied sources and land trusted datasets.
  • Maintain and fix existing ETLs, improving reliability, observability, and cost while planning safe backfills and replays.
  • Model curated layers and maintain transformation logic (e.g., dbt ), including testing, documentation, and data quality.
  • Build with Infrastructure as Code (e.g., Terraform ) and contribute to CI / CD and deployment practices.
  • Partner with Engineering, and Data Science to deliver low-latency signals and features for real-time decisioning.
  • Contribute to internal tools, reusable components, and simple dashboards that unblock self-service.

Requirements

  • Solid engineering foundation with 5+ years of relevant experience in data engineering and / or distributed systems.
  • Hands-on work building data pipelines (batch and / or streaming) using at least one distributed framework (e.g., Spark, Kafka, Flink ).
  • Comfortable with SQL and a transformation framework (e.g., dbt or similar).
  • Familiarity with AWS services for data (any mix of S3, EMR / Glue, Kinesis / MSK, Lambda, Redshift / Athena) or equivalent cloud experience.
  • Exposure to workflow orchestration (e.g., Airflow).
  • Experience using Terraform (or similar IaC) to manage data / platform resources.
  • Ownership mindset, focus on reliability, and enjoyment of collaborating in a fast-moving environment.
  • What are we trying to solve?

    Billions of people still cannot securely prove their identity. Without it, they’re shut out of education, healthcare, finance, and civic participation. We believe this must change—and that digital identity should be trustworthy, private, and accessible to everyone.

    At VIDA, we’re creating a frictionless digital identity system that meets the needs of our time and works anywhere, for everyone.

    Why are we solving this problem?

    Global initiatives like the UN and World Bank’s ID4D aim to provide legal identity for all by 2030 . We expect digital identity to become a basic right, and we want VIDA to help lead that future.

    Who are we?

    We’re a mission-driven, pragmatic team motivated by real-world impact—from preventing fraud and corruption to unlocking fair access to essential services. If that resonates with you, we’d love to talk.

    Create a job alert for this search

    Data Engineer • Karnataka, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Karnataka, India
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 25 days ago
    • Promoted
    AWS Analytics || 12+years || Bangalore

    AWS Analytics || 12+years || Bangalore

    client of NeerInfo SolutionsKarnataka, India
    Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing.Create data pipelines, ensure data quality, and implement ETL (extract, transf...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesKarnataka, India, India
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show moreLast updated: 5 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    ImpetusKarnataka, India
    We are looking for an experienced.The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and analytics solutions that drive business insights.Design...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TruecallerKarnataka, India
    Hello, Truecaller is calling you from Bangalore, India! Ready to pick up?.Our goal is to make communication smarter, safer, and more efficient, while building trust across the world.With our roots ...Show moreLast updated: 5 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti IncKarnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VeraxionKarnataka, India
    We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show moreLast updated: 3 days ago
    • Promoted
    Palantir Foundry Data Engineer - 5+ Yrs - Bangalore

    Palantir Foundry Data Engineer - 5+ Yrs - Bangalore

    USTKarnataka, India
    CCTC | ECTC | Notice Period | Location Preference.Act fast for immediate attention! ⏳📩.Strong hands-on experience with.Ability to design, build and optimize large-scale data pipelines.Familiarity ...Show moreLast updated: 5 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    CapgeminiKarnataka, India, India
    Experience with NLP And Machine Learning.Understanding RAG, AI / ML Concepts.Experience Google Vertex AI, Langchain.Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    SigmoidKarnataka, India
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 21 hours ago
    • Promoted
    Neo4j / Knowledge Graph Engineer

    Neo4j / Knowledge Graph Engineer

    PineQ Lab TechnologyKarnataka, India, India
    Looking for an experienced Knowledge Graph / Neo4j engineer to design, implement and operate graph-based data platforms and integrations. The role involves graph data modelling, building ETL pipelin...Show moreLast updated: 3 days ago
    • Promoted
    Backend Python Engineer - 17852

    Backend Python Engineer - 17852

    Turingkarnataka, karnataka, in
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Flexton Inc.Karnataka, India
    San Jose, CA with development centers in India at multiple locations.We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital a...Show moreLast updated: 14 days ago
    • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turingkarnataka, karnataka, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Quess IT StaffingKarnataka, India
    We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, IncKarnataka, India
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 21 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    PwC IndiaKarnataka, India
    We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalab...Show moreLast updated: 21 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Ubique SystemsKarnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 21 hours ago