Talent.com
Data Engineer
Data EngineerVIDA Digital Identity • Karnataka, India
Data Engineer

Data Engineer

VIDA Digital Identity • Karnataka, India
4 days ago
Job description

At VIDA we’re building the future of digital identity. As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You’ll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection . We run on AWS and make extensive use of Scala Spark, dbt, and Terraform.

Responsibilities

  • Build and expose the data lake / lakehouse so teams can understand business and product performance and make better decisions.
  • Design and evolve a data platform that enables scientists and analysts to query, model, and ship features and product metrics.
  • Develop scalable and reliable batch and streaming pipelines that ingest from varied sources and land trusted datasets.
  • Maintain and fix existing ETLs, improving reliability, observability, and cost while planning safe backfills and replays.
  • Model curated layers and maintain transformation logic (e.g., dbt ), including testing, documentation, and data quality.
  • Build with Infrastructure as Code (e.g., Terraform ) and contribute to CI / CD and deployment practices.
  • Partner with Engineering, and Data Science to deliver low-latency signals and features for real-time decisioning.
  • Contribute to internal tools, reusable components, and simple dashboards that unblock self-service.

Requirements

  • Solid engineering foundation with 5+ years of relevant experience in data engineering and / or distributed systems.
  • Hands-on work building data pipelines (batch and / or streaming) using at least one distributed framework (e.g., Spark, Kafka, Flink ).
  • Comfortable with SQL and a transformation framework (e.g., dbt or similar).
  • Familiarity with AWS services for data (any mix of S3, EMR / Glue, Kinesis / MSK, Lambda, Redshift / Athena) or equivalent cloud experience.
  • Exposure to workflow orchestration (e.g., Airflow).
  • Experience using Terraform (or similar IaC) to manage data / platform resources.
  • Ownership mindset, focus on reliability, and enjoyment of collaborating in a fast-moving environment.
  • What are we trying to solve?

    Billions of people still cannot securely prove their identity. Without it, they’re shut out of education, healthcare, finance, and civic participation. We believe this must change—and that digital identity should be trustworthy, private, and accessible to everyone.

    At VIDA, we’re creating a frictionless digital identity system that meets the needs of our time and works anywhere, for everyone.

    Why are we solving this problem?

    Global initiatives like the UN and World Bank’s ID4D aim to provide legal identity for all by 2030 . We expect digital identity to become a basic right, and we want VIDA to help lead that future.

    Who are we?

    We’re a mission-driven, pragmatic team motivated by real-world impact—from preventing fraud and corruption to unlocking fair access to essential services. If that resonates with you, we’d love to talk.

    Create a job alert for this search

    Data Engineer • Karnataka, India

    Related jobs
    Data Engineer

    Data Engineer

    Pretium Enterprise Services, India • Karnataka, India
    Would be an individual contributor responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects are desired.Collaborate within Ag...Show more
    Last updated: 18 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Are Telagadde, Karnataka, India
    Job Summary for AWS Data Engineer : We are seeking an experienced AWS Data Engineer with strong skills in Python and SQL to design, develop, and maintain cloud-based data pipelines and analyti...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer I [T500-21404]

    Data Engineer I [T500-21404]

    ADM • Karnataka, India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Finastra • Karnataka, India
    Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our business units and 8000+ custome...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Karnataka, India, India
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer 2

    Data Engineer 2

    Yubi • Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
    Last updated: 29 days ago • Promoted
    Lead Data Engineer [T500-21385]

    Lead Data Engineer [T500-21385]

    ANSR • Karnataka, India
    ANSR is hiring for one of its clients.Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members levera...Show more
    Last updated: 15 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti Inc • Karnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    The Glove • Karnataka, India
    Associate 5 to 8 yrs / Manager 8 to 12 yrs).We are seeking a talented Data Engineer with strong expertise in.Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building ...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    ACL Digital • Karnataka, India
    GCP – Firestore, Google Cloud Storage, Cloud Build,BigQuery.Nutter Framework – Experience in writing unit test in Nutter Framework.Show more
    Last updated: 29 days ago • Promoted
    Data Engineer

    Data Engineer

    Selector • Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Networth Corp • Karnataka, India
    Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services. End to end development lifecycle of complex large-scale and ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer I [T500-21306]

    Data Engineer I [T500-21306]

    ADM • Karnataka, India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 18 days ago • Promoted
    Data Engineer

    Data Engineer

    LogFix SCM Solutions Pvt Ltd • Karnataka, India
    Job Title : Fullstack Data Engineer.Data Lake, Data Warehouse, Lakehouse, and Data Mesh.Scrum / Kanban) for iterative delivery. Scope, estimate, and deliver committed work.Collaborate with teams to ensu...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Fiery • Karnataka, India
    Digital Front Ends (DFEs) and workflow solutions for the growing industrial and graphic arts print industries.Fiery is leading the transformation from analog to digital imaging with scalable, digit...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Trigent Software - Professional Services • Karnataka, India
    Interested candidates, please share your updated CV to.As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and data architectures to support...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Inc • Karnataka, India
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    Ubique Systems • Karnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show more
    Last updated: 5 days ago • Promoted