Talent.com
Staff Data Engineer

Staff Data Engineer

ConfidentialVadodara, India
5 days ago
Job description

Company Description

Wiser Solutions is a suite of in-store and eCommerce intelligence and execution tools. We're on a mission to enable brands, retailers, and retail channel partners to gather intelligence and automate actions to optimize in-store and online pricing, marketing, and operations initiatives. Our Commerce Execution Suite is available globally.

Job Description

When looking to buy a product, whether it is in a brick and mortar store or online, it can be hard enough to find one that not only has the characteristics you are looking for but is also at a price that you are willing to pay. It can also be especially frustrating when you finally find one, but it is out of stock. Likewise, brands and retailers can have a difficult time getting the visibility they need to ensure you have the most seamless experience as possible in selecting their product. We at Wiser believe that shoppers should have this seamless experience, and we want to do that by providing the brands and retailers the visibility they need to make that belief a reality.

Our goal is to solve a messy problem elegantly and cost effectively. Our job is to collect, categorize, and analyze lots of structured and semi-structured data from lots of different places every day (whether it's 20 million+ products from 500+ websites or data collected from over 300,000 brick and mortar stores across the country). We help our customers be more competitive by discovering interesting patterns in this data they can use to their advantage, while being uniquely positioned to be able to do this across both online and instore.

We are looking for a lead-level software engineer to lead the charge on a team of like-minded individuals responsible for developing the data architecture that powers our data collection process and analytics platform. If you have a passion for optimization, scaling, and integration challenges, this may be the role for you.

What You Will Do

  • Think like our customers – you will work with product and engineering leaders to define data solutions that support customers' business practices.
  • Design / develop / extend our data pipeline services and architecture to implement your solutions – you will be collaborating on some of the most important and complex parts of our system that form the foundation for the business value our organization provides
  • Foster team growth – provide mentorship to both junior team members and evangelizing expertise to those on others.
  • Improve the quality of our solutions – help to build enduring trust within our organization and amongst our customers by ensuring high quality standards of the data we manage
  • Own your work – you will take responsibility to shepherd your projects from idea through delivery into production
  • Bring new ideas to the table – some of our best innovations originate within the team

Technologies We Use

  • Languages : SQL, Python
  • Infrastructure : AWS, Docker, Kubernetes, Apache Airflow, Apache Spark, Apache Kafka, Terraform
  • Databases : Snowflake, Trino / Starburst, Redshift, MongoDB, Postgres, MySQL
  • Others : Tableau (as a business intelligence solution)
  • Qualifications

  • Bachelors / Master's degree in Computer Science or relevant technical degree
  • 10+ years of professional software engineering experience
  • Strong proficiency with data languages such as Python and SQL
  • Strong proficiency working with data processing technologies such as Spark, Flink, and Airflow
  • Strong proficiency working of RDMS / NoSQL / Big Data solutions (Postgres, MongoDB, Snowflake, etc.)
  • Solid understanding of streaming solutions such as Kafka, Pulsar, Kinesis / Firehose, etc.
  • Hands-on experience with Docker, Kubernetes, infrastructure as code using Terraform, and Kubernetes package management with Helm charts
  • Solid understanding of ETL / ELT and OLTP / OLAP concepts
  • Solid understanding of columnar / row-oriented data structures (e.g. Parquet, ORC, Avro, etc.)
  • Solid understanding of Apache Iceberg, or other open table formats
  • Proven ability to transform raw unstructured / semi-structured data into structured data in accordance to business requirements
  • Solid understanding of AWS, Linux and infrastructure concepts
  • Proven ability to diagnose and address data abnormalities in systems
  • Proven ability to learn quickly, make pragmatic decisions, and adapt to changing business needs
  • Experience building data warehouses using conformed dimensional models
  • Experience building data lakes and / or leveraging data lake solutions (e.g. Trino, Dremio, Druid, etc.)
  • Experience working with business intelligence solutions (e.g. Tableau, etc.)
  • Experience working with ML / Agentic AI pipelines (e.g. , Langchain, LlamaIndex, etc.)
  • Understands Domain Driven Design concepts and accompanying Microservice Architecture
  • Passion for data, analytics, or machine learning.
  • Focus on value : shipping software that matters to the company and the customer
  • Bonus Points

  • Experience working with vector databases
  • Experience working within a retail or ecommerce environment.
  • Proficiency in other programming languages such as Scala, Java, Golang, etc.
  • Experience working with Apache Arrow and / or other in-memory columnar data technologies
  • Supervisory Responsibility

  • Provide mentorship to team members on adopted patterns and best practices.
  • Organize and lead agile ceremonies such as daily stand-ups, planning, etc
  • Additional Information

    EEO STATEMENT

    Wiser Solutions, Inc. is an Equal Opportunity Employer and prohibits Discrimination, Harassment, and Retaliation of any kind. Wiser Solutions, Inc. is committed to the principle of equal employment opportunity for all employees and applicants, providing a work environment free of discrimination, harassment, and retaliation. All employment decisions at Wiser Solutions, Inc. are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, sex, national origin, family or parental status, disability, genetics, age, sexual orientation, veteran status, or any other status protected by the state, federal, or local law. Wiser Solutions, Inc. will not tolerate discrimination, harassment, or retaliation based on any of these characteristics.

    Skills Required

    Apache Spark, Tableau, Redshift, Sql, Apache Airflow, Docker, Terraform, Mysql, snowflake , Apache Kafka, Postgres, Mongodb, Kubernetes, Python, Aws

    Create a job alert for this search

    Staff Engineer Data • Vadodara, India

    Related jobs
    • Promoted
    Founding Data Engineer

    Founding Data Engineer

    SalaryGuideVadodara, IN
    Today, job seekers rely on outdated and biased tools to evaluate employers.We’re changing that by collecting and structuring messy public data — jobs, salaries, org structures, tech stacks, and gro...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseVadodara, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGVadodara, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladevadodara, gujarat, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalVadodara, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalAnand, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreevadodara, gujarat, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroVadodara, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Philodesign Technologies IncVadodara, IN
    The ideal candidate will have strong hands-on expertise in.Azure Data Factory (ADF), Synapse, and Databricks.ETL, SQL, and data warehousing concepts. Design, develop, and implement ETL solutions usi...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda TechVadodara, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 10 days ago
    • Promoted
    Sr. Data Engineer (Databricks)

    Sr. Data Engineer (Databricks)

    xponent.aianand, gujarat, in
    We are an Australian Data and AI company and are expanding our.Databricks Capability in India.Senior Databricks Data Engineer. AI and advanced analytics for our global clients.We are open, transpare...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgeanand, gujarat, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Covadodara, gujarat, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneVadodara, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandVadodara, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyVadodara, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Nadiad, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreevadodara, gujarat, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago