Talent.com
Lead Data Engineer
Lead Data EngineerAlgonomy • panchkula, haryana, in
Lead Data Engineer

Lead Data Engineer

Algonomy • panchkula, haryana, in
Less than 1 hour ago
Job description

Designation : Lead / Principal Software Engineer

Experience : 12+ Years

Location : Bangalore

Education : B.E / B.Tech / Masters

At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.

We aim to become the algorithmic bridge between consumers and brands / retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algo-nomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs

Are you interested in building systems to handle petabytes of retail data, while working in an agile and nimble organization? On our Data Platform team, rom ingestion to storage to driving insights and analytics on high velocity stream data.

We’re looking for Engineering leaders with passion for technology, love writing code and likes to build large scale data systems. Ideal candidate will have strong problem solving, analytic, decision-making and excellent communication with interpersonal skills. Candidates should be self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities. Candidate should be willing provide technical leadership and mentoring to a small team of highly talented and motivated engineers to deliver these solutions with highest quality.

Primary responsibilities :

  • Designing high performance Information architecture and Data Management for delivering diverse needs from high velocity data.
  • Designing and Building systems with Hadoop and Spark (MLib, GraphX), Flink, Mesos, Marathon, Yarn, Kafka
  • Involve in the algorithm design, research and production scalability.
  • Designing and implementing data pipelines to support data needs for machine learning (both batch and online), reporting, monitoring, and alerting. (Crunch, Cassandra, Hive, Presto, no-SQL databases)
  • Software engineering in Java and Scala
  • Automating tests at various levels, including end to end integration testing with synthetic known data, unit testing with JUnit, performance testing and tuning
  • Delivering analytics using standard Business intelligence tools
  • Working with rapid and innovative development methodologies like : Kanban, Continuous Integration and Daily deployments
  • Mentoring and raise the bar by improving the team’s definition of best practices and architecture with deep domain knowledge.
  • Engage with Product Management and Business to create Product roadmap, own technical backlog and roadmap for technology supremacy.
  • Evangelize solution with Professional services and Customer Success teams to drive adoption.
  • Driving various organization wide activities like Hackathon, Ideathon, brown bag sessions and technical blogs

Minimum requirements :

  • B. Tech / M.Tech in Computer Science Engineering or related fields with at least 12 years of experience in related field
  • At least 4 years of designing and managing systems with PB scale data volume and high velocity streaming data
  • High level of experience working with Big data tools : HDFS / S3, Spark / Flink,Hive,Hbase, Kafka etc
  • Hands on experience in object oriented or functional programming such as Scala or Java or Python
  • Hands on experience in coding using distributed computing architecture such as Spark
  • Good data analysis, correlation and reasoning skills
  • Knowledge and Experience working with cloud platforms.
  • Knowledge of Container management framework such as Docker, Mesos, Microservices framework for data as utility
  • Proficient in data modeling with advanced knowledge of data structures
  • Additional language skills for scripting and rapid application development
  • Desired skills and experience :

  • Knowledge of numerical programming, data science, machine learning and / or statistics a strong plus
  • Familiarity with UNIX (systems skills a plus)
  • Working in a distributed environment and has dealt with challenges around scaling and performance
  • Knowledge of Business Intelligence & datawarehouse is added advantage
  • About the Company :

    Algonomy helps consumer businesses maximize customer value by automating decisioning across their retail business lifecycle with AI-enabled solutions for eCommerce, Marketing, Merchandising, and Supply Chain. Algonomy is a trusted partner to more than 400 leading brands, with a global presence spanning over 20 countries. Our innovations have garnered recognition from top industry analysts such as Gartner and Forrester—more at www.algonomy.com.

    Create a job alert for this search

    Lead Data Engineer • panchkula, haryana, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • panchkula, haryana, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • panchkula, haryana, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • panchkula, haryana, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer – Orchestration Infrastructure

    Senior Data Engineer – Orchestration Infrastructure

    Out Of The Blue • baddi, himachal pradesh, in
    Out of the Blue is building an agentic AI platform to help eCommerce brands scale smarter and protect revenue.Our platform proactively detects and acts on what breaks growth—misfiring pixels, broke...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    System Soft Technologies • panchkula, haryana, in
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • panchkula, haryana, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more
    Last updated: 28 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • panchkula, haryana, in
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • panchkula, haryana, in
    We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more
    Last updated: 10 days ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    BPMLinks • panchkula, haryana, in
    In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer – AWS

    Data Engineer – AWS

    Recruin • panchkula, haryana, in
    Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    Kissht • baddi, himachal pradesh, in
    We are looking for a highly motivated and passionate Junior Data Engineer to join our growing data team.This role is perfect for fresh graduates or early-career professionals who have strong analyt...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • panchkula, haryana, in
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • panchkula, haryana, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more
    Last updated: 30+ days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • baddi, himachal pradesh, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • panchkula, haryana, in
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Azure Data Engineer / Data Visualization Lead (Tableau)

    Azure Data Engineer / Data Visualization Lead (Tableau)

    PROADSW3 Relations pvt. ltd. • baddi, himachal pradesh, in
    Azure Data Engineer / Data Visualization Lead (Tableau) – AM / DM | 5–8 Years | Budget : 1.Mandate : Databricks Experience. We are seeking a highly skilled Azure Data Engineer – Data Visualization Lead ...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • baddi, himachal pradesh, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • baddi, himachal pradesh, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day ago • Promoted