Talent.com
Lead Data Engineer
Lead Data EngineerAlgonomy • Hosur, Krishnagiri (district), India
Lead Data Engineer

Lead Data Engineer

Algonomy • Hosur, Krishnagiri (district), India
19 hours ago
Job description

Designation : Lead / Principal Software Engineer

Experience : 12+ Years

Location : Bangalore

Education : B.E / B.Tech / Masters

At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.

  • We aim to become the algorithmic bridge between consumers and brands / retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algo-nomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand;

and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs

Are you interested in building systems to handle petabytes of retail data, while working in an agile and nimble organization? On our Data Platform team, rom ingestion to storage to driving insights and analytics on high velocity stream data.

We’re looking for Engineering leaders with passion for technology, love writing code and likes to build large scale data systems. Ideal candidate will have strong problem solving, analytic, decision-making and excellent communication with interpersonal skills. Candidates should be self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities. Candidate should be willing provide technical leadership and mentoring to a small team of highly talented and motivated engineers to deliver these solutions with highest quality.

Primary responsibilities :

  • Designing high performance Information architecture and Data Management for delivering diverse needs from high velocity data.
  • Designing and Building systems with Hadoop and Spark (MLib, GraphX), Flink, Mesos, Marathon, Yarn, Kafka
  • Involve in the algorithm design, research and production scalability.
  • Designing and implementing data pipelines to support data needs for machine learning (both batch and online), reporting, monitoring, and alerting. (Crunch, Cassandra, Hive, Presto, no-SQL databases)
  • Software engineering in Java and Scala
  • Automating tests at various levels, including end to end integration testing with synthetic known data, unit testing with JUnit, performance testing and tuning
  • Delivering analytics using standard Business intelligence tools
  • Working with rapid and innovative development methodologies like : Kanban, Continuous Integration and Daily deployments
  • Mentoring and raise the bar by improving the team’s definition of best practices and architecture with deep domain knowledge.
  • Engage with Product Management and Business to create Product roadmap, own technical backlog and roadmap for technology supremacy.
  • Evangelize solution with Professional services and Customer Success teams to drive adoption.
  • Driving various organization wide activities like Hackathon, Ideathon, brown bag sessions and technical blogs
  • Minimum requirements :

  • B. Tech / M.Tech in Computer Science Engineering or related fields with at least 12 years of experience in related field
  • At least 4 years of designing and managing systems with PB scale data volume and high velocity streaming data
  • High level of experience working with Big data tools : HDFS / S3, Spark / Flink,Hive,Hbase, Kafka etc
  • Hands on experience in object oriented or functional programming such as Scala or Java or Python
  • Hands on experience in coding using distributed computing architecture such as Spark
  • Good data analysis, correlation and reasoning skills
  • Knowledge and Experience working with cloud platforms.
  • Knowledge of Container management framework such as Docker, Mesos, Microservices framework for data as utility
  • Proficient in data modeling with advanced knowledge of data structures
  • Additional language skills for scripting and rapid application development
  • Desired skills and experience :

  • Knowledge of numerical programming, data science, machine learning and / or statistics a strong plus
  • Familiarity with UNIX (systems skills a plus)
  • Working in a distributed environment and has dealt with challenges around scaling and performance
  • Knowledge of Business Intelligence & datawarehouse is added advantage
  • About the Company :

    Algonomy helps consumer businesses maximize customer value by automating decisioning across their retail business lifecycle with AI-enabled solutions for eCommerce, Marketing, Merchandising, and Supply Chain. Algonomy is a trusted partner to more than 400 leading brands, with a global presence spanning over 20 countries. Our innovations have garnered recognition from top industry analysts such as Gartner and Forrester—more at

    Create a job alert for this search

    Lead Data Engineer • Hosur, Krishnagiri (district), India

    Related jobs
    Data Engineer - Tech Lead

    Data Engineer - Tech Lead

    ACL Digital • Hosur, Tamil Nadu, India
    ACL Digital is Hiring# We are looking for professionals with expertise in Data Engineering.Positions : - Data Engineer - Looking for 6+years experience -Tech Lead – Data Engineer - looking for 10+...Show more
    Last updated: 18 days ago • Promoted
    Lead Data Engineer T500-21598

    Lead Data Engineer T500-21598

    ANSR • Hosur, Tamil Nadu, India
    About BRIT : Brit India GCC is the heart of Brit Insurance’s innovation engine.Their team of highly skilled professionals specializes in Data Engineering, Platform Engineering, Full-Stack Web App...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Meril • Hosur, Krishnagiri (district), India
    We're Hiring : Senior Data Engineer.We are looking for a highly skilled.If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    EXL • hosur, tamil nadu, in
    The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • Hosur, Tamil Nadu, India
    Azure Data Engineer - 6 Month+ Rolling Contract Market Day Rate on offer Remote - (Sunday to Thursday working days) Location : Remote - 1 Week per quarter in Qatar Paritas is working with a glob...Show more
    Last updated: 21 hours ago • Promoted • New!
    Lead Data Engineer T500-21385

    Lead Data Engineer T500-21385

    ANSR • Hosur, Tamil Nadu, India
    ANSR is hiring for one of its clients.About 4flow : Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management.More than 1300 team m...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    SPIRO • Hosur, Tamil Nadu, India
    Position : Lead Data Engineer Location : Bengaluru Experience : 10+ years Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big ...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer Lead

    Senior Data Engineer Lead

    Dexian • Hosur, Tamil Nadu, India
    Key Responsibilities Analyze existing HR applications and workflows related to scheduling, shift management, and location tracking. Identify process gaps, inefficiencies, and automation opportun...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    AppsForBharat • Hosur, Krishnagiri (district), India
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Analytics Engineer

    Data Analytics Engineer

    Cube Consultancy Services • hosur, tamil nadu, in
    We are seeking a skilled and motivated Data Analytics Engineer to join our growing data.This role is ideal for someone with a strong foundation in SQL, experience using Sigma.Computing, and a deep ...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Eltropy • Hosur, Tamil Nadu, India
    Role Overview : We’re looking for a Lead data engineer and ML Analyst with 5+ years of experience in data engineering, analytics, and ML-based solutions. Job Responsibilities Design and man...Show more
    Last updated: 2 days ago • Promoted
    Lead Gcp Data Engineer

    Lead Gcp Data Engineer

    Impetus • Hosur, Tamil Nadu, India
    Job Title : Lead Data Engineer – GCP (BigQuery - Composer - Python - PySpark) Location : Bengaluru Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibi...Show more
    Last updated: 2 days ago • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    IQVIA • Hosur, Tamil Nadu, India
    Work Experience : 9 to 13 Years Work location : Bengaluru Work Mode : Hybrid Must Have Skills : Data Engineering, Python, Azure Databricks, Database, People management experience Job Overvi...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Quess IT Staffing • hosur, tamil nadu, in
    Lead the design and implementation of scalable data pipelines for ingesting, transforming, and activating customer data.Develop and orchestrate workflows using Apache Airflow and Spark.S3, Glue, At...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Technical Lead-Data Engineer

    Technical Lead-Data Engineer

    Best Infosystems Ltd. • Hosur, Tamil Nadu, India
    Technical Lead-Data Engineer_Full-Time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai Job Title : Technical Lead-Data Engineer Location : Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai Jo...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • hosur, tamil nadu, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Dr. Martens plc • Hosur, Tamil Nadu, India
    SO, WHAT'S THE STORY? As a Lead Data Engineer , you will play a key role in the development and maintenance of the organization's data infrastructure. Working within a multi-disciplined team ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer Technical Lead(Azure)

    Data Engineer Technical Lead(Azure)

    Sigmoid • Hosur, Tamil Nadu, India
    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations ...Show more
    Last updated: 28 days ago • Promoted