Talent.com
Lead Data Engineer
Lead Data EngineerAlgonomy • pune, maharashtra, in
No longer accepting applications
Lead Data Engineer

Lead Data Engineer

Algonomy • pune, maharashtra, in
11 hours ago
Job description

Designation : Lead / Principal Software Engineer

Experience : 12+ Years

Location : Bangalore

Education : B.E / B.Tech / Masters

At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.

We aim to become the algorithmic bridge between consumers and brands / retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algo-nomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs

Are you interested in building systems to handle petabytes of retail data, while working in an agile and nimble organization? On our Data Platform team, rom ingestion to storage to driving insights and analytics on high velocity stream data.

We’re looking for Engineering leaders with passion for technology, love writing code and likes to build large scale data systems. Ideal candidate will have strong problem solving, analytic, decision-making and excellent communication with interpersonal skills. Candidates should be self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities. Candidate should be willing provide technical leadership and mentoring to a small team of highly talented and motivated engineers to deliver these solutions with highest quality.

Primary responsibilities :

  • Designing high performance Information architecture and Data Management for delivering diverse needs from high velocity data.
  • Designing and Building systems with Hadoop and Spark (MLib, GraphX), Flink, Mesos, Marathon, Yarn, Kafka
  • Involve in the algorithm design, research and production scalability.
  • Designing and implementing data pipelines to support data needs for machine learning (both batch and online), reporting, monitoring, and alerting. (Crunch, Cassandra, Hive, Presto, no-SQL databases)
  • Software engineering in Java and Scala
  • Automating tests at various levels, including end to end integration testing with synthetic known data, unit testing with JUnit, performance testing and tuning
  • Delivering analytics using standard Business intelligence tools
  • Working with rapid and innovative development methodologies like : Kanban, Continuous Integration and Daily deployments
  • Mentoring and raise the bar by improving the team’s definition of best practices and architecture with deep domain knowledge.
  • Engage with Product Management and Business to create Product roadmap, own technical backlog and roadmap for technology supremacy.
  • Evangelize solution with Professional services and Customer Success teams to drive adoption.
  • Driving various organization wide activities like Hackathon, Ideathon, brown bag sessions and technical blogs

Minimum requirements :

  • B. Tech / M.Tech in Computer Science Engineering or related fields with at least 12 years of experience in related field
  • At least 4 years of designing and managing systems with PB scale data volume and high velocity streaming data
  • High level of experience working with Big data tools : HDFS / S3, Spark / Flink,Hive,Hbase, Kafka etc
  • Hands on experience in object oriented or functional programming such as Scala or Java or Python
  • Hands on experience in coding using distributed computing architecture such as Spark
  • Good data analysis, correlation and reasoning skills
  • Knowledge and Experience working with cloud platforms.
  • Knowledge of Container management framework such as Docker, Mesos, Microservices framework for data as utility
  • Proficient in data modeling with advanced knowledge of data structures
  • Additional language skills for scripting and rapid application development
  • Desired skills and experience :

  • Knowledge of numerical programming, data science, machine learning and / or statistics a strong plus
  • Familiarity with UNIX (systems skills a plus)
  • Working in a distributed environment and has dealt with challenges around scaling and performance
  • Knowledge of Business Intelligence & datawarehouse is added advantage
  • About the Company :

    Algonomy helps consumer businesses maximize customer value by automating decisioning across their retail business lifecycle with AI-enabled solutions for eCommerce, Marketing, Merchandising, and Supply Chain. Algonomy is a trusted partner to more than 400 leading brands, with a global presence spanning over 20 countries. Our innovations have garnered recognition from top industry analysts such as Gartner and Forrester—more at www.algonomy.com.

    Create a job alert for this search

    Lead Data Engineer • pune, maharashtra, in

    Related jobs
    Lead Data Engineer

    Lead Data Engineer

    Searce Inc • Pune, Maharashtra, India
    Who we are? Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every t...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Pune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Pune, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Algonomy • Pune, Maharashtra, India
    Designation : Lead / Principal Software Engineer Experience : 12+ Years Location : Bangalore Education : B.Tech / Masters At Algonomy, we believe the future of our economy is Algorithmic, where busi...Show more
    Last updated: 4 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, Maharashtra, India
    Location : Banglore / Pune (Hybrid).This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and fun...Show more
    Last updated: 10 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova Solutions • Pune, Maharashtra, India
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show more
    Last updated: 20 days ago • Promoted
    Functional Data Engineer - Pune

    Functional Data Engineer - Pune

    AkzoNobel • Pune / Pimpri-Chinchwad Area, India
    Please note that this position is graded in MM3.The salary grade offered in the end depends on the level of expertise of the candidate for this role. You will contribute to exiting innovative busine...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 8 days ago • Promoted
    Azure Data Lead Engineer

    Azure Data Lead Engineer

    Persistent Systems • pune, maharashtra, in
    We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer.Job Type : Full Time Employment.Design...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Synechron • Pune, Maharashtra, India
    We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines cre...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Pune, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Pune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations. Job Type : Full Time Employment.Design, build, and maintain data pip...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 17 days ago • Promoted
    6221 Azure Data Engineer

    6221 Azure Data Engineer

    EXL • Pune, Maharashtra, India
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
    Last updated: 5 days ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    BPMLinks • Pune, Maharashtra, India
    Overview : In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and ...Show more
    Last updated: 30+ days ago • Promoted