Talent.com
Lead Data Engineer
Lead Data EngineerAlgonomy • Bangalore, IN
Lead Data Engineer

Lead Data Engineer

Algonomy • Bangalore, IN
9 hours ago
Job description

Designation : Lead / Principal Software Engineer

Experience : 12+ Years

Location : Bangalore

Education : B.E / B.Tech / Masters

At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.

We aim to become the algorithmic bridge between consumers and brands / retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algo-nomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs

Are you interested in building systems to handle petabytes of retail data, while working in an agile and nimble organization? On our Data Platform team, rom ingestion to storage to driving insights and analytics on high velocity stream data.

We’re looking for Engineering leaders with passion for technology, love writing code and likes to build large scale data systems. Ideal candidate will have strong problem solving, analytic, decision-making and excellent communication with interpersonal skills. Candidates should be self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities. Candidate should be willing provide technical leadership and mentoring to a small team of highly talented and motivated engineers to deliver these solutions with highest quality.

Primary responsibilities :

  • Designing high performance Information architecture and Data Management for delivering diverse needs from high velocity data.
  • Designing and Building systems with Hadoop and Spark (MLib, GraphX), Flink, Mesos, Marathon, Yarn, Kafka
  • Involve in the algorithm design, research and production scalability.
  • Designing and implementing data pipelines to support data needs for machine learning (both batch and online), reporting, monitoring, and alerting. (Crunch, Cassandra, Hive, Presto, no-SQL databases)
  • Software engineering in Java and Scala
  • Automating tests at various levels, including end to end integration testing with synthetic known data, unit testing with JUnit, performance testing and tuning
  • Delivering analytics using standard Business intelligence tools
  • Working with rapid and innovative development methodologies like : Kanban, Continuous Integration and Daily deployments
  • Mentoring and raise the bar by improving the team’s definition of best practices and architecture with deep domain knowledge.
  • Engage with Product Management and Business to create Product roadmap, own technical backlog and roadmap for technology supremacy.
  • Evangelize solution with Professional services and Customer Success teams to drive adoption.
  • Driving various organization wide activities like Hackathon, Ideathon, brown bag sessions and technical blogs

Minimum requirements :

  • B. Tech / M.Tech in Computer Science Engineering or related fields with at least 12 years of experience in related field
  • At least 4 years of designing and managing systems with PB scale data volume and high velocity streaming data
  • High level of experience working with Big data tools : HDFS / S3, Spark / Flink,Hive,Hbase, Kafka etc
  • Hands on experience in object oriented or functional programming such as Scala or Java or Python
  • Hands on experience in coding using distributed computing architecture such as Spark
  • Good data analysis, correlation and reasoning skills
  • Knowledge and Experience working with cloud platforms.
  • Knowledge of Container management framework such as Docker, Mesos, Microservices framework for data as utility
  • Proficient in data modeling with advanced knowledge of data structures
  • Additional language skills for scripting and rapid application development
  • Desired skills and experience :

  • Knowledge of numerical programming, data science, machine learning and / or statistics a strong plus
  • Familiarity with UNIX (systems skills a plus)
  • Working in a distributed environment and has dealt with challenges around scaling and performance
  • Knowledge of Business Intelligence & datawarehouse is added advantage
  • About the Company :

    Algonomy helps consumer businesses maximize customer value by automating decisioning across their retail business lifecycle with AI-enabled solutions for eCommerce, Marketing, Merchandising, and Supply Chain. Algonomy is a trusted partner to more than 400 leading brands, with a global presence spanning over 20 countries. Our innovations have garnered recognition from top industry analysts such as Gartner and Forrester—more at www.algonomy.com .

    Create a job alert for this search

    Lead Data Engineer • Bangalore, IN

    Related jobs
    Data Engineer - Tech Lead

    Data Engineer - Tech Lead

    ACL Digital • Bengaluru, Karnataka, India
    We are looking for professionals with expertise in Data Engineering.Data Engineer - Looking for 6+years experience -Tech Lead – Data Engineer - looking for 10+ years of experience.If this role matc...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTrip • Bangalore Urban, Karnataka, India
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    Sigmoid • Bengaluru, Karnataka, India
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer [T500-21309]

    Lead Data Engineer [T500-21309]

    ANSR • Bengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show more
    Last updated: 17 days ago • Promoted
    Technical Lead-Data Engineer

    Technical Lead-Data Engineer

    Best Infosystems Ltd. • Bengaluru, Karnataka, India
    Technical Lead-Data Engineer_Full-Time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai. Bachelor’s / relevant exp - with Snowpro Certification.Ent...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Impetus • Bengaluru, Karnataka, India
    GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer I

    Data Engineer I

    Licious • Greater Bengaluru Area, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VRIZE • Bengaluru, India
    Experience as a Data Engineer with strong track record of designing and implementing data solutions.Experience in programming language as Python, Pyspark with airflows. Experience with cloud data wa...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    VIDA Digital Identity • Greater Bengaluru Area, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
    Last updated: 2 days ago • Promoted
    AWS Lead Data engineer

    AWS Lead Data engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
    Last updated: 18 days ago • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    IQVIA • Bengaluru, Karnataka, India
    Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team perform...Show more
    Last updated: 13 days ago • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    Impetus • Bengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more
    Last updated: 29 days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy Services • Greater Bengaluru Area, India
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Greater Bengaluru Area, India
    Previous experience as a data engineer or in a similar role.Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Syn...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer - Databricks

    Lead Data Engineer - Databricks

    Tredence Inc. • Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arcana • Greater Bengaluru Area, India
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • Bengaluru, Karnataka, India
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer Technical Lead(Azure)

    Data Engineer Technical Lead(Azure)

    Sigmoid • Greater Bengaluru Area, India
    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations ...Show more
    Last updated: 2 days ago • Promoted