Talent.com
No longer accepting applications
Big Data Engineer

Big Data Engineer

Alef Educationnarela, delhi, in
16 days ago
Job description

Who we are

Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.

Today, Alef is proudly headquartered in the UAE, working hand-in-hand with ministries of education, schools, and teachers to bring smart, data-powered platforms into classrooms in over 14,000 schools.

Supporting over 1.1 million students and 50,000 teachers across the UAE, Indonesia & Morocco our AI-driven platforms generate 16+ million data points every day, helping drive smarter learning decisions. Whether it’s improving national exam results, boosting classroom engagement, or supporting educators with world-class tools, Alef is committed to impact at scale.

In 2024, Alef made history as the first EdTech company to list on the Abu Dhabi Securities Exchange (ADX), cementing our role as a regional innovator with global reach.

About The Role

As an ALEF Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You will provide technical leadership, working closely with the wider team to ensure high quality code is delivered in line with the project goals and delivery cycles. You will work closely with other teams to deliver rapid prototypes as well as production code for which you will ensure high accessibility standards are upheld. We expect familiarity with modern frameworks and languages, as well as working practices such as Clean Code, TDD, BDD, continuous integration, continuous delivery, and DevOps.

Key Responsibilities

Defining and developing services and solutions

  • Define, design, and develop services and solutions around large data ingestion, storage, and management such as withRDBMS, No SQL DBs, Log Files, Events.
  • Define, design, and run robust data pipelines / batch jobs in a production environment.
  • Architecting highly scalable, highly concurrent, and low latency systems

Maintain, support, and enhance current systems.

  • Contribute to paying down technical debt and use development approaches that minimize the growth of new technical debt.
  • Contribute feedback to improve the quality, readability, and testability of the code base within your team.
  • Mentor and train other developers in a non-line management capacity.
  • Build tools (One of SBT, Gradle, Maven).
  • Ensure all software built is robust and scalable.
  • Collaborating with Internal and external stakeholders

  • Participating in sprint planning to work with developers and project teams to ensure projects are deployable and monitorable from the outside.
  • Work with third-party and other internal providers to support a variety of integrations.
  • As part of the team, you may be expected to participate in some of the 2nd line in-house support and Out-of-Hours support rotas.
  • Proactively advise on best practices.
  • To Be The Right Fit, You'll Need

  • Degree in Computer Science, Software Engineering or related preferred
  • Minimum of 5 years experience in a Big Data
  • Follow Clean Code / Solid principles
  • Adhere and use TDD / BDD.
  • Outstanding ability to develop efficient, readable, highly optimized / maintainable and clear code.
  • Highly Proficient in either Functional Java or Scala, Python
  • Knowledge of Azure Big Data / Analytics services – ADLS (Azure Data Lake Storage), HDInsight, Azure Data Factory, Azure Synapse Analytics, Azure Fabric, Azure Event Hubs, Azure Stream Analytics, Azure Databricks
  • Experience of Storing Data in systems such as Hadoop HDFS, ADLS, Event Hubs
  • Experience of designing, setting up and running big data tech stacks such as Hadoop, Azure Databricks, Spark and distributed datastores such as Cassandra, DocumentDBs, MongoDB, Event Hubs
  • In-depth knowledge of Hadoop technology ecosystem – HDFS, Spark, Hive, HBase, Event Hubs, Flume, Sqoop, Oozie, SPARK, Avro, Parquet
  • Experience debugging a complex multi-server service.
  • In depth knowledge and experience in IaaS / PaaS solutions (eg AWS Infrastructure hosting and managed services)
  • Familiarity with network protocols - TCP / IP, HTTP, SSL, etc.
  • Knowledge of relational and non-relational database systems
  • Understanding continuous integration and delivery.
  • Mocking (any of the following Mockito, ScalaTest Spock, Jasmine, Mocha).
  • IDE Intellij or Eclipse.
  • Build tools (One of SBT, Gradle, Maven).
  • Ensure all software built is robust and scalable.
  • An ability to communicate technical concepts to a non-technical audience.
  • Working knowledge of unix-like operating systems such as Linux and / or Mac OS X.
  • Knowledge of the git version control system.
  • Ability to quickly research and learn new programming tools and techniques.
  • Create a job alert for this search

    Big Data Engineer • narela, delhi, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIDelhi, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 26 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Delhi, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsDelhi, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradDelhi, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 16 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPDelhi, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeDelhi, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseDelhi, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalDelhi, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 18 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLDelhi, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich IndiaDelhi, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsDelhi, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionDelhi, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyDelhi, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL DigitalDelhi, IN
    Grab the excellent opportunity with our company.Notice Period : Immediate to 15days.Location : Bangalore / Hyderabad / Pune / Chennai / Noida / Ahmedabad. Years in Data Engineering with GCP.Interested people ca...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXDelhi, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sonata SoftwareNoida, Uttar Pradesh, India
    We are seeking a highly skilled.The ideal candidate has strong experience building and maintaining.Datawarehouse using tools such as Snowflake, Five Tran, Airflow, and DBT.You will work closely wit...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur RugsDelhi, IN
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 14 days ago