Talent.com
Big Data Engineer

Big Data Engineer

Alef EducationNashik, IN
20 days ago
Job description

Who we are

Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.

Today, Alef is proudly headquartered in the UAE, working hand-in-hand with ministries of education, schools, and teachers to bring smart, data-powered platforms into classrooms in over 14,000 schools.

Supporting over 1.1 million students and 50,000 teachers across the UAE, Indonesia & Morocco our AI-driven platforms generate 16+ million data points every day, helping drive smarter learning decisions. Whether it’s improving national exam results, boosting classroom engagement, or supporting educators with world-class tools, Alef is committed to impact at scale.

In 2024, Alef made history as the first EdTech company to list on the Abu Dhabi Securities Exchange (ADX), cementing our role as a regional innovator with global reach.

About The Role

As an ALEF Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You will provide technical leadership, working closely with the wider team to ensure high quality code is delivered in line with the project goals and delivery cycles. You will work closely with other teams to deliver rapid prototypes as well as production code for which you will ensure high accessibility standards are upheld. We expect familiarity with modern frameworks and languages, as well as working practices such as Clean Code, TDD, BDD, continuous integration, continuous delivery, and DevOps.

Key Responsibilities

Defining and developing services and solutions

  • Define, design, and develop services and solutions around large data ingestion, storage, and management such as withRDBMS, No SQL DBs, Log Files, Events.
  • Define, design, and run robust data pipelines / batch jobs in a production environment.
  • Architecting highly scalable, highly concurrent, and low latency systems

Maintain, support, and enhance current systems.

  • Contribute to paying down technical debt and use development approaches that minimize the growth of new technical debt.
  • Contribute feedback to improve the quality, readability, and testability of the code base within your team.
  • Mentor and train other developers in a non-line management capacity.
  • Build tools (One of SBT, Gradle, Maven).
  • Ensure all software built is robust and scalable.
  • Collaborating with Internal and external stakeholders

  • Participating in sprint planning to work with developers and project teams to ensure projects are deployable and monitorable from the outside.
  • Work with third-party and other internal providers to support a variety of integrations.
  • As part of the team, you may be expected to participate in some of the 2nd line in-house support and Out-of-Hours support rotas.
  • Proactively advise on best practices.
  • To Be The Right Fit, You'll Need

  • Degree in Computer Science, Software Engineering or related preferred
  • Minimum of 5 years experience in a Big Data
  • Follow Clean Code / Solid principles
  • Adhere and use TDD / BDD.
  • Outstanding ability to develop efficient, readable, highly optimized / maintainable and clear code.
  • Highly Proficient in either Functional Java or Scala, Python
  • Knowledge of Azure Big Data / Analytics services – ADLS (Azure Data Lake Storage), HDInsight, Azure Data Factory, Azure Synapse Analytics, Azure Fabric, Azure Event Hubs, Azure Stream Analytics, Azure Databricks
  • Experience of Storing Data in systems such as Hadoop HDFS, ADLS, Event Hubs
  • Experience of designing, setting up and running big data tech stacks such as Hadoop, Azure Databricks, Spark and distributed datastores such as Cassandra, DocumentDBs, MongoDB, Event Hubs
  • In-depth knowledge of Hadoop technology ecosystem – HDFS, Spark, Hive, HBase, Event Hubs, Flume, Sqoop, Oozie, SPARK, Avro, Parquet
  • Experience debugging a complex multi-server service.
  • In depth knowledge and experience in IaaS / PaaS solutions (eg AWS Infrastructure hosting and managed services)
  • Familiarity with network protocols - TCP / IP, HTTP, SSL, etc.
  • Knowledge of relational and non-relational database systems
  • Understanding continuous integration and delivery.
  • Mocking (any of the following Mockito, ScalaTest Spock, Jasmine, Mocha).
  • IDE Intellij or Eclipse.
  • Build tools (One of SBT, Gradle, Maven).
  • Ensure all software built is robust and scalable.
  • An ability to communicate technical concepts to a non-technical audience.
  • Working knowledge of unix-like operating systems such as Linux and / or Mac OS X.
  • Knowledge of the git version control system.
  • Ability to quickly research and learn new programming tools and techniques.
  • Create a job alert for this search

    Big Data Engineer • Nashik, IN

    Related jobs
    • Promoted
    • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Newpage SolutionsNashik, IN
    Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show moreLast updated: 21 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    SGS & Conashik, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 19 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionnashik, India
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    DigitalzoneNashik, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 21 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreenashik, maharashtra, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroNashik, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNashik, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgenashik, maharashtra, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradnashik, India
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    iVoyantNashik, IN
    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 21 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incnashik, maharashtra, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivenashik, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer II

    Data Engineer II

    ClearDemandNashik, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 21 hours ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladenashik, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsNashik, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINashik, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago