No longer accepting applications
Big Data Engineer
Alef Educationbangalore, karnataka, in24 days ago
Job descriptionContribute to paying down technical debt and use development approaches that minimize the growth of new technical debt. Contribute feedback to improve the quality, readability, and testability of the code base within your team. Mentor and train other developers in a non-line management capacity. Build tools (One of SBT, Gradle, Maven). Ensure all software built is robust and scalable. Participating in sprint planning to work with developers and project teams to ensure projects are deployable and monitorable from the outside. Work with third-party and other internal providers to support a variety of integrations. As part of the team, you may be expected to participate in some of the 2nd line in-house support and Out-of-Hours support rotas. Proactively advise on best practices. Degree in Computer Science, Software Engineering or related preferred Minimum of 5 years experience in a Big Data Follow Clean Code / Solid principles Adhere and use TDD / BDD. Outstanding ability to develop efficient, readable, highly optimized / maintainable and clear code. Highly Proficient in either Functional Java or Scala, Python Knowledge of Azure Big Data / Analytics services – ADLS (Azure Data Lake Storage), HDInsight, Azure Data Factory, Azure Synapse Analytics, Azure Fabric, Azure Event Hubs, Azure Stream Analytics, Azure Databricks Experience of Storing Data in systems such as Hadoop HDFS, ADLS, Event Hubs Experience of designing, setting up and running big data tech stacks such as Hadoop, Azure Databricks, Spark and distributed datastores such as Cassandra, DocumentDBs, MongoDB, Event Hubs In-depth knowledge of Hadoop technology ecosystem – HDFS, Spark, Hive, HBase, Event Hubs, Flume, Sqoop, Oozie, SPARK, Avro, Parquet Experience debugging a complex multi-server service. In depth knowledge and experience in IaaS / PaaS solutions (eg AWS Infrastructure hosting and managed services) Familiarity with network protocols - TCP / IP, HTTP, SSL, etc. Knowledge of relational and non-relational database systems Understanding continuous integration and delivery. Mocking (any of the following Mockito, ScalaTest Spock, Jasmine, Mocha). IDE Intellij or Eclipse. Build tools (One of SBT, Gradle, Maven). Ensure all software built is robust and scalable. An ability to communicate technical concepts to a non-technical audience. Working knowledge of unix-like operating systems such as Linux and / or Mac OS X. Knowledge of the git version control system. Ability to quickly research and learn new programming tools and techniques.
Who we are
Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.
Today, Alef is proudly headquartered in the UAE, working hand-in-hand with ministries of education, schools, and teachers to bring smart, data-powered platforms into classrooms in over 14,000 schools.
Supporting over 1.1 million students and 50,000 teachers across the UAE, Indonesia & Morocco our AI-driven platforms generate 16+ million data points every day, helping drive smarter learning decisions. Whether it’s improving national exam results, boosting classroom engagement, or supporting educators with world-class tools, Alef is committed to impact at scale.
In 2024, Alef made history as the first EdTech company to list on the Abu Dhabi Securities Exchange (ADX), cementing our role as a regional innovator with global reach.
About The Role
As an ALEF Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You will provide technical leadership, working closely with the wider team to ensure high quality code is delivered in line with the project goals and delivery cycles. You will work closely with other teams to deliver rapid prototypes as well as production code for which you will ensure high accessibility standards are upheld. We expect familiarity with modern frameworks and languages, as well as working practices such as Clean Code, TDD, BDD, continuous integration, continuous delivery, and DevOps.
Key Responsibilities
Defining and developing services and solutions
- Define, design, and develop services and solutions around large data ingestion, storage, and management such as withRDBMS, No SQL DBs, Log Files, Events.
- Define, design, and run robust data pipelines / batch jobs in a production environment.
- Architecting highly scalable, highly concurrent, and low latency systems
Maintain, support, and enhance current systems.
Collaborating with Internal and external stakeholders
To Be The Right Fit, You'll Need
Create a job alert for this search
Big Data Engineer • bangalore, karnataka, in
Related jobs
- Promoted
Data Engineer
Impetusbangalore, karnataka, in GCP Developers for Gurgaon & Bangalore location.We are looking with good experience in Bigdata, Spark, Pyspark, Python / Java, GCP-Bigquery, airflow, dataflow, Dataproc, Pubsub, Cloud Composer, GCS O...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladehosur, tamil nadu, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Gcp Data Engineer
Tata Consultancy ServicesBengaluru, Karnataka, India Required Technical Skill Set • •.Big Data,Pyspark, Google Cloud, Airflow, Scala.Bangalore - TCS Bangalore Global axis (walk-in Drive).
Min 8+ years experience in BigData, Spark and Scala.Experience in...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Recrohosur, tamil nadu, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer – BigQuery / Dataform / Looker
JRD SystemsBengaluru, Karnataka, India Data Engineer – BigQuery / Dataform / Looker (Meridian Program).Transportation Data & Analytics.We are seeking a highly skilled.
You’ll play a key role in maintaining current Roadnet data flows whil...Show moreLast updated: 14 days ago
- Promoted
Data Engineer
Aezion, IncBengaluru, Karnataka, India Location : Bangalore / Coimbatore.Required Skills and Qualifications : .Data Engineering and Analytics, with at least 2+ years in a leadership role.
Proven experience managing global teams, both onsite ...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
thinkbridgehosur, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight Globalhosur, tamil nadu, in GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer(Big Data)
Andor TechBengaluru, Karnataka, India If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC.
Work on cutting-edge big data solutions f...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
AscendionBengaluru, Karnataka, India Location : Bengaluru, Chennai, Hyderabad and Pune (Hybrid Work model).The ideal candidate should have hands-on experience working with.
SQL queries to support data transformation, analytics, and repo...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Tata Consultancy Serviceshosur, tamil nadu, in Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
VAANTECHhosur, tamil nadu, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
AAA Globalhosur, tamil nadu, in Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
Veraxionhosur, tamil nadu, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
Sourcebaebangalore, karnataka, in Job Alert : Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀.We are seeking a senior engineer with.Big Data ecosystem to deliver high-performance solutions.
This is a great opportunity to...Show moreLast updated: 4 days ago
- Promoted
Engineer (Devops & Big Data)
AMISEQBengaluru, Karnataka, India You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization.
You'll partner with vendors and the i...Show moreLast updated: 4 days ago
- Promoted
- New!
Data Engineer
DraconXhosur, tamil nadu, in DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises.
As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 16 hours ago
- Promoted
Data Engineer
Dexian Indiahosur, tamil nadu, in Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 5 days ago