This job offer is not available in your country.
Big Data Engineer
Alef EducationHyderabad, IN5 days ago
Job descriptionContribute to paying down technical debt and use development approaches that minimize the growth of new technical debt. Contribute feedback to improve the quality, readability, and testability of the code base within your team. Mentor and train other developers in a non-line management capacity. Build tools (One of SBT, Gradle, Maven). Ensure all software built is robust and scalable. Participating in sprint planning to work with developers and project teams to ensure projects are deployable and monitorable from the outside. Work with third-party and other internal providers to support a variety of integrations. As part of the team, you may be expected to participate in some of the 2nd line in-house support and Out-of-Hours support rotas. Proactively advise on best practices. Degree in Computer Science, Software Engineering or related preferred Minimum of 5 years experience in a Big Data Follow Clean Code / Solid principles Adhere and use TDD / BDD. Outstanding ability to develop efficient, readable, highly optimized / maintainable and clear code. Highly Proficient in either Functional Java or Scala, Python Knowledge of Azure Big Data / Analytics services – ADLS (Azure Data Lake Storage), HDInsight, Azure Data Factory, Azure Synapse Analytics, Azure Fabric, Azure Event Hubs, Azure Stream Analytics, Azure Databricks Experience of Storing Data in systems such as Hadoop HDFS, ADLS, Event Hubs Experience of designing, setting up and running big data tech stacks such as Hadoop, Azure Databricks, Spark and distributed datastores such as Cassandra, DocumentDBs, MongoDB, Event Hubs In-depth knowledge of Hadoop technology ecosystem – HDFS, Spark, Hive, HBase, Event Hubs, Flume, Sqoop, Oozie, SPARK, Avro, Parquet Experience debugging a complex multi-server service. In depth knowledge and experience in IaaS / PaaS solutions (eg AWS Infrastructure hosting and managed services) Familiarity with network protocols - TCP / IP, HTTP, SSL, etc. Knowledge of relational and non-relational database systems Understanding continuous integration and delivery. Mocking (any of the following Mockito, ScalaTest Spock, Jasmine, Mocha). IDE Intellij or Eclipse. Build tools (One of SBT, Gradle, Maven). Ensure all software built is robust and scalable. An ability to communicate technical concepts to a non-technical audience. Working knowledge of unix-like operating systems such as Linux and / or Mac OS X. Knowledge of the git version control system. Ability to quickly research and learn new programming tools and techniques.
Who we are
Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.
Today, Alef is proudly headquartered in the UAE, working hand-in-hand with ministries of education, schools, and teachers to bring smart, data-powered platforms into classrooms in over 14,000 schools.
Supporting over 1.1 million students and 50,000 teachers across the UAE, Indonesia & Morocco our AI-driven platforms generate 16+ million data points every day, helping drive smarter learning decisions. Whether it’s improving national exam results, boosting classroom engagement, or supporting educators with world-class tools, Alef is committed to impact at scale.
In 2024, Alef made history as the first EdTech company to list on the Abu Dhabi Securities Exchange (ADX), cementing our role as a regional innovator with global reach.
About The Role
As an ALEF Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You will provide technical leadership, working closely with the wider team to ensure high quality code is delivered in line with the project goals and delivery cycles. You will work closely with other teams to deliver rapid prototypes as well as production code for which you will ensure high accessibility standards are upheld. We expect familiarity with modern frameworks and languages, as well as working practices such as Clean Code, TDD, BDD, continuous integration, continuous delivery, and DevOps.
Key Responsibilities
Defining and developing services and solutions
- Define, design, and develop services and solutions around large data ingestion, storage, and management such as withRDBMS, No SQL DBs, Log Files, Events.
- Define, design, and run robust data pipelines / batch jobs in a production environment.
- Architecting highly scalable, highly concurrent, and low latency systems
Maintain, support, and enhance current systems.
Collaborating with Internal and external stakeholders
To Be The Right Fit, You'll Need
Create a job alert for this search
Big Data Engineer • Hyderabad, IN
Related jobs
Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, trans...Show moreLast updated: 25 days ago
- Promoted
Engineer, Data
TMUS Global SolutionsHyderabad, India The Data Engineer is responsible for designing and building the infrastructure required for efficient extraction, transformation, and loading (ETL) of data from various sources using SQL, Azure, an...Show moreLast updated: 30+ days ago
- Promoted
Snowflake Data Engineer
AnblicksHyderabad, Telangana, India Snowflake Data Engineer – Early Joiners Preferred Location : Hyderabad / Ahmedabad (Hybrid) Experience : 5+ Years Openings : 10 Company : Anblicks Inc.
Great Place to Work® Certified | ❄️Snowflake E...Show moreLast updated: 26 days ago
- Promoted
Senior Data Engineer – Big Data & AWS (Python + PySpark)
CoforgeHyderabad, India We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.Job Location : Greater Noida & Hyderabad Only.
If you are a data enthusiast with a passion fo...Show moreLast updated: 14 days ago
- Promoted
Big Data Engineer - Scala / PySpark
Sheryl strategic solutions Pvt. LTD.Hyderabad Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duratio...Show moreLast updated: 14 days ago
- Promoted
Data Engineer
KeasisHyderabad, IN We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
EveriseHyderabad, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 28 days ago
- Promoted
Data Engineer- Snowflake
Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India Job Description : We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipeli...Show moreLast updated: 20 days ago
- Promoted
Senior Data Engineer
USEReadysecunderabad, telangana, in Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment.
In this role, you will be a key contributor to the...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
IntraEdgesecunderabad, telangana, in The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Big Data Engineer - Hadoop / Spark
ImpacteersHydrebad Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago
- Promoted
Estuate - GCP Data Engineer - Big Data
Estuate Software Pvt LtdHyderabad Job Title : Data Engineer / Integration Engineer Job Summary : We are seeking a highly skilled Data Engineer / Integration Engineer to join our team.The i...Show moreLast updated: 30+ days ago
- Promoted
Big Data Developer
BayOne SolutionsHyderabad, IN We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 16 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladehyderabad, telangana, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
Bahwan CyberTeksecunderabad, telangana, in We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services.
The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago
- Promoted
Softility - Big Data Engineer - Apache Spark
SoftilityHyderabad Big Data Engineer : - Design, build, and optimize robust and scalable data pipelines for both batch and real-time data i...Show moreLast updated: 30+ days ago
- Promoted
Brightedge - Big Data Engineer - ETL / Python
brightedgeHyderabad About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results.Our platform processes m...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Tata Consultancy ServicesHyderabad, Telangana, India We await your innovation at TCS : Hiring |.Required Total Experience : 3-10 years.Work location : Hyderabad, Bangalore.Years Hands-on development experience on.
Cloud Composer, Pub sub, Data proc, Data...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
INFEC ServicesHyderabad, India Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 30+ days ago
Big Data Engineer
RiskInsight Consulting Pvt LtdHyderabad, TS, INQuick Apply