We are Make IT Real Tech !
An information technology firm that provides consulting services in IT, software, and advanced areas such as Artificial Intelligence. Our global team of experts is committed to creating AI-driven workflows and solutions that enhance efficiency across the manufacturing, supply chain management, and e-commerce space. By leveraging latest technologies, we offer customized IT solutions that place us at the forefront of innovation, driving advancements in both customer engagement and operational efficiency.
We have a brand-new opportunity for a Data Engineer.
In this role, you will help build and maintain the data infrastructure that powers our analytics and machine learning systems. Sounds good? Then keep reading!
Why you will love working with us :
- Global Collaboration : Gain international experience by working with globally distributed teams
- Flexible Work Options : Enjoy remote or hybrid work arrangements that suit your lifestyle
- Work-Life Balance : Flexible working hours help you balance your professional and personal life
- Private Health Insurance : Comprehensive coverage for your peace of mind
- Extra Leave : Additional paid leave for special occasions
- Growth Opportunities : Access to valuable knowledge and experience to support your career development
- Team Building : Connect with colleagues through team-building activities and company events
- Innovation and AI : Be part of an AI-first workplace that enables everyone to drive unique business solutions through state-of-the-art technology
Key Responsibilities :
Data Pipeline Development
Design, build, and maintain efficient data pipelines using Apache Airflow for orchestration and schedulingImplement real-time data streaming solutions using Kafka for event-driven architecturesDevelop ETL / ELT processes to move and transform data between various sources and destinations ensuring reliability via monitoring mechanismsData Infrastructure & Architecture
Design and optimize data warehouse schemas in Amazon Redshift for analytical workloadsorchestrate S3 Data lakes & RDS sources for diverse formatsDrive cost-efficient, high performance data storage designsPlatform & DevOps
Deploy and manage data applications on Kubernetes for scalability and reliabilityImplement infrastructure as code practices for reproducible environmentsBuild and maintain CI / CD pipelines for data engineering workflowsData Quality & Governance
Embed automated tests, validation and lineage tracking.Ensure compliance with data privacy and security requirementsCross-functional Collaboration
Partner with BI analysts to understand reporting requirements and optimize data models in partnership with ML EngineersCollaborate with software engineers to integrate data systems with applicationsSupport product teams with data infrastructure needs and technical guidanceRequired Qualifications :
Education & Experience
Bachelor's degree in computer science, Engineering, or related technical field, or equivalent practical experience3+ years of experience building and maintaining data pipelines in production environmentsProven track record of designing scalable data architecturesTechnical Skills
Strong programming skills in Python and SQLHands-on experience with Apache Airflow and Apache KafkaProficiency with AWS data services including Redshift, RDS, and S3Experience with containerization and Kubernetes for deploying data applicationsStrong understanding of data modeling concepts for both transactional and analytical systemsExperience with version control (Git) and collaborative development practicesData Engineering Expertise
Deep understanding of ETL / ELT patterns and best practicesExperience with both batch and real-time data processing paradigmsKnowledge of data warehouse design principles, including dimensional modelingUnderstanding of distributed computing concepts and big data technologiesExperience with data quality frameworks and testing methodologiesEmbrace the opportunities that await you here!
Your journey may lead to new skills, relationships, and success.
One team. Millions of happy customers worldwide. Join us! https : / / www.thecustomizationgroup.com /