Data Engineer

This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics.

About the Role

The Engineer will work closely with product partner, data analyst, report developers, architects, data scientists and other engineers on data initiatives and will be involved in designing our next generation of data platform architecture to support increasing data demands.

Responsibilities

Design, build and maintain scalable and reliable data pipelines to process large volumes of structures, semi-structured and un-structured data from diverse sources.

Develop ETL processes to ingest, transform and load data into data warehouse, ensuring data quality, integrity and consistency.

Collaborate with business stakeholders, report developers and data scientists to understand data requirements and translate then into technical solutions for various business purposes.

Optimize performance and efficiency of data infrastructure and processes, including data storage, processing and querying.

Implement data governance policies and best practice to ensure compliance, security and privacy of sensitive data.

Troubleshoot data issues, identify root cause and implement solutions in timely manner.

Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

Qualifications

We are looking for candidate with 4+ years of experience in a Data Engineer role and has attained bachelor’s degree in technology and has experienced with Agile / Scrum development process and methodologies.

Required Skills

Experience as a Data Engineer with strong track record of designing and implementing data solutions.

Experience in programming language as Python or Java, with experience in building data pipelines and workflows.

Experience with cloud data warehousing technologies, such as Snowflake and Redshift.

Experience with distributed computing frameworks such as Cloudera, Apache Hadoop and Spark.

Experience with Cloud platforms such as AWS, Azure or Google Cloud Platform.

Experience with AWS cloud services, such as S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda.

Experience with containerization and orchestration technologies, such as Docker and Kubernetes.

Experience with building CI / CD pipeline using tools, such has GitLab and Bitbucket.

Experience with data pipeline orchestration tools, such as Airflow and Jenkins.

Knowledge of database concepts, data modelling, schemas and query languages, SQL and Hive.

Knowledge of data visualization and reporting tools, such as MicroStrategy, Tableau and Power BI.

Knowledge of data quality and monitoring techniques and tools, such as Great Expectations or similar.

Knowledge of data governance processes, lineage, cataloging, dictionaries using tools, such as DataHub or similar.

Knowledge of streaming data processing and real-time analytics technologies, such as Kafka.

Retail experience is a plus.

About VRIZE INC

VRIZE is a Global Digital & Data Engineering company, committed to delivering end-to-end Digital solutions and services to its customers worldwide. We offer business-friendly solutions across industry verticals that include Banking, Financial Services, Healthcare & Insurance, Manufacturing, and Retail. The company has strategic business alliances with industry leaders such as Adobe, IBM Sterling Commerce, IBM, Microsoft, Docker, Sisense, Competera, Snowflake, and Tableau.

VRIZE is headquartered out of Tampa (Florida) with a team size of 410 employees globally, currently, 100% of the clients undertaken are in the United States. Delivery centers are distributed in the US, Canada, Serbia, and India. Having stellar growth and future projections of 100% YOY for the last 3 years, the company has been successfully addressing its clients’ digital disruption needs. Our continued success depends to a large extent on our ability to remain at the forefront of disruptive developments in the field of information technology and leaders / team members joining the force are expected to replicate the same.

VRIZE is an equal-opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, marital status, age, national origin, ancestry, disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law. Individuals with disabilities are provided reasonable accommodation.