Data Engineer

Digitrix Software LLPKarnataka, India

5 days ago

Job description

Experience : 5 -10 years

Location : Bangalore / Pune / Kolkata / Hyderabad / Gurugram (Hybrid)

Notice Period : Immediate Joiners Only

Must Have : PostgreSQL (Advanced), Python (Intermediate level)
Concepts : ETL Process, Data modelling
CI / CD - Deployment Process, Gitlab
Cloud experience - AWS S3 / Azure BLOB, ADLS
Good to Have : Orchestration (Airflow) / Autosys etc.
Schema versioning - Liquibase / Flyway / Runway
Snowflake
Cloud Services Arora, RDS, Lambda (server less service)

Low Importance : Kafka

Responsibilities

Manage and optimize large-scale data processing, including performance tuning, orchestration

Apply QE mindset to develop well-rounded, full stack data engineering solutions; Experience of building or using automation testing framework is must have

Gather requirements from business, Develop and present technical solution to architects

Participate in ongoing exploration and experimentation with emerging technologies

Improve monitoring processes, and promote data quality and governance

Independently handle client interactions and collaborate with cross-functional teams.

Create a job alert for this search

Data Engineer • Karnataka, India