Senior/Lead Data Engineer - AWS/PythonVelodata Global Pvt Ltd • Kochi

Senior / Lead Data Engineer - AWS / Python

Velodata Global Pvt Ltd • Kochi

26 days ago

Job description

Job Title : Lead Data Engineer

Location : Kochi / Trivandrum

Experience : 10+ years

Notice Period : Immediate to 15 days

Primary Skills : AWS, Python

Job Overview :

Seeking an experienced Senior / Lead Data Engineer to design and implement scalable data ingestion frameworks, ensure data quality and validation, and build robust APIs for seamless data integration. The ideal candidate will have hands-on expertise with AWS-based big data pipelines, automation, and high-performance API development.

Key Responsibilities :

Data Ingestion Framework :

Architect and maintain ETL pipelines using AWS Glue, Lambda, EMR, ECS, EC2, Step Functions.
Optimize data ingestion for scalability, resiliency, and automation.

Data Quality & Validation :

Build automated validation and error-handling mechanisms.

Implement monitoring, logging, and alerting for data quality assurance.

API Development :

Design and develop secure RESTful APIs for internal / external data integration.

Maintain API documentation and ensure adherence to best practices.

Collaboration & Agile :

Partner with business stakeholders, data scientists, and operations.

Contribute to CI / CD pipelines (preferably GitLab) and Agile processes.

Required Qualifications :

Experience : Minimum 5+ years in data engineering / analytical platform development.

Programming : Strong in Python / PySpark / SQL for ETL and large-scale data handling.

AWS Expertise : Hands-on with AWS Glue, Lambda, Step Functions, S3, and data platforms (EMR, Apache Spark, Iceberg).

Database Exposure : DynamoDB, Aurora, Postgres, Redshift.

API Development : Proven REST API design & integration skills.

Preferred Qualifications :

Bachelors / Masters in Computer Science, Data Engineering, or related field.

Familiarity with AWS Kinesis, Firehose, SQS, and data lakehouse architectures.

Experience with data quality frameworks and API-driven integrations in multi-cluster setups.

Commitment to Information Security policies and best practices.

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Kochi

Related jobs

Data Engineer

MyData Insights Pvt Ltd • Kottayam, IN

The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more

Last updated: 3 days ago • Promoted

Senior Data Engineer

Donyati • Kottayam, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more

Last updated: 5 days ago • Promoted

Senior Data Engineer

SGS & Co • kottayam, kerala, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more

Last updated: 19 days ago • Promoted

Senior Azure Data Engineer

Tata Consultancy Services • Kochi, IN

Job Title : Senior Data Engineer (Azure / SSIS).Minimum 6 yrs of experience in building.ETL pipeline using Azure data Factory, Azure Synapse. Minimum 6 yrs of ETL development using PL / SQL.Exposure in A...Show more

Last updated: 3 days ago • Promoted

Azure Data Engineer

Tata Consultancy Services • mount, kerala, in

Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Intellias • Kochi, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more

Last updated: 19 days ago • Promoted

Senior AWS Data Engineer_Exp : 5+ Years

Atyeti Inc • kochi, kerala, in

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more

Last updated: 19 days ago • Promoted

Data Engineer

IntraEdge • Kochi, IN

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

DataOrbit AI • Kochi, IN

DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more

Last updated: 15 hours ago • Promoted • New!

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • Kochi, IN

Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more

Last updated: 15 hours ago • Promoted • New!

Data Engineer

Aceolution • Kottayam, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Mindlance • Kottayam, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more

Last updated: 3 days ago • Promoted

Senior Python Data Engineer

iVoyant • mount, kerala, in

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more

Last updated: 6 days ago • Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • Kochi, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 5 days ago • Promoted

AWS Data Engineer

Tata Consultancy Services • kochi, kerala, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more

Last updated: 28 days ago • Promoted

AWS Data Engineer

Vista Applied Solutions Group Inc • Kochi, IN

Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more

Last updated: 5 days ago • Promoted

AWS Cloud Engineer

Proglite • Kochi, IN

Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show more

Last updated: 30+ days ago • Promoted

AWS Data Architect

ACL Digital • Kottayam, IN

AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more

Last updated: 10 days ago • Promoted