Senior Data Pipeline Engineer

eInfochips (An Arrow Company)Ahmedabad, Republic Of India, IN

20 days ago

Job description

Role : Senior Data Engineer - (AWS, Opensearch)

Years of Experience : 5-8 Years

Location : Ahmedabad, Pune, Indore

Notice Period : Immediate to 45 Days Max

Job Description : We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering / Data analytics and a passion for leveraging data to drive business insights and innovation.

Qualifications :

Bachelor’s degree in Computer Science, Data Science, or a related field.

Required Skills and Qualifications :

5-8 years of experience in data engineering, with a proven track record of building and managing data solutions.

Design, develop, and manage scalable data solutions on AWS (RDS, DynamoDB, S3)

Build and optimize Logstash pipelines to push Kafka events into OpenSearch for real-time search and monitoring.

Work on OpenSearch indexing and query optimization to improve performance and scalability.

Collaborate with cross-functional teams to design and implement efficient ETL / ELT pipelines using Logstash, AWS Glue, Lambda, PySpark, and other tools.

Manage and optimize data warehouses such as DynamoDB and SQL

Ensure high availability, performance tuning, and reliability of relational and NoSQL databases.

Work with structured and unstructured data formats (JSON, CSV, XML, Excel).

Integrate data solutions with BI tools like PowerBI or any reporting.

Having Knowledge on LLM / NLP techniques, providing basic integration knowledge where applicable.

Collaborate using version control (GitHub, SVN), ticketing systems (Jira)

Excellent problem-solving, analytical, and communication skills.

Must Have

AWS

Amazon RDS

DynamoDB

Data warehouse

Logstash

Kafka

OpenSearch

Elasticsearch (alternative keyword to for OpenSearch)

Should Have

Power BI

LLM and NLP Awareness

Create a job alert for this search

Senior Data Engineer • Ahmedabad, Republic Of India, IN

Related jobs

Promoted

Senior Data Engineer

eInfochips (An Arrow Company)Ahmedabad, Gujarat, India

Role : Senior Data Engineer - (AWS, Opensearch).Years of Experience : 5-8 Years.Location : Ahmedabad, Pune, Indore.Notice Period : Immediate to 45 Days Max. We are seeking a highly motivated and enthusi...Show moreLast updated: 30+ days ago

Promoted

Salesforce Data Cloud Architect

RialtesGandhinagar, IN

Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago

Promoted

SAP Data Migration expert

Numeric TechnologiesAnand, IN

As a Sr Software Engineer (SAP) in Data Migration we expect this developer to participate in project data migration activities to support the successful data conversion from ECC to S / 4HANA (Green f...Show moreLast updated: 30+ days ago

Promoted

Data Pipeline Engineer

Kanerika IncAhmedabad, Republic Of India, IN

Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show moreLast updated: 20 days ago

Promoted

MONGO DB Administrator

IGT SolutionsAhmedabad, IN

MongoDB Administrator with Java Exposure.Immediate to 30 days preferred.MongoDB databases in a distributed environment.The ideal candidate should possess strong database administration expertise, s...Show moreLast updated: 20 days ago

Promoted

GCP Data Engineer

EXLAhmedabad, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 20 days ago

Promoted

Enterprise Data Architect

DBiz.aiAhmedabad, IN

You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show moreLast updated: 10 days ago

Promoted

Senior Data Engineer

SAIVA AIGandhinagar, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

HealthyMe AIGandhinagar, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 29 days ago

Promoted

Senior Data Integration Engineer

IndsafriNadiad, IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 20 days ago

Promoted

BIW automation

Capgemini EngineeringSanand, Gujarat, India

A Bachelor's degree in Mechatronics Engineering, Mechanical Engineering, Electrical Engineering, or a related field.Strong knowledge of control systems, robotics, and automation.Familiarity with el...Show moreLast updated: 20 days ago

Promoted

GCP Data Engineer

JRD Systemsnadiad, gujarat, in

Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 4 days ago

Promoted

Data Engineer(ETL ODI) Contract

Vienna ConsultancyGandhinagar, IN

Contract- 6 months (Extendable).Shift timings- Night shift- 9 pm IST to 6 am IST.Design, develop, and maintain functions and stored procedures using Oracle Data Integrator (ODI).Create and document...Show moreLast updated: 20 days ago

Promoted

Databricks Engineer

Tata Consultancy Servicesahmedabad, gujarat, in

Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required. Experience in transforming the data using A...Show moreLast updated: 29 days ago

Promoted

Senior Data Engineer

Saransh Incgandhinagar, gujarat, in

Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 20 days ago

Promoted

Senior Data Engineer

USEReadygandhinagar, gujarat, in

Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago

Promoted

Backend and Data Pipeline Engineer

JRD SystemsAnand, IN

Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago

Promoted

snowflake Cloud Database Administrator

Leading automobile GCCahmedabad, gujarat, in

Cloud Platform Expertise : Familiarity with leading cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, and Snowflake is essential. Understanding their database offerings, such as AWS...Show moreLast updated: 30+ days ago