Data Pipeline EngineerPeople Prime Worldwide • Hyderabad, Republic Of India, IN
Data Pipeline Engineer
People Prime Worldwide • Hyderabad, Republic Of India, IN
30+ days ago
Job descriptionMandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python. Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git. Worked on Amazon’s Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazon’s Compute services like Amazon Lambda, Amazon EC2 and Amazon’s Storage service like S3 and few other services like SNS. Good to have knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc. Have worked with columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques – Snappy, Gzip. Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.
Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines. We help enterprises store, enrich, activate and monetise their data to improve their customers’ experiences, develop new revenue streams and lower their business costs. Over 80% of the Fortune 100 trust our client for data solutions.
The company’s consolidated revenues for fiscal 2024 (ended March 31, 2024). approximately $57.5 billion USD., and the company has approximately 296,000 employees worldwide. It delivers digital solutions utilising Lumada in five sectors, including Mobility, Smart Life, Industry, Energy and IT, to increase our customers’ social, environmental and economic value.
TITLE : DATA ENGINEER
LOCATION : HYDRABAD,NOIDA
EXPERIENCE : 5+
MANDATORY SKILL : AWS,Python, Pyspark
- IMMEDIATE JOINER
5+ years of overall IT experience, which includes hands on experience in Big Data technologies.
Create a job alert for this search
Data Pipeline Engineer • Hyderabad, Republic Of India, IN
Related jobs
Cloud Data Pipeline Engineer
RapidBrains • Hyderabad, Republic Of India, IN
Design, develop, and optimize large-scale data analytics and data warehouse solutions using Azure Data Factory and Azure Databricks.
Build and maintain data lake architectures to process multi-forma...Show more
Last updated: 1 day ago • Promoted
Lead Data Pipeline Engineer
Multiscale Technologies India • Hyderabad, Republic Of India, IN
Data Engineer, Forward Deployed Applications.Location : Hyderabad, India (on-site at client location).Role Type : Individual Contributor.
We are hiring a Data Engineer to build reliable data pipelines...Show more
Last updated: 21 days ago • Promoted
AI Engineer (Data Pipelines & RAG)
BeGig • Hyderabad, IN
Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
Last updated: 11 days ago • Promoted
Data Pipeline Engineer
HCLTech • Hyderabad, Republic Of India, IN
Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more
Last updated: 17 days ago • Promoted
Data Engineer
Recro • Hyderabad, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
Luxoft • Hyderabad, Republic Of India, IN
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 3 days ago • Promoted
Lead Data Pipeline Engineer
Saras Analytics • Hyderabad, Republic Of India, IN
We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show more
Last updated: 30+ days ago • Promoted
Principal Data Pipeline Engineer
EverestDX Inc • Hyderabad, Republic Of India, IN
Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show more
Last updated: 11 days ago • Promoted
Senior Data Pipeline Engineer
Creditsafe Technology • Hyderabad, Republic Of India, IN
With the largest owned database supported by a partner network, Creditsafe provides data on 320 million companies in over 100 countries to support its customers in this regard.Creditsafe is scaling...Show more
Last updated: 8 hours ago • Promoted • New!
Data Pipeline Engineer
Travel & Payments • Hyderabad, Republic Of India, IN
At Yuno, we are building the payment infrastructure that enables all companies to participate in the global market.Founded by a team of seasoned experts in the payments and IT industries, Yuno prov...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
Logic Pursuits • Hyderabad, Republic Of India, IN
Data Engineer (Snowflake + dbt).We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team.
The ideal candidate will be proficient in building scala...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipeline Engineer
People Tech Group Inc • Hyderabad, Republic Of India, IN
We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects.
The ideal candidate will have strong expertise in SQL, Python, data model...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipeline Engineer
nexocean • Hyderabad, Republic Of India, IN
We are excited to announce an opening for Lead Data Engineer !.SQL, Python, Snowflake, ADF, ETL, Data Pipeline.Work closely with Product owners / managers to understand the business needs.Collaborate...Show more
Last updated: 1 day ago • Promoted
Data Pipeline Engineer
Tata Consultancy Services • Hyderabad, Republic Of India, IN
Role : Azure Data Engineer – Databricks, DBT.Required Technical Skill Set : Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse.
Build the solution for optimal extraction, ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipeline Engineer
247Hire • Hyderabad, Republic Of India, IN
Proven offshore recruitment solutions including candidate sourcing, screening & recruiting, sales development, VMS recruiting and more.
At 247Hire, our mission is simple : to empower yours.From sourc...Show more
Last updated: 6 days ago • Promoted
Azure Data Pipeline Engineer
ValueMomentum • Hyderabad, Republic Of India, IN
Job Title : Azure Data Engineer.Azure Data Factory, Azure Synapse, Azure Datalake, Advanced SQL.Experience in developing data ingestion, data processing and analytical pipelines.Extensive hands-on e...Show more
Last updated: 1 day ago • Promoted
Data Pipeline Engineer
Zemoso Technologies • Hyderabad, Republic Of India, IN
Chennai / Hyderabad / Mumbai / Pune / Bangalore (Hybrid).Demonstrate a strong command of Python programming language, actively contributing to the.
Set up and maintain efficient data pipelines, ensuring smo...Show more
Last updated: 8 hours ago • Promoted • New!
Data Engineer
Aceolution • Hyderabad, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted