No longer accepting applications
Big Data Specialist
Atomic Northsangli, maharashtra, in8 days ago
Job descriptionWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability. Design, develop, and maintain data pipelines using PySpark and related Big Data technologies. Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem. Write efficient HiveQL and SQL queries to handle large-scale datasets. Perform performance tuning and optimization of distributed data systems. Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions. Manage and schedule workflows using Apache Airflow or Oozie. Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy. Proven experience in Big Data Engineering with a focus on PySpark. Strong knowledge of HDFS, Hive, Sqoop, and related tools. Proficiency in SQL / HiveQL for large datasets. Expertise in performance tuning and optimization of distributed systems. Familiarity with Agile methodology and collaborative team practices. Experience with workflow orchestration tools (Airflow / Oozie). Strong problem-solving, analytical, and communication skills. Knowledge of data modeling and data warehousing concepts. Exposure to DevOps practices and CI / CD pipelines for data engineering. Experience with other Big Data frameworks such as Spark Streaming or Kafka.
Big Data Engineer
Location : Pune / Nagpur (WFO)
Experience Required : 8+ Years
- Long term onsite to Abu Dhabi
Job Summary :
Key Responsibilities :
Required Skills :
Good to Have :
Create a job alert for this search
Data Big Data • sangli, maharashtra, in
Related jobs
- Promoted
Big Data Developer (Hive, Pyspark)
Tata Consultancy Servicessangli, maharashtra, in Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex).
Hands-on experience of Hadoop, Python, PySpark,...Show moreLast updated: 17 days ago
- Promoted
Data Specialist
VicTree SolutionsKolhapur, IN Design and implement data pipelines using AWS services such as.Develop and maintain data processing and transformation scripts using.
Optimize data storage and retrieval using AWS database services ...Show moreLast updated: 1 day ago
- Promoted
SAP Data Quality & Master Data Specialist
TekGenioKolhapur, IN SAP Data Quality & Master Data Specialist (MRO / MDO / Content.We are seeking an experienced(4Y+) SAP Data Quality & Master Data Specialist to manage,.
SAP systems with a focus on MRO (Maintenance, Repa...Show moreLast updated: 5 days ago
- Promoted
Senior Data Engineer / Architect - Snowflake
Aezion, IncKolhapur, IN We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling.
The ideal candidate will design ...Show moreLast updated: 1 day ago
- Promoted
Data Migration Specialist
Atlas - the Recruitment PlatformKolhapur, IN Before you start reading, please read this carefully!.I've spent a good amount of time thinking about what to write : D.Anyone who successfully passes our 30 minute SQL assessment will receive $30 h...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Analyst (DOMO Specialist) || Healthcare industry || Upto 30 LPA
TalentiserKolhapur, IN As a Data Analyst, you will be responsible for designing, developing, and maintaining dashboards, reports, and data visualizations in.
You will partner closely with business and technical teams to p...Show moreLast updated: 11 hours ago
- Promoted
Data Analyst
DraconXKolhapur, IN AI business automation and AI-driven SaaS platforms.Specializing in MVP development, custom software, and automation systems, we help startups and enterprises accelerate growth and innovation.Our e...Show moreLast updated: 17 days ago
- Promoted
Senior Data Analyst
Ruder Finn IndiaKolhapur, IN Ruder Finn is seeking a Senior Data Analyst (Data Analyst III) to join its award-winning Emerging Technology & Analytics team.
The chosen candidate will support the agency’s new business efforts by ...Show moreLast updated: 28 days ago
- Promoted
Data Engineer
AceolutionKolhapur, IN Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Alp Consulting Ltd.Kolhapur, IN Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
FornaxKolhapur, IN If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 1 day ago
- Promoted
Senior Data Scientist
Aditya Birla Fashion and Retail Ltd.Kolhapur, IN We are looking for a motivated.The ideal candidate should have strong fundamentals in analytics, hands-on experience in Python, SQL, and Power BI, and a good understanding of cloud platforms.You wi...Show moreLast updated: 1 day ago
- Promoted
BIG QUERY CONSULTANT
APPIT Software Incsangli, maharashtra, in Design, build and optimize large volume data pipelines using Big Query on Google Cloud Platform.Work on complex SQL, performance tuning, query optimization and large data processing workloads.Imple...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
American InferenceKolhapur, IN Please apply directly through for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.
We are an AI and Data Consulti...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
OWOWKolhapur, IN Data Engineer – AI-Powered Marketing Personalization Platform.AI-powered marketing personalization platform (V2.You’ll design and implement a robust multi-database infrastructure that enables real-...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Architect- Snowflake
USEReadyKolhapur, IN USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage.
USEReady partners with cloud...Show moreLast updated: 1 day ago
- Promoted
Data Annotator
Innodata Inc.Kolhapur, IN Innodata (NASDAQ : INOD) is a leading data engineering company.With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4...Show moreLast updated: 28 days ago
- Promoted
Data Migration Specialist
Berg SearchKolhapur, IN A revolutionary recruitment platform leveraging cutting-edge generative AI technology to streamline your workflow.They're redefining recruitment through automation and intelligence.The platform int...Show moreLast updated: 7 days ago