No longer accepting applications
Big Data Specialist
Atomic NorthKochi, Kerala, India9 days ago
Job descriptionDesign, develop, and maintain data pipelines using PySpark and related Big Data technologies. Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem. Write efficient HiveQL and SQL queries to handle large-scale datasets. Perform performance tuning and optimization of distributed data systems. Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions. Manage and schedule workflows using Apache Airflow or Oozie. Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy. Proven experience in Big Data Engineering with a focus on PySpark. Strong knowledge of HDFS, Hive, Sqoop, and related tools. Proficiency in SQL / HiveQL for large datasets. Expertise in performance tuning and optimization of distributed systems. Familiarity with Agile methodology and collaborative team practices. Experience with workflow orchestration tools (Airflow / Oozie). Strong problem-solving, analytical, and communication skills. Knowledge of data modeling and data warehousing concepts. Exposure to DevOps practices and CI / CD pipelines for data engineering. Experience with other Big Data frameworks such as Spark Streaming or Kafka.
Big Data Engineer
Location : Pune / Nagpur (WFO)
Experience Required : 8+ Years
- Long term onsite to Abu Dhabi
Job Summary :
We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems.
The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.
Key Responsibilities :
Required Skills :
Good to Have :
Create a job alert for this search
Data Big Data • Kochi, Kerala, India
Related jobs
- Promoted
Senior Data Architect- Snowflake
USEReadyKottayam, IN USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage.
USEReady partners with cloud...Show moreLast updated: 2 days ago
- Promoted
SAP Data Quality & Master Data Specialist
TekGenioKochi, IN SAP Data Quality & Master Data Specialist (MRO / MDO / Content.We are seeking an experienced(4Y+) SAP Data Quality & Master Data Specialist to manage,.
SAP systems with a focus on MRO (Maintenance, Repa...Show moreLast updated: 6 days ago
- Promoted
Data Science Specialist
LawSikhoKochi, IN N8N Developer / Automation Engineer.The ideal candidate should have strong experience with.Integrate multiple systems and APIs (REST, GraphQL, etc.
Monitor, troubleshoot, and optimize existing workf...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIKottayam, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Live ConnectionsKottayam, IN Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer - Data Acquisition
InfoBeansKottayam, IN We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 11 days ago
- Promoted
Data Scientist
upGrad RekrutKochi, IN You will work on end-to-end data-driven solutions — from data cleaning to model deployment — enabling key insights for strategic decisions.
Analyze large, complex datasets to extract meaningful busi...Show moreLast updated: 9 days ago
- Promoted
Data Migration Specialist
Atlas - the Recruitment PlatformKochi, IN Before you start reading, please read this carefully!.I've spent a good amount of time thinking about what to write : D.Anyone who successfully passes our 30 minute SQL assessment will receive $30 h...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
AceolutionKottayam, IN Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
- Promoted
Data Analyst
DraconXKottayam, IN AI business automation and AI-driven SaaS platforms.Specializing in MVP development, custom software, and automation systems, we help startups and enterprises accelerate growth and innovation.Our e...Show moreLast updated: 18 days ago
- Promoted
Data Migration Specialist
Berg SearchKochi, IN A revolutionary recruitment platform leveraging cutting-edge generative AI technology to streamline your workflow.They're redefining recruitment through automation and intelligence.The platform int...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer
MindlanceKochi, IN We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 2 days ago
- Promoted
Sr. Data Engineer
HNR TechKottayam, IN We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 11 days ago
- Promoted
Data Scientist
Singularis VenturesKochi, Kerala, India Highly skilled Senior Machine Learning Engineer with expertise in Deep Learning, Large Language Models (LLMs), and MLOps / LLMOps to design, optimize, and deploy cutting-edge AI solutions.The ideal c...Show moreLast updated: 30+ days ago
- Promoted
Data Analyst (DOMO Specialist) || Healthcare industry || Upto 30 LPA
TalentiserKottayam, IN As a Data Analyst, you will be responsible for designing, developing, and maintaining dashboards, reports, and data visualizations in.
You will partner closely with business and technical teams to p...Show moreLast updated: 1 day ago
- Promoted
- New!
Data Science Specialist
SkillsBridge.AIKochi, IN The Data Science team at skillsbridge is at the forefront of innovation, leveraging AI and machine learning to transform skill assessment, career development, and talent management.We build intelli...Show moreLast updated: 14 hours ago
- Promoted
Clinical Data Specialist
IQVIA IndiaKochi, Kerala, India PM OR 2 : 00 PM to 11 : 00 PM (Pickup and drop would ne provided.The shift assignment is purely based on project requirements and the candidate must be open to working in either of two shifts.Provide b...Show moreLast updated: 30+ days ago
- Promoted
BIG QUERY CONSULTANT
APPIT Software Inckochi, kerala, in Design, build and optimize large volume data pipelines using Big Query on Google Cloud Platform.Work on complex SQL, performance tuning, query optimization and large data processing workloads.Imple...Show moreLast updated: 8 days ago