SolarSquare Energy - Data Engineer - Python
SolarSquare EnergyMumbai17 days ago
Job descriptionArchitect & Build : Design, implement and manage cloud-based data platform using a modern ELT (Extract, Load, Transform) approach. Data Ingestion : Develop and maintain robust data ingestion pipelines from a variety of sources, including operational databases (MongoDB, RDS), real-time IoT streams, and third-party APIs using services like AWS Kinesis / Lambda or Azure Event Hubs / Functions. Data Lake Management : Build and manage a scalable and cost-effective data lake on AWS S3 or Azure Data Lake Storage (ADLS Gen2), using open table formats like Apache Iceberg or Delta Lake. Data Transformation : Develop, test, and maintain complex data transformation models using dbt. Champion a software engineering mindset by applying principles of version control (Git), CI / CD, and automated testing to all data logic. Orchestration : Implement and manage data pipeline orchestration using modern tools like Dagster, Apache Airflow, or Azure Data Factory. Data Quality & Governance : Establish and enforce data quality standards. Implement automated testing and monitoring to ensure the reliability and integrity of all data assets. Performance & Cost Optimization : Continuously monitor and optimize the performance and cost of the data platform, ensuring our serverless query engines and storage layers are used efficiently. Collaboration : Work closely with data analysts and business stakeholders to understand their needs, model data effectively, and deliver datasets that power our BI tools (Metabase, Power BI). 3+ years of professional experience in a data engineering role. Expert-level proficiency in SQL and the ability to write complex, highly-performant queries. Proficient in Python based data cleaning packages and tools. Experience in python is a must. Hands-on experience building data solutions on a major cloud provider (AWS or Azure), utilizing core services like AWS S3 / Glue / Athena or Azure ADLS / Data Factory / Synapse. Proven experience building and maintaining data pipelines in Python. Experience with NoSQL databases like MongoDB, including an understanding of its data modeling, aggregation framework, and query patterns. Deep understanding of data warehousing concepts, including dimensional modeling, star / snowflake schemas, and data modeling best practices. Hands-on experience with modern data transformation tools, specifically dbt. Familiarity with data orchestration tools like Apache Airflow, Dagster, or Prefect. Proficiency with Git and experience working with CI / CD pipelines for data projects. Experience with real-time data streaming technologies, specifically AWS Kinesis or Azure Event Hubs. Experience with data cataloging and governance tools (i.e, OpenMetadata, DataHub, Microsoft Purview). Knowledge of infrastructure-as-code tools like Terraform or CloudFormation. Experience with containerization technologies (Docker, Kubernetes).
Description :
As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.
You will :
- design and implement robust, scalable data pipelines and architect modern data solutions.
- using a best-in-class technology stack.
Your work will transform raw, messy data into clean, reliable, and actionable data products that power decision-making across the business. Youll collaborate cross-functionally with product managers, data analysts, data scientists, and software engineers to understand data needs and deliver high-performance data solutions.
Your impact will be measured by how effectively data is delivered, modeled, and leveraged to drive business outcomes.
Key Responsibilities :
Required Skills & Experience (Must-Haves) :
Preferred Skills & Experience (Nice-to-Haves) :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer Python • Mumbai
Related jobs
Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project.
This is a high-impact role requiring strong ha...Show moreLast updated: 20 days ago
- Promoted
ETL Data Engineer - Python / PySpark
Information TechnologyMumbai Key Responsibilities : - Design, develop, and maintain robust data pipelines and ETL / ELT workflows using PySpark, Python, and SQL.
Build and manage data ingestion and ...Show moreLast updated: 27 days ago
- Promoted
Sciative Solutions- Data Engineer - Python / Spark
Sciative Solutions Private LimitedMumbai Job Responsibilities : - Collaborate with data scientists, software engineers, and business stakeholders to understand data requirements and design efficient data mod...Show moreLast updated: 30+ days ago
- Promoted
Lead / Senior Engineer - Python
TESTQ Technologies LimitedMumbai About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show moreLast updated: 16 days ago
- Promoted
Senior Data Engineer – Snowflake & Python (Remote, India or EU)
Az-Tec Talentdombivli, maharashtra, inRemote
- Promoted
AWS Data Engineer
TerraGiGThane, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 1 day ago
- Promoted
Python API + Data Engineer
Digitrix Software LLPKalyan-Dombivli, IN API development and large-scale data processing.Write clean, testable, and scalable code with.S3, Athena, Glue, EMR, SageMaker) for data engineering and model deployment.
Collaborate cross-functiona...Show moreLast updated: 25 days ago
- Promoted
Lead Data Engineer - Python / Big Data
HyreSnapMumbai Responsibilities : - Design, execution, and management of a large and complex distributed data system.Monitoring of performance and optimizing existing proje...Show moreLast updated: 30+ days ago
- Promoted
Python+AWS Data Engineer
ConfidentialNoida, Pune, Mumbai Analyze and translate business requirements into scalable and resilient design.Own parts of the application and continuously improve them in an agile environment.
Create high quality maintainable pr...Show moreLast updated: 30+ days ago
- Promoted
Backend and Data Pipeline Engineer
JRD SystemsMumbai, IN Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer
9NEXUSthane, maharashtra, in Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment.
The role involves building high-perf...Show moreLast updated: 1 day ago
- Promoted
Senior Python Engineer
Acorn GlobusKalyan-Dombivli, IN This is a full-time remote role for a Python Developer at Acorn Globus.The Python Developer will be responsible for back-end web development, software development, object-oriented programming (OOP)...Show moreLast updated: 25 days ago
- Promoted
Lead Data Engineer
ITQube LTDthane, maharashtra, in Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 22 days ago
- Promoted
Python Data Engineer
iVoyantKalyan-Dombivli, IN One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs.
we use Fast API).Data processing and reporting usin...Show moreLast updated: 1 day ago
- Promoted
Python AWS Data Engineer
Digitrix Software LLPKalyan-Dombivli, IN Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
- Promoted
Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines
CareerXperts Consultingmumbai city, maharashtra, in Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show moreLast updated: 1 day ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsthane, maharashtra, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 20 days ago
- Promoted
Collinson Group - Data Engineer - Python / Scala
Collinson Loyalty & Benefits Private Limited”Mumbai Key Responsibilities : - Design, develop, and maintain data pipelines for collecting, transforming, a...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer - Python / ETL
NEXTHIRE LLPMumbai Description : Job Title : Data Engineer (Python, PySpark, BigQuery) Location : Mumbai (Onsite) Experience : 7+ YearsShow moreLast updated: 5 days ago