Data Engineer - SQL / Python
hashxpertPune30+ days ago
Job descriptionBuild and maintain robust ETL / ELT workflows using Python, SQL, Apache Beam, and Spark. Automate data transformation processes and integrate with downstream analytics platforms. Ensure modular, reusable, and testable code for data operations. Implement security controls across data pipelines, including IAM policies, encryption, and secure API integrations. Monitor and enforce data quality, lineage, and governance standards in the data lake. Collaborate with InfoSec teams to align with compliance frameworks such as ISO 27001, NIST, and GDPR. Integrate data workflows with CI / CD pipelines using tools like Jenkins, GitHub Actions, or Cloud Build. Manage deployment automation and rollback strategies for data infrastructure. Maintain version control and environment consistency across dev, test, and & Troubleshooting : Set up alerting and monitoring using Stackdriver, Prometheus, or equivalent tools. Troubleshoot pipeline failures, latency issues, and data anomalies. Conduct root cause analysis and implement preventive measures. Bachelors or Masters degree in Computer Science, Information Security, or related field. 5+ years of experience in cloud-based data engineering and security. Strong proficiency in Python, SQL, and GCP services (BigQuery, Dataflow, Pub / Sub, Cloud Storage). Experience with Apache Beam, Spark, and Airflow. Familiarity with API integration, CI / CD practices, and infrastructure-as-code (Terraform preferred). Knowledge of cloud security principles and data governance frameworks. Excellent problem-solving, communication, and documentation skills. Google Professional Data Engineer or Cloud Security Engineer Certified Information Systems Security Professional (CISSP) ITIL Foundation or equivalent
Description :
We are seeking a highly skilled and security-conscious System Security Engineer with deep expertise in designing, implementing, and securing scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub / Sub, and Cloud Storage, and will be responsible for ingesting and processing real-time data from connected vehicles and IoT devices. This role demands a strong understanding of ETL / ELT workflows, data governance, and cloud-native security practices.
Key Responsibilities :
Data Pipeline Engineering :
- Design and implement scalable, fault-tolerant data pipelines using GCP services including BigQuery, Dataflow, Pub / Sub, and Cloud Storage.
- Develop real-time ingestion frameworks to process data from IoT devices and connected vehicle systems.
- Optimize data flow performance and ensure high availability across distributed systems.
ETL / ELT Development :
Security & Governance :
DevOps & CI / CD :
Required Skills & Qualifications :
Preferred Certifications :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer • Pune
Related jobs
)
- Promoted
Data Engineer
IntraEdgePune, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Trinity Technology Solutions LLCPune, Maharashtra, India Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL.
Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show moreLast updated: 3 days ago
- Promoted
- New!
Python Software Engineer
Teamware Solutionspune, maharashtra, in Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Role : Python Software Engineer - IC.Location : Bangalore / Hyderabad / pune / Mumbai.
Shift : (Flexibility Required) / ...Show moreLast updated: 18 hours ago
- Promoted
- New!
Functional Data Engineer - Pune
AkzoNobelPune / Pimpri-Chinchwad Area, India Please note that this position is graded in MM3.The salary grade offered in the end depends on the level of expertise of the candidate for this role.
You will contribute to exiting innovative busine...Show moreLast updated: 10 hours ago
- Promoted
Azure Data Engineer - Python / SQL
PMR Softtech Pvt. Ltd (Innovative Infotech )Pune Job Title : Azure Data : 1.Data Solutions Design and Implementation : - Design and implement modern...Show moreLast updated: 30+ days ago
- Promoted
Avient - Analytics Engineer - SQL / Python
AVIENT MATERIALS INDIA PRIVATE LIMITEDPune Key Responsibilities : - Design, develop, and maintain scalable data warehouse solutions.Write and optimize complex SQL queries f...Show moreLast updated: 13 days ago
- Promoted
PySpark Databricks Engineer - SQL / Azure
Confidential CompanyPune Primary Tech skills : AZURE ,Databricks ,Pyspark, SQL Secondary Tech skills : ADF, Synapse Job Description : Show moreLast updated: 30+ days ago
- Promoted
Databricks Data Engineer
AscendionPune, Maharashtra, India Job Title : Senior Data Engineer Experience : 3+ years Location : Gurgaon / Pune / Bangalore Skills : PySpark, SQL, Databricks, AWS.
Role Summary : We are looking for 3–4 experienced Databricks Develop...Show moreLast updated: 30+ days ago
- Promoted
Celebal Technologies - Data Engineer - Python / SQL
Celebal TechnologiesPune Responsibilities : Platform Expertise : - Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platfo...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer - Python / SQL
AceNetPune Description : Job Summary : We are seeking experienced and technically proficient Azure Data Engineers to join our team.You should be well versed...Show moreLast updated: 12 days ago
- Promoted
Data Engineer
SynechronPune, Maharashtra, India We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better.
Our global consulting firm combines cre...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Persistent SystemsPune, Maharashtra, India A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions.
Proven ability to work across the full software develo...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer - Python / SQL
VIPANY GLOBAL SOLUTIONS PRIVATE LIMITEDPune Responsibilities for Data Engineer : - Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet function...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
DigitalzonePune, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
Persistent Systemspune, maharashtra, in We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations.
Job Type : Full Time Employment.Design, build, and maintain data pip...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight GlobalPune, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
- New!
AWS Data Engineer
COVET IT INCPune, IN Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc.
We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 20 hours ago
- Promoted
Senior Data Engineer
EXLPune, Maharashtra, India Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show moreLast updated: 18 days ago