This job offer is not available in your country.
ETL Developer (SQL & GCP)
ConfidentialBengaluru / Bangalore21 days ago
Job descriptionUtilize Google Cloud Dataform to implement SQL-based data transformations in BigQuery following best practices in data modeling, version control, and dependency management. Develop modular SQL workflows using Dataform to simplify transformation logic and enhance reusability. Integrate Dataform into existing ETL / ELT pipelines to streamline data engineering and analytics workflows. Leverage Dataform's automated testing, scheduling, and Git-based version control for collaborative development and data quality assurance. Work with diverse data sources (databases, APIs, streaming data, and cloud storage) to integrate data into centralized repositories. Ensure data consistency, integrity, and accuracy through rigorous testing and validation. Implement incremental data loads, change data capture (CDC), and batch / real-time ETL strategies . Leverage GCP services like Dataflow, Dataproc, Cloud Functions, and Pub / Sub to handle data ingestion and transformation. Write complex SQL queries, stored procedures, and functions to support analytical and operational data needs. Optimize SQL queries for performance tuning and cost efficiency in BigQuery, Cloud SQL, and other relational databases. Ensure proper indexing, partitioning, and clustering strategies for optimal query performance. Deploy and monitor ETL workflows using GCP-native tools (Cloud Composer / Airflow, Dataform, Dataflow, Dataprep, etc.). Implement CI / CD pipelines for ETL jobs using Terraform, Cloud Build, GitHub Actions, or Jenkins. Work with Infrastructure and DevOps teams to ensure secure and reliable deployment of ETL solutions in a cloud environment. Implement data validation, data cleansing, and error-handling mechanisms in ETL pipelines. Monitor data pipeline performance and ensure timely resolution of issues and failures. Work with stakeholders to define data governance policies , metadata management, and access controls. Maintain comprehensive documentation for ETL workflows, data transformations, and technical design. Collaborate with data engineers, data analysts, and business teams to understand data needs and optimize data processing workflows. Conduct code reviews and provide mentorship to junior developers when necessary. Hands-on experience in designing and implementing ETL pipelines. Proficiency in ETL tools such as Apache Airflow (Cloud Composer), Dataflow, or Informatica . Strong expertise in SQL (DDL, DML, performance tuning, indexing, partitioning, stored procedures, etc.). Experience working with relational (Cloud SQL, PostgreSQL, MySQL) and NoSQL databases (Bigtable, Firestore, MongoDB, etc.). Strong hands-on experience with Google Cloud Platform (GCP) services : BigQuery (data warehousing & analytics) Cloud Storage (data lake storage) Cloud Composer (Apache Airflow) (workflow orchestration) Cloud Functions (serverless ETL tasks) Cloud Dataflow (Apache Beam-based data processing) Pub / Sub (real-time streaming) Dataproc (Hadoop / Spark-based processing) Google Cloud Dataform (SQL-based transformations for BigQuery) Experience with Python, SQL scripting, and Shell scripting for ETL automation. Knowledge of PySpark or Apache Beam is a plus. Experience in deploying ETL workflows using Terraform, Cloud Build, or Jenkins. Familiarity with Git / GitHub for version control.
Key Responsibilities :
1. ETL Pipeline Development :
- Design, develop, and maintain scalable ETL processes to extract, transform, and load data from various structured and unstructured sources into GCP-based data warehouses (BigQuery, Cloud SQL, Cloud Storage, etc.).
- Develop efficient SQL queries and scripts to support data transformation, aggregation, and validation.
- Optimize ETL workflows to ensure low-latency data processing and high performance.
2. Google Cloud Dataform & Data Transformation :
3. Data Integration & Management :
4. Database & SQL Development :
5. Cloud & DevOps Integration :
6. Data Quality & Governance :
7. Documentation & Collaboration :
Required Skills & Qualifications :
1. Technical Skills :
ETL Development :
SQL & Database Management :
Cloud (GCP) Expertise :
Programming & Scripting :
CI / CD & DevOps :
Skills Required
Git Hub, Git, Sql, Python, Terraform
Create a job alert for this search
Etl Developer • Bengaluru / Bangalore
Related jobs
)
- Promoted
ETL Testing
Mount Talent Consulting Pvt Ltd.Bengaluru, Karnataka, India Available Locations- Hyderabad (F2F only), Bangalore, Chennai, Pune, Gurgaon, TVM.Relevant exp- 3 Yrs in ETL , Python Scripting, SQL queries.
ETL validation and data quality checks.Collaborate with ...Show moreLast updated: 24 days ago
- Promoted
Databricks
Teamware Solutionsbangalore, karnataka, in Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Office a week (Oniste) / Bangalore.Shift- 2- 11 pm ( cab facility will be provided).
Immediate to 20 Days preferred.As...Show moreLast updated: 5 days ago
- Promoted
Guidewire ClaimsCenter Data Analyst (SQL | ETL | P&C Insurance)
Sky Systems, Inc. (SkySys)hosur, tamil nadu, in Guidewire ClaimsCenter Data Analyst.Full-Time Contract (40hrs / week).Standard (Must work until 11 : 30am EST).Hybrid - India (3x days onsite / week in India).
We are seeking a Senior Claims Data Analyst ...Show moreLast updated: 7 days ago
- Promoted
ETL Developer
Pinnacle Group, Inc.Bangalore, IN PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes.
Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
- Promoted
IDMC Lead
HCLTechhosur, tamil nadu, in An exciting opportunity for professionals expert as IDMC Lead / Sr Developer.Develop ETL workflows and sessions using Informatica data cloud (IICS / IDMC) and PowerCenter.
Set up Power Exchange connecti...Show moreLast updated: 30+ days ago
- Promoted
NucleusTeq - Senior Python Developer - ETL / SQL
NucleusTeq Consulting Pvt. Ltd.Bangalore Experience : 6 Year + Role Description : - Strong Python programming with experience on building modular applications, API integrations and packaging.Stron...Show moreLast updated: 30+ days ago
- Promoted
ETL LEAD with IBM DataStage experienced
IntraEdgeBangalore, IN ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
- Promoted
Natobotics - Tableau Desktop Developer - ETL / SQL
Natobotics Technologies Pvt LimitedBangalore Job Title : BI Developer Tableau & SQL Experience : 59 Years Role Overview : &...Show moreLast updated: 30+ days ago
- Promoted
ETL Testing
Tata Consultancy Servicesbangalore, karnataka, in Greetings from TATA CONSULTANCY SERVICES!.Years of Experience : 4 - 10 years.Must have 4 - 10 years of experience in data warehouse and ETL testing, preferable with ETL tool - Must be proficient in ...Show moreLast updated: 23 days ago
- Promoted
Looker (SQL Query + ETL)
Tata Consultancy ServicesBengaluru, Karnataka, India Role : Looker (SQL Query + ETL).Location : Bangalore / Chennai / Gandhinagar.Experience and exposure in Looker product.Strong expertise in SQL for querying, scripting, and developing database objects.Reg...Show moreLast updated: 6 days ago
- Promoted
SSIS Developer - ETL
TeamWare SolutionsBangalore Notice Period : Immediate Job Description : We are looking for a skilled SSIS Developer to join our dynamic team.The successf...Show moreLast updated: 10 days ago
- Promoted
Integers.Ai - Senior ETL Developer
Integers.AiBangalore Job Description : ETL Developer Role : ETL Developer Job Location : Bangalore (Hybrid 3 days from office...Show moreLast updated: 8 days ago
- Promoted
Senior ETL Developer - Data Engineering
HyrHubBangalore Role Senior ETL Developer with 6+ Years of experience development and maintenance in a data engineering project.Notice Period Immediate Joiners ONLY Show moreLast updated: 6 days ago
- Promoted
ETL Developer
Rrootshell Technologiiss Pvt LtdBengaluru, Karnataka, India Hope you are doing well & Safe!.Rrootshell Technologiiss Pvt Ltd.We are HIRING & URGENT Requirement for.ETL / Data Engineer – Data Migration.
This is for FULL -TIME role and Remote Work Opportunity.Hi...Show moreLast updated: 6 days ago
- Promoted
CloverDX and SQL Developer
Teamware Solutionsbangalore, karnataka, in We are seeking a skilled CloverDX and SQL Developer to join our dynamic team.The successful candidate will be responsible for designing, developing, and maintaining ETL (Extract, Transform, Load) p...Show moreLast updated: 5 days ago
- Promoted
Senior ETL Developer
BCE Global TechBengaluru, Karnataka, India At BCE Global Tech, immerse yourself in exciting projects that are shaping the future of both consumer and enterprise telecommunications.
This involves building innovative mobile apps to enhance use...Show moreLast updated: 23 days ago
- Promoted
Data Engineer (SQL ADF)
Talent Corner HR Services Pvt Ltdbangalore, karnataka, in Must Have : SQL Development, Azure Data Factory, ETL Processes.The Ideal candidate will have a.SQL, experience with ETL processes, and a deep understanding of data modelling and database performance...Show moreLast updated: 13 days ago
- Promoted
ETL Developer - SQL / Power Center
Akshaya IT Business solutionsBangalore Job Title : ETL Developer (Informatica) Experience : 4-6 Years Primary Skill Set : ...Show moreLast updated: 30+ days ago
- Promoted
- New!
ETL Developer - Data Integration
LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITEDBangalore Role Overview : We are seeking a highly skilled and experienced ETL Developer with strong expertise in Snowflake and dbt (Jinja + SQL).The ideal c...Show moreLast updated: 14 hours ago
- Promoted
Snowflake DB Developer - ETL / SQL
Kezan ConsultingBangalore Position : Snowflake Developer + Python.Experience : 48 years.Location : (Gurugram / Bangalore ).Joining : Immediate / [Specify Notice Period].Job Summar...Show moreLast updated: 30+ days ago