Talent.com
sfj business solutions pvt. ltd.
Python + SQL PySpark + SQL PySpark Data Modeler/Data Architectsfj business solutions pvt. ltd. • Bengaluru / Bangalore, India
Python + SQL PySpark + SQL PySpark Data Modeler/Data Architect

Python + SQL PySpark + SQL PySpark Data Modeler/Data Architect

sfj business solutions pvt. ltd. • Bengaluru / Bangalore, India
30+ days ago
Job description
Pyspark Data Engineer

As a Pyspark developer you Must have 2+ years in Pyspark.

Strong Programming Experience, Python, Pyspark, Scala Is Preferred.

Experience in designing and implementing CI/CD, Build Management, and Development strategy.

Experience with SQL and SQL Analytical functions, experience participating in key business, architectural and technical decisions

Scope to get trained on AWS cloud technology Python Developer

  • As a Python developer you must have 2+ years in Python / Pyspark.
  • Strong programming experience, Python, Pyspark, Scala is preferred.
  • Experience in designing and implementing CI/CD, Build Management, and Development strategy.
  • Experience with SQL and SQL Analytical functions, experience participating in key business, architectural and technical decisions
  • Scope to get trained on AWS cloud technology As a senior software engineer with Capgemini, you will have 3 + years of experience in Scala with strong project track record

Hands On experience in Scala/Spark developer

Hands on SQL writing skills on RDBMS (DB2) databases

Experience in working with different file formats like JSON, Parquet, AVRO, ORC and XML.

Must have worked in a HDFS platform development project.

Proficiency in data analysis, data profiling, and data lineage

Strong oral and written communication skills

Experience working in Agile projects. Data Modeler

Good knowledge and expertise on data structures and algorithms and calculus, linear algebra, machine learning and modeling.

Experience in data warehousing concepts including Star schema, snowflake or data vault for data mart or data warehousing

Experience using data modeling software like Erwin, ER studio, MySQL Workbench to produce logical and physical data models.

Knowledge of enterprise databases such as DB2/Oracle/PostgreSQL/MYSQL/SQL Server.

Hands on knowledge and experience with tools and techniques for analysis, data manipulation and presentation (e.g. PL/SQL, PySprak, Hive, Impala and other scripting tools)

Experience with Software Development Lifecycle using the Agile methodology.

Knowledge of agile methods (SAFe, Scrum, Kanban) and tools (Jira or Confluence)

Expertise in conceptual modelling; ability to see the big picture and envision possible solutions

Experience in working in a challenging, fast-paced environment

Excellent communication & stakeholder management skills. Design, develop, and optimize PL/SQL procedures, functions, triggers, and packages.

Write efficient SQL queries, joins, and subqueries for data retrieval and manipulation.

Develop and maintain database objects such as tables, views, indexes, and sequences.

Optimize query performance and troubleshoot database issues to improve efficiency.

Work closely with application developers, business analysts, and system architects to understand database requirements.

Ensure data integrity, consistency, and security within Oracle databases.

Develop ETL processes and scripts for data migration and integration.

Document database structures, stored procedures, and coding best practices.

Stay up-to-date with Oracle database technologies, best practices, and industry trends.
Skills Required
hdfs , Data Modeling, Hive, Scala, Confluence, Impala, Pyspark, Avro, Data Warehousing, Xml, Sql, Json, orc, Db2, Oracle, Jira, Mysql, Postgresql, Agile, Python, Sql Server
Create a job alert for this search

Python + SQL PySpark + SQL PySpark Data Modeler/Data Architect • Bengaluru / Bangalore, India

Similar jobs

AWS Big data pyspark SQL Spark Airflow

ScaleneWorksBengaluru, Karnataka, India
Quick Apply

Job Title: AWS Big Data Engineer.We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow.The ideal candidate will have a strong backg... Show more

Team Lead - Data Engineer (Python, PySpark,SQL)

Sigmoid AnalyticsBengaluru, Karnataka, IN

Role: Team Lead – Data Engineer (Python, PySpark, SQL).Align with key client initiatives and interface daily with customers across leading Fortune 500 companies to understand strategic requirements... Show more

Data Architect

MathCobangalore, karnataka, in

This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP.The ideal candidate will build high-volume data pipelines, real-time ... Show more

 • Promoted

AWS Data Architect

Tata Consultancy Servicesbangalore, karnataka, in

TCS Hiring for AWS Data Architect.Note: Candidates below 9 years of IT experience shall not be considered).JOB LOCATION: Bengaluru, Chennai, Hyderabad, Pune, Kolkata, Delhi.Design & Implement ETL/d... Show more

 • Promoted

PL/SQL & Python Developer

SII Group IndiaBengaluru, Republic Of India, IN

Design and implement PL/SQL packages, procedures, and data‑quality rules to support reconciliation, accrual calculations and workflow automation.Build scalable data‑processing pipelines, ETL workfl... Show more

 • Promoted

Pyspark

Tata Consultancy Servicesbangalore, karnataka, in

We are looking for a skilled and experienced professional to join our team.The ideal candidate should have 5-10 year of relevant experience and to be comfortable working in dynamic, fast-paced envi... Show more

 • Promoted

Data Architect

Grid Dynamicsbangalore, karnataka, in

Location: Bangalore, Hyderabad, or Chennai.Years of experience: 12-16 Years.In-depth Technology experience.Good Stability and strong communication skills.The Data Architect will design and govern s... Show more

 • Promoted

Senior Data Platform Architect

Bison Global SearchBengaluru, Republic Of India, IN

Hope you are having a great week.They work on integrated procedure documentation and workflow automation solutions in healthcare domain.Please find below details about the role :.Bengaluru, India (... Show more

 • Promoted

PL/SQL Developer

Lorven Technologies Inc.bangalore, karnataka, in

We’re Hiring: PL Sql Developer.Notice Period : Immediate,15 days, serving notice period.PL/SQL procedures, functions, packages, and triggers.Collaborate with developers and analysts to understand d... Show more

 • Promoted

Data Architect

Infosyskarnataka, bangalore urban, India

About the Role We are looking for an experienced Senior Data Engineer with 8 years of hands-on expertise in Python , Databricks , and large-scale distributed data systems.This role involves leading... Show more

 • Promoted

PL/SQL Developer

HCLTechbangalore, karnataka, in

Bangalore, Hyderabad, Chennai, Pune, Vijayawada.The role involves hands-on database development, data analysis, and close collaboration with stakeholders and customers.Stored Procedures and Trigger... Show more

 • Promoted

Oracle Developer (PL SQL)

SII Group Indiabangalore, karnataka, in

Design and implement PL/SQL packages, procedures, and data‑quality rules to support reconciliation, accrual calculations and workflow automation.Build scalable data‑processing pipelines, ETL workfl... Show more

 • Promoted

Data Modeler

Tata Consultancy Servicesbangalore, karnataka, in

Position-Data Modeler - Knowledge Graph.Skill-Data Modeller(Knowledge Graph), SQL, Python.Strong hands-on python, python sql and graphQL.Experience implementing data models, graph based data models... Show more

 • Promoted

PL/SQL Developer

Synechronbangalore, karnataka, in

Strong hands-on experience in PL/SQL development.Extensive expertise in writing complex procedures, functions, packages, triggers, and cursors.Solid hands-on experience in Oracle Database developme... Show more

 • Promoted

Data Pipeline Architect (PySpark)

Tata Consultancy ServicesBengaluru, Republic Of India, IN

We are looking for a skilled and experienced professional to join our team.The ideal candidate should have 5-10 year of relevant experience and to be comfortable working in dynamic, fast-paced envi... Show more

 • Promoted

Cloud Data Architect (GCP)

LTMBengaluru, Republic Of India, IN

A GCP Big Query professional designs develops and optimizes largescale data warehouses ELT.ETL pipelines and SQL scripts within Google Cloud Responsibilities include managing data ingestion PubSub ... Show more

 • Promoted

Data Architect

Exult Globalbangalore, karnataka, in

We are seeking a talented Azure Data Architect with strong expertise in Azure Databricks, specifically in PySpark and SQL, to join our data team.You will play a key role in Architecture, building s... Show more

 • Promoted

Senior Data Architect- Databricks

Quantiphibangalore, karnataka, in

Senior Technical Architect - Databricks.As Senior Technical Architect - Data bricks at Quantiphi, you will solve enterprise data problems and will develop solutions for migration, storage, and proc... Show more

 • Promoted

AI/ML Solutions Architect

Tata Consultancy ServicesBengaluru, Republic Of India, IN

Year of Experience- 10 to 18 years.Required Skill set- Python, PySpark, ML-Ops, NLP, AWS/ GCP/ Azure.Provide AI/ML solution to business problems in BFSI domain and work with relevant stakeholders t... Show more

 • Promoted

Data Architect

Concentrixbangalore, karnataka, in

Data modeling for OLTP and OLAP/EDW.Source‑to‑target data mappings, writing complex transformation rules.Data modeling, mapping, profiling, documentation.Project Manager mindset: Planning, organizi... Show more