Talent.com
Python Developer - ETL

Python Developer - ETL

IISCBangalore
4 days ago
Job description

SALARY : 7LPA - CDPG :

At CDPG, we are committed to democratising data and our mission is to help harness its power by creating data exchange platforms and seamlessly integrating them into the broader context of Data for Public Good. By ensuring that data exchange is conducted ethically, with a focus on privacy and security, we strive to make the benefits of data accessible to all, promoting inclusivity in decision-making processes.

Scope of Work :

  • Collect requirements and collaborate with city officials, agencies, system integrators, solution providers, and other data sources to integrate relevant datasets into the data exchange platform.
  • Deploy and manage data exchange, while supporting application providers in building solutions for optimised management and citizen services.

Responsibilities :

  • Evaluate smart city solution APIs and datasets, create data models, develop software ETL modules, perform unit testing, and deploy them in the cloud instance.
  • Develop ETL modules in Python to ingest data into data exchange using REST APIs and streaming protocols such as AMQP and MQTT. This includes containerizing the adapters, creating data models, and catalogue entries according to data exchange specifications.
  • Follow best practices for software development and adhere to Agile methodology throughout.
  • Required Skills :

  • Excellent software design and programming skills in Python, and Java / JavaScript, with proficiency in data model technologies such as JSON-schema, JSON-LD, and Protobuf, along with strong functional testing skills.
  • Solid understanding of available data sources and APIs in city solutions, including the ability to evaluate data quality, availability frequency, and common issues like data stream repetitions, as well as familiarity with various data fields and their meanings, and data structure formats (JSON, GeoJSON).
  • Experience in developing ETL modules in Python for data ingestion into data exchange using REST APIs and streaming protocols such as AMQP and MQTT, including containerizing adapters and creating data models and catalogue entries according to data exchange specifications, while adhering to best practices in software development and Agile methodology.
  • Good understanding and expertise in working with geospatial data (vector and raster), with experience in processing geospatial data using GIS tools like QGIS and ESRI, and skilled in analysing, transforming, and visualising geospatial data.
  • Proficient in Linux, with experience in GIT version control and cloud computing platforms.
  • Strong understanding of IoT and Smart City solutions, GIS, Big Data, and Cloud applications aimed at enhancing citizen convenience and efficient service delivery, with a commitment to creating a positive societal impact.
  • (ref : hirist.tech)

    Create a job alert for this search

    Etl Developer • Bangalore

    Related jobs
    • Promoted
    ETL Testing

    ETL Testing

    Mount Talent Consulting Pvt Ltd.Bengaluru, Karnataka, India
    Available Locations- Hyderabad (F2F only), Bangalore, Chennai, Pune, Gurgaon, TVM.Relevant exp- 3 Yrs in ETL , Python Scripting, SQL queries. ETL validation and data quality checks.Collaborate with ...Show moreLast updated: 30+ days ago
    • Promoted
    Python Developer

    Python Developer

    ACL Digitalhosur, tamil nadu, in
    ACL Digital is hiring Python Developers.Years of experience- 5 to 8 Yrs.Strong design & programming skills in.Logical reasoning and analytical skills. Network protocols, Ansible, NMS devices).Rest, ...Show moreLast updated: 18 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Pinnacle Group, Inc.Bangalore, IN
    PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes. Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
    • Promoted
    Python Squish Developer

    Python Squish Developer

    L&T Technology ServicesGreater Bengaluru Area, India
    Must have strong background in implementing and extending exiting automation using python with Squish.Exposure in squish test frameworks. Able to detail out requirements and write and maintain test ...Show moreLast updated: 18 days ago
    • Promoted
    Senior Python Developer - ETL & Data Pipeline Automation

    Senior Python Developer - ETL & Data Pipeline Automation

    Geektrust.comBangalore
    Role overview : - Proficient in Python, with hands-on experience using Pandas for large dataset processing.Solid knowledge of ETL frameworks and pipeline automation ...Show moreLast updated: 30+ days ago
    • Promoted
    Reveille Technologies - Snowflake Developer - ETL / Python

    Reveille Technologies - Snowflake Developer - ETL / Python

    Reveille TechnologiesBangalore
    Description : We are actively seeking an experienced and passionate Senior Snowflake + Python Developer to join our growing data engineeri...Show moreLast updated: 9 days ago
    • Promoted
    Python Developer

    Python Developer

    Avenue CodeBengaluru, Karnataka, India
    About the company : Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical.We’re privately held, prof...Show moreLast updated: 11 days ago
    • Promoted
    Sr. GenAI / Python Developer

    Sr. GenAI / Python Developer

    BCI~ITGreater Bengaluru Area, India
    BCI is looking for GenAI / Python Developers to join an ongoing project for our direct client in the USA.You will join an offshore team that is growing and there is a lot of new and exciting work t...Show moreLast updated: 18 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Manhattan AssociatesBengaluru, Karnataka, India
    Experience Range : 6 to 9 years.ETL / ELT tools such as SSIS, Informatica.SQL queries and SSIS packages for performance.SSAS Tabular and / or Multidimensional models, with MDX.XML, JSON, PowerShell, an...Show moreLast updated: 18 days ago
    • Promoted
    Python Developer ( Python, Pyspark, Glue)

    Python Developer ( Python, Pyspark, Glue)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Python Developer ( Python, Pyspark, Glue).Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, Kolkata. Pls find the Job Description below.Python Develop...Show moreLast updated: 18 days ago
    • Promoted
    ETL Developer

    ETL Developer

    USTBengaluru, Karnataka, India
    UST is looking for a ETL Developer with atleast 5 years of exp.Required Experience : 5+ Years.NP : Immediate to 30 days only. Interested candidate can share your updated CV to bhoopathyraja.We are s...Show moreLast updated: 18 days ago
    • Promoted
    Genio OpenText ETL Developer

    Genio OpenText ETL Developer

    Best Infosystems Ltd.Bengaluru, Karnataka, India
    Genio OpenText ETL Developer_Full-Time_Pune / Bangalore / Mumbai / Pune / Hyd / Noida_Work Mode : Hybrid mode.Pune / Bangalore / Mumbai / Pune / Hyd / Noida. Ability to relate the product functionality to business proce...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav SolutionsBengaluru, Karnataka, India
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 14 days ago
    • Promoted
    Azure Databricks Lead - Python / ETL

    Azure Databricks Lead - Python / ETL

    Gig ConsultantsBangalore
    Description : Key Responsibilities : - Lead the design, development, and optimization of large-scale data solutions using Azure Databrick...Show moreLast updated: 17 days ago
    • Promoted
    Integers.Ai - Senior ETL Developer

    Integers.Ai - Senior ETL Developer

    Integers.AiBangalore
    Job Description : ETL Developer Role : ETL Developer Job Location : Bangalore (Hybrid 3 days from office...Show moreLast updated: 30+ days ago
    • Promoted
    Capgemini - Axiom Developer - Python / ETL

    Capgemini - Axiom Developer - Python / ETL

    Capgemini Technology Services India LimitedBangalore
    Your Role : - 4+ years experience in development of reports in AxiomSL Controllers View 10 - Good understanding on Da...Show moreLast updated: 30+ days ago
    • Promoted
    ETL Developer - Data Integration

    ETL Developer - Data Integration

    LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITEDBangalore
    Role Overview : We are seeking a highly skilled and experienced ETL Developer with strong expertise in Snowflake and dbt (Jinja + SQL).The ideal c...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - ETL / Python

    Senior Data Engineer - ETL / Python

    iitjobs IncBangalore
    We are looking for a highly experienced Senior Data Engineer with a strong background in data engineering, data wrangling, and data visualization. The ideal candidate will have 4+ years of experienc...Show moreLast updated: 30+ days ago