Talent.com
Python ETL Developer

Python ETL Developer

ConfidentialBengaluru / Bangalore
30+ days ago
Job description

Key Responsibilities :

  • Design, develop, and maintain ETL workflows and pipelines using Python
  • Extract data from various sources (databases, APIs, flat files) and perform data transformations to meet business requirements
  • Load processed data into target systems such as data warehouses, data lakes, or databases
  • Optimize ETL processes for performance, scalability, and reliability
  • Collaborate with data architects and analysts to understand data requirements and design solutions
  • Implement data validation and error-handling mechanisms to ensure data quality
  • Automate routine ETL tasks and monitoring using scripting and workflow tools
  • Document ETL processes, data mappings, and technical specifications
  • Troubleshoot and resolve issues in ETL workflows promptly
  • Follow data governance, security policies, and compliance standards

Required Skills :

  • 4 to 5 years of hands-on experience in Python programming for ETL development
  • Strong knowledge of ETL concepts and data integration best practices
  • Experience with ETL frameworks / libraries such as Airflow, Luigi, Apache NiFi, Pandas , or similar
  • Proficiency in SQL and working with relational databases (Oracle, MySQL, SQL Server, etc.)
  • Familiarity with data formats like JSON, XML, CSV, Parquet
  • Experience in cloud platforms and tools such as AWS Glue, Azure Data Factory, or GCP Dataflow is a plus
  • Understanding of data warehousing concepts and architectures (star schema, snowflake schema)
  • Experience with version control tools such as Git
  • Knowledge of containerization (Docker) and CI / CD pipelines is desirable

    • Preferred Qualifications :

  • Experience working with big data technologies such as Hadoop, Spark, or Kafka
  • Familiarity with NoSQL databases (MongoDB, Cassandra)
  • Experience with data visualization and reporting tools
  • Certification in Python or Data Engineering tools
  • Knowledge of Agile methodologies and working in collaborative teams

    • Soft Skills :

  • Strong analytical and problem-solving skills
  • Excellent communication and collaboration abilities
  • Detail-oriented and committed to delivering high-quality work
  • Ability to manage multiple tasks and meet deadlines
  • Proactive and eager to learn new technologies and tools

    • Skills Required

    Python Programming, Airflow, Apache Nifi, Pandas

    Create a job alert for this search

    Etl Developer • Bengaluru / Bangalore