Talent.com
This job offer is not available in your country.
Data Engineer - Python

Data Engineer - Python

ACENET CONSULTING PRIVATE LIMITEDBangalore
30+ days ago
Job description

About Us :

AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors.

We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If youre passionate about technology and thrive in a fast-paced environment, we want to hear from you.

Job Summary :

We are looking for a skilled Python Data Engineer who is having experience in creating large scale data processing pipelines using a Python and Spark based framework. Responsible to work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and Streaming & should possess strong SQL Responsibilities :

  • Design and development of highly optimized and scalable ETL applications using Python and Spark.
  • Undertaking end-to-end project delivery (from inception to post-implementation support), including review and finalization of business requirements, creation of functional specifications and / or system designs, and ensuring that end-solution meets business needs and expectations.
  • Development of new transformation processes to load data from source to target, or performance tuning of existing ETL code (mappings, sessions).
  • Analysis of existing designs and interfaces and applying design modifications or enhancements.
  • Coding and documenting data processing scripts and stored procedures.
  • Providing business insights and analysis findings for ad-hoc data requests.
  • Testing software components and complete solutions (including debugging and troubleshooting) and preparing migration documentation.
  • Providing reporting-line transparency through periodic updates on project or task Requirements and Qualifications :
  • Should have strong programming skills in Python.
  • Experience in creating large scale data processing pipelines using a Python and Spark based

framework.

  • Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and
  • Streaming

  • Should possess strong SQL skills.
  • Excellent understanding of Unix ecosystem and should have experience in creating the shell scripts.
  • Excellent understanding of Hive / Hadoop ecosystem.
  • Solid Understanding of data engineering concepts and best practices.
  • Excellent understanding of Job Scheduling mechanisms like Autosys, TWS.
  • Excellent problem solving and analytical skills.
  • Excellent verbal and written communication skills.
  • Experience in optimizing large data loads.
  • Secondary Skills / Desired skills :

  • Exposure to an Agile Development environment would be a plus.
  • Strong understanding of Data warehousing domain.
  • Ability to architect an ETL solution and data conversion strategy.
  • Good understanding of dimensional modelling.
  • Why Join Us :

  • Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors.
  • Continuous investment in employee growth and professional development with a strong focus on up & re-skilling.
  • Competitive compensation & benefits, ESOPs and international assignments.
  • Supportive environment with healthy work-life balance and a focus on employee well-being.
  • Open culture that values diverse perspectives, encourages transparent communication and rewards to Apply :
  • If you are interested in joining our team and meet the qualifications listed above, please apply and submit your resume highlighting why you are the ideal candidate for this position.

    ref : hirist.tech)

    Create a job alert for this search

    Data Engineer Python • Bangalore

    Related jobs
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Career Hotspot & ServicesBangalore
    Key Responsibilities : Python Proficiency : - Demonstrate strong command of Python, actively contributing to the development and enhancement of d...Show moreLast updated: 30+ days ago
    Python, Airflow Data Engineer

    Python, Airflow Data Engineer

    Infosys LimitedBengaluru, Karnataka, India
    Python + Airflow Data Engineer.We are seeking a highly skilled Python / Airflow Data Engineer with 3 to 6 years of experience, specifically with a strong background in AWS technologies.The ideal ca...Show moreLast updated: 13 days ago
    GCP Data Engineer-Python

    GCP Data Engineer-Python

    Saaki Argus & Averil ConsultingBengaluru, Karnataka, India
    Quick Apply
    BigQuery, Cloud Composer (Airflow), Dataproc, and GCS.Jenkins, GitLab) for automated deployments.Strong problem-solving skills and ability to work in a.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python

    Data Engineer - Python

    TechPoppyBangalore
    Role Name : Data Engineer _ Customer Operations Engineer Location : Bangalo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python

    Data Engineer - Python

    HyreSnapBangalore
    Responsibilities : - Creating complex data processing pipelines, as part of diverse, high-energy teams.Designing scalable implementations of the models developed by our Data S...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Peak Hire SolutionsBangalore
    Job Description : Review Criteria : - Strong Data Engineer / Scientist Profiles ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer - SQL / Python

    Data Engineer - SQL / Python

    TEAM GEEK SOLUTIONS PRIVATE LIMITEDBangalore
    About the Role : We are looking for a skilled Data Engineer with a strong foundation in Snowflake, dbt, and SQL to join our growing data en...Show moreLast updated: 19 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Shorlist ProfessionalsBangalore
    Job Description : Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a leading Big4 Consulting firm and provider of fin...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    DashhireBangalore
    Responsibilities : - Design, develop, and optimize ETL pipelines using Azure Data Factory (ADF).Build and manage data lakes and data warehouses usi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Corp PlacementsBangalore
    Hiring : Hiring a Data Engineer with around 5 years experience to be based at Bangalore.Experience in Postgress and Bigquery is essential. Job Role : Data Engineer.Location : &l...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Crescendo GlobalBangalore
    Job Description : Location : Bangalore Are you a seasoned Data Engineer passionate about turning complex datasets int...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / ETL

    Data Engineer - Python / ETL

    Innova ESIBangalore
    About the Role : We are looking for experienced GCP Data Engineers to join our data team.The ideal candidates will have strong expertise in building and managing data...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Align Knowledge Centre Pvt. Ltd.Bangalore
    Job Description : We are looking for a highly skilled Data Engineer with strong expertise in Python, SQL, and Big Data technologies to join our data ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    Master Mind ConsultancyBangalore
    Primary Mandate Skills : - Python - Pyspark - Azure Key responsibilities : ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Vmultiply SolutionsBangalore
    Requirement : Data Engineer Experience : 5+yrs Mandatory skills : python, SQL, AWS, Lambda, system design Location : Bangalo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - ETL / Python

    Data Engineer - ETL / Python

    XHire.OneBangalore
    Responsibilities : - As a Data Engineer you will be a key operational and hands-on engineer delivering business tenancies as part of the data platform strategy execution across...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    Tiyasha Software Private Limited.Bangalore
    Job Title : Data Engineer (Contract-to-Hire) Experience Level : 6 to 10 Years Location : Hybrid - 3 Days Onsite (Pune, Bangalore, Noida, Mumbai, Hyderabad)...Show moreLast updated: 30+ days ago
    Python Data Engineer

    Python Data Engineer

    preferable.aiBengaluru, KA, in
    Quick Apply
    Developer in python -1-3+ years.Must have solid understanding of developing in python.Data Integration Expert 3-5+ years. Must have solid understanding of data modeling, Data warehousing concepts, a...Show moreLast updated: 14 days ago