Talent.com
This job offer is not available in your country.
Big Data Engineer (Spark, SparkSQL)

Big Data Engineer (Spark, SparkSQL)

Anicalls (Pty) LtdHyderabad, Telangana, India
9 hours ago
Job description
  • 2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform
  • Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)
  • Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
  • Unix Shell Scripting and setting up CRON
  • Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
  • Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller).
  • Prior Experience in Consumer Banking Domain is an advantage.
  • Prior Experience in the agile delivery method is an advantage.
  • Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
  • Core Java skillset is an added advantage. Airflow is an added advantage.
  • Good Knowledge and Experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus.
  • Create a job alert for this search

    Big Data Engineer • Hyderabad, Telangana, India

    Related jobs
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    RiskInsight Consulting Pvt LtdHyderabad, Telangana, India
    Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, trans...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Lead Big Data Software Engineer

    Lead Big Data Software Engineer

    EpamHyderabad, Telangana, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    StraiveHyderabad, Telangana, India
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIHyderabad, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Saaki Argus & Averil ConsultingHyderabad, Telangana, India
    Notice Period : Immediate Joiner or 30 Day.Hands-on experience on technologies like.Hive, Scala, Spark, AWS, HBase.Proficient in Hadoop distributions such as. Good working experience on technologies...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Sr Cloud Big Data Engineer, SMAI

    Sr Cloud Big Data Engineer, SMAI

    MicronHyderabad, Telangana, India
    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIHyderabad, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 21 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisHyderabad, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Azure Data Spark

    Azure Data Spark

    Anicalls (Pty) LtdHyderabad, Telangana, India
    Technical, organizational, and cultural leadership for the team.Build the team by hiring individual contributors, ensuring a healthy mix of talent across seniority, styles, and backgrounds.As a mem...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Grid DynamicsHyderabad, Telangana, India
    Proven experience leading data engineering teams, including distributed teams across multiple geographies and time zones. Effective in managing cross-team collaboration with architects, product mana...Show moreLast updated: 22 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Rapinno Tech Solutions Pvt.Ltd.Hyderabad, Telangana, India
    Big Data Engineer Locations : Hyderabad | Chennai | Pune | Bangalore Skills : Scala, Python, Apache Spark, PySpark, AWS, CI / CD Experience : 3 to 11 years Scala Developer Multiple Locations Strong hand...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Senior Big Data Software Engineer

    Senior Big Data Software Engineer

    EpamHyderabad, Telangana, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Epergne SolutionsHyderabad, Telangana, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Apache Big Data Cloud Engineer

    Apache Big Data Cloud Engineer

    Anicalls (Pty) LtdHyderabad, Telangana, India
    Experience designing, developing, and testing applications using proven or emerging technologies, in a variety of technologies and environments. Experience in using and tuning relational databases (...Show moreLast updated: 9 hours ago
    • Promoted
    Bigdata Engineer

    Bigdata Engineer

    TAO Digital SolutionsHyderabad, Telangana, India
    Immediate Joiners! Job Description : Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques. Candidate will possess experience in developing hig...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Senior PySpark Data Engineer -Hyderbad-Hybrid

    Senior PySpark Data Engineer -Hyderbad-Hybrid

    Rapsys Technologies Pte Ltd.Hyderabad, Telangana, India
    We're Hiring : Senior PySpark Data Engineer!.We are seeking an experienced Senior PySpark Data Engineer to design, develop, and optimize large-scale data processing solutions.The ideal candidate wil...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    PySpark Developer

    PySpark Developer

    Anicalls (Pty) LtdHyderabad, Telangana, India
    PySpark Developer / PySpark Data Engineer.Should have at least three years of strong experience in PySpark.Strong communication and client-facing skills.Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Bigdata Engineer - E6871

    Bigdata Engineer - E6871

    NisumHyderabad, Telangana, India
    Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services. Integrate new data sources a...Show moreLast updated: 9 hours ago