Talent.com
This job offer is not available in your country.
Principal Data Engineer

Principal Data Engineer

KYFEXDelhi, IN
1 day ago
Job description

About KYFEX :

KYFEX is a leading AI consulting firm, dedicated to harnessing the power of artificial intelligence to revolutionize business operations across the globe. Our expertise in Large Language Models (LLMs) positions us at the cutting edge of AI technology, enabling us to offer unparalleled solutions to our clients. As we continue to grow, we're seeking a skilled Remote Principal Data Engineer to lead our efforts in managing and optimizing data processes for LLM training.

Job Responsibilities :

  • Lead the design and implementation of scalable data pipelines for the training of open-source LLMs.
  • Work closely with AI researchers and engineers to understand data requirements and ensure efficient data processing for AI model training.
  • Develop and maintain robust data storage solutions, ensuring data integrity, security, and compliance.
  • Optimize data retrieval and processing techniques to reduce training time and improve model performance.
  • Implement monitoring, logging, and alert systems to ensure high availability and performance of data systems.
  • Collaborate with cross-functional teams to integrate LLM solutions into client projects, providing expert advice on data engineering best practices.
  • Stay abreast of the latest developments in data engineering and LLM technologies, continuously improving KYFEX’s data strategies.

Minimum Requirements :

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering, with a proven track record of building and managing large-scale data pipelines.
  • Strong proficiency in programming languages such as Python or Scala.
  • Extensive experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud services (AWS, Google Cloud, Azure).
  • Demonstrated experience in data modeling, ETL development, and data warehousing.
  • Knowledge of machine learning concepts and experience supporting data needs for AI / ML projects.
  • Excellent problem-solving skills and the ability to work independently in a fully remote environment.
  • Preferred Skills :

  • Master’s degree or Ph.D. in a related field.
  • Experience with open-source LLMs and understanding of NLP data processing.
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes).
  • Experience in implementing data security and privacy practices.
  • Strong communication skills, with the ability to lead teams and collaborate effectively with stakeholders.
  • Why Join KYFEX?

  • Work at the forefront of AI technology with a team of experts passionate about innovation.
  • Enjoy the flexibility and benefits of a fully remote position.
  • Engage in challenging and meaningful projects that have a real-world impact.
  • Benefit from a culture of continuous learning, professional development, and collaborative achievement.
  • To Apply :

    Interested candidates are invited to submit their resume, a cover letter detailing their experience with LLMs, and any relevant project samples or GitHub links to careers@kyfex.com with "Remote Principal Data Engineer Application" as the subject line.

    KYFEX is committed to diversity and inclusion and encourages applications from all qualified individuals, including those from diverse backgrounds and underrepresented groups.

    Create a job alert for this search

    Principal Engineer • Delhi, IN

    Related jobs
    • Promoted
    Principal Snowflake Data Engineer

    Principal Snowflake Data Engineer

    Health CatalystHyderabad, Telangana, India
    The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space.We are working on ...Show moreLast updated: 1 day ago
    Principal Data Engineer

    Principal Data Engineer

    Brightly Software India Private LimitedNoida, Uttar Pradesh, India
    Build a brighter future while learning and growing with a Siemens company at the intersection of technology, community and sustainability. Our global team of innovators is always looking to create m...Show moreLast updated: 12 days ago
    Principal Data Engineer

    Principal Data Engineer

    AMGENINDIA
    Join Amgens Mission of Serving Patients.At Amgen, if you feel like youre part of something bigger, its because you are.Our shared missionto serve patients living with serious illnessesdrives all th...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    AutodeskBengaluru, IND
    Autodesk is looking for diverse engineering candidates to join Product Access and Compliance team, a collection of systems and teams focused on detecting and exposing non-compliant users of Autodes...Show moreLast updated: 16 days ago
    • Promoted
    Staff / Principal Data Engineer

    Staff / Principal Data Engineer

    Credit Saison IndiaIndia
    Established in 2019, CS India is one of the country’s fastest growing Non-Bank Financial Company (NBFC) lenders, with verticals in wholesale, direct lending and tech-enabled partnerships with Non-B...Show moreLast updated: 15 days ago
    Principal Data Engineer

    Principal Data Engineer

    TakedaIND, Bengaluru
    At Takeda, we are leading digital evolution and global transformation.By building innovative solutions and future-ready capabilities, we are meeting the need of patients, our people, and the planet...Show moreLast updated: 30+ days ago
    • Promoted
    Dainik Bhaskar - Principal Data Engineer

    Dainik Bhaskar - Principal Data Engineer

    Dainik BhaskarNoida
    Job Description : What you need to do : a.We're building the most personalized and intelligent news experiences for India's next 750 million digi...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Salesforce Engineer - Data Migration

    Principal Salesforce Engineer - Data Migration

    HyrEzy Talent SolutionsHyderabad
    JOB TITLE : Principal Salesforce Engineer (Data : Pune / Mumbai / Hyderabad Experience : 7+ yrs.SHIFT TIME : General Shift (9 : 30 to 6 : 30) ...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    GSKINDIA
    Job Title : Principal Data Engineer.This role requires a blend of leadership and hands-on technical expertise.The candidate will be responsible for leading data engineering strategy and delivery acr...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Software Engineer - Data Analytics

    Principal Software Engineer - Data Analytics

    HyringNinjaBangalore
    Current opening : We are seeking an experienced and highly skilled Senior Principal Software Engineer to join our team.This is a senior-level position focused on building inno...Show moreLast updated: 12 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    KYFEXNadiad, IN
    KYFEX is a leading AI consulting firm, dedicated to harnessing the power of artificial intelligence to revolutionize business operations across the globe. Our expertise in Large Language Models (LLM...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    MakeMyTripBengaluru, Karnataka, India
    Must have 8+ years of experience.We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer exp...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    Wiser SolutionsVadodara, Gujarat, India
    When looking to buy a product whether it is in a brick and mortar store or online it can be hard enough to find one that not only has the characteristics you are looking for but is also at a price ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    TechfullyHyderabad, Telangana, India
    Principal Data Engineer _ Hyderabad (Onsite).Strong expertise in SQL, Python or Scala, and modern ETL / ELT frameworks.Deep knowledge of data warehousing solutions (e. Snowflake, Redshift, BigQuery) a...Show moreLast updated: 1 day ago
    Principal Data Engineer

    Principal Data Engineer

    MEDTRONICINDIA
    At Medtronic you can begin a life-long career of exploration and innovation, while helping champion healthcare access and equity for all. Youll lead with purpose, breaking down barriers to innovatio...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Stealth StartupPune, Maharashtra, India
    Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query...Show moreLast updated: 1 day ago
    Principal Data Engineer

    Principal Data Engineer

    autodesk india pvt ltdINDIA
    Autodesk is looking for diverse engineering candidates to join Product Access and Compliance team, a collection of systems and teams focused on detecting and exposing non-compliant users of Autodes...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    ScaleneWorksBengaluru, Karnataka, India
    Quick Apply
    Being aware of departmental guidance on best practices, processes, templates, clauses and playbooks.Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    McCormick & CompanyIndia
    The Principal Data Engineer will lead the data engineering team, help formulate the organizational data strategy, and work with the cloud analytics platform owners and business stakeholders to ensu...Show moreLast updated: 9 days ago
    Principal Data Engineer

    Principal Data Engineer

    NasdaqAffluence, Bangalore
    Nasdaq Technology is looking for a passionate Principal Data Engineer, to join the Bangalore technology center in India.If Innovation and effectiveness drive you forward this is the place for you!....Show moreLast updated: 16 days ago