Description

In this role, you will:

  • Design, develop, and deploy robust infrastructure for LLM integration within the Legacy Leap platform.
  • Collaborate with AI Scientists to understand LLM requirements and translate them into scalable and secure platform components.
  • Develop and maintain APIs and services for seamless interaction between the platform and various LLMs.
  • Optimize platform performance for efficient handling of LLM workloads.
  • Implement robust monitoring and logging solutions to ensure the health and performance of the LLM integration layer.
  • Stay up-to-date on the latest advancements in LLM tools, frameworks, and platform engineering best practices.
  • Contribute to developing internal documentation and best practices for LLM platform operations.

 

You are the ideal candidate if you have:

  • Proven experience in building and deploying large-scale platforms.
  • Proficiency in programming languages like Python, Java, Javascript, or Go.
  • Expertise in containerization technologies (e.g., Docker) and infrastructure orchestration tools.
  • Strong understanding of distributed systems principles and microservices architecture.
  • Worked on event-driven architecture using tools like RabbitMQ
  • Experience with NoSQL and RDBMS
  • Experience working with APIs
  • Working knowledge of front-end technologies like React
  • Experience with cloud platforms like AWS, Azure, or GCP (familiarity with specific LLM deployment environments a plus).
  • Excellent problem-solving and analytical skills.
  • The ability to work independently and as part of a cross-functional team.
  • A strong passion for innovation and a desire to build impactful solutions.
  • Great code/design skills
  • Adherence to practices like TDD, Clean Code, Domain oriented design 

 

Bonus points for:

  • Experience working with Large Language Models (LLMs) or other deep learning models.
  • Familiarity with DevOps principles and practices.
  • Experience with security best practices for cloud-based deployments.
  • Experience in building IDE plugins
  • Experience in extending open source platform 
  • Experience in pipeline orchestration using tools like Airflow or similar