Platform Engineer - LLM Platform

In this role, you will:

• Design, develop, and deploy robust infrastructure for LLM integration within the Legacy Leap platform.
• Collaborate with AI Scientists to understand LLM requirements and translate them into scalable and secure platform components.
• Develop and maintain APIs and services for seamless interaction between the platform and various LLMs.
• Optimize platform performance for efficient handling of LLM workloads.
• Implement robust monitoring and logging solutions to ensure the health and performance of the LLM integration layer.
• Stay up-to-date on the latest advancements in LLM tools, frameworks, and platform engineering best practices.
• Contribute to developing internal documentation and best practices for LLM platform operations.

You are the ideal candidate if you have:

• Proven experience in building and deploying large-scale platforms.
• Proficiency in programming languages like Python, Java, Javascript, or Go.
• Expertise in containerization technologies (e.g., Docker) and infrastructure orchestration tools.
• Strong understanding of distributed systems principles and microservices architecture.
• Worked on event-driven architecture using tools like RabbitMQ
• Experience with NoSQL and RDBMS
• Experience working with APIs
• Working knowledge of front-end technologies like React
• Experience with cloud platforms like AWS, Azure, or GCP (familiarity with specific LLM deployment environments a plus).
• Excellent problem-solving and analytical skills.
• The ability to work independently and as part of a cross-functional team.
• A strong passion for innovation and a desire to build impactful solutions.
• Great code/design skills
• Adherence to practices like TDD, Clean Code, Domain oriented design 

Bonus points for:

• Experience working with Large Language Models (LLMs) or other deep learning models.
• Familiarity with DevOps principles and practices.
• Experience with security best practices for cloud-based deployments.
• Experience in building IDE plugins
• Experience in extending open source platform 
• Experience in pipeline orchestration using tools like Airflow or similar