In this role, you will:
- Design, develop, and deploy robust infrastructure for LLM integration within the Legacy Leap platform.
- Collaborate with AI Scientists to understand LLM requirements and translate them into scalable and secure platform components.
- Develop and maintain APIs and services for seamless interaction between the platform and various LLMs.
- Optimize platform performance for efficient handling of LLM workloads.
- Implement robust monitoring and logging solutions to ensure the health and performance of the LLM integration layer.
- Stay up-to-date on the latest advancements in LLM tools, frameworks, and platform engineering best practices.
- Contribute to developing internal documentation and best practices for LLM platform operations.
You are the ideal candidate if you have:
- Proven experience in building and deploying large-scale platforms.
- Proficiency in programming languages like Python, Java, Javascript, or Go.
- Expertise in containerization technologies (e.g., Docker) and infrastructure orchestration tools.
- Strong understanding of distributed systems principles and microservices architecture.
- Worked on event-driven architecture using tools like RabbitMQ
- Experience with NoSQL and RDBMS
- Experience working with APIs
- Working knowledge of front-end technologies like React
- Experience with cloud platforms like AWS, Azure, or GCP (familiarity with specific LLM deployment environments a plus).
- Excellent problem-solving and analytical skills.
- The ability to work independently and as part of a cross-functional team.
- A strong passion for innovation and a desire to build impactful solutions.
- Great code/design skills
- Adherence to practices like TDD, Clean Code, Domain oriented design
Bonus points for:
- Experience working with Large Language Models (LLMs) or other deep learning models.
- Familiarity with DevOps principles and practices.
- Experience with security best practices for cloud-based deployments.
- Experience in building IDE plugins
- Experience in extending open source platform
- Experience in pipeline orchestration using tools like Airflow or similar