Senior ML Operations & Python Engineer

Job Responsibilities:
Client is seeking three knowledgeable Senior Client Operations & Python Engineers with advanced Python and Flask, Large Language Models, Open API engineering, Containerization and Swagger expertise for a multi-year engagement to work with a foremost Healthcare IT Solutions Group in their Innovations Project Team.

Prerequisites for the selection of the Consultant encompass:

• Advanced Python programming for back-end development for Machine Learning Operations.
• Expertise with OpenAPI specs.
• Conversant with LLMs, specifically Llama 2 or Mistral.
• Familiar with Prompt Engineering.
• Required to productionize Large Language Model (LLM) based solutions.
• Capable of taking an open-source Large Language Model (LLM) and fine tuning it to reflect custom data and retrieve data from a Vector database.
• Will be required to design a RESTful API that interfaces with a Large Language Model (LLM) and can be used for user consumption.
• Write Helm charts and the web front end.
• Must be skilled in modularizing machine learning code.
• Will transform Data Scientists' models into scalable, maintainable systems.
• Integrate the APIs with MongoDB (Reddis, Vector, databases, embedding models).
• Should have expertise in deploying and managing containerized applications using Kubernetes.
• Ability to take an open-source hugging face model and productionalize it so that user can use it on custom data.
• Plan the builds with Swagger CodeGen, Editor and Inspector.
• Experience with Jupyter notebooks, Flask, FastAPI, and on premises Docker and Kubernetes.
• Angular and Node are also utilized in this environment.
• Document plan and steps for development.