LLMOps Engineer

We are okay with remote. 

Key note from Manager-

Candidate should be able to support for LLM models- including incidents management, ongoing model management and maintenance, and user support

Candidate should be able to support Gen AI solutions -monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring

Core Skills needed –

•  Strong experience in developing, deploying, and managing large language models, specifically on Microsoft Azure.

•  Proven expertise in Azure cloud platforms and services, including Azure Machine Learning, Azure Kubernetes Service, and Azure DevOps.

•  Strong knowledge of LLMOPS guardrails implementation practices.

•  Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders.

Job Duties:

• Ops support for LLM models including incidents management, ongoing model management and maintenance, and user support

• GenAI solutions monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring

• Guardrails review and monitoring including bais audits, and other identified guardrail checks based on implemented GenAI solutions

• Code management support including proactive code optimization beyond breakfixes

 LLMs provide context and memory capabilities, while generative AI enables the production of engaging responses