About the Role:
Job Title: Lead Generative AI Engineer
Key Responsibilities:
Architect, build and deploy well-managed core APIs and SDKs to access LLMs and our proprietary FMs including training, fine-tuning and prompting tasks, including orchestration SDKs.
Design APIs for performance, real-time applications, scale, ease of use and governance automation.
Develop application-specific interfaces that leverage LLMs and FMs to continue to enhance the associate and customer experience.
Enable our users to build new GenAI capabilities.
Develop tools and processes to monitor API access patterns and operational health.
Design and implement AI safety and guardrails in the API layer working closely with researchers.
Minimum Qualifications:
Bachelor’s degree in Computer Science, Computer Engineering or a technical field
At least 6 years of experience designing and building data-intensive solutions using distributed computing and cache optimization techniques
At least 6 years of experience programming with Python, Go, Scala, or Java
At least 1 years of experience building, scaling, and optimizing training or inferencing systems for deep neural networks
Desired Qualifications:
Familiarity with building large-scale AI products or platforms for NLP, speech, computer vision, or recommendation systems serving millions of users.
Ability to move fast in an environment with ambiguity at times, and with competing priorities and deadlines.
Experience At Tech And Product-driven Companies/startups Preferred.
Ability to iterate rapidly with researchers and engineers to improve a product experience while building the foundational capabilities.
Familiarity with deploying large neural network models in demanding production environments.
Have experience with API security, observability, cloud access control and privacy best practices.
Location: McLean, VA (Hybrid role 2 days a week)
Bachelor's degree