APPLYDJINN
Vacancy catalog
OLD

Long-running vacancy

This listing is older than 30 days but its source has not removed it. Verify availability on the original company page before applying.

EPAM
Open role>1 month

Lead Azure DevOps Engineer

EPAM
Armenia; Georgia; Kazakhstan +2 more

Armenia; Georgia; Kazakhstan; Kyrgyzstan; Uzbekistan

Work model
Hybrid
Experience
5+ years
Employment
Not specified
Compensation
Not disclosed
Technology signal
11 tags

Technology context

11

Parsed from the vacancy text; ordered by relevance to this role.

AILLMAzureReliability EngineeringDevOpsAPICI/CDAzure API ManagementAzure DevOpsLiteLLMLLM security

Full listing

Role description

We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.

Responsibilities

  • Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
  • Integrate models and providers into gateway solutions to support enterprise-scale operations
  • Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
  • Establish observability and resilience mechanisms to maintain production stability
  • Implement LLM routing and broker logic to optimize model performance and reliability
  • Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
  • Take ownership of gateway implementation projects and deliver functional solutions rapidly
  • Collaborate with cross-functional teams to align gateway operations with organizational security standards
  • Monitor and troubleshoot production systems to ensure continuous availability

Requirements

  • 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
  • Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
  • Proficiency in LiteLLM and other LLM gateway platforms
  • Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
  • Understanding of LLM routing, broker logic, and token/rate control mechanisms
  • Skills in observability, resilience engineering, and production system operations
  • Capability to take ownership and deliver functional gateway implementations rapidly
  • English proficiency at B2 level or higher