AI Architect

AI Architect

Remote: Work from Home Full-Time

Phoenix, AZ

New York, NY

Cincinnati, OH

Seattle, WA

Overland Park, KS

Charlotte, NC

Kansas City, MO

Kansas City, KS

Portland, OR

Full time

R0032147

It's fun to work at a company where people truly believe in what they are doing!

Job Description:

Epiq is standing up a brand‑new AI Architecture function to design the platform, pipelines, and standards that power AI across Legal Solutions. This is a hands‑on role for a builder who ships production systems—not just theory.

You’ll define the technical vision, establish LLMOps/MLOps practices, mentor engineers, and ensure solutions are secure, compliant, and reliable in a .NET product ecosystem with Python‑based AI services running on Azure.

What you’ll do

• Own the AI system architecture end‑to‑end: data flows, model development, training/inference pipelines, deployment strategies, and integration into .NET products.
• Stand up and evolve LLMOps/MLOps foundations: model/asset registry, CI/CD, evaluation (offline/online), observability, rollback/kill switches, and cost/performance controls.
• Build Azure-first services and infrastructure (e.g., Azure ML, Azure OpenAI, AKS, Azure Functions, Azure Storage, Azure Key Vault), enabling secure, scalable AI in production.
• Implement guardrails and governance (privacy, data handling, RBAC, auditability) and partner with Security/Legal to operationalize responsible AI.
• Collaborate with product and engineering to identify high‑value use cases and deliver measurable outcomes, not just prototypes.
• Mentor and influence engineers through design reviews, reference implementations, standards, and training.
• Act as a conduit to IT/DevOps to align infra, networking, and platform reliability with product needs.
• Translate complex AI concepts into actionable plans for business and technical audiences

What you’ll bring (must‑have)

• 7+ years in software engineering with 3+ years architecting AI/ML systems in production (or equivalent experience).
• Python for AI services and familiarity with .NET/C# for product integration and service contracts.
• Proven delivery of training/inference pipelines on containers/Kubernetes with a major cloud (preferably Azure).
• Hands‑on experience with model lifecycle (selection/fine‑tuning, versioning, deployment, rollback), CI/CD, observability, and evaluation/guardrails for LLM and ML systems.
• Strong communication with the ability to translate complex concepts into actionable roadmaps for technical and non‑technical partners.

Bonus points (nice‑to‑have)

• Azure ML registries/endpoints, Azure OpenAI, AKS, GitHub Actions/Azure DevOps; experience with mlflow, Airflow/Prefect, Feast/feature stores, vector search (e.g., Azure AI Search, pgvector, Milvus, FAISS).
• Data privacy/compliance background in regulated industries.
• Deep SDLC/DevEx skills (templates, scaffolding, internal libraries, golden paths).
• Understanding of MicroVM, Containerization/Kubernetes, Microservices

#LI-Remote

The Compensation range for this role is 150,000 to 165,000 USD annually and may be eligible for an annual bonus.​        

Your specific salary will be determined based on several factors:

• Location-based market rate for the role

• Your abilities in relation to the job specification

• Performance during screening and interview

• Pay parity with the wider team in the considered location