NB.
All work
02Private AI2025

On-Prem Legal AI

A private AI workspace for legal teams, with local models and document workflows on organization-controlled hardware.

Recorded walkthrough · 1:33 · Silent recording
Role
AI engineer
Year
2025
Status
Deployed on-premise
Stack
RAGLocal LLMsSecurity

The mess

Legal and other sensitive-data teams need document assistance without making a third-party cloud model the default destination for confidential information. The product had to make local AI accessible through a usable workspace.

The system

I helped build a private AI workspace around local model deployment, model management, and document-oriented workflows. Ollama runs inference and Open WebUI provides the browser interface on organization-controlled hardware. The design keeps models, documents, storage, and inference under the organization’s control.

The result

Local model management and document-oriented assistance on customer-controlled infrastructure.

Document-oriented AI workflows
Organization-controlled storage and inference
Local model deployment and management