LOKI
Tech Specs.
Tech specs
- Deployment
- On-premises on included hardware (Docker Compose). Fully offline operation possible (air gap). NVIDIA GPU support.
- Language model (default)
- Local open-weights LLM (122B parameters, quantized) on your own GPU hardware, incl. reasoning mode.
- Optional model providers
- Anthropic, OpenAI, Google Gemini, Mistral AI, Cohere, Groq, DeepSeek, xAI, OpenRouter, and OpenAI-compatible endpoints. At runtime via dashboard, keys encrypted.
- Retrieval
- Hybrid search (vector + sparse fusion) on PostgreSQL/pgvector, cross-encoder reranking, semantic and exact pattern search.
- Document analysis
- Structure-aware parsing (layout, tables, OCR de/en), vision model for images, local Whisper transcription for audio and video.
- File formats
- 50, incl. PDF, DOCX/DOC/ODT/RTF, XLSX/XLS/ODS/CSV, PPTX/PPT, MSG (incl. attachments), PNG/JPG/TIFF/SVG, MP4/MOV/MKV/MP3/WAV, TXT/MD/HTML/JSON/YAML.
- Agent tools
- Document search (semantic + exact), web search with page fetching and sources, Python sandbox with charts, SQL on connected databases, Word and PowerPoint generation, arXiv, weather. With human-in-the-loop approvals.
- Access control
- Roles (admin/manager/user), groups, knowledge bases as scopes with security trimming in the vector index.
- Sign-in
- Username/password (JWT, httpOnly cookies) and Microsoft Entra ID SSO (multi-tenant, tenant approval). Configured at runtime in the dashboard, automatic group assignment for new SSO users. Two-factor sign-in (TOTP) with recovery codes, mandatory if you wish. Lockout after repeated failed attempts, password reset by email.
- Microsoft 365
- SharePoint folders and libraries as document sources (incremental sync: new, changed, and deleted files), Entra group sync, SharePoint access rights carried over. Sync runs visible in the dashboard, scheduled or on demand.
- Databases
- PostgreSQL, MySQL, MariaDB, Microsoft SQL Server and Oracle. Read-only queries, granted per group.
- Web search
- Self-hosted metasearch engine (SearXNG) on the appliance. Results and fetched pages as numbered sources, no requests to internal addresses, HEIMDALL check before sending, can be switched off per chat.
- Cloud quota
- Token budget for the whole company per day, week and month. Notice from 80 %, at 100 % LOKI carries on with the local model automatically.
- Setup & updates
- Setup wizard in German and English: addresses, certificate, first admin, two-factor sign-in. Signed one-click updates in the dashboard, with release notes, automatic database backup and a way back to an older version.
- Audit & monitoring
- Log of external model access incl. token usage, activity log, usage statistics, OpenTelemetry tracing and metrics.
- Interfaces
- Chat app, admin dashboard, embeddable website widget. German and English, light and dark mode.
- Ingestion
- Drag-and-drop upload (up to 100 MB in chat, 50 MB in the dashboard), watched server folders with daily sync, SharePoint sources with incremental sync, bulk import and export.
And that is far from everything.
Connect knowledge
- PDF, Office, email, images, audio, video
- Scans via text recognition, German and English
- Tables stay tables
- Formulas read as LaTeX
- Figures and drawings described
- Recordings transcribed locally
- Saved Outlook emails with attachments
- Drag-and-drop upload with access group
- Watch server folders, set exclusions
- Connect SharePoint, files stay there¹
- SharePoint permissions carried over¹
- Databases from PostgreSQL to Oracle
- MySQL, MariaDB and SQL Server too
- Indexing progress, retry failed files
Ask
- Choose data sources per chat
- Research the web with your own search engine
- Searches by meaning and keyword
- Ask a SQL database in plain language
- Search the mailbox, read only¹
- Attach files to the question
- Dictate, recognized locally
- Pick the model in chat, local by default
- Pick the effort: fast, medium, thorough
- Warning banner for cloud models
- Prompt before sensitive data leaves²
- Handle locally instead of sending²
- Edit a message and send it again
- Stop an answer at any time
Check the answer
- Numbered sources in the text
- Web pages cited, with a link
- Passage highlighted in the PDF
- Passage marked in Word files too
- Figures from the source in the answer
- Reasoning expandable, with duration
- Every tool call with input and result
- SQL and Python in plain text
- Read-only database queries
- Charts from real code
- Charts full-size on click
- HTML preview without scripts
- Formulas, tables, Mermaid diagrams
- Answers in the language of the question
Keep working
- Export as PDF with sources and attachments
- Export selected messages only
- Copy an answer in one click
- Read aloud with on-device voices only
- Thumbs up or down, with a note
- Feedback with a screenshot
- Full-text search across all chats
- Hits highlighted in the chat, with navigation
- Pin chats and sort them by dragging
- Chat titles set automatically
- “Remember …” for later chats
- View, delete or switch off memories
- Learns from finished chats, can be switched off
- Notices when something no longer applies
Manage and secure
- Permissions reach into the search index
- Admins see only granted content in chat
- Permission changes without re-indexing
- Grant tools per group
- Each user’s access at a glance
- Sign-in with Microsoft Entra ID¹
- Two-step sign-in
- Lockout after repeated failed attempts
- Lock accounts instead of deleting them
- Custom patterns, e.g. for order numbers²
- Every decision in the audit log²
- Every cloud request logged
- Token limit per cloud provider, then local
- Signed updates with automatic rollback³
¹ With Microsoft 365. ² With HEIMDALL, once a policy is active. ³ Needs a connection to the update source.
Thought through. Down to the detail.
Visible thinking.
The model's reasoning streams live. Collapsible, with timing.
Speak instead of type.
Voice input with live waveform, transcribed locally.
Remembers what matters.
Name, role, recurring projects: LOKI remembers durable facts across conversations. Viewable, deletable, switchable off anytime.
Chat as PDF.
Export entire conversations including sources.
Find everything again.
Search across chat history with hit navigation, pin and rename chats.
Beautiful code.
Markdown with syntax highlighting, Mermaid diagrams, and LaTeX formulas.
Edits welcome.
Edit your own messages and run them again.
Your language, your look.
German and English, light and dark mode, attachments up to 100 MB.
LOKI everywhere. Including your website.
One script tag is enough, and LOKI answers questions right on your website: as a subtle chat bubble in your colors, with your logo and your suggested starter questions. Visitors need no account. The widget only accesses the content you release for it.

One stack. One command.
LOKI ships as a complete container stack on specialized hardware: reverse proxy with TLS, API, background workers, vector database, interfaces, and the code sandbox, wired up and ready. Plus an offline mode for environments without any internet: all model weights come preinstalled. A wizard guides you through setup, and you install updates with one click in the dashboard, whenever you choose. The database is backed up automatically first.
Air-gap ready.
In offline mode, not a single external download takes place. Everything is on board.
Sandbox with a one-way street.
Code executed by the agent runs in a container without network access, without write permissions, with hard resource limits. Reachable only through a one-way proxy.
Measurable.
Every request, every tool and every indexing run can be traced. With bundled monitoring on request.
Any model. Your rules.
Out of the box, LOKI works with a large open-weights language model on the included GPU hardware. No API keys, no cloud. If you want more, you enable additional providers via the dashboard: Anthropic, OpenAI, Google, Mistral, Cohere, Groq, DeepSeek, xAI, OpenRouter, or any OpenAI-compatible endpoint. Many models also let you pick the effort: fast, medium or thorough.
Local by default.
The included model runs on your hardware. If a cloud provider goes down, it steps in automatically.
Flags cloud use.
If a chat uses an external model, everyone in that conversation sees a clear warning banner.
Keys kept safe.
API keys are stored encrypted and never shown in plain text.
Live today. And what comes next.
LOKI grows with every release. Here's the current status.
Live today
- Cited answers with source highlighting in the PDF
- 50 file formats incl. audio and video transcription
- Live database access (SQL via natural language)
- Word, PowerPoint, and charts straight from the chat
- Human-in-the-loop for sensitive actions
- Microsoft 365: Entra ID SSO, SharePoint as a document source with incremental sync and carried-over permissions, calendar via slash command
- HEIMDALL as the built-in compliance filter for external AI calls: NER plus regex, decide in the chat, every call in the audit log
- Persistent memory across conversations
- Feedback on answers right in the chat
- Embed widget for your own website
- Dashboard with usage statistics
- Web search via a self-hosted search engine, with sources and HEIMDALL checks
- Two-step sign-in and lockout after failed attempts
- Cloud quota per day, week and month, then automatically local
- One-click updates in the dashboard, with backup and a way back to the previous version
In development
- Refine presentations in dialogue, slide by slide, with live preview
- Proactive monitoring with notifications
- Skill marketplace with curated workflows
Platform character
LOKI is end product and platform at the same time. If you start with the end product, you can add your own skills later. If you start with custom development, you have full technical depth from day one.
LOKI can make mistakes. Please verify important information against the cited sources.