Local AI Chat
Chat with a small AI model that runs entirely in your browser; nothing you type is sent to a server.
- AI model
- …
- Download size
- … ·
- Device
- Checking browser support…
Small local models can be wrong or make things up. Do not rely on them for important facts. The conversation stays in this tab and is deleted when you close it.
Private AI chat
Everything you type into popular AI chatbots is sent to a server. Local AI Chat downloads a small language model to your browser and runs it entirely on your device. Your questions, notes and messages never go anywhere.
Model options
- Qwen2.5 0.5B: multilingual, though answers in languages other than English are limited and often inaccurate
- SmolLM2 360M: English, faster
The model is about 260–490 MB depending on your choice and device, and is only downloaded when you click Download and confirm; it's cached afterwards.
Features
Answers stream word by word and you can stop them at any time. In browsers with WebGPU the graphics card is used for faster responses.
Set your expectations
These small models aren't as knowledgeable as large cloud models; they suit simple questions, text drafts and experiencing on-device AI. Always verify important information.
How to use Local AI Chat
- Choose a model and confirm the download.
- Wait for the model to load.
- Type your message and send it.
- Watch the answer stream in; stop it if you like.
Why use this tool?
Try AI without sharing your data with anyone, and without an internet connection once the model is downloaded.
FAQ
Why is it slower than online chatbots?
The model runs on your own device, usually on the CPU. In browsers with WebGPU (current Chrome and Edge) it can use the graphics card and is faster.
Can I chat in languages other than English?
Qwen2.5 can write other languages, but answers are limited and often wrong. English questions give the best results.
Is my chat history saved?
No, the chat is only kept in the open tab and never sent to a server.
Related tools
AI Translator (On-Device)
Translate text between English and 23 languages with OPUS-MT models on your device; nothing goes to a translation server.
Open toolAI Text Summarizer
Turn English articles and long texts into short, medium or detailed summaries without sending the text anywhere.
Open toolAI Document Q&A
Upload a PDF, TXT or Markdown file and ask questions; the document is parsed, indexed and answered on your device.
Open toolAI Text to Speech
Turn English text into natural speech with 14 American and British voices, adjustable speed and WAV download.
Open tool