All posts
AI & LLMs
· 1 min read · ↗ simonwillison.net
Unseeable Prompt Injections and AI Browsers
OpenAI recently introduced an AI-powered browser, but giving an LLM free rein over web browsing creates massive security challenges. LLMs remain fundamentally vulnerable to prompt injection, and having an agent ingest arbitrary untrusted web content while holding active session cookies is a terrifying attack surface.
Security researchers at Brave demonstrated that prompt injections can even be hidden inside images using perturbations imperceptible to the human eye. When a multimodal agent views the page, it reads instructions that a human user cannot see at all. That is not a technology you want executing actions inside an authenticated browser session.