8x more visitors from AI assistants than from search engines

So I ran the numbers and Lacuna, our ML research map, now gets 8x more visitors from AI assistants than from search engines.
We figured out our AEO (answer engine optimization):
- We made the site really fast. Median page serve time is 25 ms, p99 411 ms. Over the last 7 days we've been serving ~87 requests per second on average.
- Every page has a plain Markdown version for LLMs to read.
- Paper pages bundle the paper, the related work and the open questions.
- We cleaned up the sitemap and the pages, and removed thousands of dead links the crawlers were hitting. OpenAI's crawler had cut its crawl of Lacuna ~10x, ChatGPT clicks halved about a week later, and they came back after the fix (probably not a coincidence).
Lacuna is built into Althea, an AI research assistant built for AI researchers, and you can set it up with your Claude + Codex.
First posted on LinkedIn, October 28, 2026.


