Blocking AI crawlers on a Magic Pages-hosted site takes one toggle. Here's exactly where to find it and how to confirm it's working.
Open the Customer Portal
From inside Ghost Admin, open the left sidebar and click Customer Portal. The portal loads inline.
Jannis Fedoruk-Betschki
Go to the Configuration tab
In the portal's top navigation, click Configuration. Scroll until you reach the AI crawlers section – it sits between Twitter API and the cache-purge action.
By default, the toggle is off:
Flip the toggle
Click the toggle next to Block AI crawlers from accessing this site. The portal saves the change immediately and confirms it with a message.
Changes typically reach Cloudflare's edge within a few seconds. We allow up to 60 seconds in the worst case.
Verify it works
You can confirm the block is live with a quick curl from any machine – replace yourdomain.com with your site's address:
curl -I -A "GPTBot/1.0" https://yourdomain.com/The response should start with HTTP/2 403. A normal browser request still returns 200:
curl -I https://yourdomain.com/No need to throw around terminal commands though. We've tested the implementation and it does work 😉
If you want to confirm this, please send us a quick message at [email protected] and we'll double-check everything for you.
Turn it off again
Flip the same toggle. AI crawlers can access your site again within about a minute. Nothing else changes – your content, search indexing, and human visitors are untouched throughout.
Background
For why this exists, what's blocked, and what isn't, see AI Crawler Controls on Magic Pages.
