State how AI may use your content
Set your preferences for search, live AI answers, and AI training, and get the Content-Signal lines to add to your robots.txt. In our scans, around 96% of stores have not set this yet.
# Generated free with UnderstoodBy.ai (https://www.understoodby.ai/tools) User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: /
Why stating your AI content preferences matters
The Content-Signal directive, introduced by Cloudflare, lets you state in your robots.txt how you are willing to let automated systems use your content. It separates three things that used to be lumped together: search indexing, AI input (grounding live answers), and AI training. You can say yes to being found and quoted while saying no to training, for example.
For a store that wants AI visibility, allowing search and AI input is the friendly posture, because those are what put you in front of shoppers. The training choice is yours. Setting the signal explicitly is a small, current, and clear way to put your preferences on record. In our scans, around 96% of stores have not done it.
How to install it
Shopify
- Open robots.txt.liquid in your theme code editor.
- Add the generated lines inside the file (they sit alongside your existing rules).
- Confirm the result at yourstore.com/robots.txt.
WordPress / WooCommerce
- Edit robots.txt via your SEO plugin or over SFTP.
- Paste in the generated lines.
- Confirm the result at yoursite.com/robots.txt.
Next.js / custom
- Add the lines to public/robots.txt or your robots route.
- Deploy.
- Confirm the result at yourdomain.com/robots.txt.
Questions
What is the Content-Signal directive?
It is a robots.txt addition, promoted by Cloudflare, that states whether you permit your content to be used for search, as AI input for live answers, and for AI training. It makes your preferences explicit rather than implied.
Is it enforced?
It is a stated preference, like the rest of robots.txt. Well-behaved crawlers respect it. It is a clear signal of intent, not a hard technical block.
What should a store that wants AI visibility choose?
Allowing search and AI input keeps you visible in the surfaces shoppers use. The training choice is a separate decision and entirely yours.
Does this replace my AI robots.txt rules?
No. It complements them. Use the AI robots.txt tool to set crawler access, and Content-Signal to state how the content may be used.
Want to know how AI actually reads your store?
This tool fixes one signal. Our free scan checks all of them and gives you a 0 to 100 AI Visibility Score in about a minute, no signup to see it.
Get my free score