To notify search engines to exclude your website from search results:

Basic Site-Wide Exclusion:

1. Go to Settings > Crawlers
2. Check "Block search engine crawlers"

This adds a robots.txt rule that prevents search engines from indexing your entire site while keeping it accessible to visitors.

Excluding Specific Pages:

You can exclude individual pages using two methods:

1. Page Settings Method:

• Open Pages panel
• Click gear icon (⚙️) on desired page
• Go to SEO tab
• Enable "Hide page from search results"

2. Code Injection Method:

<meta name="robots" content="noindex" />

Important Notes:

• Excluding a collection page also excludes all its items (products, blog posts, etc.)
• Individual collection items cannot be excluded separately
• Index page exclusion doesn't affect subpages
• These methods only block external search engines, not site search
• Pages remain accessible to direct visitors

Method Comparison:

Page Settings:

• Available on all plans
• No coding required
• Removes page from sitemap
• Not available for homepages
• Auto-activated on demo pages

Code Injection:

• Requires Personal plan or higher
• Requires manual code addition
• Page stays in sitemap
• Works on homepages

For AI crawler exclusion specifically, use the dedicated AI scan exclusion settings in your site controls.

Remember that changes may take time to reflect in search results as search engines need to re-crawl your site to recognize these changes.

Related Articles

Previous Articles