AI Tracker
Measure the real impact of AI on your SEO.
SEO Dashboard
Analyze your project's performance with our SEO Dashboard.
Rank Tracker
Track all your keywords with unlimited Rank Tracker.
SEO Reports
Learn how to create and automate SEO reports.
SEO Extension
Discover SEOcrawl's all-in-one SEO extension.
New
Task Manager
Organizing tasks and project priorities has never been easier.
SEO Annotations
Analyze the SEO results of your implementations.
SEO Monitor
Track all changes to your website with the new SEO Monitor.
SEO Cannibalization
Learn how to identify and fix cannibalization issues in your project.
Crawler
Discover all new features of our crawler.
SEO Visibility
How to calculate your SEO visibility score.
SEO Opportunities
How to detect and leverage SEO opportunities.
BookPricingDemo
Roadmap
See the product roadmap for 2026.
SEO Dictionary
Discover all the most important SEO terms with examples.
Changelog
Explore all improvements, new features, and updates.
Blog
News and resources to take your SEO project to the next level.
Getting Started
Discover step by step how to get the most out of SEOcrawl.
SEO Tutorials
Discover with our SEO tutorials all the elements that will help you.
AI Tracker
Measure the real impact of AI on your SEO.
Prompt Tracking
Measure and optimize your brand visibility in ChatGPT and AI.
ENES
LoginStart Free Trial

SEOcrawl Bot Technical Information

  • David Kaufmann
  • December 16, 2022
  • SEOcrawl,SEOcrawl

Have your website servers blocked the SEOcrawl bot and prevented you from seeing all the valuable insights we have launched for you? Fret not! In order to gain access, all you have to do is enter the following data to your server’s white-list:

user-agent:SeoCrawlerBot

user-agent:SeoCrawlerBot

By doing this, we will be able to keep on providing data on:

  • SEO Monitor:code changes.
  • Crawling: technical crawling and indexing issues; and
  • much more that is yet to come.

In case any issue arises, we will be pleased to help you out.

About the Author:

David Kaufmann

David Kaufmann

Leave a CommentCancel reply

Comment

Save my name, email, and website in this browser for the next time I comment.

Ready to try SEOcrawl?

14-day free trial. No credit card required.

Start Free Trial