Crawler information
About the Crobi crawler
Crobi audits public landing pages when one of our customers asks it to. If you’ve seen our user agent in your logs, someone requested an audit of one of your pages.
The crawler loads the page once at desktop and mobile size, the way a visitor’s browser would. It does not follow links, submit forms or log in.
Questions or requests: [email protected].