KeepOmniBot

KeepOmniBot is the crawler behind Keep Omni. It reads public pages of sites whose owners added them to Keep Omni, and public changelog and pricing pages those owners chose to watch. It checks whether published content is still accurate. It does not index pages for search, train models, or submit forms.

How to recognise it

Every request sends this User-Agent:

How it behaves

• It reads robots.txt on every domain before crawling and follows it.
• At most 2 requests at a time to one host, with at least 500 ms between requests to the same host.
• Requests time out after 15 seconds.
• It only fetches pages; it never sends personal data or logs in.

How to block it

Add this to your site's robots.txt:

User-agent: KeepOmniBot
Disallow: /

To block only part of a site, replace / with the path you want excluded. Changes apply the next time the crawler reads your robots.txt.

Contact

If the crawler causes a problem on your site, write to hi@k-o.pro and I will look into it.