Term Detective bot

How our crawler works

User agent: TermDetectiveBot/0.1 (+https://termdetective.com/bot; hello@termdetective.com)

What it reads

Publicly posted terms of service, privacy policies, data processing agreements, subprocessor lists, AI-specific terms, and trust and security pages. Only on a vendor's own domain, never third-party copies.

How often

Once to discover a vendor, then re-checked monthly. Documents on sites that allow it are re-fetched daily to watch for changes.

What it respects

robots.txt, at most one request per second per domain, and about six document fetches per vendor per day. It never logs in, solves CAPTCHAs, or works around bot protection. If a site blocks it, it stops and a person reviews the page manually.

Opt out

Email hello@termdetective.com and we will stop crawling your site within 24 hours.

Vendors: see how we handle corrections.