CrawlerControl
Product guide

Privacy

The tool calculates and creates files in your browser. It needs no account and does not send your input to Chapa Lab.

Privacy by design

  1. 01

    Advertising is disabled; there is no CMP, ad slot or request to an advertising network. ChapaLab uses Cloudflare Web Analytics to measure visits and loads its script manually. External services receive the data needed to process your request and apply their own policies.

  2. 02

    The data is processed in the browser and is not sent to Chapa Lab.

  3. 03

    Language preferences remain only during the session.

  4. 04

    Downloads are generated on the device under the user's control.

Your data stays on this device

Paste your robots.txt and try a route

The tool calculates and creates files in your browser. It needs no account and does not send your input to Chapa Lab.

Your inputs
Contents of robots.txt · local route · User-agent
What you do
The data is processed in the browser and is not sent to Chapa Lab.
What you get
Downloads are generated on the device under the user's control.
Advertising and measurement
Advertising is disabled; there is no CMP, ad slot or request to an advertising network. ChapaLab uses Cloudflare Web Analytics to measure visits and loads its script manually. External services receive the data needed to process your request and apply their own policies.

Responsible scope

Sources and scope

robots.txt is not authentication, security, or a deindexing command. The simulator implements a practical subset of RFC 9309 and does not query remote URLs.

Try the tool