Werkery

robots.txt Tester

Paste robots.txt + a path, see whether the path is allowed for a specific user agent. Implements RFC 9309 (Robots Exclusion Protocol).

Tool by ·
ad slot ()
✗ Disallowed
Matched rule: Disallow: /admin/
ad slot ()

How it works

  1. 1
    Paste robots.txt
    Source content.
  2. 2
    Type path + UA
    What to test.
  3. 3
    Read
    Allow/disallow with rule shown.

Frequently asked

How is precedence decided?

RFC 9309: the longest matching rule wins. Group with the most specific User-Agent applies. * is the catch-all and lowest priority.

Get new tools first.

One tool per week. No ads. Unsubscribe anytime.

Related tools

URL Parser
Break a URL into its parts — scheme, host, port, path, query parameters, hash. Visualize query string as a table.
HTTP Status Code Lookup
Look up any HTTP status code — 200, 301, 404, 418, 502, more. Get name, RFC reference, and a one-line explanation of when servers use it.
MIME Type Lookup
Find the MIME type for a file extension, or look up extensions for a MIME type. Includes common image, video, audio, document, and archive formats.
Termination Letter Generator
Create a legally sound termination letter for your apartment, employment contract, mobile phone contract, gym membership, or insurance — in seconds, AI-powered.
Rent Reduction Calculator
Calculate the permissible rent reduction for housing defects (mould, heating failure, noise) and generate a defect notice letter to your landlord.
Garnishment Exemption Calculator 2026
Calculate your protected income based on the current garnishment table 2026 (valid since July 1, 2025). Includes maintenance obligations.
Tool designed and editorially reviewed by Felix Brübach. Text drafted with AI assistance and reviewed for legal and factual accuracy before publication. Not legal advice — for complex cases, consult a lawyer.
ad slot ()