Binary Tech InstituteBinary TechInstitute
All free tools

Free tool

WordPress

WordPress Robots.txt Generator

Build a WordPress robots.txt with wp-admin rules, a sitemap line, and optional extra Disallow paths. Copy it to the site root.

Runs in your browser — your data stays on your device

Free tool
robots.txt
# Generated by Binary Tech Institute WordPress Robots.txt Generator
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /?s=
Disallow: /search/
Disallow: /cgi-bin/

Sitemap: https://example.com/sitemap_index.xml
  • Place robots.txt at the site root (https://example.com/robots.txt). WordPress can also serve a virtual file; a physical file wins.
  • Blocking /wp-admin/ in robots.txt hides it from crawlers. It is not a login firewall. Keep a strong password and 2FA.

robots.txt is a crawl hint, not a lock. WordPress site owners still get two things wrong: they block all of /wp-admin/ without allowing admin-ajax.php, and they forget the Sitemap line that Google Search Console already expects. This free WordPress robots.txt generator writes a conservative file for technical SEO: Disallow wp-admin with Allow admin-ajax, optional search-URL blocks, and a sitemap URL you paste from Yoast, Rank Math, or core /wp-sitemap.xml. Use it without installing another plugin.

How to use the WordPress Robots.txt Generator

  1. 1

    Paste your sitemap URL, usually https://your-domain/sitemap_index.xml or /wp-sitemap.xml.

  2. 2

    Keep Disallow /wp-admin/ and Allow admin-ajax.php unless you have a reason to change them.

  3. 3

    Copy the file to the site root as robots.txt, then test the URL in a browser and in Google Search Console.

Why robots.txt still matters for WordPress SEO

A missing sitemap line slows discovery. A Disallow on /wp-admin/ without admin-ajax can break front-end features that crawlers hit. Blocking /wp-admin/ also does not hide wp-login.php from attackers. We teach robots.txt as a crawl budget and politeness file, then put real protection in .htaccess, 2FA, and updates. That split is what separates technical SEO from a false sense of security.

WordPress robots.txt generator with examples

With the defaults you get User-agent: *, Disallow: /wp-admin/, Allow: /wp-admin/admin-ajax.php, search Disallows, and Sitemap: https://example.com/sitemap_index.xml. Replace the example host with your domain before you upload the file.

Guides and next steps

Privacy note

Generation runs in your browser. We do not crawl your site.

Frequently asked questions

Explore more

Related free tools

More WordPress .htaccess and robots.txt generators for hosting and SEO basics.

View all tools
WordPress

WordPress .htaccess

Free online WordPress .htaccess generator for permalinks, HTTPS, redirects, and security rules. Copy a file you can paste without extra plugins.

Open tool
DNS & lookup

HTTP Status Checker

Free HTTP status code checker for web developers and IT support. See live status codes, redirect chains, and final URLs for any public website.

Open tool
DNS & lookup

SSL Certificate Checker

Free SSL certificate checker for website owners and cybersecurity students. Inspect issuer, SANs, validity dates, and fingerprints for any public HTTPS host.

Open tool
Security

Security Headers Checker

Free HTTP security headers checker for website owners and cybersecurity students. Score HSTS, CSP, X-Frame-Options, and other hardening headers on any public site.

Open tool
Developer

HTML Formatter

Free online HTML formatter for frontend developers and beginners. Pretty-print minified or messy HTML locally in your browser—no install.

Open tool
Career

IT Skills Assessment

Free online IT skills assessment for beginners, students, and career changers. Score Windows, networking, security, Microsoft 365, and WordPress.

Open tool
View all free tools

Ready to go beyond free tools?

Live mentor-led courses turn calculator practice into real networking and IT skill.

View recommended courseAll courses