What is a robots.txt file?

A text file at the site root that suggests which paths crawlers should skip. It is not access control.

How do I create robots.txt for WordPress?

Generate the file here, or create robots.txt in the web root. A physical file overrides the virtual one WordPress can serve.

A User-agent: * group, Disallow: /wp-admin/ with Allow: /wp-admin/admin-ajax.php, and a Sitemap line.

Yes, block /wp-admin/ and allow admin-ajax.php. That hides admin screens from crawlers. It does not replace a password or 2FA.

Add a line: Sitemap: https://your-domain/sitemap_index.xml. This generator writes that line from the URL you enter.

A free online builder for a WordPress robots.txt file aimed at technical SEO and site owners.

It writes User-agent, Disallow, Allow, and Sitemap lines from the options you tick. Nothing is uploaded for you.

Set the sitemap URL, choose Disallow rules, copy the file, and place it at https://your-domain/robots.txt.

Yes. It is free with no sign-up.

Yes. Mobile browsers are supported.

Free WordPress Robots.txt Generator | Binary Tech