Troubleshooting

Sitemap or robots.txt problems

A sitemap that shows "Page not found", or robots.txt and AI crawler settings that don't take effect, usually come from plain permalinks, a real robots.txt file on the server, or a cache.

The sitemap shows "Page not found"

  1. Permalinks: go to Settings → Permalinks and click Save Changes without changing anything. This refreshes WordPress's address rules, which the sitemap needs.
  2. Plain permalinks: if your addresses look like ?p=123, choose Post name on the same screen. The site check offers this as a one-click fix.
  3. Sitemap switched off: check Kufi → SEO → Settings → Sitemaps → Publish an XML sitemap.
  4. Cache: purge your caching plugin and host cache, then try again in a private window.

The same steps fix a missing /llms.txt.

Google Search Console says "Couldn't fetch"

  • Open https://your-site.com/sitemap_index.xml in a private window. If it loads, wait a day: Search Console often retries.
  • Make sure the site isn't hidden: Settings → Reading → Discourage search engines must be off.
  • A firewall or security plugin may block Google. Check its logs for blocked Googlebot requests.

robots.txt changes don't show

Kufi SEO writes robots.txt for you, but a real robots.txt file in your site's main folder always wins. The site check warns about it ("A robots.txt file on the server overrides these settings").

  1. Open your host's file manager (or FTP) and find robots.txt next to wp-config.php.
  2. Copy any rules you want to keep into Kufi → SEO → Settings → AI and crawlers → Extra rules.
  3. Delete or rename the file.
  4. Open https://your-site.com/robots.txt to check.

Some hosts create this file automatically. If it comes back, ask the host to stop generating it.

The sitemap doesn't list a page

  • The page is hidden from search (its SEO box, or its content type under Search appearance).
  • It's a draft, private or password-protected.
  • Its ID is in Sitemaps → Leave out these IDs.
  • Its content type isn't ticked under What to include (when you ticked some).

More in Troubleshooting

Still need help?

Tell us what you are trying to do and what you see. We read every message.