WordPress.org

English (UK)

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: robots.txt

Plugin Tag: robots.txt

  • Unblock CSS & JS for Googlebot

    (0 total ratings)

    Modifies robots.txt to allow Googlebot access JS and CSS files.

    Miina Sikk 60+ active installations Tested with 4.4.34

  • CeeWP Robots.txt Manager

    (0 total ratings)

    Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

    CeeWP 50+ active installations Tested with 6.8.3

  • Block Common Crawl via robots.txt

    (0 total ratings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ active installations Tested with 6.3.7

  • Block Feed and Comments via robots.txt

    (0 total ratings)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 30+ active installations Tested with 6.3.7

  • Admin Robots.txt Editor

    (2 total ratings)

    Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

    Karan Makani 20+ active installations Tested with 6.8.3

  • LJPL Armored robots.txt

    (0 total ratings)

    Add some directives to your robots.txt file to keep your site safer

    Lukasz Jasinski 10+ active installations Tested with 3.4.2

  • ChatBot Blocker by CellarWeb

    (0 total ratings)

    ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

    Rick Hellewell 10+ active installations Tested with 6.4.7

  • AI Deny

    (1 total ratings)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 10+ active installations Tested with 6.9

  • Copyright AI Content Licensing – Block AI Crawlers + Get Paid

    (0 total ratings)

    AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

    Tyler Martin 10+ active installations Tested with 6.9

  • Thin Content Manager

    (1 total ratings)

    See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

    msfreed 10+ active installations Tested with 3.7.41

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.24

  • AI Rights Protection by SimpleFeed

    (1 total ratings)

    Protect your rights by reviewing and blocking AI bots from using your content without compensation.

    Alex Khomichenko Fewer than 10 active installations Tested with 6.7.4

  • Advanced SEO Toolkit

    (0 total ratings)

    Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.

    Mehdi Rezaei Fewer than 10 active installations Tested with 6.6.4

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart Fewer than 10 active installations Tested with 6.9

  • Block old browser versions and suspicious browsers

    (0 total ratings)

    With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.

    hupe13 Fewer than 10 active installations Tested with 6.9

  • Check System Details

    (0 total ratings)

    Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.

    Prabhat Fewer than 10 active installations Tested with 6.2.8

  • LLMs.txt – AI Website Content Crawling

    (0 total ratings)

    Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.

    Magazine3 Fewer than 10 active installations Tested with 6.8.3

  • IntentDeep Virtual Files for SEO – Robots.txt, Sitemaps & More

    (1 total ratings)

    Create robots.txt, sitemaps, ads.txt & JSON files at any path from WordPress dashboard. No FTP needed. Database-driven virtual files.

    IntentDeep Fewer than 10 active installations Tested with 6.9

  • HumanGate

    (0 total ratings)

    Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.

    DarkAI Fewer than 10 active installations Tested with 6.9

  • Flavio

    (0 total ratings)

    Make your life easy and grow with us. AI-powered SEO assistant for WordPress.

    marketgoo Fewer than 10 active installations Tested with 6.9