WordPress.org

Brezhoneg

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.28

  • AI Deny

    (1 total ratings)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 10+ active installations Tested with 6.9

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.24

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9

  • Azayem Bots Tracker – Bot Visits Logger

    (0 total ratings)

    A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).

    botstracker Fewer than 10 active installations Tested with 6.9

  • WEO LLMS & AI Crawler Guide

    (2 total ratings)

    The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …

    Md Atiar Rahman Ovi Fewer than 10 active installations Tested with 6.9

  • Valvai – AI Traffic Control Center

    (0 total ratings)

    Block, log and monetise AI crawlers directly from your WordPress dashboard.

    valvai Fewer than 10 active installations Tested with 6.8.3

  • AI Bot Monitor

    (0 total ratings)

    Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.

    straightdigital Fewer than 10 active installations Tested with 6.7.4

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart Fewer than 10 active installations Tested with 6.9