[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"$fikpPlqFq2ED8OdrFQn-EQ3UY4R0uZo3YjV4pOQV5W_c":3,"$fEL6g1ZqUs4Qcv2HrWSg_94xoMo9wtGmMqQxv0vzb64A":414,"$fYLbkHs8awFvAG6hPFUwZO3wCrc2WOG1xiT7J977nSaE":419},{"slug":4,"name":5,"version":6,"author":7,"author_profile":8,"description":9,"short_description":10,"active_installs":11,"downloaded":12,"rating":11,"num_ratings":11,"last_updated":13,"tested_up_to":14,"requires_at_least":15,"requires_php":16,"tags":17,"homepage":22,"download_link":23,"security_score":24,"vuln_count":11,"unpatched_count":11,"last_vuln_date":25,"fetched_at":26,"discovery_status":27,"vulnerabilities":28,"developer":29,"crawl_stats":25,"alternatives":36,"analysis":139,"fingerprints":390},"crawl-hunt-seo-audit-tool","Crawl Hunt – Advanced SEO Optimization Tool","1.0.9","themeshopy","https:\u002F\u002Fprofiles.wordpress.org\u002Fthemeshopy\u002F","\u003Cp>Crawl Hunt is a comprehensive WordPress plugin that helps you monitor and track website changes through automated crawling. Perfect for SEO monitoring, content tracking, and staying updated with your website’s status.\u003C\u002Fp>\n\u003Cp>This plugin connects to the Crawl Hunt service. You must opt in by clicking “Connect Crawl Hunt” inside the plugin before any data is sent to the service.\u003C\u002Fp>\n\u003Cp>\u003Cstrong>Features:\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Automated website crawling\u003C\u002Fli>\n\u003Cli>Track URL status and changes\u003C\u002Fli>\n\u003Cli>REST API integration for external crawlers\u003C\u002Fli>\n\u003Cli>Simple and intuitive admin interface\u003C\u002Fli>\n\u003Cli>Detailed crawl logs and history\u003C\u002Fli>\n\u003Cli>Secure account connection to Crawl Hunt\u003C\u002Fli>\n\u003Cli>Lightweight and performant\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>\u003Cstrong>External Service:\u003C\u002Fstrong> \u003Ca href=\"https:\u002F\u002Fwww.crawlhunt.com\" rel=\"nofollow ugc\">Crawl Hunt\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>\u003Cstrong>Data sent to the service:\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cul>\n\u003Cli>WordPress site URL during connection\u003C\u002Fli>\n\u003Cli>Account authentication token for API access\u003C\u002Fli>\n\u003Cli>Dashboard data requests initiated by the user\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>\u003Cstrong>Terms of Use:\u003C\u002Fstrong> \u003Ca href=\"https:\u002F\u002Fwww.crawlhunt.com\u002Fterms-and-conditions\" rel=\"nofollow ugc\">https:\u002F\u002Fwww.crawlhunt.com\u002Fterms-and-conditions\u003C\u002Fa>\u003Cbr \u002F>\n\u003Cstrong>Privacy Policy:\u003C\u002Fstrong> \u003Ca href=\"https:\u002F\u002Fwww.crawlhunt.com\u002Fprivacy-policy\" rel=\"nofollow ugc\">https:\u002F\u002Fwww.crawlhunt.com\u002Fprivacy-policy\u003C\u002Fa>\u003C\u002Fp>\n","A powerful website crawler and monitoring tool for WordPress.",0,451,"2026-06-30T06:39:00.000Z","7.0.2","5.7","7.4",[18,19,20,21],"crawler","monitoring","seo","website-monitor","https:\u002F\u002Fwww.crawlhunt.com\u002F","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fcrawl-hunt-seo-audit-tool.1.0.9.zip",100,null,"2026-07-22T17:31:50.256Z","no_bundle",[],{"slug":7,"display_name":7,"profile_url":8,"plugin_count":30,"total_installs":31,"avg_security_score":32,"avg_patch_time_days":33,"trust_score":34,"computed_at":35},34,3180,99,30,93,"2026-08-25T22:57:30.816Z",[37,57,79,99,121],{"slug":38,"name":39,"version":40,"author":41,"author_profile":42,"description":43,"short_description":44,"active_installs":11,"downloaded":45,"rating":11,"num_ratings":11,"last_updated":46,"tested_up_to":47,"requires_at_least":48,"requires_php":49,"tags":50,"homepage":55,"download_link":56,"security_score":24,"vuln_count":11,"unpatched_count":11,"last_vuln_date":25,"fetched_at":26},"dislike404-broken-link-checker","dislike404.com Broken Link Checker","1.0.2","Michael","https:\u002F\u002Fprofiles.wordpress.org\u002Fmichaelrenz\u002F","\u003Cp>\u003Ca href=\"https:\u002F\u002Fdislike404.com\" rel=\"nofollow ugc\">dislike404.com\u003C\u002Fa> is a free, cloud-based broken link checker that automatically monitors your website for 404 errors, broken links, and HTTP issues — and sends you email alerts before search engines or visitors notice anything is wrong.\u003C\u002Fp>\n\u003Cp>The scanning runs entirely on dislike404.com’s servers, not on your WordPress installation. This plugin gives you a convenient way to trigger on-demand scans and check results directly from your WordPress admin panel — without having to log in to dislike404.com each time.\u003C\u002Fp>\n\u003Cp>dislike404.com is completely free. Unverified websites scan up to 200 pages; once you verify your site, the limit rises to 50,000 pages per scan.\u003C\u002Fp>\n\u003Ch4>What dislike404.com does\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>Automatically scans your website on a configurable schedule (daily to monthly)\u003C\u002Fli>\n\u003Cli>Checks internal pages, external links, images, and scripts for HTTP errors\u003C\u002Fli>\n\u003Cli>Validates redirect chains across multiple hops\u003C\u002Fli>\n\u003Cli>Sends email alerts when broken links or errors are detected\u003C\u002Fli>\n\u003Cli>GDPR-compliant — servers hosted in Germany, no third-party trackers\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>What this plugin adds\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>Trigger an on-demand scan with a single click from the WordPress Settings page\u003C\u002Fli>\n\u003Cli>Optional “Scan Now” button in the WordPress admin bar for quick access on every page\u003C\u002Fli>\n\u003Cli>Real-time scan status — see when a scan is running, finished, or if errors were found\u003C\u002Fli>\n\u003Cli>Direct link to the full scan report on dislike404.com\u003C\u002Fli>\n\u003Cli>Verify your website directly from the plugin settings (if WordPress is installed at the root) — manual verification via dislike404.com is always available as an alternative\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>Requirements\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>A free account at \u003Ca href=\"https:\u002F\u002Fdislike404.com\" rel=\"nofollow ugc\">dislike404.com\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>Your WordPress site added to your dislike404.com account\u003C\u002Fli>\n\u003Cli>An API token generated in your dislike404.com profile\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>Privacy and External Services\u003C\u002Fh4>\n\u003Cp>This plugin connects to api.dislike404.com (https:\u002F\u002Fapi.dislike404.com) to trigger scans and retrieve scan results. The following data is sent to dislike404.com:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Your API token (for authentication)\u003C\u002Fli>\n\u003Cli>The UUID of the website you want to scan\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>No personal data of your WordPress users is transmitted.\u003Cbr \u002F>\nData is only sent when you actively trigger a scan, when the plugin polls for scan status updates, or when you visit the plugin settings page (to load the list of your registered websites from dislike404.com).\u003C\u002Fp>\n\u003Cp>By using this plugin you agree to the \u003Ca href=\"https:\u002F\u002Fdislike404.com\u002Fterms-of-service\" rel=\"nofollow ugc\">dislike404.com Terms of Service\u003C\u002Fa> and \u003Ca href=\"https:\u002F\u002Fdislike404.com\u002Fprivacy-policy\" rel=\"nofollow ugc\">Privacy Policy\u003C\u002Fa>.\u003C\u002Fp>\n","Free automatic broken link checker for WordPress — detect 404 errors and HTTP issues, get email alerts and trigger scans from your admin panel.",224,"2026-04-24T11:47:00.000Z","6.9.5","6.0","8.0",[51,52,53,20,54],"404","broken-link-checker","broken-links","website-monitoring","https:\u002F\u002Fdislike404.com\u002Fguides\u002Fwordpress-plugin\u002Fgetting-started-with-the-wordpress-plugin","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fdislike404-broken-link-checker.1.0.2.zip",{"slug":58,"name":59,"version":60,"author":61,"author_profile":62,"description":63,"short_description":64,"active_installs":65,"downloaded":66,"rating":67,"num_ratings":68,"last_updated":69,"tested_up_to":70,"requires_at_least":71,"requires_php":72,"tags":73,"homepage":76,"download_link":77,"security_score":78,"vuln_count":11,"unpatched_count":11,"last_vuln_date":25,"fetched_at":26},"robots-txt-editor","Robots.txt Editor","1.1.4","Processby","https:\u002F\u002Fprofiles.wordpress.org\u002Fprocessby\u002F","\u003Cp>The plugin allows you to create and edit the robots.txt file on your site.\u003C\u002Fp>\n\u003Ch4>Features\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>Works with multisite network on Subdomains;\u003C\u002Fli>\n\u003Cli>An example of the correct file for WordPress;\u003C\u002Fli>\n\u003Cli>Works out of the box;\u003C\u002Fli>\n\u003Cli>Totally Free.\u003C\u002Fli>\n\u003C\u002Ful>\n","Robots.txt for WordPress",10000,125677,90,8,"2021-01-16T00:07:00.000Z","5.6.17","4.0","5.6",[18,74,75,20],"robots","robots-txt","","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Frobots-txt-editor.zip",85,{"slug":80,"name":81,"version":82,"author":83,"author_profile":84,"description":85,"short_description":86,"active_installs":87,"downloaded":88,"rating":67,"num_ratings":89,"last_updated":90,"tested_up_to":14,"requires_at_least":91,"requires_php":16,"tags":92,"homepage":76,"download_link":96,"security_score":32,"vuln_count":97,"unpatched_count":11,"last_vuln_date":98,"fetched_at":26},"better-robots-txt","Better Robots.txt – AI-Ready Crawl Control & Bot Governance","3.1.2","Pagup","https:\u002F\u002Fprofiles.wordpress.org\u002Fpagup\u002F","\u003Cp>Better Robots.txt replaces the default WordPress robots.txt workflow with a smarter, structured version you can configure and preview before publishing.\u003C\u002Fp>\n\u003Cp>Instead of a blank textarea, you get a guided wizard with presets, plain-language explanations, and a final Review & Save step so you can inspect the generated robots.txt before it goes live.\u003C\u002Fp>\n\u003Cp>Built for beginners and advanced users alike, Better Robots.txt helps you control how search engines, AI crawlers, SEO tools, archive bots, bad bots, social preview bots, and other automated agents interact with your site.\u003C\u002Fp>\n\u003Cp>Trusted by thousands of WordPress sites, Better Robots.txt is designed for the AI era without resorting to hype, vague promises, or hidden rules.\u003C\u002Fp>\n\u003Cp>Better Robots.txt is available in Free, Pro, and Premium editions. The free plugin covers the guided workflow and essential crawl control features, while Pro and Premium unlock additional governance, protection, and AI-ready modules. Some screenshots on the plugin page show features from all three editions.\u003C\u002Fp>\n\u003Ch3>A quick overview\u003C\u002Fh3>\n\u003Cp>\u003Ciframe loading=\"lazy\" title=\"Better robots.txt Video — AI-Ready Crawl Control for WordPress\" src=\"https:\u002F\u002Fplayer.vimeo.com\u002Fvideo\u002F1169756981?dnt=1&app_id=122963\" width=\"750\" height=\"372\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write; encrypted-media; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\">\u003C\u002Fiframe>\u003C\u002Fp>\n\u003Ch3>Why Better Robots.txt is different\u003C\u002Fh3>\n\u003Cp>Most robots.txt plugins fall into one of three categories:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Simple text editor\u003C\u002Fli>\n\u003Cli>Virtual robots.txt manager\u003C\u002Fli>\n\u003Cli>Single-purpose AI or policy add-on\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>Better Robots.txt goes further.\u003C\u002Fp>\n\u003Cp>It gives you a complete, guided crawl control workflow so you can:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Choose a preset that matches your goals\u003C\u002Fli>\n\u003Cli>Control major crawler categories without writing everything by hand\u003C\u002Fli>\n\u003Cli>Keep core WordPress protection rules visible and editable\u003C\u002Fli>\n\u003Cli>Clean up low-value crawl paths that waste crawl budget\u003C\u002Fli>\n\u003Cli>Generate a cleaner robots.txt output\u003C\u002Fli>\n\u003Cli>Preview the final result before saving\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch3>What you can control\u003C\u002Fh3>\n\u003Cp>Better Robots.txt helps you manage:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Search engine visibility\u003C\u002Fli>\n\u003Cli>AI and LLM crawler behavior\u003C\u002Fli>\n\u003Cli>AI usage signals such as search, ai-input, and ai-train preferences\u003C\u002Fli>\n\u003Cli>SEO tool crawlers\u003C\u002Fli>\n\u003Cli>Bad bots and abusive crawlers\u003C\u002Fli>\n\u003Cli>Archive and Wayback access\u003C\u002Fli>\n\u003Cli>Feed crawlers and crawl traps\u003C\u002Fli>\n\u003Cli>WooCommerce crawl cleanup\u003C\u002Fli>\n\u003Cli>CSS, JavaScript, and image crawling rules\u003C\u002Fli>\n\u003Cli>Social media preview crawlers\u003C\u002Fli>\n\u003Cli>ads.txt and app-ads.txt allowance\u003C\u002Fli>\n\u003Cli>llms.txt generation\u003C\u002Fli>\n\u003Cli>Advanced directives such as crawl-delay and custom rules\u003C\u002Fli>\n\u003Cli>Final review before publishing\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch3>Editions\u003C\u002Fh3>\n\u003Cp>Better Robots.txt is available in three editions:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Free – Includes the guided setup, the Essential preset, core crawl control features, and the final Review & Save workflow.\u003C\u002Fli>\n\u003Cli>Pro – Adds more advanced governance and protection modules, including additional AI, crawler, and cleanup controls.\u003C\u002Fli>\n\u003Cli>Premium – Unlocks the most restrictive and advanced protection options, including the Fortress preset and additional high-control modules.\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>Some options shown in the interface are marked Free, Pro, or Premium so users can immediately understand which modules belong to each edition.\u003C\u002Fp>\n\u003Ch3>AI crawler controls by edition\u003C\u002Fh3>\n\u003Cp>The Free edition lets site owners choose a basic global policy for AI search and discovery crawlers: allow or block. AI training crawlers remain separated from AI search crawlers, so a site can block training use while still allowing AI-powered search and answer discovery.\u003C\u002Fp>\n\u003Cp>The Pro and Premium editions add advanced controls, including per-bot AI crawler rules, custom user agents, AI usage signals, llms.txt, and additional machine-readable governance files.\u003C\u002Fp>\n\u003Cp>Better Robots.txt separates AI-related agents into three practical families:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>AI training crawlers, such as GPTBot, Google-Extended, and ClaudeBot.\u003C\u002Fli>\n\u003Cli>AI search and discovery crawlers, such as OAI-SearchBot, PerplexityBot, and Claude-SearchBot.\u003C\u002Fli>\n\u003Cli>User-action fetchers, such as ChatGPT-User, Perplexity-User, and Claude-User.\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>User-action fetchers are triggered by user requests. Depending on the provider, robots.txt may not apply to those fetches in the same way as it applies to automated crawlers. For stronger enforcement, combine robots.txt with server logs, WAF rules, provider verification, or IP-based controls where available.\u003C\u002Fp>\n\u003Ch3>Presets\u003C\u002Fh3>\n\u003Cp>Setup starts with four modes:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Essential – A clean, practical configuration for most websites that want a better robots.txt without complexity.\u003C\u002Fli>\n\u003Cli>AI-First – For publishers and content sites that want AI-ready governance without shutting down discovery.\u003C\u002Fli>\n\u003Cli>Fortress – For websites that want stronger protection against scraping, archive capture, and unnecessary crawl activity.\u003C\u002Fli>\n\u003Cli>Custom – For users who prefer to configure each module manually.\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>For many sites, one preset plus a quick review is enough.\u003C\u002Fp>\n\u003Ch3>Built for beginners and experts\u003C\u002Fh3>\n\u003Cp>Beginners get:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>A guided setup instead of a raw robots.txt box\u003C\u002Fli>\n\u003Cli>Preset-based configuration\u003C\u002Fli>\n\u003Cli>Plain-language explanations for important choices\u003C\u002Fli>\n\u003Cli>A safer workflow with a final preview step\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>Advanced users get:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Editable core WordPress protection rules\u003C\u002Fli>\n\u003Cli>Fine-grained crawler controls by category\u003C\u002Fli>\n\u003Cli>WooCommerce-oriented cleanup options\u003C\u002Fli>\n\u003Cli>Consolidated output options\u003C\u002Fli>\n\u003Cli>Advanced directives and custom rules\u003C\u002Fli>\n\u003Cli>A final output they can inspect before publishing\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch3>AI-ready, without hype\u003C\u002Fh3>\n\u003Cp>Better Robots.txt includes features for modern AI-related crawl governance, including:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>AI crawler handling\u003C\u002Fli>\n\u003Cli>Optional llms.txt support\u003C\u002Fli>\n\u003Cli>AI usage signals for compliant systems\u003C\u002Fli>\n\u003Cli>Optional machine-readable governance signals for advanced use cases\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>These features help you express how you want automated systems to use your content.\u003C\u002Fp>\n\u003Cp>However, Better Robots.txt does not claim to control AI by force. Like robots.txt itself, these signals are most useful with compliant systems and good-faith crawlers.\u003C\u002Fp>\n\u003Ch3>What Better Robots.txt is\u003C\u002Fh3>\n\u003Cp>Better Robots.txt is:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>A robots.txt governance plugin for WordPress\u003C\u002Fli>\n\u003Cli>A guided configuration workflow instead of a raw text editor\u003C\u002Fli>\n\u003Cli>A crawl control layer to reduce wasteful crawling\u003C\u002Fli>\n\u003Cli>A practical bridge between SEO, crawl hygiene, and AI-era policy signaling\u003C\u002Fli>\n\u003Cli>A way to keep your crawl policy clearer for humans and machines\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>Technical reference for advanced users: Better Robots.txt also maintains a public \u003Ca href=\"https:\u002F\u002Fgithub.com\u002FGautierDorval\u002Fbetter-robots-txt\" rel=\"nofollow noopener noreferrer ugc\">GitHub repository\u003C\u002Fa> with product definition, governance notes, and machine-readable artefacts.\u003C\u002Fp>\n\u003Ch3>What Better Robots.txt is not\u003C\u002Fh3>\n\u003Cp>Better Robots.txt is not:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>A firewall or Web Application Firewall (WAF)\u003C\u002Fli>\n\u003Cli>An anti-scraping enforcement engine\u003C\u002Fli>\n\u003Cli>A legal compliance engine\u003C\u002Fli>\n\u003Cli>A guarantee that every bot will obey your rules\u003C\u002Fli>\n\u003Cli>A replacement for server-level security or access control\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>It helps you publish a clearer crawl policy.\u003C\u002Fp>\n\u003Cp>It does not replace infrastructure-level protection.\u003C\u002Fp>\n\u003Ch3>Typical use cases\u003C\u002Fh3>\n\u003Cp>Use Better Robots.txt if you want to:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Clean up a weak or noisy default robots.txt\u003C\u002Fli>\n\u003Cli>Reduce crawl waste on WordPress or WooCommerce\u003C\u002Fli>\n\u003Cli>Keep major search engines allowed while restricting other bots\u003C\u002Fli>\n\u003Cli>Control whether archive bots can snapshot your site\u003C\u002Fli>\n\u003Cli>Publish AI usage preferences more clearly\u003C\u002Fli>\n\u003Cli>Keep social preview bots allowed while limiting scrapers\u003C\u002Fli>\n\u003Cli>Review the final file before making it live\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch3>Key Features\u003C\u002Fh3>\n\u003Cul>\n\u003Cli>Guided step-by-step wizard\u003C\u002Fli>\n\u003Cli>Preset-based setup: Essential, AI-First, Fortress, Custom\u003C\u002Fli>\n\u003Cli>Search engine visibility controls\u003C\u002Fli>\n\u003Cli>AI and LLM crawler governance\u003C\u002Fli>\n\u003Cli>AI usage signals support\u003C\u002Fli>\n\u003Cli>SEO tool crawler controls\u003C\u002Fli>\n\u003Cli>Bad bot and abusive crawler options\u003C\u002Fli>\n\u003Cli>Archive and Wayback access controls\u003C\u002Fli>\n\u003Cli>Spam, feed, and crawl trap cleanup\u003C\u002Fli>\n\u003Cli>WooCommerce crawl cleanup options\u003C\u002Fli>\n\u003Cli>CSS, JavaScript, and image crawling rules\u003C\u002Fli>\n\u003Cli>Social media preview crawler controls\u003C\u002Fli>\n\u003Cli>ads.txt and app-ads.txt allowance\u003C\u002Fli>\n\u003Cli>Optional llms.txt generation\u003C\u002Fli>\n\u003Cli>Consolidated output option\u003C\u002Fli>\n\u003Cli>Core WordPress protection rules remain visible and editable\u003C\u002Fli>\n\u003Cli>Final Review & Save preview screen\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>About the publisher\u003C\u002Fh4>\n\u003Cp>Better Robots.txt is developed and maintained by \u003Ca href=\"https:\u002F\u002Fpagup.com\u002F\" rel=\"nofollow ugc\">Pagup\u003C\u002Fa>, a digital readability firm based in Quebec, Canada. Pagup helps organizations become correctly understood by search engines, generative AI systems, and autonomous agents.\u003C\u002Fp>\n\u003Cp>The robots.txt file is the first surface that AI crawlers read when they discover a site. A well-structured robots.txt that references governance files such as llms.txt, ai-manifest.json, and interpretation policies helps AI systems understand your site faster and more accurately.\u003C\u002Fp>\n\u003Cp>Better Robots.txt is one component of a broader digital readability practice that includes \u003Ca href=\"https:\u002F\u002Fpagup.com\u002Fen\u002Fservices\u002Fsemantic-content-architecture\u002F\" rel=\"nofollow ugc\">semantic content architecture\u003C\u002Fa>, \u003Ca href=\"https:\u002F\u002Fpagup.com\u002Fen\u002Fservices\u002Fai-governance-and-machine-readability\u002F\" rel=\"nofollow ugc\">AI governance and machine readability\u003C\u002Fa>, and \u003Ca href=\"https:\u002F\u002Fpagup.com\u002Fen\u002Fglossary\u002Finterpretive-seo\u002F\" rel=\"nofollow ugc\">interpretive SEO\u003C\u002Fa>.\u003C\u002Fp>\n\u003Ch4>Part of the Pagup ecosystem\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fpagup.com\u002F\" rel=\"nofollow ugc\">pagup.com\u003C\u002Fa> — Digital readability firm. Diagnostic, semantic architecture, AI governance.\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fgautierdorval.com\u002F\" rel=\"nofollow ugc\">gautierdorval.com\u003C\u002Fa> — Doctrine, canonical definitions, interpretive governance research.\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Finterpretive-governance.org\u002F\" rel=\"nofollow ugc\">interpretive-governance.org\u003C\u002Fa> — Formal versioned standard for interpretive governance.\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fbetter-robots.com\u002F\" rel=\"nofollow ugc\">better-robots.com\u003C\u002Fa> — Documentation and resources for Better Robots.txt.\u003C\u002Fli>\n\u003C\u002Ful>\n","Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …",5000,321566,102,"2026-07-04T14:07:00.000Z","5.0",[93,94,95,75,20],"ai-crawlers","bot-blocker","llms-txt","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fbetter-robots-txt.3.1.2.zip",2,"2023-02-14 00:00:00",{"slug":100,"name":101,"version":102,"author":103,"author_profile":104,"description":105,"short_description":106,"active_installs":107,"downloaded":108,"rating":24,"num_ratings":109,"last_updated":110,"tested_up_to":111,"requires_at_least":112,"requires_php":16,"tags":113,"homepage":119,"download_link":120,"security_score":24,"vuln_count":11,"unpatched_count":11,"last_vuln_date":25,"fetched_at":26},"llm-bot-tracker-by-hueston","LLM Bot Tracker – AI Crawler Detection & Analytics","1.6.0","Hueston","https:\u002F\u002Fprofiles.wordpress.org\u002Fhuestonwins\u002F","\u003Cp>\u003Cstrong>Is ChatGPT, Claude, Perplexity, or Gemini crawling your website? This plugin automatically tracks every AI bot visit to give you the data you need! 🤖\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cp>LLM Bot Tracker is the most comprehensive AI crawler analytics plugin for WordPress, providing automatic 24\u002F7 monitoring of artificial intelligence bots, search crawlers, and web scrapers accessing your content.\u003C\u002Fp>\n\u003Ch4>🎯 How It Works\u003C\u002Fh4>\n\u003Cp>\u003Cstrong>Install \u003Cspan aria-hidden=\"true\" class=\"wp-exclude-emoji\">→\u003C\u002Fspan> Activate \u003Cspan aria-hidden=\"true\" class=\"wp-exclude-emoji\">→\u003C\u002Fspan> Done!\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cp>That’s it. The plugin immediately starts tracking all AI bot activity in the background. No configuration needed. View your data anytime in the admin dashboard at \u003Cstrong>Tools > LLM Crawler Logs\u003C\u002Fstrong>.\u003C\u002Fp>\n\u003Ch4>🚀 Why Track AI Bots & Crawlers?\u003C\u002Fh4>\n\u003Cp>The web is changing. AI-powered search engines like Perplexity, You.com, and SearchGPT are revolutionizing how people find information. Traditional SEO isn’t enough anymore – you need \u003Cstrong>LLMO (Large Language Model Optimization)\u003C\u002Fstrong>.\u003C\u002Fp>\n\u003Cp>\u003Cstrong>This plugin automatically captures:\u003C\u002Fstrong>\u003Cbr \u002F>\n* \u003Cstrong>Every AI bot visit\u003C\u002Fstrong> – Timestamp, bot name, pages accessed, IP address\u003Cbr \u002F>\n* \u003Cstrong>AI crawler patterns\u003C\u002Fstrong> – Which content AI systems value most\u003Cbr \u002F>\n* \u003Cstrong>Training data usage\u003C\u002Fstrong> – When GPT, Claude, or Gemini scrape your content\u003Cbr \u002F>\n* \u003Cstrong>Crawl frequency\u003C\u002Fstrong> – How often each AI system visits\u003Cbr \u002F>\n* \u003Cstrong>Geographic origins\u003C\u002Fstrong> – Where AI bot traffic originates\u003Cbr \u002F>\n* \u003Cstrong>Response codes\u003C\u002Fstrong> – Success rates and errors for AI crawlers\u003C\u002Fp>\n\u003Cp>Without this data, you’re flying blind in the AI era of search.\u003C\u002Fp>\n\u003Ch4>✨ Core Features\u003C\u002Fh4>\n\u003Cp>\u003Cstrong>🤖 Automatic Detection of 59 AI Bots Including:\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cul>\n\u003Cli>\u003Cstrong>OpenAI Family:\u003C\u002Fstrong> GPTBot, ChatGPT-User, OAI-SearchBot (SearchGPT)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Anthropic Family:\u003C\u002Fstrong> ClaudeBot, Claude-Web, Claude-SearchBot  \u003C\u002Fli>\n\u003Cli>\u003Cstrong>Perplexity:\u003C\u002Fstrong> PerplexityBot, Perplexity-User\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Google AI:\u003C\u002Fstrong> Google-Extended, GoogleOther, Google-CloudVertexBot, GoogleAgent-Mariner, Gemini-Deep-Research\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Amazon AI:\u003C\u002Fstrong> Amazonbot, NovaAct (Nova AI Agent)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Meta AI:\u003C\u002Fstrong> FacebookBot, Meta-ExternalAgent, Meta-ExternalFetcher\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Microsoft:\u003C\u002Fstrong> Bingbot (AI-enhanced), MSN Bot\u003C\u002Fli>\n\u003Cli>\u003Cstrong>AI Assistants:\u003C\u002Fstrong> Devin (Software Engineering AI), LinerBot (Academic Research), QualifiedBot\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Common Crawl:\u003C\u002Fstrong> CCBot (feeds multiple AI systems)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>ByteDance:\u003C\u002Fstrong> Bytespider (TikTok AI)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>AI Search & Research:\u003C\u002Fstrong> You.com (YouBot), Timpi (Timpibot), Allen Institute (AI2Bot), Cohere (Cohere-AI)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Data Extraction:\u003C\u002Fstrong> Diffbot (structured data extraction for ML)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Others:\u003C\u002Fstrong> MistralAI, Neeva bot, SemrushBot with AI\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>\u003Cstrong>📊 Powerful Analytics Dashboard (Tools > LLM Crawler Logs)\u003C\u002Fstrong>\u003Cbr \u002F>\n* Complete log of all AI bot activity\u003Cbr \u002F>\n* Advanced filtering by bot type, date range, URL path, IP address\u003Cbr \u002F>\n* \u003Cstrong>Configuration Tab\u003C\u002Fstrong> – Smart cache detection with setup guides and bot patterns\u003Cbr \u002F>\n* \u003Cstrong>NEW:\u003C\u002Fstrong> CSV export – download your data for offline analysis\u003Cbr \u002F>\n* 30-day trend analysis – spot patterns and changes\u003Cbr \u002F>\n* Top bots leaderboard – see your most frequent AI visitors\u003Cbr \u002F>\n* Path analysis – discover your most AI-visited content\u003Cbr \u002F>\n* Geographic IP tracking with location data\u003Cbr \u002F>\n* Bot verification via IP lookup\u003Cbr \u002F>\n* Response code tracking (200, 404, etc.)\u003Cbr \u002F>\n* Bulk actions for log management\u003Cbr \u002F>\n* Export filtered or complete datasets\u003C\u002Fp>\n\u003Cp>\u003Cstrong>⚡ Performance & Privacy\u003C\u002Fstrong>\u003Cbr \u002F>\n* Runs silently in background – zero configuration\u003Cbr \u002F>\n* Lightweight – adds \u003C0.01s to page load\u003Cbr \u002F>\n* Smart data storage – automatic log rotation\u003Cbr \u002F>\n* GDPR compliant – no human tracking\u003Cbr \u002F>\n* No external API calls\u003Cbr \u002F>\n* 100% local data storage\u003C\u002Fp>\n\u003Cp>\u003Cstrong>🎨 Optional Display Shortcodes\u003C\u002Fstrong>\u003Cbr \u002F>\nWant to display AI bot stats on your site? Use these optional shortcodes:\u003Cbr \u002F>\n* \u003Ccode>[wpcs_llm_stats]\u003C\u002Fcode> – Statistics table\u003Cbr \u002F>\n* \u003Ccode>[wpcs_llm_bar]\u003C\u002Fcode> – Animated bar chart\u003Cbr \u002F>\n* \u003Ccode>[wpcs_llm_last100]\u003C\u002Fcode> – Recent activity feed\u003Cbr \u002F>\n* \u003Ccode>[wpcs_llm_ip_list]\u003C\u002Fcode> – Compact IP list\u003Cbr \u002F>\n* \u003Ccode>[wpcs_crawler_stats]\u003C\u002Fcode> – Combined view\u003C\u002Fp>\n\u003Cp>\u003Ch4>📈 Who Needs This Plugin?\u003C\u002Fh4>\n\u003C\u002Fp>\n\u003Cul>\n\u003Cli>\u003Cstrong>Content Creators\u003C\u002Fstrong> – Know which AI systems value your content\u003C\u002Fli>\n\u003Cli>\u003Cstrong>SEO Professionals\u003C\u002Fstrong> – Master LLMO and AI SEO with real data\u003C\u002Fli>\n\u003Cli>\u003Cstrong>News Publishers\u003C\u002Fstrong> – Track AI interest in your stories\u003C\u002Fli>\n\u003Cli>\u003Cstrong>E-commerce Sites\u003C\u002Fstrong> – Detect AI shopping assistant crawlers\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Tech Companies\u003C\u002Fstrong> – Monitor competitive AI intelligence gathering\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Documentation Sites\u003C\u002Fstrong> – See which docs AI systems reference\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Educational Platforms\u003C\u002Fstrong> – Understand AI training on your content\u003C\u002Fli>\n\u003Cli>\u003Cstrong>Any WordPress Site\u003C\u002Fstrong> – Future-proof your content strategy\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>💡 Real User Success Stories\u003C\u002Fh4>\n\u003Cblockquote>\n\u003Cp>“Discovered ChatGPT was hitting our API docs 2,000+ times daily. We optimized those pages and saw a 40% increase in AI-driven traffic!” – Tech Startup\u003C\u002Fp>\n\u003Cp>“The background tracking revealed Perplexity visits our site every 6 hours. This data completely changed our content strategy.” – Digital Publisher\u003C\u002Fp>\n\u003Cp>“Found ByteDance scraping our entire product catalog at 3 AM daily. Now we can make informed decisions about blocking.” – E-commerce Owner\u003C\u002Fp>\n\u003C\u002Fblockquote>\n\u003Ch4>🔍 Actionable Insights You’ll Get\u003C\u002Fh4>\n\u003Cp>\u003Cstrong>Automatic tracking reveals:\u003C\u002Fstrong>\u003Cbr \u002F>\n* Which AI companies are most interested in your content\u003Cbr \u002F>\n* Your most valuable pages according to AI systems\u003Cbr \u002F>\n* Optimal posting times for AI crawler discovery\u003Cbr \u002F>\n* Suspicious scraping patterns to investigate\u003Cbr \u002F>\n* Content gaps AI systems are looking for\u003Cbr \u002F>\n* Competitive intelligence on AI training data\u003C\u002Fp>\n\u003Cp>\u003Cstrong>Make informed decisions about:\u003C\u002Fstrong>\u003Cbr \u002F>\n* Which bots to allow or block in robots.txt\u003Cbr \u002F>\n* Content optimization for AI-powered search\u003Cbr \u002F>\n* Publishing schedules for maximum AI visibility\u003Cbr \u002F>\n* Technical SEO for AI crawlers\u003Cbr \u002F>\n* LLMO strategy development\u003C\u002Fp>\n\u003Ch4>🛠️ Advanced Administration\u003C\u002Fh4>\n\u003Cp>The plugin works automatically, but power users can:\u003Cbr \u002F>\n* Filter logs by any parameter\u003Cbr \u002F>\n* Analyze patterns across time periods\u003Cbr \u002F>\n* Identify bot behavior anomalies\u003Cbr \u002F>\n* Track crawler response codes\u003Cbr \u002F>\n* Monitor crawl budget usage\u003Cbr \u002F>\n* Set up custom tracking rules\u003Cbr \u002F>\n* Export data for external analysis\u003C\u002Fp>\n\u003Ch4>📚 Resources & Documentation\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fhueston.co\u002Fllmo-ai-seo\u002Fwhat-is-llmo-complete-guide-to-large-language-model-optimization\u002F\" rel=\"nofollow ugc\">What is LLMO? Complete Guide\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fgithub.com\u002FHuestonCo\u002Fwordpress-llm-crawler-log\" rel=\"nofollow ugc\">GitHub Repository\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fwordpress.org\u002Fsupport\u002Fplugin\u002Fllm-bot-tracker-by-hueston\u002F\" rel=\"ugc\">Support Forum\u003C\u002Fa>\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>🏆 Why Choose LLM Bot Tracker?\u003C\u002Fh4>\n\u003Cp>✅ \u003Cstrong>Automatic & Effortless\u003C\u002Fstrong> – Install and forget, it just works\u003Cbr \u002F>\n✅ \u003Cstrong>Most Comprehensive\u003C\u002Fstrong> – Tracks more AI bots than any other plugin\u003Cbr \u002F>\n✅ \u003Cstrong>Lightweight\u003C\u002Fstrong> – Won’t slow your site like analytics plugins\u003Cbr \u002F>\n✅ \u003Cstrong>Privacy-First\u003C\u002Fstrong> – No cookies, no human tracking, GDPR ready\u003Cbr \u002F>\n✅ \u003Cstrong>Actively Maintained\u003C\u002Fstrong> – New bot detection added monthly\u003Cbr \u002F>\n✅ \u003Cstrong>100% Free Forever\u003C\u002Fstrong> – No premium upsells or feature gates\u003Cbr \u002F>\n✅ \u003Cstrong>Professional Support\u003C\u002Fstrong> – Built by Hueston, trusted WordPress experts since 2019\u003C\u002Fp>\n\u003Cp>\u003Cstrong>Join thousands of sites gaining AI visibility insights. Install LLM Bot Tracker today and understand your AI traffic immediately!\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Ch3>Additional Information\u003C\u002Fh3>\n\u003Ch4>System Requirements\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>WordPress 6.5 or higher\u003C\u002Fli>\n\u003Cli>PHP 7.4 or higher  \u003C\u002Fli>\n\u003Cli>MySQL 5.6 or higher\u003C\u002Fli>\n\u003Cli>10MB free disk space\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>Privacy Policy\u003C\u002Fh4>\n\u003Cp>This plugin only tracks AI bots and crawlers, never human visitors. All data is stored locally in your WordPress database. No external API calls are made. No personal data is collected, transmitted, or sold.\u003C\u002Fp>\n\u003Ch4>Credits\u003C\u002Fh4>\n\u003Cul>\n\u003Cli>Built with ❤️ by the \u003Ca href=\"https:\u002F\u002Fhueston.co\" rel=\"nofollow ugc\">Hueston LLMO Team\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>Special thanks to the WordPress community for feedback and testing.\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Ch4>Legal Notice\u003C\u002Fh4>\n\u003Cp>This plugin is not affiliated with OpenAI, Anthropic, Perplexity, Google, Meta, or any AI company mentioned. All bot names and trademarks are property of their respective owners. This plugin simply detects and reports on publicly identifiable user agents.\u003C\u002Fp>\n","Automatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …",900,2835,1,"2025-09-24T17:21:00.000Z","6.8.6","6.5",[114,115,116,117,118],"ai-bot-tracker","ai-seo","chatgpt-detector","claude-bot","perplexity-crawler","https:\u002F\u002Fgithub.com\u002FHuestonCo\u002Fwordpress-llm-crawler-log","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fllm-bot-tracker-by-hueston.1.6.0.zip",{"slug":122,"name":123,"version":124,"author":125,"author_profile":126,"description":127,"short_description":128,"active_installs":129,"downloaded":130,"rating":24,"num_ratings":131,"last_updated":132,"tested_up_to":14,"requires_at_least":72,"requires_php":16,"tags":133,"homepage":137,"download_link":138,"security_score":24,"vuln_count":11,"unpatched_count":11,"last_vuln_date":25,"fetched_at":26},"ai-content-signals","AI Content Signals","1.3.0","Fernando Tellado","https:\u002F\u002Fprofiles.wordpress.org\u002Ffernandot\u002F","\u003Cp>AI Content Signals lets you declare, in a machine-readable way, how AI systems may use your content: for search indexing, real-time AI answers (RAG), or model training. It started with Cloudflare’s Content Signals in robots.txt and now expresses the same preferences across several surfaces, so more crawlers and tools can read them:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>\u003Cstrong>robots.txt\u003C\u002Fstrong> — Cloudflare Content Signals (search \u002F ai-input \u002F ai-train)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>HTTP header\u003C\u002Fstrong> — \u003Ccode>X-Robots-Tag: noai, noimageai\u003C\u002Fcode>\u003C\u002Fli>\n\u003Cli>\u003Cstrong>HTML meta\u003C\u002Fstrong> — robots \u003Ccode>noai, noimageai\u003C\u002Fcode>\u003C\u002Fli>\n\u003Cli>\u003Cstrong>\u002F.well-known\u002Ftdmrep.json\u003C\u002Fstrong> — W3C Text and Data Mining Reservation Protocol\u003C\u002Fli>\n\u003Cli>\u003Cstrong>EU Directive 2019\u002F790\u003C\u002Fstrong> rights reservation\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>Everything is opt-in and does not change your robots.txt output unless you enable it.\u003C\u002Fp>\n\u003Cp>\u003Cstrong>The signals you control\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cp>You set three preferences, and AI Content Signals expresses each one in the right format on every surface you enable:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>\u003Cstrong>search\u003C\u002Fstrong> — allow or deny search indexing and traditional search results (links and short snippets)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>ai-input\u003C\u002Fstrong> — allow or deny using your content for real-time AI answers (RAG, grounding, AI Overviews)\u003C\u002Fli>\n\u003Cli>\u003Cstrong>ai-train\u003C\u002Fstrong> — allow or deny using your content to train or fine-tune AI models\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>These three come from Cloudflare’s Content Signals vocabulary, written to your robots.txt. When you deny AI training, the same opt-out is also emitted on any other surface you enable: \u003Ccode>noai, noimageai\u003C\u002Fcode> in an HTML meta tag and an \u003Ccode>X-Robots-Tag\u003C\u002Fcode> header, plus a \u003Ccode>tdm-reservation\u003C\u002Fcode> in your TDMRep manifest. Declaring the same preference in several places means a crawler that ignores one signal may still honor another.\u003C\u002Fp>\n\u003Cp>\u003Cstrong>Key Features\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cul>\n\u003Cli>Easy-to-use settings page in WordPress admin\u003C\u002Fli>\n\u003Cli>Set global defaults for all crawlers\u003C\u002Fli>\n\u003Cli>Configure specific settings for individual AI bots (GPTBot, ClaudeBot, PerplexityBot, etc.)\u003C\u002Fli>\n\u003Cli>Add custom bot User-Agents\u003C\u002Fli>\n\u003Cli>Supports both physical and virtual robots.txt files\u003C\u002Fli>\n\u003Cli>Option to create physical robots.txt with basic WordPress rules\u003C\u002Fli>\n\u003Cli>Preview generated Content Signals before applying\u003C\u002Fli>\n\u003Cli>Export and import settings as JSON for easy migration between sites\u003C\u002Fli>\n\u003Cli>Optional legal text with EU Directive reference\u003C\u002Fli>\n\u003Cli>Developer-friendly: filter hook to extend the predefined bots list\u003C\u002Fli>\n\u003Cli>Works with existing robots.txt from SEO plugins\u003C\u002Fli>\n\u003Cli>Automatic sitemap detection and inclusion\u003C\u002Fli>\n\u003Cli>Optional extra output surfaces: HTML robots meta tag (noai, noimageai), X-Robots-Tag header, and a W3C TDMRep file at \u002F.well-known\u002Ftdmrep.json\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>\u003Cstrong>Supported Bots\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cp>The plugin includes predefined settings for 28 major AI crawlers:\u003C\u002Fp>\n\u003Cul>\n\u003Cli>OpenAI GPTBot, OAI-SearchBot, and ChatGPT-User\u003C\u002Fli>\n\u003Cli>Anthropic ClaudeBot, Claude-Web, and anthropic-ai\u003C\u002Fli>\n\u003Cli>Perplexity Bot and Perplexity-User\u003C\u002Fli>\n\u003Cli>Google Extended (Gemini) and GoogleOther\u003C\u002Fli>\n\u003Cli>Amazon Bot\u003C\u002Fli>\n\u003Cli>Apple Extended\u003C\u002Fli>\n\u003Cli>Meta\u002FFacebook Bot and meta-externalagent\u003C\u002Fli>\n\u003Cli>DuckDuckGo DuckAssistBot\u003C\u002Fli>\n\u003Cli>Allen Institute AI2Bot\u003C\u002Fli>\n\u003Cli>Mistral AI\u003C\u002Fli>\n\u003Cli>ByteDance Bytespider\u003C\u002Fli>\n\u003Cli>DeepSeek AI\u003C\u002Fli>\n\u003Cli>xAI Grok\u003C\u002Fli>\n\u003Cli>Huawei Pangu\u003C\u002Fli>\n\u003Cli>Common Crawl, Cohere AI, Diffbot, You.com Bot, and more\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>\u003Cstrong>Important Notice\u003C\u002Fstrong>\u003C\u002Fp>\n\u003Cp>Content Signals is a declarative standard – it expresses your preferences but does not technically enforce them. AI companies are not legally required to respect these signals, though the plugin includes legal text referencing EU copyright directives.\u003C\u002Fp>\n\u003Cp>The IETF AI Preferences (AIPREF) Working Group is currently developing a formal standard based on similar concepts. This plugin implements the current Cloudflare Content Signals specification and will be updated as standards evolve.\u003C\u002Fp>\n\u003Cp>This plugin works best when combined with other protection measures like traditional robots.txt rules and server-level bot management.\u003C\u002Fp>\n\u003Ch3>Support\u003C\u002Fh3>\n\u003Cp>Need private support or custom development?\u003C\u002Fp>\n\u003Cp>Do you need one-on-one help, priority troubleshooting, or a custom feature, integration, or tweak built specifically for your site? I offer private support and custom development. Just \u003Ca href=\"mailto:ai-content-signals@ayudawp.com\" rel=\"nofollow ugc\">contact me\u003C\u002Fa> and tell me what you need.\u003C\u002Fp>\n\u003Cp>Need help or have suggestions?\u003C\u002Fp>\n\u003Cul>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fservicios.ayudawp.com\" rel=\"nofollow ugc\">Official website\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fwordpress.org\u002Fsupport\u002Fplugin\u002Fai-content-signals\u002F\" rel=\"ugc\">WordPress support forum\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fwww.youtube.com\u002FAyudaWordPressES\" rel=\"nofollow ugc\">YouTube channel\u003C\u002Fa>\u003C\u002Fli>\n\u003Cli>\u003Ca href=\"https:\u002F\u002Fayudawp.com\" rel=\"nofollow ugc\">Documentation and tutorials\u003C\u002Fa>\u003C\u002Fli>\n\u003C\u002Ful>\n\u003Cp>Love the plugin? Please leave us a \u003Ca href=\"https:\u002F\u002Fwordpress.org\u002Fsupport\u002Fplugin\u002Fai-content-signals\u002Freviews\u002F#new-post\" rel=\"ugc\">5-star review\u003C\u002Fa> and help spread the word!\u003C\u002Fp>\n\u003Ch3>About AyudaWP.com\u003C\u002Fh3>\n\u003Cp>We are specialists in WordPress security, SEO, and performance optimization plugins. We create tools that solve real problems for WordPress site owners while maintaining the highest coding standards and accessibility requirements.\u003C\u002Fp>\n","Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.",500,3221,3,"2026-06-16T17:57:00.000Z",[134,135,136,75,20],"ai","cloudflare","crawlers","https:\u002F\u002Fservicios.ayudawp.com","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fai-content-signals.1.3.0.zip",{"attackSurface":140,"codeSignals":376,"taintFlows":385,"riskAssessment":386,"analyzedAt":389},{"hooks":141,"ajaxHandlers":197,"restRoutes":198,"shortcodes":374,"cronEvents":375,"entryPointCount":30,"unprotectedCount":11},[142,148,152,156,161,167,171,175,179,184,188,192],{"type":143,"name":144,"callback":145,"file":146,"line":147},"action","admin_menu","crawl_hunt_admin_menu","includes\u002Fadmin.php",42,{"type":143,"name":149,"callback":150,"file":146,"line":151},"admin_enqueue_scripts","crawl_hunt_admin_enqueue_scripts",148,{"type":143,"name":153,"callback":154,"priority":109,"file":146,"line":155},"admin_head","crawl_hunt_suppress_admin_notices",191,{"type":143,"name":157,"callback":158,"file":159,"line":160},"template_redirect","crawl_hunt_apply_redirects","includes\u002Ffrontend.php",54,{"type":162,"name":163,"callback":164,"priority":165,"file":159,"line":166},"filter","get_canonical_url","crawl_hunt_filter_canonical_url",10,74,{"type":143,"name":168,"callback":169,"priority":109,"file":159,"line":170},"wp_head","crawl_hunt_output_canonical",176,{"type":143,"name":168,"callback":172,"priority":173,"file":159,"line":174},"crawl_hunt_output_schema_markup",5,223,{"type":162,"name":176,"callback":177,"priority":173,"file":159,"line":178},"style_loader_tag","crawl_hunt_global_async_preload_css",254,{"type":143,"name":180,"callback":181,"priority":182,"file":159,"line":183},"wp_enqueue_scripts","crawl_hunt_apply_defer_script_strategy",1000,310,{"type":162,"name":185,"callback":186,"priority":165,"file":159,"line":187},"robots_txt","crawl_hunt_apply_robots_txt_allows",412,{"type":162,"name":189,"callback":190,"priority":165,"file":159,"line":191},"wp_robots","crawl_hunt_noindex_exclusion_filter",456,{"type":143,"name":193,"callback":194,"file":195,"line":196},"rest_api_init","crawl_hunt_register_rest_routes","includes\u002Frest-routes.php",262,[],[199,207,214,219,224,229,235,240,245,250,255,261,265,269,274,279,284,289,294,299,304,309,314,319,324,329,334,339,344,349,354,359,364,369],{"namespace":200,"route":201,"methods":202,"callback":204,"permissionCallback":205,"file":195,"line":206},"crawl-hunt\u002Fv1","\u002Flog",[203],"POST","crawl_hunt_log_crawl","crawl_hunt_verify_api_key",15,{"namespace":200,"route":208,"methods":209,"callback":211,"permissionCallback":212,"file":195,"line":213},"\u002Flogs",[210],"GET","crawl_hunt_get_logs","closure",22,{"namespace":200,"route":215,"methods":216,"callback":217,"permissionCallback":212,"file":195,"line":218},"\u002Fsettings",[210],"crawl_hunt_get_settings",31,{"namespace":200,"route":215,"methods":220,"callback":221,"permissionCallback":222,"file":195,"line":223},[203],"crawl_hunt_save_settings","crawl_hunt_require_admin_with_nonce",40,{"namespace":200,"route":225,"methods":226,"callback":227,"permissionCallback":222,"file":195,"line":228},"\u002Fauth\u002Fconnect-url",[210],"crawl_hunt_auth_connect_url",47,{"namespace":200,"route":230,"methods":231,"callback":232,"permissionCallback":233,"file":195,"line":234},"\u002Fauth\u002Fcallback",[210],"crawl_hunt_auth_callback","crawl_hunt_verify_oauth_params",53,{"namespace":200,"route":236,"methods":237,"callback":238,"permissionCallback":222,"file":195,"line":239},"\u002Fauth\u002Fredirect",[210],"crawl_hunt_auth_redirect",59,{"namespace":200,"route":241,"methods":242,"callback":243,"permissionCallback":222,"file":195,"line":244},"\u002Fauth\u002Fdisconnect",[203],"crawl_hunt_auth_disconnect",65,{"namespace":200,"route":246,"methods":247,"callback":248,"permissionCallback":222,"file":195,"line":249},"\u002Fproxy\u002Fdashboard-data",[203],"crawl_hunt_proxy_dashboard_data",72,{"namespace":200,"route":251,"methods":252,"callback":253,"permissionCallback":222,"file":195,"line":254},"\u002Fproxy\u002Fconnection-status",[203],"crawl_hunt_proxy_connection_status",79,{"namespace":200,"route":256,"methods":257,"callback":258,"permissionCallback":259,"file":195,"line":260},"\u002Fimages\u002Falt",[203],"crawl_hunt_update_image_alt","crawl_hunt_verify_auth_token",86,{"namespace":200,"route":262,"methods":263,"callback":264,"permissionCallback":259,"file":195,"line":34},"\u002Fpages\u002Fmeta",[203],"crawl_hunt_update_page_meta",{"namespace":200,"route":266,"methods":267,"callback":268,"permissionCallback":259,"file":195,"line":24},"\u002Fpages\u002Fredirect",[203],"crawl_hunt_update_page_redirect",{"namespace":200,"route":270,"methods":271,"callback":272,"permissionCallback":259,"file":195,"line":273},"\u002Fpages\u002Fcanonical",[203],"crawl_hunt_update_page_canonical",107,{"namespace":200,"route":275,"methods":276,"callback":277,"permissionCallback":259,"file":195,"line":278},"\u002Fpages\u002Fschema",[203],"crawl_hunt_insert_page_schema",114,{"namespace":200,"route":275,"methods":280,"callback":282,"permissionCallback":259,"file":195,"line":283},[281],"DELETE","crawl_hunt_delete_page_schema",121,{"namespace":200,"route":285,"methods":286,"callback":287,"permissionCallback":259,"file":195,"line":288},"\u002Fpages\u002Ffix-inlinks",[203],"crawl_hunt_fix_inlinks",128,{"namespace":200,"route":290,"methods":291,"callback":292,"permissionCallback":259,"file":195,"line":293},"\u002Ftheme\u002Fassets",[210],"crawl_hunt_get_theme_assets",137,{"namespace":200,"route":295,"methods":296,"callback":297,"permissionCallback":259,"file":195,"line":298},"\u002Ftheme\u002Fminify-asset",[203],"crawl_hunt_minify_theme_asset",144,{"namespace":200,"route":300,"methods":301,"callback":302,"permissionCallback":259,"file":195,"line":303},"\u002Ftheme\u002Fcompress-image",[203],"crawl_hunt_compress_theme_image",151,{"namespace":200,"route":305,"methods":306,"callback":307,"permissionCallback":259,"file":195,"line":308},"\u002Ftheme\u002Fdefer-asset",[203],"crawl_hunt_defer_theme_asset",158,{"namespace":200,"route":310,"methods":311,"callback":312,"permissionCallback":259,"file":195,"line":313},"\u002Ftheme\u002Frevert-asset",[203],"crawl_hunt_revert_theme_asset",165,{"namespace":200,"route":315,"methods":316,"callback":317,"permissionCallback":259,"file":195,"line":318},"\u002Ftheme\u002Fdelete-backup-asset",[203],"crawl_hunt_delete_backup_theme_asset",172,{"namespace":200,"route":320,"methods":321,"callback":322,"permissionCallback":259,"file":195,"line":323},"\u002Ftheme\u002Fasync-preload-css",[203],"crawl_hunt_apply_async_preload_css",179,{"namespace":200,"route":325,"methods":326,"callback":327,"permissionCallback":259,"file":195,"line":328},"\u002Fgsc\u002Frobots-txt\u002Fpreview",[203],"crawl_hunt_gsc_preview_robots_txt",188,{"namespace":200,"route":330,"methods":331,"callback":332,"permissionCallback":259,"file":195,"line":333},"\u002Fgsc\u002Frobots-txt\u002Fapply",[203],"crawl_hunt_gsc_apply_robots_txt",195,{"namespace":200,"route":335,"methods":336,"callback":337,"permissionCallback":259,"file":195,"line":338},"\u002Fgsc\u002Frobots-txt\u002Frevert",[203],"crawl_hunt_gsc_revert_robots_txt",202,{"namespace":200,"route":340,"methods":341,"callback":342,"permissionCallback":259,"file":195,"line":343},"\u002Fgsc\u002Fllms-txt\u002Fapply",[203],"crawl_hunt_gsc_apply_llms_txt",209,{"namespace":200,"route":345,"methods":346,"callback":347,"permissionCallback":259,"file":195,"line":348},"\u002Fgsc\u002Fcanonical\u002Fpreview",[203],"crawl_hunt_gsc_preview_canonical",219,{"namespace":200,"route":350,"methods":351,"callback":352,"permissionCallback":259,"file":195,"line":353},"\u002Fgsc\u002Fcanonical\u002Fapply",[203],"crawl_hunt_gsc_apply_canonical",226,{"namespace":200,"route":355,"methods":356,"callback":357,"permissionCallback":259,"file":195,"line":358},"\u002Fgsc\u002Fcanonical\u002Frevert",[203],"crawl_hunt_gsc_revert_canonical",233,{"namespace":200,"route":360,"methods":361,"callback":362,"permissionCallback":259,"file":195,"line":363},"\u002Fgsc\u002Fnoindex\u002Fpreview",[203],"crawl_hunt_gsc_preview_noindex",242,{"namespace":200,"route":365,"methods":366,"callback":367,"permissionCallback":259,"file":195,"line":368},"\u002Fgsc\u002Fnoindex\u002Fapply",[203],"crawl_hunt_gsc_apply_noindex",249,{"namespace":200,"route":370,"methods":371,"callback":372,"permissionCallback":259,"file":195,"line":373},"\u002Fgsc\u002Fnoindex\u002Frevert",[203],"crawl_hunt_gsc_revert_noindex",256,[],[],{"dangerousFunctions":377,"sqlUsage":378,"outputEscaping":380,"fileOperations":382,"externalRequests":97,"nonceChecks":109,"capabilityChecks":383,"bundledLibraries":384},[],{"prepared":131,"raw":11,"locations":379},[],{"escaped":228,"rawEcho":11,"locations":381},[],16,4,[],[],{"summary":387,"deductions":388},"The crawl-hunt-seo-audit-tool v1.0.5 plugin exhibits a strong security posture based on the provided static analysis.  There are no identified critical or high-severity issues in the code. All SQL queries are prepared, all output is properly escaped, and importantly, all REST API routes have permission callbacks. This indicates a proactive approach to security by the developers, minimizing common web application vulnerabilities. The absence of any known CVEs and a clean vulnerability history further reinforces this positive assessment.  The plugin has a moderate attack surface consisting solely of REST API endpoints, which are protected by permission callbacks, mitigating the risk of unauthorized access or manipulation.",[],"2026-04-16T13:37:14.002Z",{"wat":391,"direct":402},{"assetPaths":392,"generatorPatterns":397,"scriptPaths":398,"versionParams":399},[393,394,395,396],"\u002Fwp-content\u002Fplugins\u002Fcrawl-hunt-seo-audit-tool\u002Fbuild\u002Fhome\u002Findex.js","\u002Fwp-content\u002Fplugins\u002Fcrawl-hunt-seo-audit-tool\u002Fbuild\u002Fhome\u002Fstyle-index.css","\u002Fwp-content\u002Fplugins\u002Fcrawl-hunt-seo-audit-tool\u002Fbuild\u002Fdashboard\u002Findex.js","\u002Fwp-content\u002Fplugins\u002Fcrawl-hunt-seo-audit-tool\u002Fbuild\u002Fdashboard\u002Fstyle-index.css",[],[393,395],[400,401],"crawl-hunt-seo-audit-tool\u002Fbuild\u002Fhome\u002Findex.asset.php","crawl-hunt-seo-audit-tool\u002Fbuild\u002Fdashboard\u002Findex.asset.php",{"cssClasses":403,"htmlComments":407,"htmlAttributes":408,"restEndpoints":409,"jsGlobals":411,"shortcodeOutput":413},[404,405,406],"wrap","crawl-hunt-home-root","crawl-hunt-dashboard-root",[],[],[410],"\u002Fwp-json\u002Fcrawl-hunt\u002Fv1",[412],"crawlHuntSEOAudit",[],{"error":415,"url":416,"statusCode":417,"statusMessage":418,"message":418},true,"http:\u002F\u002Flocalhost\u002Fapi\u002Fplugins\u002Fcrawl-hunt-seo-audit-tool\u002Fbundle",404,"no bundle for this plugin yet",{"slug":4,"current_version":6,"total_versions":420,"versions":421},6,[422,428,435,442,449,456],{"version":6,"download_url":23,"svn_tag_url":423,"released_at":25,"has_diff":424,"diff_files_changed":425,"diff_lines":25,"trac_diff_url":426,"vulnerabilities":427,"is_current":415},"https:\u002F\u002Fplugins.svn.wordpress.org\u002Fcrawl-hunt-seo-audit-tool\u002Ftags\u002F1.0.9\u002F",false,[],"https:\u002F\u002Fplugins.trac.wordpress.org\u002Fchangeset?old_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.8&new_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.9",[],{"version":429,"download_url":430,"svn_tag_url":431,"released_at":25,"has_diff":424,"diff_files_changed":432,"diff_lines":25,"trac_diff_url":433,"vulnerabilities":434,"is_current":424},"1.0.8","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fcrawl-hunt-seo-audit-tool.1.0.8.zip","https:\u002F\u002Fplugins.svn.wordpress.org\u002Fcrawl-hunt-seo-audit-tool\u002Ftags\u002F1.0.8\u002F",[],"https:\u002F\u002Fplugins.trac.wordpress.org\u002Fchangeset?old_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.7&new_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.8",[],{"version":436,"download_url":437,"svn_tag_url":438,"released_at":25,"has_diff":424,"diff_files_changed":439,"diff_lines":25,"trac_diff_url":440,"vulnerabilities":441,"is_current":424},"1.0.7","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fcrawl-hunt-seo-audit-tool.1.0.7.zip","https:\u002F\u002Fplugins.svn.wordpress.org\u002Fcrawl-hunt-seo-audit-tool\u002Ftags\u002F1.0.7\u002F",[],"https:\u002F\u002Fplugins.trac.wordpress.org\u002Fchangeset?old_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.6&new_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.7",[],{"version":443,"download_url":444,"svn_tag_url":445,"released_at":25,"has_diff":424,"diff_files_changed":446,"diff_lines":25,"trac_diff_url":447,"vulnerabilities":448,"is_current":424},"1.0.6","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fcrawl-hunt-seo-audit-tool.1.0.6.zip","https:\u002F\u002Fplugins.svn.wordpress.org\u002Fcrawl-hunt-seo-audit-tool\u002Ftags\u002F1.0.6\u002F",[],"https:\u002F\u002Fplugins.trac.wordpress.org\u002Fchangeset?old_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.5&new_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.6",[],{"version":450,"download_url":451,"svn_tag_url":452,"released_at":25,"has_diff":424,"diff_files_changed":453,"diff_lines":25,"trac_diff_url":454,"vulnerabilities":455,"is_current":424},"1.0.5","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fcrawl-hunt-seo-audit-tool.1.0.5.zip","https:\u002F\u002Fplugins.svn.wordpress.org\u002Fcrawl-hunt-seo-audit-tool\u002Ftags\u002F1.0.5\u002F",[],"https:\u002F\u002Fplugins.trac.wordpress.org\u002Fchangeset?old_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.4&new_path=%2Fcrawl-hunt-seo-audit-tool%2Ftags%2F1.0.5",[],{"version":457,"download_url":458,"svn_tag_url":459,"released_at":25,"has_diff":424,"diff_files_changed":460,"diff_lines":25,"trac_diff_url":25,"vulnerabilities":461,"is_current":424},"1.0.4","https:\u002F\u002Fdownloads.wordpress.org\u002Fplugin\u002Fcrawl-hunt-seo-audit-tool.1.0.4.zip","https:\u002F\u002Fplugins.svn.wordpress.org\u002Fcrawl-hunt-seo-audit-tool\u002Ftags\u002F1.0.4\u002F",[],[]]