Plugin / Booter – Bots & Crawlers Manager

uPress

Description

Description

Booter – Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.
The plugin uses a number of existing technologies which are known by crawlers and bots and takes them one step forward – smartly and almost completely automatically.
To allow the plugin to function correctly, you must follow the instructions and manually enter some data (which must be done by a human being to avoid errors).

At the prevention level

  • Booter allows you to manage and create an advanced dynamic robots.txt file.
  • View a 404 error log to see the most common bad links.
  • Blocking bad bots that cause high server loads due to very frequent page crawls, or are used to search for security vulnerabilities.

At the treatment level

  • Booter allows you to limit the amount of requests from crawlers and bots, if or when they exceed the specified amount of requests per minute, it will be rejected for a specified period of time.
  • Rejecting links that we do not want in the fastest way, not by just blocking but by sending the appropriate HTTP status code to make search engines forget them.

Instructions for use in case of damage treatment

  1. Activate the plugin.
  2. Enable the 404 error log option.
  3. Set the access rate limit.
  4. Watch the 404 log, try to find common parts in the URLs that repeats most often.
  5. Enter the common parts to the “reject links” page, and ensure the rejection code is 410.
  6. Clear the 404 error log.
  7. Repeat the process once every few hours until the 404 error log remains blank.
  8. Check the status of your website’s index coverage every few days.

Ratings

5
3 reviews

Rating breakdown

Details Information

Version

1.4.2

First Released

20 May, 2019

Total Downloads

5,091

Wordpress Version

4.0 or higher

Tested up to:

5.3

Require PHP Version:

-

Tags

Contributors

Languages

The plugin hasn't been transalated in any language other than English.

DIRECTORY DISCLAIMER

The information provided in this THEME/PLUGIN DIRECTORY is made available for information purposes only, and intended to serve as a resource to enable visitors to select a relevant theme or plugin. wpSocket gives no warranty of any kind, express or implied with regard to the information, including without limitation any warranty that the particular theme or plugin that you select is qualified on your situation.

The information in the individual theme or plugin displayed in the Directory is provided by the owners and contributors themselves. wpSocket gives no warranty as to the accuracy of the information and will not be liable to you for any loss or damage suffered by you as a consequence of your reliance on the information.

Links to respective sites are offered to assist in accessing additional information. The links may be outdated or broken. Connect to outside sites at your own risk. The Theme/Plugin Directory does not endorse the content or accuracy of any listing or external website.

While information is made available, no guarantee is given that the details provided are correct, complete or up-to-date.

wpSocket is not related to the theme or plugin, and also not responsible and expressly disclaims all liability for, damages of any kind, arising out of the use, reference to, or reliance on, any information or business listed throughout our site.

Keep Leading Your Followers!
Share it for them.