Stop Web Crawlers

Description

Stop Web Crawlers has been developed to block referrer spam attacks on your WordPress website.

Stop Web Crawlers will reduce the likelihood that your site will be crawled by the Referrer spammers like;

> semalt.com , Darodar.com, buttons-for-website, ilovevitaly.co, screentoolkit.com, myftpupload.com,
> best-seo-offer.com,  Get-Free-Traffic-Now.com,  best-seo-solution.com,  4webmasters.org,  luxup.ru, 
> blackhatworth.com,  7makemoneyonline.com,  priceg.com,  prodvigator.ua, resellerclub.com,  savetubevideo.com,   
> kambasoft.com,  socialseet.ru,  superiends.org,  vodkoved.ru,  o-o-8-o-o.ru,  iskalko.ru, websocial.me,  
> ykecwqlixx.ru,  slftsdybbg.ru,  seoexperimenty.ru,  darodar.com,  econom.co,  edakgfvwql.ru,  adcash.com, 
> adviceforum.info,  hulfingtonpost.com,  europages.com.ru,  gobongo.info,  cenoval.ru,  cityadspix.com
>

In total Stop Web Crawlers protects your site from 1439 known referrer spammers.

If these Crawlers attempt to crawl your website they sent 403 access prohibited error response

The additional functionality planned for this plugin for the future is also to remove Ghost Referrer spammers from accessing your Google Analytics.

There is no need to edit your .htaccess or mess around with robots.txt, all is required is too install the plugin and activate the plugin.

The plugin is currently designed to run unattended and automatically.

There is a settings section, but this is currently only a placeholder for future functionality, which will be activated in future releases of the plugin.

Other bots will be added to the block list over time via updates to this plugin.

Donations

Installation

  1. Upload the stop-web-crawlers folder to the /wp-content/plugins/ directory
  2. Activate the Stop Web Crawlers plugin through the ‘Plugins’ menu in WordPress
  3. Configure the plugin by going to the Stop Web Crawlers menu that appears in your admin menu

Reviews

Fantastic

Our new website, without even a load of new content was flooded with loads of websites “linking” traffic to us. but it all seemed suspicious . After installing your plugin over night it seemed they stopped! Thanks!

Thanks

Perfect, recommend it to everyone … got rid of semalt[.]com and break even killed over 1000 bad spiders … thank you for developing and maintaining compatible with the current version of wordpress.

Read all 2 reviews

Contributors & Developers

“Stop Web Crawlers” is open source software. The following people have contributed to this plugin.

Contributors

Changelog

1.3.5

Database schema improvements
Database upgrade feature
Dashboard UI enhancements
Crawler Logging feature
Enhanced Activation
Improved Uninstall
Improved crawler list updates

1.3.4

Added submit a feature email
Responsive Image in Sidebar
Algorithm improvements to Bot detection
Updated product description url
added version number checker
added access to settings on plugin settings

1.3.3

Removed duplicate menu label in admin menu
Fixed error to relative paths in views
Added Twitter follow icon on dashboard

1.3.2

Improved Dashboard page
Added Admin CSS styles
Tidied up List Table columns

1.3.1

Code clean up removing deprecated classes

1.3.0

Major refactor of the code base 

1.2.2

Fixed Urgent bug caused by deprecated call

1.2.1

Typo fixed in readme file
Fixed error in which we were inadvertently linking to a spmmer in readme
updated dashboard 

1.2.0

Updated the database to include over 1100 known referer spam bots
Improve blocking
Updated Dashboard Text
Tested against WordPress beta 4.7

1.1.0

Added Logo to Admin Dashboard Menu
Add New Web Crawler functionality implemented
Dashboard View Revamp
Additional Refactoring to improve long term support

1.0.6

Updated license header
Improved refactoring
Added minimum WordPress version check

1.0.5

Added functionality for filter not run for logged in users or admin users

1.0.4

Updated readme text 

1.0.3

Fix upgrade bug and patched HTML formatting

1.0.2

Bug fix from a source control merge issue

1.0.1

Cosmetic changes

1.0.0

Initial release