Skip to content

Bot list now fetched from an updated source#276

Open
TopperH wants to merge 1 commit intocharlotte-ruby:masterfrom
TopperH:updated_crawlers_list
Open

Bot list now fetched from an updated source#276
TopperH wants to merge 1 commit intocharlotte-ruby:masterfrom
TopperH:updated_crawlers_list

Conversation

@TopperH
Copy link

@TopperH TopperH commented Feb 5, 2019

The crawlers list was out of date, and was especially ineffective for facebook bots.
I moved to a more maintained one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant