Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: spiders

found 7 packages in 3ms

isbot10.2mUnlicense5.1.32

🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.

omrilotanabout 1 month agobot, crawlers, spiders, googlebot

npmGitHubHomepage

robot-directives83.1kMIT0.4.0

Parse robot directives within HTML meta and/or HTTP headers.

stevenvachonover 3 years agocrawlers, header, html, http

@microlink/ua1.6kMIT1.2.10

A simple redis primitives to incr() and top() user agents

microlinkhq25 days agobot, crawlers, googlebot, redis

bot-detector183ISC1.0.10

It uses the user-agents.org xml file for detecting bots.

wedgiesover 3 years agospiders, crawlers, bot detection, robots.txt

isbot-bundle221.0.4

isbot Bundle UMD

RedCastorover 3 years agobot, crawlers, spiders, googlebot

Packages

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

Lodash modular utilities.

modules, stdlib, util

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const