Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

found 477 packages in 20ms

A specification compliant robots.txt parser with wildcard (*) matching support.

samclarkealmost 3 years agorobots.txt, parser, user-agent, scraper

linkinator401.4kMIT7.5.2

Find broken links, missing images, etc in your HTML. Scurry around your site and find all those broken links.

JustinBeckwithabout 1 month agobroken link checker, link checker, dead link checker, link validator

simplecrawler145.1kBSD-2-Clause1.1.9

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

simplecrawlerover 3 years agosimple, crawler, spider, cache

isbot-fast106.1kMIT1.2.0

JavaScript module detecting bots/crawlers/spiders via user-agent

mahovichover 3 years agobot, spider, robot, crawler

shift-parser71.3kApache-2.08.0.0

ECMAScript parser that produces a Shift format AST

shapesecurityover 3 years agoShift, AST, node, parser

Packages

Lightweight debugging utility for Node.js and the browser

Lodash modular utilities.

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

Higher-order functions and common patterns for asynchronous code

Babel compiler core.