Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: crawler

found 1,384 packages in 27ms

@nodelib/fs.walk217.8mMIT3.0.1

A library for efficiently walking a directory recursively

nodelibabout 1 year agoNodeLib, fs, FileSystem, file system

npmGitHub

fdir185.8mMIT6.5.0

The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

thecodrr6 months agoutil, os, sys, fs

npmGitHub

puppeteer-extra-plugin-stealth1.7mMIT2.11.2

Stealth mode: Applies various techniques to make detection of headless puppeteer harder.

berstendalmost 3 years agopuppeteer, puppeteer-extra, puppeteer-extra-plugin, stealth

npmGitHub

apify-client423.8kApache-2.02.22.0

Apify API client for JavaScript

apify4 days agoapify, api, apifier, crawler

npmGitHubHomepage

@crawlee/core249.4kApache-2.03.15.3

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

apify1 day agoapify, headless, chrome, puppeteer

npmGitHubHomepage

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

facebook react

React is a JavaScript library for building user interfaces.

react

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const