Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: robotstxt

found 12 packages in 2ms

generate-robotstxt442.7kMIT8.0.3

Awesome generator robots.txt

itgalaxyabout 3 years agorobotstxt, robots.txt, generate, robots-txt

robotstxt-webpack-plugin61.9kMIT8.0.0

A webpack plugin to output a robots.txt file

itgalaxyalmost 3 years agorobots.txt, robots, robotstxt, generate

astro-robots-txt50.5kMIT1.0.0

Generate a robots.txt for Astro

alextimalmost 2 years agoastro-integration, astro, astro-component, seo

robots-txt-parser8.6kMIT2.0.3

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

ChrisAkroydabout 3 years agorobots, txt, robots.txt, parser

robots8020.10.1

Parser for robots.txt

ekalininabout 3 years agorobots.txt, robotstxt, parser

Packages

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

Lodash modular utilities.

modules, stdlib, util

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const