Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: tokenizer

found 502 packages in 23ms

js-tokens164.8mMIT9.0.1

Tiny JavaScript tokenizer.

lydell2 months agoJavaScript, js, ECMAScript, es

npmGitHub

css-tree104.5mMIT3.1.0

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

csstreeabout 2 months agocss, ast, tokenizer, parser

npmGitHub

micromark28.7mMIT4.0.0

small commonmark compliant markdown parser with positional info and concrete tokens

micromarkover 1 year agocommonmark, compiler, gfm, html

npmGitHub

strtok316.7mMIT10.0.1

A promise based streaming tokenizer

Borewit5 days agotokenizer, reader, token, async

npmGitHub

ret47.9mMIT0.5.0

Tokenizes a string that represents a regular expression.

fentalmost 2 years agoregex, regexp, regular expression, parser

npmGitHub

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

facebook react

React is a JavaScript library for building user interfaces.

react

babel babel-core

Babel compiler core.

6to5, babel, classes, const