Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: tokenizer

found 609 packages in 30ms

js-tokens316.5mMIT10.0.0

Tiny JavaScript tokenizer.

lydell26 days agoJavaScript, js, ECMAScript, es

npmGitHub

css-tree171mMIT3.1.0

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

csstreeabout 1 year agocss, ast, tokenizer, parser

npmGitHub

micromark61.7mMIT4.0.2

small commonmark compliant markdown parser with positional info and concrete tokens

micromark10 months agocommonmark, compiler, gfm, html

npmGitHub

strtok351.5mMIT10.3.4

A promise based streaming tokenizer

Borewit5 months agotokenizer, reader, token, async

npmGitHub

chevrotain22.7mApache-2.011.0.3

Chevrotain is a high performance fault tolerant javascript parsing DSL for building recursive decent parsers

Chevrotainover 2 years agoparser, syntax, lexical, analysis

npmGitHubHomepage

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

facebook react

React is a JavaScript library for building user interfaces.

react

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const