keywords:tokenize - npm search

jsx-convert

A CLI tool for converting JSX files into standard JS.

yatchee

published version 1.1.7, 2 years ago

Maintenance: 29%. Quality: 53%. Popularity: 0%.

@k14v/printf-tokenize

printf format string tokenize

kelvur

published version 0.0.6, 3 months ago

Maintenance: 33%. Quality: 45%. Popularity: 2%.

jsx-to-hyperscript

A CLI command for converting JSX files into standard JS.

grainstackdev

published version 2.2.1, 2 years ago

Maintenance: 27%. Quality: 53%. Popularity: 0%.

json-lexer

lexing json

finnpauls

published version 1.2.0, 3 years ago

Maintenance: None. Quality: 64%. Popularity: 10%.

@legt/token-service

Middleware for calling blockchain interactions in a web2 environment

t0xny

published version 0.0.0, 6 months ago

Maintenance: 33%. Quality: 45%. Popularity: 0%.

extract-comments

Uses esprima to extract line and block comments from a string of JavaScript. Also optionally parses code context (the next line of code after a comment).

jonschlinkert

published version 1.1.0, 6 years ago

Maintenance: None. Quality: 62%. Popularity: 10%.

positional-tokenizer

Tokenizes a text using regex rules and returns the tokens with their positions in the text given.

cmajsmith

published version 1.0.6, 2 years ago

Maintenance: 15%. Quality: 61%. Popularity: 0%.

wink-tokenizer

Multilingual tokenizer that automatically tags each token with its type

sanjaya

published version 5.3.0, 3 years ago

Maintenance: None. Quality: 63%. Popularity: 7%.

css-tokenize

Transform stream that tokenizes CSS

anandthakker

published version 1.0.1, 10 years ago

Maintenance: None. Quality: 52%. Popularity: 14%.

glsl-token-inject-block

safely inject a block of tokens into a shader

mattdesl

published version 1.1.0, 9 years ago

Maintenance: None. Quality: 61%. Popularity: 9%.

wink-nlp-utils

NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.

sanjaya

published version 2.1.0, 2 years ago

Maintenance: None. Quality: 63%. Popularity: 6%.

@parsing-kit/lexer

JavaScript library for tokenizing strings with regular expressions

ivteplo

published version 2.3.0-alpha.8, 2 years ago

Maintenance: 17%. Quality: 52%. Popularity: 0%.

snapdragon-lexer

Converts a string into an array of tokens, with useful methods for looking ahead and behind, capturing, matching, et cetera.

jonschlinkert

published version 4.0.0, 6 years ago

Maintenance: None. Quality: 63%. Popularity: 4%.

tokenize-comment

Uses snapdragon to tokenize a single JavaScript block comment into an object, with description, tags, and code example sections that can be passed to any other comment parsers for further parsing.

jonschlinkert

published version 3.0.1, 6 years ago

Maintenance: None. Quality: 62%. Popularity: 4%.

@nojaja/tokenize-comment

Uses snapdragon to tokenize a single JavaScript block comment into an object, with description, tags, and code example sections that can be passed to any other comment parsers for further parsing.