tokenize

0.0.3 • Public • Published

tokenize NPM version Downloads Build Status Coveralls Status

JavaScript tokenizer

Example:

var tokenize = require('tokenize');
tokenize('dad cat', [{type: "variable", regex: /[a-z]+/},{type:"whitespace", regex: /\s/}], function(err,results){
})

Package Sidebar

Install

npm i tokenize

Weekly Downloads

81

Version

0.0.3

License

MIT

Last publish

Collaborators

  • bifodus