@yozora/tokenizer-math
v2.4.0
Published
Tokenizer for processing fenced math block (formulas)
Maintainers
lemonclownReadme
@yozora/tokenizer-math produces Math nodes. See documentation for details.
Install
npm install --save @yozora/tokenizer-mathUsage
@yozora/tokenizer-math is built into @yozora/parser.
With DefaultParser
A tokenizer must be registered with an IParser before use.
import { DefaultParser } from '@yozora/core-parser'
import ParagraphTokenizer from '@yozora/tokenizer-paragraph'
import TextTokenizer from '@yozora/tokenizer-text'
import MathTokenizer from '@yozora/tokenizer-math'
const parser = new DefaultParser()
.useFallbackTokenizer(new ParagraphTokenizer())
.useFallbackTokenizer(new TextTokenizer())
.useTokenizer(new MathTokenizer())
parser.parse(`
$$x^2 + y^2=z^2$$
$$
f(x)=\left\lbrace\begin{aligned}
&x^2, &x < 0\\
&0, &x = 0\\
&x^3, &x > 0
\end{aligned}\right.
$$
`)With @yozora/parser
import YozoraParser from '@yozora/parser'
const parser = new YozoraParser()
parser.parse(`
$$x^2 + y^2=z^2$$
$$
f(x)=\left\lbrace\begin{aligned}
&x^2, &x < 0\\
&0, &x = 0\\
&x^3, &x > 0
\end{aligned}\right.
$$
`)With @yozora/parser-gfm
import GfmParser from '@yozora/parser-gfm'
import MathTokenizer from '@yozora/tokenizer-math'
const parser = new GfmParser()
parser.useTokenizer(new MathTokenizer())
parser.parse(`
$$x^2 + y^2=z^2$$
$$
f(x)=\left\lbrace\begin{aligned}
&x^2, &x < 0\\
&0, &x = 0\\
&x^3, &x > 0
\end{aligned}\right.
$$
`)With @yozora/parser-gfm-ex
import GfmExParser from '@yozora/parser-gfm-ex'
import MathTokenizer from '@yozora/tokenizer-math'
const parser = new GfmExParser()
parser.useTokenizer(new MathTokenizer())
parser.parse(`
$$x^2 + y^2=z^2$$
$$
f(x)=\left\lbrace\begin{aligned}
&x^2, &x < 0\\
&0, &x = 0\\
&x^3, &x > 0
\end{aligned}\right.
$$
`)Options
| Name | Type | Required | Default |
| :--------- | :------- | :------- | :------------------------------- |
| name | string | No | "@yozora/tokenizer-math" |
| priority | number | No | TokenizerPriority.FENCED_BLOCK |
name: Unique tokenizer name. Generated tokens retain it so the parser can dispatch later phases to the same tokenizer.priority: Processing priority. Tokenizers with higher values run first. During block matching, a higher-priority tokenizer can interrupt a lower-priority tokenizer.