The value returned by Lexer.current and Lexer.peek to signal the end of the input is reached.

A type that turns a buffer into a token stream.

A type that represents a bunch of bytes to process using a lexer.

A type to efficiently check if certain words are keywords.

A type describing a language, such as its file extensions and names.

A registry of languages and their lexers.

A token to highlight.