NAME

Web::Temma::Tokenizer - A tokenizer for Temma::Parser

DESCRIPTION

The Web::Temma::Tokenizer is a tokenizer for the Temma::Parser module in the Temma package <https://github.com/wakaba/temma>. It should not be used for any other purpose.

SEE ALSO

Temma::Parser module in the Temma package <https://github.com/wakaba/temma>.

AUTHOR

Wakaba <wakaba@suikawiki.org>.

LICENSE

Copyright 2007-2015 Wakaba <wakaba@suikawiki.org>.

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

This library derived from a JSON file, which contains data extracted from HTML Standard. "Written by Ian Hickson (Google, ian@hixie.ch) - Parts © Copyright 2004-2014 Apple Inc., Mozilla Foundation, and Opera Software ASA; You are granted a license to use, reproduce and create derivative works of this document."