Tokenizer

Tokenizes text via Regex (simple). Displays token count and offsets.

Result

Tokenization results will appear here...

Discover More Useful Tools

Want to learn more about Zerlo and our collection of handy online tools? We're constantly developing new helpers for digital life.

Learn More

Our Partners

33d.ch regaro.ch whapsi.com docsatlas.com hytale-base.com

Dark

.ns-wrap { all: initial; font-family: system-ui, sans-serif; } .ns-wrap { position: fixed; left: 12px; bottom: 12px; z-index: 2147483647; max-width: min(92vw, 380px); } #ns-js-close { display: none; } #ns-js-close:checked + .ns-box { display: none; } .ns-box { display: flex; align-items: flex-start; gap: 10px; padding: 12px 40px 12px 12px; border-radius: 10px; background: #dc2626; color: #ffffff; border: 1px solid #7f1d1d; box-shadow: 0 10px 30px rgba(0,0,0,.30); font-size: 14px; } .ns-close { position: absolute; right: 10px; top: 8px; font-size: 20px; cursor: pointer; color: #fff; opacity: .9; }

⚠️

Please enable JavaScript to use all features.

Sign in

Create account

Reset password

Reset password

Security code

Tokenizer

Input

Result

Discover More Useful Tools

About Zerlo

Links

Social Media