WordTokenizers
Last updated: Feb 8, 2026
Downloads last 30 days
466
Downloads last week
121
Downloads last day
7
Downloads last 30 days
466
Downloads last week
121
Downloads last day
7
Total Downloads
Downloads by Region
Dependencies
27 packages (3 direct, 24 transitive)
| Package | Depth ↑ | Downloads ↓ |
|---|---|---|
| DataDeps | Direct | 2,270 |
| HTML_Entities | Direct | 479 |
| StrTables | Direct | 469 |
| Scratch | Depth 2 | 89,587 |
| Reexport | Depth 2 | 85,135 |
| HTTP | Depth 2 | 74,375 |
| RelocatableFolders | Depth 2 | 52,538 |
| SHA | Depth 2 | 68 |
| p7zip_jll | Depth 2 | 55 |
| CodecZlib | Depth 3 | 139,119 |
| PrecompileTools | Depth 3 | 129,877 |
| OpenSSL | Depth 3 | 91,035 |
| LoggingExtras | Depth 3 | 79,732 |
| URIs | Depth 3 | 73,340 |
| ConcurrentUtilities | Depth 3 | 73,225 |
| MbedTLS | Depth 3 | 70,152 |
| SimpleBufferStream | Depth 3 | 65,565 |
| ExceptionUnwrapping | Depth 3 | 64,840 |
| NetworkOptions | Depth 3 | 219 |
| Preferences | Depth 4 | 198,504 |
| TranscodingStreams | Depth 4 | 121,411 |
| BitFlags | Depth 4 | 65,965 |
| OpenSSL_jll | Depth 4 | 61,908 |
| MbedTLS_jll | Depth 4 | 52,721 |
| Zlib_jll | Depth 4 | 276 |
| MozillaCACerts_jll | Depth 4 | 222 |
| TOML | Depth 5 | 839 |
Dependents
29 packages (13 direct, 16 transitive) · 1,019 downloads (last 30 days)
| Package | Depth ↑ | Downloads ↓ |
|---|---|---|
| Snowball | Direct | 395 |
| TextAnalysis | Direct | 394 |
| TextEncodeBase | Direct | 54 |
| Transformers | Direct | 46 |
| FlashRank | Direct | 16 |
| CorpusLoaders | Direct | 13 |
| StringAnalysis | Direct | 6 |
| TextModels | Direct | 1 |
| SemanticSpaces | Direct | 0 |
| KnetLayers | Direct | 0 |
| LLMTextAnalysis | Direct | 0 |
| TextGraphs | Direct | 0 |
| SemanticTrajectories | Direct | 0 |
| BytePairEncoding | Depth 2 | 50 |
| RAGTools | Depth 2 | 30 |
| MLJText | Depth 2 | 9 |
| FastAI | Depth 2 | 3 |
| ClapeyronHANNA | Depth 2 | 2 |
| CitableCorpusAnalysis | Depth 2 | 0 |
| BERTAnalysisGUI | Depth 2 | 0 |
| SemanticCaches | Depth 2 | 0 |
| ColBERT | Depth 2 | 0 |
| TrillionDollarWords | Depth 2 | 0 |
| GenGPT3 | Depth 2 | 0 |
| PPLM | Depth 2 | 0 |
| FastTabular | Depth 3 | 0 |
| ProToPortal | Depth 3 | 0 |
| FastMakie | Depth 3 | 0 |
| FastVision | Depth 3 | 0 |