Searched refs:TikToken (Results 1 – 8 of 8) sorted by relevance
1 # TikToken clone for PHP - PHP GPT3 tokenizer17 use TikToken\Encoder;
3 namespace TikToken; namespace
6 use TikToken\Encoder;
136 "TikToken\\": "src"
13 use TikToken\Encoder;
156 - All token counting uses TikToken encoder for rough estimates
7 use TikToken\Encoder;