Searched refs:buildBpeRanks (Results 1 – 1 of 1) sorted by relevance
61 $this->bpeRanks = $this->buildBpeRanks($bpeMerges);152 private function buildBpeRanks(array $bpes): array function in TikToken\\Encoder