Searched refs:tokenizer (Results 1 – 4 of 4) sorted by last modified time
115 $tokens = $this->tokenizer($text);505 public function tokenizer($text, $wc = false)488 public function tokenizer($text, $wc=false) { global() function in dokuwiki\\Search\\Indexer
500 * Improve the performance of the strict mode tokenizer, making highlighting of languages like
950 $words = $Indexer->tokenizer($term_noparen, true);
22 * Version of the indexer taking into consideration the external tokenizer.246 return $Indexer->tokenizer($string, $wc);