Function: tokenize()
function tokenize(text): string[];Defined in: packages/mcp/src/search.ts:32
Lowercase alphanumeric tokens, minimum two characters.
Trailing-s stemming (webhooks -> webhook) is applied identically to the index and the query, so plural and singular forms always match. Stems are prefixes of the original word, which keeps snippet lookup working.
Parameters
| Parameter | Type |
|---|---|
text | string |
Returns
string[]