Right. My point was that it doesn’t view any of these as words without a shit ton of additional effort and processing power. That it doesn’t view tokens as words and therefore can’t just search a direct synonym. The whole thing is a bloated mess of over design to take half a step forward and then 6 steps to the left.
Huh? Tokens is not how you seem similar words, or concepts. vector similarity search is.
Right. My point was that it doesn’t view any of these as words without a shit ton of additional effort and processing power. That it doesn’t view tokens as words and therefore can’t just search a direct synonym. The whole thing is a bloated mess of over design to take half a step forward and then 6 steps to the left.