OpenAI-powered Semantic Search for Prune your Follows?
This weekend I explored Semantic Search using OpenAI and Vector Search from Xata to see if it could be something for Prune your Follows.
To understand the difference better, I created a demo comparing it to the other two search options Xata provides: full-text search with fuzzy matching and partial plaintext search using "contains".
Searching for "norway" all three gives us results for accounts mentioning "norway" in some way:
However, when searching for "norwegians" we can see where Semantic Search shines. @nynorskdama does not mention "norwegian" or "norway", but semantically "norsk" is the same as "norwegian" in Norwegian 🤯
It might also know that "Ulsteinvik" is geography part of Norway and thus semantically close to "norwegians" as is the case when searching for "valdres" - a location in Norway and it gives us accounts located other places in Norway:
For a great rundown of how to get started and the article I used to kick start my journey, check out Swizec's Build semantic search in an afternoon? Yep 🤯 even if it took me longer than an afternoon 😬
All the best,