AI search sounds great in theory, but it has flaws. We know firsthand, since it’s one of the many AI integrations we’ve worked on with our publishers.
Thanks to natural language processing (NLP), AI is very smart about detecting patterns and establishing links between words. The more data it’s trained on, the better it gets. For media companies and brands, training AI on your own content can lead to a powerful engine that is ready to search. There’s no better example of that than what we did with Raw Story, creating an editorial chatbot based on 300,000+ pieces of content.
But there are some areas where AI search leaves a lot to be desired. Maybe over time these things will be smoothed out, but for now you need to know about them to deliver the best user experience.
Let’s break down the pros and cons further.
The Best Approach
So what’s our proposed solution? Use AI to do what it’s best at, and then use traditional search for the rest.
Our recommendation has evolved. We were once all in on AI search as being a superior search experience. But the data and user feedback is clear — it’s not always quite right.
There’s nothing wrong with a more traditional search experience, but layer in the following and it becomes really powerful:
- Use AI to check for typos and correct them.
- Use AI to find similar keyword matches and capture intent, instead of using it purely for finding content.
- Use AI to check whether a keyword is intended for semantic or lexical search, and choose the best tool to use.
You can also make tweaks to the way the AI is operating. For example, a user complained that results were old and contained unrelated posts. Our shift? We adjusted sorting to prioritize similarity within a 60-day period, improving relevance.
When it comes to single-word queries, we also made a change there. Use AI for multiword queries, but regular search for a single-word query, and the results are much improved.
Another common complaint is that you can’t search by author name in AI search results. This is another area you can make adjustments. Either feed that information into the AI and train it on authors, or add a widget to show authors that match search results.
At the end of the day, yes, use AI. Don’t be afraid of its shortcomings. But also be aware of them, and make adjustments so that your users have the best experience possible.
This article originally appeared on RebelMouse.com and was syndicated by MediaFeed.org.
Featured Image Credit: hirun / iStock.
