Mastering commercial intent: the psychology behind “Best vs. New” searches

Intro

Two people open Google within minutes of each other. One types “best streaming service.” The other types “new streaming service.” Same category. Completely different minds.

The first person is done exploring. They’ve decided they want something, they just haven’t chosen. They want a shortlist, a verdict, a reason to commit. The second is still assembling the picture. What exists? What’s worth knowing? They’re not close to a decision; they might not even be certain they have a problem to solve.

One word separates them. From a content and conversion standpoint, that gap is enormous.

“Best” is a shorthand for “I’m almost decided”

Commercial investigation intent is the term SEO practitioners use for the mindset behind “best [product]” searches. According to Semrush’s research on keyword intent, these users are researching before purchasing, but their research has a direction. They want comparison guides, ranked lists, user reviews, something that helps them eliminate options rather than discover them.

The psychology is shortlisting logic. Think of it like walking into a restaurant already knowing you want pasta, you read the menu to narrow down, not to figure out if you’re hungry. A query like “best project management software for remote teams” carries that same specificity. The modifier “best” signals that the user already understands the category. They’re evaluating within it, not exploring it.

This is why “best” queries tend to convert, and why ranking for them matters. Semrush’s keyword intent framework places commercial searches just below transactional ones (think “buy X now”) in terms of proximity to a purchase decision. Serve these users with a generic overview or a thinly veiled sales pitch, and they’ll leave. Give them a structured comparison with honest trade-offs, and you’ve earned trust.

“New” searches sound similar. They’re not.

Change “best” to “new” and the entire psychological profile shifts.

Someone searching “new social gaming apps” or “new streaming services 2026” is in discovery mode, curious, possibly restless with what they already know, or aware the category is moving fast. Fresh social gaming brands, for instance, attract exactly this kind of traffic: users who know the space exists and want to see what’s emerged recently, not a ranked verdict on established names.

Discovery searches are awareness-stage behavior. The user hasn’t committed to buying anything. They’re building a mental map of the category. Trying to convert a “new” search with a hard sales pitch is like proposing on a first date, technically possible, but almost certainly the wrong call.

That’s not a weakness in the traffic. It’s a content opportunity, provided you meet them where they actually are.

The mismatch problem nobody talks about

Most content strategies quietly bleed here: brands build conversion-focused pages optimized for “best” and then use the same pages to capture “new” traffic. The intent doesn’t match. Neither does the result.

Semrush’s search behavior data is instructive. Desktop users make search-result decisions in under five seconds. The average U.S. query runs 3.4 words. Mobile users reformulate their searches 29.3% of the time, versus 17.9% on desktop, a sign that mobile search is more exploratory, less resolved. These aren’t abstract data points. They say that the window to signal relevance is tiny, and that getting the intent wrong means the bounce happens before a human reads your first line.

Google’s guidance on helpful content reinforces this at the algorithm level. The search engine rewards pages built for “a specific existing or intended audience”, which demands knowing whether that audience is comparing or still discovering. A page targeting a “best” query should feel like a trusted recommendation from someone who did the work. A page targeting “new” searches should feel like a curated overview: here’s what’s emerged, here’s what’s interesting about it, here’s why it matters right now.

Different content. Different architecture. Different call to action.

What each type actually needs

For “best” searches, the content job is filtering. Ranked criteria. Transparent methodology. The reader needs to trust that someone did the vetting on their behalf, and that the list exists to help them decide, not to funnel them toward a pre-chosen sponsor. First-hand experience (what Google’s E-E-A-T framework calls Experience, Expertise, Authoritativeness, and Trustworthiness) builds that trust faster than any design element.

For “new” searches, the content job is curation. What’s arrived recently. What’s worth paying attention to. Why this category is moving right now. Conversion is downstream. Your actual job is to get added to the reader’s mental shortlist, so when they arrive at the “best” search stage three days later, they already know your name.

The timing matters more than most teams admit. Someone in the “new” phase today is often a “best” searcher by the end of the week.

The word tells you everything

Searchers don’t explain themselves. They don’t write “I am currently in the evaluation stage of my purchase journey.” They type three words and hit Enter.

But those three words carry a psychological signature. Where they are in the decision cycle. What content will hold their attention. What call to action will feel appropriate rather than premature. “Best” is a near-decided mind looking for permission to choose. “New” is a curious mind still drawing the map.

The brands and publishers that understand this aren’t just doing better SEO. They’re having a more honest conversation with their readers, one that starts by listening to the single word that tells them exactly who showed up.