Search Relevance - SearchStax


SearchStax® by Measured Search® includes search analytics reports that track the relevance and click-through events of your deployment.

To view the displays on this page, you must:

  1. Create an analytics app.
  2. Insert analytics scripts in your search-results page.
  3. Let people use your search application so you can collect statistics.
  4. Navigate from the Analytics node on the left-side navigation column to the list of Analytics Apps.
  5. Click the blue arrow icon to the right of the appropriate App.
  6. Select the Relevance node in the navigation bar at the left edge of the SearchStax window.

Average Click Position

When a user selects a search-result item and clicks on it, what was the position of the item in the list? Look for Average Click Position under the Relevance menu on the left side of the SearchStax dashboard.

Average Click Position is a good gauge of the effectiveness of the search results. Low numbers (below 5 or so) mean that the users found the desired items near the top of the search results. Higher numbers indicate that the search was successful, but the user had to scroll down through the search results to find the desired items.

In general, the lower the number the better. Over time you would like to see the Average Click Position trend down.

Screenshot

The data table below the graph lets us dig for more information. It can be filtered by a keyword or by setting a numeric limit on Average Click Position, Clicks, or Search Volume. It can be sorted up or down on any one of the columns.

screenshot

Column Name Description
Query The primary search query. The display does not include the settings of facets and filters.
Average Click Position The average position of the result item when this query resulted in a clickthrough event.
Clicks Number of clickthrough events in the requested time period.
Search Volume Number of searches for this query in the requested time period.

MRR

Mean Reciprocal Rank (MRR) is a weighted average of click-through positions resulting in a value between zero and one. Higher values indicate that the "right answer" was often near the top of the search results. Look for MRR under the Relevance menu on the left side of the SearchStax dashboard.

Screenshot

MRR gives us feedback on the quality of our search experience. It helps us tune the system. For instance, did the recent changes in the synonym list improve the search experience? If so, then the MRR value should have risen. An upward trend in the MMR value over time indicates that the search is becoming more focused on the needs of the users.

Similar Searches

The Similar Searches display gathers similar user queries in order to identify patterns in user behavior when discovering a particular result. Look for Similar Searches under the Relevance menu on the left side of the SearchStax dashboard.

This display is a powerful tool to improve the search experience for your users. It shows user queries that led to specific results. This lets the team optimize search relevance algorithms and extend the set of synonyms.

Screenshot

Column Name Description
Clicked Item Various queries led users to click-through the same result item. This is how we know that the queries are related.
Queries (Top 50) The most popular queries that led to this result item.
Unique Queries Number of textually-distinct queries that led to a click-through on this item.