A ramble about accuracy compared with NDCG scores for evaluating effectiveness of information retrieval. It’s an introduction, so if you already know what they are, you can skip this.
A couple of weeks ago, we released a new tool for training the IBM Watson Retrieve and Rank service (a search service that uses machine learning to train it how to sort search results into the best order).
This afternoon, I deployed a collection of small updates to the tool and thought I’d make a few notes about what’s changed.
Most of them are a bunch of incremental updates and minor bug fixes.
For example, support for a wider range of Bluemix environments, support for larger document cluster sizes, displaying the amount of disk space left in a cluster, and so on.
One update in particular I thought was more interesting, and worth explaining.