The Verge’s Review Scale

Re: my postscript wondering how in the world David Pierce’s scathing review of the Humane AI Pin resulted in a 4/10 score — I didn’t realize that The Verge has a page describing their review scale:

We assume the 10-point scale is relatively straightforward, but below is a short guide as to how we view the numbers. All review scores are whole points. We no longer use half points or decimals when scoring a product.

  1. Utter garbage and an embarrassment.
  2. A product that should be avoided at all costs.
  3. Bad — not something we’d recommend.
  4. Mediocre — has multiple outstanding issues.
  5. Just okay. This product works well in some areas but likely has significant issues in others.
  6. Good. There are issues but also redeeming qualities.
  7. Very good. A solid product with some flaws.
  8. Excellent. A superb product with minor or very few flaws.
  9. Nearly perfect.
  10. The best of the best.

Those are great descriptions and that’s a useful 10-point scale! But by these guidelines, the AI Pin should have gotten a 2. Maybe a 3, tops, but I’d say “should be avoided at all costs” fits. Definitely far short of 4’s “mediocre”.

But this isn’t the first time I’ve found The Verge’s review scoring incoherent.

★ Thursday, 11 April 2024