Quantative measures are so easy to optimize around that they’re the lazy yard stick to measure against.
Chasing after mechanisms to influence the number, rather than doing your level best to be a good citizen on the platform (which would in turn be rewarded with a higher number) just leads to people gaming the system.
The best systems are those where a win-win situation applies. We built a quant measure into a platform I helped design last year for micro-volunteering. There was concern that people would “just volunteer in order to get their score higher”, but frankly – who cares? More people taking part in the desired behaviour? Game away.
So, what is a platform’s desired behaviour? Is it to help people optimise around a number?
Or something else?