Every product has a number that makes the team feel good and tells them nothing. Page views. Registered users. Downloads. Likes. The number goes up, the team celebrates, and nothing about the business actually changed.
Vanity metrics are numbers that look like progress and are not. They are easy to gather, flattering to report, and almost completely disconnected from whether the product is healthy. They are the comfort food of product analytics.
This article is about how to recognize them and, more importantly, how to pick numbers that would tell you the truth even when the truth is uncomfortable.
What a vanity metric is
A vanity metric has a few defining qualities. It is easy to get. It moves in one direction, mostly up. It is impressive to show to leadership. And it does not tell you whether you should change anything.
The last quality is the important one. The test of a metric is not whether it is accurate. It is whether it changes your behavior. A metric that goes up every month, that you celebrate and then ignore, is a vanity metric no matter how real the underlying number is.
Total registered users is the classic example. It only ever goes up. It says nothing about whether anyone is using the product, whether they stick around, or whether they would pay. It flatters, and it hides.
Why they are so seductive
Vanity metrics win because they are aligned with incentives. They are easy to collect, so they are collected. They are easy to report, so they are reported. And they are easy to hear, so leadership asks for them.
A product manager who reports "page views are up 40 percent" gets a nod. A product manager who reports "activation is flat and we are not sure why" gets questions. The incentive is to find the number that sounds good.
This is not usually dishonesty. It is a slow drift toward the comfortable. The uncomfortable numbers require explanation, and explanation is work, and the work gets avoided.
The uncomfortable-news test
There is a simple test for whether a metric is a vanity metric. Ask: could this number tell me something I do not want to hear?
If the answer is no, if the metric can only flatter, it is a vanity metric. A real metric is one that would drop, and that drop would mean something, and you would act on it.
Churn can tell you bad news. Activation can tell you bad news. Revenue can tell you bad news. Page views almost never can. That is why page views are a vanity metric and churn is not.
The metrics that matter are the ones that can fail, because failing is how they inform. This is the same logic as outcomes versus outputs: the useful measure is the one that can disappoint you.
Vanity versus actionable
The distinction is clearest in pairs.
- Downloads versus retention. A million downloads is a headline. The share of people still using the app after a month is a signal. Only the second tells you whether the product works.
- Page views versus activation. Traffic tells you people arrived. Activation tells you whether the first visit turned into something. Arrival without activation is just noise.
- Daily active users versus engagement depth. Logging in is not the same as doing the thing the product exists for. A dashboard that is opened and closed in ten seconds is not a retained user.
The pattern is consistent. The vanity metric counts an event that is easy to count. The actionable metric measures an outcome that is hard to move. And this is exactly the trap described in the article on dashboards that say everything: a surface full of easy numbers is a surface that hides the hard one.
The north star problem
The opposite failure is to chase a single perfect metric and never settle on one. Teams will spend months debating the north star and, in the meantime, measure nothing consistently.
The north star does not need to be perfect. It needs to be the best proxy for the value the product delivers, and it needs to be something the team can actually move. It is a starting point that gets refined, not a truth revealed by analysis.
A better approach than endless debate is to pick a candidate, instrument it, and watch whether it helps decisions. If it does, keep it. If it flatters and changes nothing, it was a vanity metric in disguise.
Leading versus lagging
One more distinction matters. Lagging metrics tell you what already happened. Revenue this quarter is lagging. Leading metrics tell you what is likely to happen next. Week-one activation is leading, because it predicts retention.
Vanity metrics are usually lagging and unactionable at the same time. They tell you a nice story about the past and give you nothing to do about the future.
A healthy measurement setup has a small number of leading indicators that the team can influence today, plus a lagging number that tells them whether it all worked. The leading indicators are the ones worth putting on a dashboard; the lagging ones belong in a monthly report.
The takeaway
The metric that flatters you is probably the wrong one, not because it is inaccurate but because it is comfortable. The discipline of good measurement is choosing numbers that would tell you the truth even when the truth is inconvenient. The test is simple: could this number disappoint me? If it cannot, it is not measuring the product. It is measuring your mood.
