Vanity Metrics That Masquerade as Validation

Not all metrics are created equal. Some measure progress. Others measure motion.

Vanity metrics are numbers that go up and make you feel good but don't correlate with business outcomes. They're dangerous because they create a false sense of validation — the feeling that things are working when the underlying reality is ambiguous.

Engagement vs revenue

Engagement metrics (page views, session duration, feature usage) measure attention, not value. Users can be highly engaged with a free product they'd never pay for. Revenue metrics measure willingness to exchange money for value — the only unambiguous signal.

Downloads vs activation

Download counts are the most common vanity metric. A download represents curiosity, not commitment. Activation — the moment a user completes the core action that delivers value — is the metric that matters.

The gap between downloads and activation is the conversion gap. Most products have an enormous one.

Social proof illusions

Testimonials, case studies, and "as seen in" logos create social proof that feels like validation. But social proof measures perception, not product-market fit. A product can have excellent PR and terrible retention.

The metrics hierarchy

From least to most meaningful:

1. Impressions/reach — People saw your marketing (meaningless alone)
2. Signups/downloads — People were curious enough to try (low signal)
3. Activation — People completed the core value action (moderate signal)
4. Retention — People came back without being prompted (strong signal)
5. Revenue — People paid money (strongest signal)
6. Expansion revenue — People paid more over time (PMF signal)

What to ignore

Ignore metrics that: - Can be inflated by spending money (paid downloads, sponsored impressions) - Don't connect to a revenue outcome within two steps - Are growing while revenue is flat or declining - Measure input (effort, features shipped) rather than output (value delivered)

How this decision shapes execution

The metrics you choose to track determine the decisions you make. If you're optimizing for vanity metrics, your execution will prioritize activities that inflate those metrics — more features, more marketing, more content — while the underlying product-market fit question remains unanswered. Choosing the right metrics is choosing the right execution path.