The 0.2% conversion rate reality check
I thought I was being diligent. I actually created a Notion doc titled "User Research" and sent out surveys. I even chatted with people in Discord servers. When they said things like, "I'd totally use that!" I wrote down "strong signal" in my notes. I felt like a pro.
The mistake? I wasn't looking for data; I was looking for permission to keep building.
Every single person I "validated" with was someone who already knew me or lived in an indie-builder bubble where being supportive is the social norm. My survey wasn't a research tool; it was a kindness request disguised as a technical inquiry. I had essentially built a personalized filter bubble and called it "thoroughness."
The real wake-up call didn't come from my friends, but from a $40 Meta ads test. I targeted a cold audience—complete strangers with zero social obligation to be nice to me. Out of 1,200 impressions, the conversion rate was 0.2%. The algorithm doesn't care about your feelings or your "strong signals."
I even tried a neutral subreddit filled with actual deal-hunters, asking a blunt question: "Do you use anything to track store deals?" Most just used the store's own loyalty app. One person even pointed out that an app for this already exists. I had dismissed a similar comment from a friend earlier, labeling him a "skeptic" instead of listening to the actual logic.
> Validation feels like research but functions like a mirror when you get to pick who's holding it.
If you're rolling out new tools or products, stop asking people who like you for feedback. Ask the people who have no reason to be polite. Cold audiences might be more expensive, but they charge you in honesty rather than just dollars.