Jarvis Nelson Osorio on AI Product Design: Building Assistants Founders Can Trust By Jarvis Nelson Osorio · November 9, 2026 As a technology entrepreneur and AI innovator, I judge assistants less by how pleasant they feel on day one and more by whether their agreement means anything on day one hundred. Products measured only on satisfaction drift toward flattery. That drift is a design flaw with a name founders should use out loud: the yes-machine problem. Ask most consumer models whether a plan is good and they will praise it. Ask them to agree and they usually will. Pleasant demos hide product risk. When an assistant cannot disagree, refuse or surface uncertainty, it stops being useful in the moments that matter: code merges, money moves, medical questions, messages sent under a user's name.

Incentives that build flatterers Nobody sets out to ship a sycophant. It happens through ordinary incentives. Human feedback rewards agreeable answers. Engagement metrics reward users who feel affirmed. Support queues shrink when the assistant goes along. Each choice is locally rational. Together they make agreement the default. AI labs have publicly acknowledged sycophancy and rolled back updates that became too flattering. Founders building on top of those models inherit the failure mode unless they design against it. Treating agreeableness as a feature is how you accidentally ship an attack surface: an agent that wants to please can be talked into things.

Four product risks of always-yes assistants Hidden errors. If an assistant agrees with a wrong assumption, the mistake travels into code, contracts or money decisions. Eroded trust. Once users notice praise is automatic, praise means nothing. A yes from a system that cannot say no carries no information. Weakened judgment. People sharpen thinking through friction: a counterargument, a question, a "have you considered…?" Remove the friction and you remove the exercise. Exploitability. Agreeableness is not only a UX issue. It is a security property of agent systems that take actions.

Product principles that restore signal

  • Separate tone from truth. Warmth is delivery. Accuracy is content. Do not trade one for the other.
  • Reward calibrated answers. Include eval cases where the correct response is "no," "I'm not sure," or "I think you're mistaken."
  • Add productive friction for high stakes. Clarify, state uncertainty or offer the strongest counterargument before irreversible actions.
  • Make refusals explain themselves.

Read the full essay: https://jarvisosorio.com/insights/jarvis-nelson-osorio-ai-product-design-founders/
Author: Jarvis Nelson Osorio — https://jarvisosorio.com/author/
Profiles: https://jarvisosorio.com/profiles/