Capabilities & Limits /capabilities-and-limits--judge-the-survivors

Discernment

Stress-test a source AND the AI through your questions, then judge what survives.

Product Discernment
0/8

Challenge

  1. Challenge 01

    Run your three questions at both a source and at Claude. Mark each answer keeps / refine / reject. Flag any specific (name, date, number, citation) you could not verify independently.

  2. Challenge 02

    Pick the single most confident answer that turned out unverifiable and say which AI limit produced it β€” hallucination, knowledge cutoff, or no tool access.

  3. Challenge 03

    You ask an AI: "What are the top three reasons the printing press changed Europe?" The AI lists three reasons with confident language. Now ask a historian the same question and compare. Which reasons does the AI omit? Which does the historian emphasize differently? Which survive both?

  4. Challenge 04

    An AI generates five claims about how a company operates. Pick the one that sounds most like inside knowledge (specific, confident, detailed). Try to verify it. If you can't, ask: Is the AI drawing on public data that happens to be detailed? Or is it inventing plausibility? Write one question you'd ask the AI to expose which it is.

  5. Challenge 05

    An AI explains a technical concept (how transistors work, why plants need sunlight). Write three follow-up questions designed to expose the limits of its explanation. Then ask the AI those questions. For each answer, decide: Did it hold up, or did it hedge, contradict itself, or admit it doesn't know?

  6. Challenge 06

    A source (article, report, interview) makes an argument. Ask the AI to play the strongest counterargument to that source. Then ask: Which side's argument survives your stress-test better? What evidence is each side missing? Where are they both wrong?

  7. Challenge 07

    Ask an AI for a number (a statistic, a percentage, a cost). Then ask: "Where does that number come from?" If it cites a source, check if the source actually contains it. If it can't cite the source, ask: "Are you confident enough to stake your reputation on that number?" Note what survives: the number itself or only the caveat.

  8. Challenge 08

    Compare how a source and Claude answer the same open-ended question (e.g., "What's the biggest challenge in education?" or "Why do people procrastinate?"). Map what each one includes, leaves out, and assumes. Then decide: What's the core insight that both touch? What would you need to believe to accept each one? What survives cross-checking?