🤖

How to understand what AI does well and know what it gets wrong

Smarter Than You Think, More Confused Than You'd Expect
Keep This
✅ AI is strong at
  • Summarizing large amounts of text quickly
  • 💡 Generating lots of ideas in seconds
  • 🔄 Rewriting content in different tones or styles
  • 🌐 Translating text between languages
  • 🔍 Finding patterns across lots of information
  • 📝 Drafting a solid starting point for writing
  • 📚 Explaining a concept multiple different ways
❌ AI struggles with
  • 📅 Recent events, its knowledge has a cutoff
  • ⚖️ Moral or ethical judgment, it has no values
  • 🤷 Knowing when it's wrong, it doesn't flag it
  • 😢 Understanding how someone genuinely feels
  • 👤 Knowing your specific context or situation
  • 😂 Humor or sarcasm that depends on who said it
  • 🛑 Deciding when to stop and just listen
Why?

AI doesn't know things, it predicts what words should come next, based on patterns in text it was trained on. It sounds confident regardless of whether the answer is right or completely made up. That's not a bug you can see, it's how the system works.

3 Questions to Ask Before You Trust an AI Output

Use these every time
1

Could this be outdated?

If the answer depends on something recent, news, stats, events, people's roles, verify it independently. AI's knowledge stops at a cutoff date.

2

Is this something AI can actually know?

If it requires your personal context, real-time info, or genuine judgment, AI is guessing. You know your situation better than it does.

3

Does confidence = correctness here?

AI always sounds sure. That doesn't mean it's right. For anything important, check a real source, especially for specific facts, names, and numbers.

The key parallel from today's lesson
Your tournament
The most confidently pitched idea often won, even if it wasn't the best. The crowd validated it because everyone agreed.
How AI picks
The highest-probability word pattern wins, not the most accurate one. AI sounds authoritative because that's how its training text was written.