Table of Contents

    Hallucinations & Fact-Checking

    Hallucinations & Fact-Checking
    Figure: Hallucinations & Fact-Checking

    PROMPT ENGINEERING

    Hallucinations & Fact-Checking

    When AI sounds confident but is wrong — and how to catch it before it costs you.

    What Is a Hallucination?

    A hallucination is when an AI produces confident, plausible-sounding information that is actually false or made up. The danger is the tone: the model states fiction with the same authority as fact.

    This happens because a language model predicts likely words — it does not truly "know" facts or check a database of truth. Most of the time the prediction is correct, but when it isn't, the output can be confidently, convincingly wrong.

    In one line: The model is a brilliant word-predictor, not a fact-checker — so confident does not mean correct.

    A Simple Analogy

    Imagine a very articulate student who never says "I don't know." Asked about anything, they give a smooth, confident answer — even when they're guessing. That fluency is exactly what makes AI hallucinations so easy to miss.

    Why Do Models Hallucinate?

    Understanding the causes helps you anticipate and prevent them.

    1

    It Predicts Words

    Probability, not truth.

    The model guesses the next likely word — not the verified fact.

    2

    Gaps in Training

    Incomplete knowledge.

    Missing, outdated, or thinly-covered topics invite invention.

    3

    No Live Access

    Can't check reality.

    Without tools, it can't verify real-time or recent facts.

    4

    Vague Prompts

    Ambiguity invites guessing.

    Unclear requests leave gaps the model fills with plausible fiction.

    How to Reduce Hallucinations

    You can dramatically lower the risk with a few prompting habits.

    1. Ask for Sources (or Uncertainty)

    Answer the question below. For each claim, cite a source.
    If you are not certain, say "I'm not sure" instead of guessing.
    
    Question: [your question here]

    2. Ground It with RAG

    Answer using ONLY the context provided below.
    If the answer is not in the context, reply:
    "Not found in the provided documents."
    
    Context:
    """
    [paste trusted document here]
    """

    3. Be Specific

    Weak:   "Tell me about the policy."
    Strong: "Summarise the leave carry-forward rule from the 2024
             policy in 3 bullet points. If unknown, say so."
    The most powerful anti-hallucination phrase you can add to any prompt: "If you don't know, say you don't know."

    Always Fact-Check

    • Verify dates, numbers, and names against a reliable source
    • Cross-check quotes and statistics before you publish them
    • Confirm high-stakes facts independently — never rely on one output
    • Be extra cautious with legal, medical, or financial claims
    • Never trust confident-sounding output blindly

    When to Fact-Check Hardest

    Risk Level Examples Checking Needed
    Low Brainstorming, draft ideas, casual writing Light review
    Medium Reports, summaries, study notes Verify key facts
    High Legal, medical, financial, published content Independently confirm everything

    Common Pitfalls to Watch Out For

    Pitfall 1 — Trusting fluency A polished, confident tone feels trustworthy — but style is not evidence. Fluent output can still be false.
    Pitfall 2 — Fake citations Models can even invent realistic-looking sources, page numbers, or URLs. Always confirm that a cited source actually exists and says what's claimed.
    Fix — Verify, then trust Treat AI output as a well-informed draft, not a final authority. Ground it, ask for sources, and independently confirm anything that matters.

    Key Takeaway

    AI hallucinates because it predicts words, not truth. Reduce the risk by asking for sources, grounding with RAG, and being specific — then always fact-check. Remember: confident does not mean correct, and verification is your job.