Putting HI at the Heart of AI: Fact Check Prompting
HI fact checking AI using Fact Prompt Pattern
The buzz around Artificial Intelligence (AI), particularly Large Language Models (LLMs) like ChatGPT and its contemporaries, is undeniable. These tools offer incredible potential to augment our capabilities, generate creative text, and synthesize information at lightning speed. However, as we integrate AI more deeply into our workflows, a critical challenge emerges: accuracy.
The buzz around Artificial Intelligence (AI), particularly Large Language Models (LLMs) like ChatGPT and its contemporaries, is undeniable. These tools offer incredible potential to augment our capabilities, generate creative text, and synthesize information at lightning speed. However, as we integrate AI more deeply into our workflows, a critical challenge emerges: accuracy.
HI fact checking AI using Fact Prompt Pattern
LLMs are designed to generate plausible, often convincing, text based on the vast datasets they were trained on. The problem? They don't understand truth in the human sense. They can, and often do, generate incorrect information, inaccuracies, or "hallucinations" that sound perfectly reasonable. Relying solely on AI output without scrutiny isn't just inefficient; it can be risky.
This is where Human Intelligence (HI) must take centre stage. AI is a powerful tool, but HI provides the essential oversight, critical thinking, and contextual understanding. The very existence of practical techniques to manage AI's limitations underscores this point. One such powerful technique is the Fact Check List Pattern for prompting.
What is the Fact Check List Pattern?
Think of the Fact Check List Pattern as building a quality control step directly into your interaction with an LLM. [source: 2] It's a simple instruction you give the AI before or as part of your main request.
The core idea is to instruct the LLM to automatically extract and list the key factual claims, assumptions, or specific pieces of data it uses within the response it generates. This list appears at the end of the AI's output, clearly signposted.
Why This Pattern Proves HI is Essential
The fact that we need a pattern like this speaks volumes. It acknowledges a fundamental truth: AI, in its current form, is not an oracle of infallible truth. It's more like an incredibly fast, knowledgeable, but sometimes unreliable research assistant.
AI Provides the Draft, HI Provides the Judgement: The LLM can generate content and even identify its own key claims, but it lacks the real-world experience, ethical compass, and critical reasoning skills to verify those claims independently. That's the role of HI.
Encourages Critical Assessment: The pattern actively prompts the human user to pause and verify. It shifts the interaction from passive acceptance to active engagement and critical thinking – core components of Human Intelligence.
Highlights the HI+AI Partnership: Effective use of AI isn't about replacing human thought; it's about augmenting it. This pattern facilitates a structured collaboration where AI does the heavy lifting of information generation and preliminary tagging, while HI performs the crucial validation and sense-checking.
The Fact Check List pattern isn't a criticism of AI; it's a framework for its responsible and intelligent use, guided by human oversight.
HI fact checking AI
How to Use the Fact Check List Pattern (A Quick Guide)
Implementing this is straightforward. Here’s a succinct framework: [source: 2]
The Instruction: Add this instruction to your prompt, either as a preliminary setup or within the specific request: "Whenever you generate text/output based on my requests, please append a section at the end titled 'Fact Checklist:'. List the core factual statements, assumptions, or claims made in your generated text that should be verified for accuracy."
Example 1: Getting Information
Task: Ask the LLM to explain a concept like photosynthesis.
Setup: Apply the fact checklist instruction.
Potential Output: The LLM explains photosynthesis and appends:
Fact Checklist:
Plants use sunlight, water, and CO2.
Oxygen is a byproduct.
Chlorophyll is involved in the process.
HI Action: You now have clear points to quickly verify using reliable external sources.
Example 2: Generating Marketing Copy
Task: Ask the LLM to write about a new 'auto-sync' product feature.
Setup: Apply the fact checklist instruction.
Potential Output: The LLM generates the copy and appends:
Fact Checklist:
Feature syncs data automatically between devices.
Synchronization occurs every 5 minutes.
Compatible with platforms X, Y, and Z.
HI Action: You can easily check these specific claims against the actual product specifications.
The Takeaway
The Fact Check List Pattern is a simple yet powerful technique for improving the reliability of information obtained from LLMs. More importantly, its very necessity serves as a clear reminder: Human Intelligence – our ability to question, verify, apply context, and exercise critical judgment – must remain firmly at the heart of how we leverage Artificial Intelligence.
AI can accelerate and assist, but HI must lead, validate, and direct.
By consciously using patterns like this, we can foster a more effective, responsible, and truly intelligent partnership between humans and AI. [source: 9]