4. Self Consistency

Self Consistency

Self-consistency involves prompting a language model with multiple queries or variations of a question to check for consistency in its responses. It helps ensure reliability and coherence in generated content.

• Example: Asking a language model, “What is the capital of France?” and then later in the conversation, asking, “Can you confirm the capital of France once again?”

15 different types of Self Consistency prompting examples for various real life tasks:

1. Translation Verification:
   • Original Prompt: “Translate the phrase ‘Bonjour’ from French to English.”
   • Self-Consistency Prompt: “Verify the translation of ‘Bonjour’ from French to English provided earlier in the conversation.”
2. Mathematical Calculation Check:
   • Original Prompt: “What is 6 multiplied by 9?”
   • Self-Consistency Prompt: “Double-check the result of the multiplication problem involving 6 and 9 given previously.”
3. Fact Verification:
   • Original Prompt: “What year did the Titanic sink?”
   • Self-Consistency Prompt: “Confirm the year of the Titanic’s sinking mentioned earlier to ensure accuracy.”
4. Historical Event Confirmation:
   • Original Prompt: “When did World War II end?”
   • Self-Consistency Prompt: “Ensure the accuracy of the information provided regarding the end of World War II.”
5. Geographical Fact Check:
   • Original Prompt: “What is the capital of Japan?”
   • Self-Consistency Prompt: “Double-check the capital of Japan mentioned earlier to ensure correctness.”
6. Spelling Verification:
   • Original Prompt: “How do you spell ‘accommodation’?”
   • Self-Consistency Prompt: “Confirm the spelling of ‘accommodation’ provided earlier in the conversation for accuracy.”
7. Definition Validation:
   • Original Prompt: “What is the definition of ‘photosynthesis’?”
   • Self-Consistency Prompt: “Verify the definition of ‘photosynthesis’ previously stated to ensure clarity and correctness.”
8. Quotation Accuracy Check:
   • Original Prompt: “What did Albert Einstein say about imagination?”
   • Self-Consistency Prompt: “Check the accuracy of the Albert Einstein quote related to imagination mentioned earlier.”
9. Timeline Confirmation:
   • Original Prompt: “When was the Declaration of Independence signed?”
   • Self-Consistency Prompt: “Confirm the date of the signing of the Declaration of Independence provided earlier in the conversation.”
10. Historical Figure Fact-Checking:
    • Original Prompt: “Who was the first President of the United States?”
    • Self-Consistency Prompt: “Double-check the name of the first President of the United States mentioned earlier for correctness.”
11. Scientific Law Verification:
    • Original Prompt: “What is Newton’s third law of motion?”
    • Self-Consistency Prompt: “Validate the accuracy of Newton’s third law of motion as explained earlier.”
12. Grammar Rule Review:
    • Original Prompt: “When do we use ‘its’ vs. ‘it’s’?”
    • Self-Consistency Prompt: “Revisit the explanation of the difference between ‘its’ and ‘it’s’ to ensure consistency and correctness.”
13. Capitalization Check:
    • Original Prompt: “Is ‘New York’ capitalized in this sentence?”
    • Self-Consistency Prompt: “Verify the capitalization of ‘New York’ as mentioned earlier for consistency.”
14. Unit Conversion Confirmation:
    • Original Prompt: “Convert 10 kilometers to miles.”
    • Self-Consistency Prompt: “Confirm the accuracy of the conversion from kilometers to miles provided earlier.”
15. Historical Fact Validation:
    • Original Prompt: “Who was the first person to step on the moon?”
    • Self-Consistency Prompt: “Verify the identity of the first person to step on the moon mentioned earlier to ensure accuracy.”