Critical Analysis Skill (Is-It-Ture)

A comprehensive framework for systematic dialectical examination of viewpoints, factual statements, or web content, based on the critical thinking methodology of "Asking the Right Questions" by Browne and Keeley.

Core Analysis Process

Step 1: Determine Analysis Type

Classify the input into one of the following types:

Type	Characteristics	Analysis Focus
Factual Statement	Verifiable objective claims involving data, research, statistics, etc.	Authenticity, scientific basis, evidence support
Opinion-based Statement

Contains value judgments, opinions, or suggestions | Thesis, conclusion, argument, evidence, assumptions |
| Web/Article Content | Mixed content combining facts and opinions | Separate facts from opinions, then analyze each |

Step 2: Factual Statement Verification Framework

For each factual statement, systematically verify the following dimensions:

2.1 Source Tracing

• - Original Source: Where did this data/conclusion originate?
• Authority: Does the source have professional credentials (academic journals, government agencies, renowned research institutions)?
• Timeliness: Is the information outdated? Are there more recent studies or data?

2.2 Multi-Source Cross-Validation (Mandatory Step)

Multi-source cross-validation must be performed for ALL types of input (factual statements, opinion-based statements, web content):

2.2.1 Verification Strategies

Verification Method	Action
Direct Search Verification	Use search engines to find reliable sources for original data/research
Cross-Validation

Verify the same fact through 3+ different reliable sources |
| Reverse Verification | Search whether the information has been denied by official/authoritative institutions |
| Deep Tracing | Trace the information dissemination chain to find the original source |

2.2.2 Source Reliability Ratings

Grade	Type	Description
A+	Government official data, prestigious academic journals, peer-reviewed research	Highest credibility
A

Reports from renowned institutions (WHO, World Bank, etc.), verified mainstream media reports | Highly credible |
| B+ | Professional media, industry association reports, content with clear source citations | Basically credible |
| B | General media reports, personal blogs without clear sources | Requires cross-validation |
| C | Social media, forum posts, content with untraceable sources | Suspicious |
| D | Anonymous posts, marketing content, confirmed misinformation | Not credible |

2.2.3 Information Source Type Identification

Type	Characteristics	Risk Level
Misinformation	Content contradicts established facts, no reliable source support	High
Marketing Copy

Commercial purpose, exaggeration or out-of-context presentation | High |
| Unverifiable Private Information | No verifiable source, subjective statements presented as objective facts | Medium-High |
| Misleading Information | Partially true but deliberately misleading | High |
| Outdated Information | Previously correct data/conclusions that are now obsolete | Medium |

2.2.4 Cross-Validation Checklist

• - [ ] Was the original source found? What is the original source?
• [ ] Are there 3+ independent reliable sources supporting this information?
• [ ] Are there any reliable sources that contradict this?
• [ ] Has this information been denied or corrected by authoritative institutions?
• [ ] Does the information come from known misinformation sources?
• [ ] Is there any out-of-context or selective quoting?
• [ ] Have the data/statistics been deliberately distorted (scale, base, comparison method)?

2.2.5 Information Tracing Path

CODEBLOCK0

2.3 Scientific Principle Verification

• - Consistency with Known Scientific Principles: Does the statement align with established scientific theories?
• Mechanism Explanation: Can it explain the underlying causal mechanism?
• Boundary Conditions: What are the applicable conditions and scope of this conclusion?

2.4 Evidence Quality Assessment

• - Direct Evidence: Is there direct experimental data, statistical data, or research results supporting it?
• Indirect Evidence: Is the inference chain rigorous?
• Sample Quality: Is the research sample representative? Is the sample size sufficient?
• Research Design: Is the research methodology scientific? Are there design flaws?

2.5 Logical Consistency

• - Internal Consistency: Are there internal contradictions within the statement?
• External Consistency: Does it align with other reliable evidence?
• Causation vs. Correlation: Has causation been confused with correlation?

Step 3: Opinion-Based Statement Analysis Framework

Deconstruct opinion-based statements into their components for systematic analysis, while performing multi-source cross-validation on any factual content involved:

3.1 Thesis Identification

• - Core Question: What question is the author trying to answer?
• Thesis Type: Descriptive (what is) or Prescriptive (what should be)?

3.2 Conclusion Extraction

• - Main Conclusion: What is the author's core claim?
• Sub-conclusions: What specific points support the main conclusion?
• Conclusion Priority: Which are main points and which are supporting arguments?

3.3 Argument Structure Analysis

CODEBLOCK1

• - Reasons: What reasons does the author use to support the conclusion?
• Evidence Types:

- Personal experience/cases - Unofficial expert opinions - Eyewitness testimony - Typical cases - Quoted authorities/experts - Personal observation - Research results/statistical data - Analogies - Presumed premises

• - Evidence Quality: How strong a conclusion can this type of evidence support?

3.4 Assumption Identification

Explicit Assumptions (clearly stated by the author):

• - What are the author's preconditions?

Implicit Assumptions (unstated but necessary):

• - Value Assumption: What does the author consider more important? (efficiency vs. fairness, individual vs. collective, etc.)
• Descriptive Assumption: What does the author believe about how the world works?

Questions for Examining Assumptions:

• - Is this assumption true/correct?
• If the assumption is false, does the conclusion still hold?
• Does this assumption conflict with reader or societal consensus?

3.5 Position Analysis

• - Author's Position: From what standpoint is the author speaking?
• Beneficiary: Who benefits from this viewpoint?
• Conflict of Interest: Is there obvious interest-driven motivation?
• Reader's Position: Is the reader automatically placed in a certain position?

Step 4: Common Fallacy Identification

Examine arguments in opinion-based statements for logical fallacies:

Fallacy Type	Description	Verification Question
Ad Hominem	Attacking the person rather than the argument	Is it questioning the person rather than the argument?
Straw Man

Distorting the opposing view | Is it refuting a point the opponent didn't make? |
| Slippery Slope | Unwarranted chain inference | Is there sufficient evidence for each step? |
| Appeal to Authority | Using authority instead of argument | Is the authority an expert in this field? Is the issue within their expertise? |
| Appeal to Emotion | Using emotion instead of logic | Is it manipulating reader emotions rather than reasoning? |
| False Dilemma | Creating a false either/or situation | Are middle-ground or other possibilities ignored? |
| Equivocation | Changing key term definitions | Have key concepts changed during argumentation? |
| Circular Reasoning | Using the conclusion to prove the premise | Are the reasons merely restatements of the conclusion? |
| Hasty Generalization | Concluding from insufficient samples | Is the sample sufficient to represent the whole? |
| Post Hoc Ergo Propter Hoc | Assuming sequence equals causation | Is there another explanation? |

Step 5: Web/Article Content Processing

For web content, additionally perform the following steps:

5.1 Source Reliability Assessment

• - Website Reputation: What is the nature of the website? (government/academic/commercial/personal blog)
• Author Information: Is author information provided? What is the author's professional background?
• Citations: Are reliable sources cited?
• Update Date: Is the information current?

5.2 Content Structure Analysis

• - Fact vs. Opinion Separation: Distinguish between objective facts and subjective opinions
• Contextual Completeness: Is it taken out of context? Is important background missing?
• Presentation Method: Is the data presentation misleading (truncated scales, sample selection, etc.)?

5.3 Source Cross-Validation (Web-Specific)

Web content cross-validation requires special attention to:

Verification Item	Action
Domain Verification	Check if it's a spoofed/phishing website
Publication Time Verification

Find the original publication date and subsequent update records |
| Content Consistency Verification | Compare web snapshots to check for content tampering |
| Citation Source Tracing | Trace all external links cited in the webpage |
| Reverse Image Search | Perform reverse image search to verify if images have been misappropriated |
| Social Media Cross-Validation | Search whether this content was spread on social media and if there was subsequent debunking |

Step 6: Comprehensive Assessment

Based on the above analysis, provide a structured assessment conclusion:

Assessment Standards

Grade	Rating	Meaning
Highly Credible	⭐⭐⭐⭐⭐	Sufficient reliable evidence, consistent with scientific principles, rigorous logic
Basically Credible

⭐⭐⭐⭐ | Evidence basically sufficient, minor doubts may exist | | Pending Verification | ⭐⭐⭐ | Insufficient evidence, more information needed | | Questionable | ⭐⭐ | Obvious logical problems or insufficient evidence | | Not Credible | ⭐ | Serious errors, misinformation, or malicious misleading |

Assessment Report Structure

CODEBLOCK2

Usage Examples

Example 1: Factual Statement Verification

Input: "A study shows that drinking coffee every day can extend lifespan."

Analysis Output:
CODEBLOCK3

Example 2: Opinion-Based Statement Verification

Input: "We should completely ban artificial intelligence because it will replace human jobs."

Analysis Output:
CODEBLOCK4

Important Notes

1. 1. Maintain Objectivity: Do not take sides during analysis; let evidence speak
2. Distinguish Certainty from Speculation: Clearly mark what is certain vs. what is speculation
3. Acknowledge Uncertainty: Be transparent about problems that cannot be determined rather than forcing conclusions
4. Focus on Evidence Quality: Not all evidence has equal value
5. Recognize Timeliness: Information may change over time; dynamic evaluation is needed
6. Multi-perspective Examination: Multiple reasonable perspectives may exist for the same issue
7. Prioritize Multi-Source Validation: For all input, multi-source cross-validation MUST be performed first; do not rely solely on a single source
8. Be Vigilant Against Source-less Information: For information that cannot be traced to reliable sources, credibility ratings must be lowered

Output Standards

The final output MUST contain ALL of the following sections:

1. 1. Analysis Type Determination: Clearly state whether it is factual or opinion-based
2. Multi-Source Cross-Validation (Mandatory):

- Original source rating - Cross-validation results (supported/contradicted/not found) - Information type identification

1. 3. Systematic Verification: Analyze item by item according to the above framework
2. Verdict: Clear credibility rating (⭐-⭐⭐⭐⭐⭐)
3. Reasoning Process: Complete reasoning chain supporting the conclusion
4. Usage Recommendations: How to correctly use this information

Credibility Downgrade Triggers

The following situations MUST trigger credibility rating downgrade:

Trigger Condition	Downgrade Magnitude
Original source cannot be found	At least 1 grade lower
No reliable source for cross-validation

At least 2 grades lower |
| Contradicting information found | At least 1 grade lower |
| Identified as misinformation/marketing/misleading | Directly mark as not credible |
| Information from anonymous/private sources | At least 2 grades lower |