scientific-critical-thinking
Evaluate scientific claims and research methodology for rigor, bias, and validity. Use evidence-based frameworks like GRADE and Cochrane to analyze experiments, protocols, and study conclusions.
Introduction
The Scientific Critical Thinking skill serves as a systematic framework for researchers, scientists, and analysts to perform rigorous technical evaluation of scientific literature and experimental plans. By integrating established methodologies such as the GRADE evidence grading framework and the Cochrane Risk of Bias (ROB) tool, this skill enables users to dissect complex research claims, identify methodological flaws, and assess the reliability of statistical inferences. It is an essential tool for conducting systematic reviews, preparing meta-analyses, and ensuring that research protocols maintain high standards of internal, external, and construct validity.
-
Perform comprehensive methodology critiques including study design assessment, randomization quality checks, and blinding verification.
-
Conduct systematic bias detection for cognitive, selection, measurement, and analysis-related biases (e.g., HARKing, p-hacking, publication bias).
-
Apply evidence grading frameworks to determine the strength and quality of scientific findings.
-
Identify and address potential confounders and threats to statistical conclusion validity.
-
Coordinate with the scientific-schematics skill to automatically generate publication-quality figures, decision trees, and bias identification flowcharts.
-
Use this skill when reviewing research papers, planning new experiments, or interpreting conflicting evidence in clinical or laboratory settings.
-
Input typically includes research protocols, study manuscripts, or raw experimental designs; output consists of structured critical summaries, validation checklists, and suggested visual schematics.
-
Always verify statistical assumptions and ensure that the chosen experimental design is appropriate for the specific research question.
-
Note that for formal peer review document composition, this skill complements the peer-review skill by focusing on analytical rigor rather than editorial tone.
-
When documenting findings, prioritize the use of schematics to visualize bias pathways or experimental validity frameworks, ensuring all visuals adhere to accessibility standards.
Repository Stats
- Stars
- 19,690
- Forks
- 2,198
- Open Issues
- 42
- Language
- Python
- Default Branch
- main
- Sync Status
- Idle
- Last Synced
- Apr 29, 2026, 06:43 AM