Exercise: Analysing Scientific Claims
This exercise helps you to critically evaluate scientific claims and to apply scientific thinking in everyday life.
Task 1: Analysing a Science News Item
Choose a recent news article that reports on a scientific study and analyse it using the following questions:
- Source check:
- Is the original study cited or linked?
- In which journal was the study published?
- Who carried out and funded the study?
- Study design:
- What kind of study was carried out (experiment, observational study, etc.)?
- How large was the sample?
- Was there a control group or other comparison groups?
- Presentation of results:
- Are the results presented precisely and without exaggeration?
- Are limitations or uncertainties mentioned?
- Is a distinction made between correlation and causation?
- Contextualisation:
- Is the study placed in the broader research context?
- Are differing results from other studies mentioned?
- Are independent experts given a voice?
- Conclusion:
- Is the reporting balanced and appropriate?
- What important information might be missing?
- How could the reporting be improved?
Task 2: Applying Scientific Thinking in Everyday Life
Choose a personal problem or decision from your everyday life and apply scientific thinking principles:
- Problem definition:
- Formulate the problem or decision clearly and precisely.
- Which factors or variables are relevant?
- Forming a hypothesis:
- What possible solutions or options are there?
- Which assumptions underlie these options?
- Data collection:
- What information do you need in order to make a well-founded decision?
- How can you gather this information systematically?
- Analysis:
- How can you analyse the gathered information objectively?
- Which cognitive biases could influence your analysis?
- Conclusion and implementation:
- Which option appears most sensible based on your analysis?
- How can you check the effectiveness of your decision?
Task 3: Distinguishing Between Science and Pseudoscience
Analyse a potentially pseudoscientific claim using the following criteria:
- Falsifiability:
- Is the claim formulated in such a way that it could in principle be refuted?
- Are conditions named under which the claim would be false?
- Evidence:
- What evidence is put forward for the claim?
- Is the evidence systematically collected or selectively chosen?
- Are there independent confirmations of the evidence?
- Methodology:
- Are the methods used presented transparently?
- Do the methods meet scientific standards?
- Are there methodological weaknesses or distortions?
- Integration:
- Is the claim in agreement with established scientific knowledge?
- If not, is it explained why established knowledge should be revised?
- Development:
- Has the theory or claim developed further over time?
- Were earlier versions modified on the basis of new evidence?
- Community:
- Is the claim examined by a critical community of experts?
- Is there an open discourse about strengths and weaknesses?
- Conclusion:
- Is it more a matter of science or pseudoscience?
- Which features were decisive for your assessment?