Pretrained Data and Biases

Pretrained Data and Biases

Knowledge Ark · Addictions & Liberation

Examine the assumptions you bring with you.

We meet new information with a history: things we have learned, people we trust, experiences we remember and expectations we may never have put into words.

That history can help us understand a situation. It can also leave an assumption untested, make a familiar explanation especially convincing or give someone's status more weight than their evidence deserves.

Learning to notice these influences gives you a practical starting point: identify the belief, examine what supports it and decide how much confidence it deserves now.

Use the comparison carefully

“Pretrained data” is a metaphor for prior learning

In this collection, “pretrained data” is an informal way to describe the experience, knowledge and expectations we bring to a new situation. It is not a clinical diagnosis or an established psychological category.

The comparison has limits. A person has a body, relationships, changing circumstances and a lived history. Human learning continues throughout life and cannot be reduced to loading a fixed dataset into a machine. The metaphor is useful only while it helps us ask clearer questions.

For example, imagine entering a workplace where you assume that asking for help signals incompetence. You may have learned that expectation in an earlier job. In your current team, asking early might be welcomed because it prevents delays. The old expectation is understandable, but it needs checking in the new setting.

Two questions belong together: “How did I come to believe this?” and “What supports believing it now?” The first concerns the belief's history. The second concerns its present justification.

An idea learned from a parent can be accurate. An idea you developed independently can be mistaken. Familiarity, novelty and social origin do not settle a claim's truth.

You also do not need to discard a tradition to demonstrate independence. After reflection, you may keep it, change part of it or choose something else. The useful outcome is a position you can explain and reconsider when circumstances or evidence change.

Look at the experiences around the belief

Expectations develop through several kinds of experience

People can learn by observing others as well as through direct instruction and their own experience. Psychological accounts of observational learning examine how behavior changes through observation and how this relates to a person's learning history and circumstances. Watching an action does not mean everyone will copy it or adopt the same belief about it.[1]

When you explore a particular assumption, consider several possible routes. The examples below illustrate questions to investigate; they do not diagnose how your own beliefs developed.

What you see

If every meeting you attend is dominated by the most senior person, you may come to expect that speaking is mainly their role. Seeing another team invite questions can offer a different example.

What people say

Phrases such as “We always do it this way” or “Reliable people never say no” express expectations directly. Ask whether they describe a practical requirement, a preference or an assumption.

What happens afterward

Praise, teasing, exclusion or a helpful response can all become part of your experience of an action. Record the response you actually received before predicting that everyone will react the same way.

Other influences are practical. The nearest shop may determine where you buy food. A shift pattern may determine when you eat. A family responsibility may limit the events you can attend. These circumstances deserve attention alongside beliefs about what is normal.

People within a family or culture can also disagree. Different generations, friendships, workplaces and personal experiences may support different expectations. “My culture believes…” often needs a more precise description of which people, practice and setting you mean.

Try writing: “In the situations I remember, this response was common.” That leaves room for other experiences without dismissing the ones you had. You can acknowledge what shaped an expectation while checking how far it applies.

Find out what kind of statement you are making

A common practice, an expectation and a good reason can differ

A useful distinction in social-norm research separates what we believe others usually do from what we believe they approve of or expect. These are often called descriptive norms and injunctive norms. UNICEF's guidance also distinguishes such social expectations from personal attitudes and from behavior driven by other circumstances.[2]

Several kinds of statement can appear in one conversation. Separating them helps you choose the right question.

Five statements that require different kinds of examination
Kind of statement Hypothetical example Useful question
Perceived common practice “Most people here toast with wine.” Which people and occasions have I observed?
Perceived social expectation “They will think I am rude if I decline.” What have people actually said or done?
Personal preference or value “I enjoy taking part in the celebration.” Which parts matter most to me?
Factual claim “This drink improves sleep.” What relevant research supports that claim?
Formal rule “Attendance is required by the organization.” What does the actual policy require, and where does it apply?

Frequency does not establish safety, fairness or usefulness. A practice may be common and still deserve review. Equally, an unusual preference does not need to become a universal rule before you can express it.

Our impressions of a group can be mistaken. In four studies published in 1993, Prentice and Miller found that students tended to believe they were more uncomfortable with campus drinking practices than the average student was. This illustrates pluralistic ignorance: a mismatch between people's own views and what they assume others think. It was research in a particular US college setting, not a description of every community.[3]

Before accepting “Everyone wants this,” ask whether everyone has had an opportunity to answer. Silence, participation and approval are different observations. Someone may take part because an alternative was unavailable, because they prefer to avoid an argument or because they enjoy only part of the activity.

Notice how you select and assess evidence

Confirmation bias can make a belief easier to defend than to test

Confirmation bias describes tendencies to favor information that supports an existing belief or expectation. It can appear in the questions we ask, the sources we choose and the standards we apply when evaluating an answer.

Imagine believing that working late is the clearest sign of commitment. You notice a colleague who stays late and completes an excellent project. You give less attention to another colleague who delivers excellent work within ordinary hours. Both cases matter to the claim, but only one easily fits your explanation.

Selective searching

You search for reasons the existing practice works, then stop once you find an encouraging article. Try phrasing the question so that several possible answers remain open.

Uneven scrutiny

A small study supporting your view seems persuasive; a similar study challenging it seems too limited. Ask whether the same limitation matters in both cases.

Selective examples

The successful cases are easy to describe, but you have no record of unsuccessful attempts or ordinary outcomes. Check what your examples leave out.

In a classic experiment, Lord, Ross and Lepper asked 48 undergraduates with opposing views on capital punishment to assess two constructed research reports with conflicting conclusions. Participants generally evaluated the report supporting their existing position more favorably. The researchers varied which method produced which conclusion, helping reveal how the result affected judgments of the method. This illustrates biased evaluation in a specific task; it does not show that evidence always makes people more entrenched.[4]

Rejecting weak evidence is appropriate. The concern is whether you would recognize the same weakness if the result supported your position. A balanced process can still conclude that one claim has much stronger support than another.

Nor does a defensive reaction establish confirmation bias. Someone may be tired, misunderstood, concerned about consequences or responding to a real insult. Examine the reasoning and context before assigning a psychological explanation.

Find the step where a question disappears

A belief can shape which experiences you get to observe

Sometimes an expectation influences your actions in a way that limits opportunities to check it. Consider this invented example: a person believes that asking questions in meetings will make them look unprepared.

  1. 1 · The expectation

    “Questions will make me look incompetent.”

    The person carries an assumption into the meeting. It may reflect earlier experiences, but it has not been checked with this team.

  2. 2 · The response

    They remain silent.

    They avoid the anticipated discomfort. As a result, the meeting offers little direct evidence of how colleagues would respond to a reasonable question.

  3. 3 · The selected observation

    They notice another quiet colleague.

    That silence seems to confirm the expectation. The colleague's actual reason for being quiet remains unknown.

  4. 4 · The conclusion

    “Clearly, nobody should ask.”

    An untested interpretation starts to sound like an established group rule. The person enters the next meeting with the same expectation.

Several points invite a useful check. The person could ask how the team prefers to handle questions, observe what happens when someone requests clarification, or raise a manageable question in a setting where they feel comfortable doing so.

The outcome is open. The team may welcome questions, react inconsistently or actually discourage them. If the environment penalises reasonable participation, that is information about the environment. Private reflection alone cannot change an organization's incentives or behavior.

Looking at the sequence keeps the question concrete: what did I predict, what did I do, what evidence became available and what conclusion did I draw?

Match confidence to the relevant competence

Trust expertise while examining what it supports

In everyday discussions, authority bias often refers to giving a statement too much weight because of who said it. A title, reputation or confident presentation can make a claim feel settled before its connection to the evidence has been examined.

Relevant expertise is a legitimate reason to take a source seriously. We rely on specialists because no one can independently reproduce every experiment, inspect every structure or master every field.

The National Academies' report on science communication notes that people, including scientists outside their own specialties, rely on trusted sources to interpret and validate information. It also distinguishes perceived expertise from actual credentials and discusses the roles of competence, integrity and dependability in trust.[5]

Questions that make trust more specific
Check Ask Why it matters
Relevant field What experience or training relates to this exact question? Competence in one subject does not automatically transfer to another.
Evidence What observations, methods or research support the statement? A claim becomes easier to assess when its basis is visible.
Scope Who and which circumstances does the conclusion cover? A finding about one group may not justify advice for everyone.
Independent assessment How do other qualified sources assess the evidence? Several reposts of one person's claim provide little independent checking.
Uncertainty and correction What remains uncertain, and how are mistakes corrected? A useful source can explain limits and revise an answer.

A chef may offer excellent guidance on preparing coffee. That does not automatically make their personal caffeine routine suitable health advice for every viewer. A clinician's expertise also has a scope; a careful answer may involve checking evidence or consulting another specialty.

Financial interests deserve disclosure and scrutiny, but payment does not by itself prove that a statement is false. Look at whether the methods, findings and conclusions withstand examination. Apply the same standard to a source you admire and one you dislike.

Different roles can contribute different information. A person's experience tells you how a practice affected them. A specialist can help assess broader evidence. Your values and circumstances matter when deciding what to do with that information.

Turn the same questions toward your own reasoning

Knowing the names of biases does not make us immune

Once you learn about confirmation bias, examples in other people's arguments can become easy to spot. Your own conclusion may still feel like the obvious product of careful reasoning.

Pronin, Lin and Ross studied this asymmetry in research on the bias blind spot. Participants often regarded themselves as less susceptible to described biases than comparison people. These findings concern self-perception and particular tasks; they do not establish that every person has the same biases or that every confident judgment is mistaken.[6]

A practical response is to make your checking process visible. “I am open-minded” is difficult to assess. “I looked for evidence that would challenge this explanation and applied the same quality checks to both results” describes something you can review.

Three questions to ask yourself

  1. Which result would I most like to be true, and has that affected where I searched?
  2. Would I accept this method or argument if it supported a conclusion I disliked?
  3. What specific observation could lead me to narrow, revise or abandon my claim?

Avoid turning bias language into a way to dismiss someone. “You are conditioned” leaves the claim untouched. “This conclusion uses one successful example but omits the unsuccessful attempts” identifies a gap the two of you can examine.

Include the possibility that the other person has information you lack. A disagreement may involve different evidence, definitions, constraints or priorities. Before explaining why someone thinks as they do, check that you understand what they are actually saying.

Replace a vague intention with a repeatable process

Make your checks specific enough to change the inquiry

“Be objective” is a reasonable intention, but it does not tell you what to do next. A useful checking process names the claim, gives alternatives a fair examination and makes the standard of evidence explicit.

In two experiments, Lord, Lepper and Preston found that prompting people to consider an opposing possibility had a greater corrective effect on biased judgments than a general request to be fair and unbiased. This supports a specific checking question in those tasks, not a permanent cure for bias.[7]

  1. Check 1

    Write an answerable claim

    Replace “This routine is best” with a statement about a particular outcome and setting. “This meeting format helps our team identify problems early” can be examined more directly.

  2. Check 2

    State what would count against it

    Identify a relevant observation before searching. If problems are repeatedly discovered only after the meeting, that may challenge your explanation of what the format achieves.

  3. Check 3

    Compare plausible explanations

    A successful project might reflect the meeting format, an experienced team, a simpler task or several factors together. Ask what information could help distinguish those possibilities.

  4. Check 4

    Use the same quality checks

    Look at how information was gathered, what was compared and what is missing. Check whether your assessment changes when you imagine the result favoring another position.

  5. Check 5

    Trace claims to their sources

    Follow a summary back to the original report when practical. Check whether several articles are repeating the same source, and whether the original conclusion is narrower than the headline.

  6. Check 6

    Record a proportionate conclusion

    You may keep the belief, qualify it, suspend judgment or change your mind. Write what the evidence supports and the question that remains unresolved.

Results can depend on the prompt and outcome. In a 2023 study using constructed, conflicting health-research summaries, a question about judging the same methods with opposite results reduced biased assimilation, but did not significantly change the measured before-and-after attitude shift. Generating possible flaws in a separate study did not reduce biased assimilation. A checking exercise can help with one part of judgment without changing every part.[8]

Considering an alternative does not require giving it equal credibility. An unsupported claim does not become strong evidence because it opposes your view. Choose credible challenges and examine their substance.

For a more detailed approach to evaluating arguments, continue with Core Principles of Critical Inquiry.

Make the question clear enough to discuss

Question a practice without judging an entire community

A custom may carry memories, hospitality, faith, friendship or a sense of continuity. When discussing a change, name the part you want to reconsider. “I would like a lower gift budget this year” is more specific than “Our traditions are irrational.”

Begin by identifying any shared purpose. If everyone wants the gathering to feel welcoming, ask which arrangements support that aim and which create avoidable pressure. People can care about the same purpose while preferring different ways to express it.

Ask about the expectation

“Is this something everyone prefers, or something we have continued without discussing?” Leave room for people to say they enjoy it.

State your own position

“I want to join the celebration, and this spending level does not work for me.” A practical limit is relevant information, even if others have different resources.

Offer a concrete possibility

“Could we agree on a modest limit or exchange something homemade?” A specific proposal gives people something they can assess.

Listen for a distinction between a factual disagreement and a difference in values. “This costs less” can be checked. “I prefer a formal meal” expresses a preference. The conversation may require practical negotiation as well as evidence.

Be equally willing to hear that a change would create difficulties you had not considered. Ask about those difficulties without treating them as proof that no change is possible.

You do not need to win an argument about the history of a custom before setting a personal limit. If a stated boundary is repeatedly ignored, describe what happened and decide what support or different arrangement you need. More explanation is not always the next useful step.

Bring the distinctions into ordinary decisions

Three examples of checking a familiar assumption

These examples are invented. Each shows a different question: whether a social expectation is shared, whether status supports a claim and whether a personal experience establishes a cause.

Example A · Family expectations

“Everyone wants expensive gifts.”

Lina feels pressure to match the gifts exchanged at previous celebrations. She assumes a smaller gift would signal less care.

The check: she asks what family members enjoy about the exchange and proposes a spending limit before the next occasion.

The result: several welcome the limit; one prefers the old arrangement. The family discusses a choice that had previously been treated as unanimous.

The lesson: visible participation did not reveal everyone's private preference. Asking produced information that guessing could not.

Example B · Workplace authority

“The senior person must be right.”

Tomas hears an experienced manager recommend a new scheduling system. Her experience is relevant, but the claim concerns a team with different duties from her previous one.

The check: he asks which problem the system solved, what evidence showed improvement and whether the same conditions apply here.

The result: the team identifies useful features and agrees on a limited trial with clear review criteria.

The lesson: the manager's knowledge contributes to the decision while the proposal remains open to examination.

Example C · Coffee and sleep

“A familiar routine cannot be involved.”

Milda has difficulty sleeping and dismisses caffeine as a possibility because she has consumed it for years. A favourite creator also promotes coffee as a productivity essential.

The check: she reviews the amount and timing of caffeine alongside other changes in her routine, and consults reliable health guidance.

The result: she revises “It cannot be caffeine” to “It is one possible contributor worth assessing.” She seeks professional advice if sleep problems persist.

The lesson: neither familiarity nor a creator's personal experience settles what is happening in her circumstances.

For the caffeine example, the FDA identifies sleep problems, anxiety and other effects as possible signs of too much caffeine, notes differences in sensitivity, and recommends gradual reduction for regular users who want to cut back. A brief “detox” is not a reliable test of a single cause: withdrawal and other changes can affect how someone feels.[9]

Personal observations can help you ask better questions, but several factors may change together. Keep the conclusion as narrow as the observation allows. See Caffeine: The “Acceptable” Stimulant — A Deep Dive for the substance-specific discussion.

Let the conclusion fit what you learned

Changing your confidence can be enough

Belief revision does not always mean moving from complete agreement to complete rejection. Often, the useful change concerns scope: “This works for everyone” becomes “This helped in those circumstances, and I do not yet know how widely it applies.”

Separate three decisions: what you think is true, how confident you are and what action makes sense. You may be uncertain about why a routine is unhelpful while still deciding that its cost is too high for you.

Several reasonable outcomes of checking a belief
Outcome What you might say What follows
Keep it “The relevant evidence still supports this conclusion.” Explain the basis and remain open to material new information.
Narrow it “This seems to apply to this setting, with these limits.” Avoid extending the claim beyond the evidence.
Reduce confidence “I had overlooked a plausible alternative explanation.” Identify the information that would help distinguish the possibilities.
Suspend judgment “I do not have enough reliable information to decide.” Choose an appropriate next step without pretending certainty.
Change it “The evidence contradicts the central claim.” Update the conclusion and any decisions that depend on it.

A credible counterexample can refute an absolute statement such as “No one here welcomes questions.” It does not establish the opposite absolute statement that everyone always welcomes them. Quantities, conditions and exceptions matter.

Likewise, a majority view is not automatically correct, and a minority view is not automatically insightful. Compare the quality, relevance and independence of the evidence. A well-supported expert consensus deserves different weight from a collection of unsupported assertions.

Match effort to the decision. A low-cost preference may need little investigation. A consequential health, financial or safety decision may require relevant professional advice. You can practise independent judgment while recognizing the limits of your own knowledge.

Make one belief available for review

Use a short record you can return to

Choose a manageable subject: a meeting habit, a spending expectation or an assumption about how someone will respond. Avoid starting with a question so broad that you cannot tell what evidence would answer it.

The prompts below are an educational exercise, not a validated psychological assessment. Write a few lines and leave unanswered questions visible.

A seven-question belief review

  1. What is the claim? Put it into one sentence with a clear setting and scope.
  2. Where have I encountered it? Note people, experiences or sources without assuming a single cause.
  3. What supports it now? Separate observations, research, testimony and preference.
  4. What challenges it? Include credible counterexamples and limitations in the supporting evidence.
  5. Am I using consistent standards? Consider whether the same evidence would persuade me with a different conclusion.
  6. What remains uncertain? Identify a missing fact, an alternative explanation or a value judgment.
  7. What will I do next? Keep, qualify or revise the belief; ask a question; seek advice; or pause the decision.

Return to the record after a relevant conversation or new observation. Compare what you expected with what happened. If nothing new has emerged, you do not need to repeat the analysis simply to feel certain.

If you explore the question with another person, ask them to identify a missing step or a plausible alternative. A useful exchange gives both people permission to clarify, disagree and revise their positions.

Continue with Self-Reflection Tools for journaling prompts and an emotional event log. For examining new claims without drifting into either gullibility or blanket distrust, read Balancing Openness and Skepticism.

Research and further reading

Sources and the limits of their claims

The studies below examine particular samples, tasks and outcomes. They help explain possible patterns of judgment; they cannot diagnose the motives or reasoning of a person from a single disagreement. Examples and exercises in this article are illustrative.

  1. Fryling, Johnston and Hayes, 2011. Understanding Observational Learning: An Interbehavioral Approach. The Analysis of Verbal Behavior, 27, 191–203.A theoretical discussion of observational learning and its relation to learning history and context. Return to the discussion ↑
  2. UNICEF, 2021. Defining Social Norms and Related Concepts (PDF).Distinguishes perceived behavior, perceived approval, personal attitudes and other influences on action. Return to the discussion ↑
  3. Prentice and Miller, 1993. Pluralistic ignorance and alcohol use on campus. Journal of Personality and Social Psychology, 64(2), 243–256.Four studies of students' own attitudes and their estimates of peers' attitudes; results concern a specific social setting. Return to the discussion ↑
  4. Lord, Ross and Lepper, 1979. Biased assimilation and attitude polarization (PDF). Journal of Personality and Social Psychology, 37(11), 2098–2109.A study using constructed, conflicting reports to examine how prior attitudes influence evidence evaluation. Return to the discussion ↑
  5. National Academies of Sciences, Engineering, and Medicine, 2017. The complexities of communicating science, in Communicating Science Effectively.Discusses interpretation of scientific information, expertise, trust and credibility. Return to the discussion ↑
  6. Pronin, Lin and Ross, 2002. The bias blind spot: perceptions of bias in self versus others. Personality and Social Psychology Bulletin, 28(3), 369–381.Research on perceived susceptibility to bias in oneself and comparison people. Return to the discussion ↑
  7. Lord, Lepper and Preston, 1984. Considering the opposite: a corrective strategy for social judgment. Journal of Personality and Social Psychology, 47(6), 1231–1243.Two experiments comparing specific consideration of alternatives with more general instructions. Return to the discussion ↑
  8. Greitemeyer, 2023. Counter explanation and consider the opposite. Journal of Applied Social Psychology.Two studies illustrating that corrective prompts can affect evidence evaluation differently from measured attitude change. Return to the discussion ↑
  9. US Food and Drug Administration. Spilling the Beans: How Much Caffeine Is Too Much?Guidance on caffeine sensitivity, possible effects of excess intake and gradual reduction. Return to the discussion ↑
Carry your experience with room to learn

A familiar belief can become a considered position.

Your history gives you a starting point. You can examine an assumption, recognize a useful tradition, trust relevant expertise and revise a conclusion when the evidence calls for it. Begin with one claim you can describe clearly and one question that could improve your understanding.

Back to the top ↑

Back to blog