True-or-false questions are among the most commonly used assessment question formats. Their simplicity makes them quick to write and easy to administer, but that simplicity can be deceptive. Although they appear straightforward to write, there are a number of pitfalls that can reduce the quality of the assessment evidence they produce.
However, when designed well, true-or-false questions can be an efficient and effective way to assess knowledge and understanding. This article explores what makes true-or-false questions effective, where they work best, common pitfalls to avoid, and practical strategies for writing stronger assessment items.
Understanding True-or-False Questions
A true-or-false question consists of a single statement that learners judge to be either correct or incorrect. Because each statement has a predetermined correct answer, scoring is objective and doesn’t rely on evaluator judgment. This makes true-or-false questions distinct from opinion-based or open-ended questions, in which multiple responses may be valid or interpretation plays a larger role in scoring.
Unlike open-ended questions, true-or-false questions don’t require a learner to explain their reasoning, as they typically assess recognition or recall. For this reason, they’re often used to assess foundational knowledge, factual recall, understanding of terminology, concept recognition, and a learner’s ability to distinguish accurate information from common misconceptions—areas where answers are clear and unambiguous.
True-or-false questions are most often included alongside other item types within an assessment rather than as the primary measure of skill mastery. Used appropriately, they help confirm understanding of essential concepts before moving on to more complex demonstrations of knowledge or skill.
The Advantages of Using True-or-False Questions
Carefully written true-or-false questions offer assessment designers the following benefits:
- Efficient authoring: True-or-false questions are relatively quick to create compared to more complex item types, making them an efficient choice when developing assessments or building large item banks
- Broad content coverage: Their straightforward format allows assessment designers to cover a broad range of concepts within a single assessment, increasing opportunities to measure key knowledge and understanding.
- Fast, consistent automatic scoring: Assessment platforms can score responses instantly, reducing manual grading time while providing learners with immediate feedback. Automated scoring also makes true-or-false questions practical for large-scale assessments, where hundreds or thousands of learners need to be assessed using the same scoring criteria.
The Limitations of True-or-False Questions
While true-or-false questions provide a variety of advantages, their limitations should also be considered when deciding whether they are the right item type for a particular learning objective.
Guessing can affect reliability
One of the most obvious disadvantages of this item type is that learners have a 50/50 chance of answering correctly. Because of this, a single true-or-false question provides limited evidence of mastery. A correct response may reflect knowledge, but it may also result from guessing, making it difficult to determine whether the learner actually understands the content. For this reason, true-or-false questions are typically most effective as part of a broader assessment rather than as standalone evidence of learning.
Complex thinking is difficult to measure
True-or-false questions are also limited in their ability to measure higher-order thinking, making them less suitable for application, analysis, evaluation, or synthesis. According to Bloom’s Taxonomy, these cognitive processes require learners to go beyond simple recall by applying, analyzing, evaluating, or creating knowledge.
Because true-or-false questions ask learners to judge a single statement rather than demonstrate their reasoning, they cannot capture the problem-solving process behind an answer. A correct response doesn’t reveal why the test taker answered correctly, while an incorrect answer may not identify the specific misconception that led to the error.
Poor wording has a greater impact
Because true-or-false questions contain only a single statement and two response options, learners have little opportunity to clarify the intended meaning of an item. As a result, small wording choices can have an outsized effect on how the question is interpreted, making precise wording especially important for this item type.
Poorly written questions can reduce validity—that is, the extent to which a question accurately measures the intended knowledge or skill. When wording is ambiguous or misleading, it becomes harder to determine whether a learner’s response reflects their knowledge of the subject or their interpretation of the wording.
Common Mistakes That Weaken True-or-False Questions
Recognizing common item-writing mistakes can help assessment designers create true-or-false questions that more accurately reflect learner knowledge. Research on item-writing guidelines has identified recurring concerns related to ambiguous wording, guessing, and testwiseness, reinforcing the importance of careful question design.
Ambiguous wording
Ambiguous language can make it difficult for learners to interpret a question’s intent. When a statement can reasonably be interpreted in more than one way, an incorrect response may reflect confusion about the wording rather than a lack of knowledge of the concept.
Weak: True or False: Employees should regularly back up important files.
The word regularly is open to interpretation, making it unclear whether a learner answered incorrectly because they misunderstood the policy or interpreted the timeframe differently.
Improved: True or false: Employees should back up important files at the end of each workday.
The specific timeframe allows learners to demonstrate their knowledge of company policy without having to interpret what regularly means.
Multiple ideas in a single question
A true-or-false question should assess one idea at a time. When a statement combines multiple claims, learners may know that one part is true while being unsure about another, making a single true-or-false response difficult to interpret.
Weak: True or False: Laboratory personnel should wear safety goggles and dispose of chemical waste in designated containers.
A learner may know one procedure but not the other, making it impossible to determine which concept they understand.
Improved:
- True or False: Laboratory personnel should wear safety goggles when handling hazardous chemicals.
- True or False: Chemical waste should be disposed of in designated containers.
Separating the two procedures allows each question to measure a distinct concept and makes knowledge gaps easier to identify.
Absolute language
Words such as always, never, all, and none can unintentionally signal that a statement is false because exceptions are often possible. This can allow learners to use wording patterns rather than subject knowledge to determine the answer.
Weak: True or False: Employees should always report workplace incidents to their direct supervisor.
Improved: True or False: Company policy requires employees to report workplace incidents through the designated reporting process.
The improved version removes the absolute cue and focuses the item on the specific policy learners are expected to know.
Best Practices For Writing Effective True-or-False Questions
Recognizing weak items is only one part of effective assessment authoring. Developing high-quality true-or-false questions also requires a structured design and review process. By following a workflow guided by the best practices below, assessment designers can achieve a strong true-or-false section.
- Align each question with a learning objective: Every true-or-false question should be written to assess a specific learning objective. Starting with the objective helps ensure each item measures the intended knowledge or skill and supports the overall purpose of the assessment.
- Write one clear, objective statement: Each item should present a single statement that can be judged as true or false based on the intended content.
- Base false statements on plausible misconceptions rather than obvious falsehoods: Effective false statements should reflect errors or misunderstandings learners might realistically hold. This requires learners to apply their understanding of the concept rather than simply recognize clearly incorrect information.
- Review every item before delivery: Check each question for unclear wording, multiple concepts, unintended clues, and consistency with the rest of the assessment. This helps ensure responses reflect learner knowledge rather than flaws in item construction.
- Pilot and revise questions based on performance data: Reviewing how learners perform on an item can reveal questions that are confusing, too easy, or not measuring the intended learning objective. Using this information to refine future assessments strengthens overall assessment quality.
Assessment platforms such as TAO can help teams apply structured item creation, review, and quality assurance processes more consistently across assessments.
How True-or-False Questions Fit into a Broader Assessment Strategy
True-or-false questions are a useful tool within a broader assessment strategy, but they are not a one-size-fits-all solution. Institutions should select complementary item types based on the learning objectives they intend to measure and the evidence they need to gather. Research suggests that combining different question formats can provide a more complete picture of learner understanding than relying on a single format.
True-or-false questions can also be used to structure assessments. They’re often used early in an assessment to confirm prerequisite knowledge before candidates progress to tasks that require application, analysis, and problem-solving. This helps ensure later questions build on foundational concepts rather than assess higher-order thinking skills before basic understanding has been demonstrated.
Used strategically, true-or-false questions can also improve assessment efficiency. Their streamlined format and automatic scoring make them well suited to assessing foundational knowledge at scale, allowing institutions to reserve more detailed, open-ended item types for learning objectives that require learners to demonstrate reasoning, application, or complex problem-solving. This can reduce the time and resources required for assessment delivery and scoring without sacrificing the quality of evidence gathered.
Turning Better Questions Into Better Assessment
True-or-false questions remain one of the most widely used assessment item types because they are simple, efficient, and effective when used appropriately. Rather than relying on the format alone, assessment designers should focus on thoughtful item construction, careful review, and selection of the right question type for each learning objective.
When incorporated into a balanced assessment strategy, well-written true-or-false questions provide meaningful evidence of learner understanding and support more reliable assessment outcomes.
Looking to strengthen your assessment authoring process? Learn how TAO Accelerate helps organizations create, deliver, and manage high-quality digital assessments at scale.
