Question 1

Which of the following is the best remedy for QRPs?

Accepted Answer

A)   pre-registration
B)   registration
C)   post-registration
D)   self-correction

Question 2

Use of the Spearman-Brown formula would be inappropriate to

Accepted Answer

A)   estimate the effect on reliability of shortening a test.
B)   determine the number of items needed in a test to obtain the desired level of reliability.
C)   estimate the internal consistency of a speed test.
D)   All of these

Question 3

Because of the unique problems in assessing very young children,which of the following would be the BEST practice when attempting to estimate the reliability of tests designed to measure cognitive and motor abilities in infants?

Accepted Answer

A)   Use relatively short test-retest intervals.
B)   Use relatively long test-retest intervals.
C)   Do not use the test-retest method for estimating reliability of the test.
D)   Use only inter-scorer reliability estimates.

Question 4

Field trials of DSM-5 demonstrated a mean kappa that was indicative of a ______ level of agreement among raters.

Accepted Answer

A)   poor
B)   fair
C)   good
D)   "kinder and gentler"

Question 5

Which BEST conveys the meaning of an inter-scorer reliability estimate of .90?

Accepted Answer

A)   Ninety percent of the scores obtained are reliable.
B)   Ninety percent of the variance in the scores assigned by the scorers was attributed to true differences and 10% to error.
C)   Ten percent of the variance in the scores assigned by the scorers was attributed to true differences and 90% to error.
D)   Ten percent of the test's items are in need of revision according to the majority of the test's users.

Question 6

One of the problems associated with classical test theory has to do with

Accepted Answer

A)   the notion that there is a "true score" on a test has great intuitive appeal.
B)   the fact that CTT assumptions are often characterized as "weak."
C)   its assumptions concerning the equivalence of all items on a test.
D)   its assumptions allow for its application in most situations.

Question 7

By definition,estimates of reliability can range from _______.

Accepted Answer

A)   -3.00 to +3.00
B)   1 to10
C)   0 to 1
D)   -1 to 1

Question 8

IRT is a term used to refer to

Accepted Answer

A)   a model that has many parameters.
B)   a parameter that has many models.
C)   a family of models for data analysis.
D)   a dysfunctional family of models.

Question 9

In the Chapter 5 Meet an Assessment Professional feature,Dr.Bryce B. Reeve noted the necessity for very brief questionnaires in his work due to the fact that many of his clients were:

Accepted Answer

A)   young children with very short attention spans.
B)   seriously ill and would find taking tests burdensome.
C)   visually impaired an unable to focus for an extended period of time.
D)   All of these

Question 10

Stanley (1971) wrote that in classical test theory,a so-called "true score" is "not the ultimate fact in the book of the recording angel." By this,Stanley meant that

Accepted Answer

A)   it would be imprudent to trust in Divine influence when estimating variance.
B)   the amount of test variance that is true relative to error may never be known.
C)   it is near impossible to separate fact from fiction with regard to "true scores."
D)   All of these

Question 11

Most reliability coefficients,regardless of the specific type of reliability they are measuring,range in value from

Accepted Answer

A)   -1 to +1.
B)   0 to 100.
C)   0 to 1.
D)   negative infinity to positive infinity.

Question 12

As the confidence interval increases,the range of scores into which a single test score falls is likely to

Accepted Answer

A)   decrease.
B)   increase.
C)   remain the same.
D)   alternately decrease and increase.

Question 13

Coefficient alpha is the reliability estimate of choice for tests

Accepted Answer

A)   with dichotomous items and binary scoring.
B)   with homogeneous items.
C)   that can be scored along a continuum of values.
D)   that contain heterogeneous item content and binary scoring.

Question 14

An estimate of test-retest reliability is often referred to as a coefficient of stability when the time interval between the test and retest is more than

Accepted Answer

A)   30 days.
B)   60 days.
C)   3 months.
D)   6 months.

Question 15

The "20" and "21" in KR-20 and KR-21 represent

Accepted Answer

A)   numbers held constant in the denominator.
B)   numbers held constant in the numerator.
C)   the order in which the formulas were created.
D)   the age of Fred Kuder's sons when the formulas were developed.

Question 16

Test-retest estimates of reliability are referred to as measures of ________,and split-half reliability estimates are referred to as measures of ________.

Accepted Answer

A)   true scores; error scores
B)   internal consistency; stability
C)   inter-scorer reliability; consistency
D)   stability; internal consistency

Question 17

A psychologist administers a test and the test-taker scores a 52.If the cut-off score for eligibility for a particular program is 50,what index will best help the psychologist determine how much confidence to place in the test-taker's obtained score of 52?

Accepted Answer

A)   the standard error of difference
B)   the standard error of measurement
C)   measures of central tendency: mean, median, or mode
D)   measures of variability such as the standard deviation

Question 18

A dichotomous test item is one that

Accepted Answer

A)   presents the testtaker with a dichotomy.
B)   is frequently used in Common Core reading subtests.
C)   is exemplified by a True/False item.
D)   All of these

Question 19

Which is NOT a possible source of error variance?

Accepted Answer

A)   test administration
B)   test scoring
C)   test interpretation
D)   All are possible sources of error variance.

Question 20

A vice president (VP) of personnel employs a "Corporate Screening Test" in the hiring process.For future testing purposes,the VP maintains records of scores achieved by __________ as opposed to ___________ in order to avoid restriction-of-range effects.

Accepted Answer

A)   job applicants; hired employees
B)   hired employees; job applicants
C)   successful employees; hired employees
D)   successful employees; other corporate officers

Exam 5: Reliability

Coefficient alpha is the reliability estimate of choice for tests

Correct AnswerverifiedShow Answer

By definition,estimates of reliability can range from _______.

Correct AnswerverifiedShow Answer

Stanley (1971) wrote that in classical test theory,a so-called "true score" is "not the ultimate fact in the book of the recording angel." By this,Stanley meant that

Correct AnswerverifiedShow Answer

Which is NOT a possible source of error variance?

Correct AnswerverifiedShow Answer

IRT is a term used to refer to

Correct AnswerverifiedShow Answer

Field trials of DSM-5 demonstrated a mean kappa that was indicative of a ______ level of agreement among raters.

Correct AnswerverifiedShow Answer

In the Chapter 5 Meet an Assessment Professional feature,Dr.Bryce B. Reeve noted the necessity for very brief questionnaires in his work due to the fact that many of his clients were:

Correct AnswerverifiedShow Answer

Most reliability coefficients,regardless of the specific type of reliability they are measuring,range in value from

Correct AnswerverifiedShow Answer

A psychologist administers a test and the test-taker scores a 52.If the cut-off score for eligibility for a particular program is 50,what index will best help the psychologist determine how much confidence to place in the test-taker's obtained score of 52?

Correct AnswerverifiedShow Answer

The "20" and "21" in KR-20 and KR-21 represent

Correct AnswerverifiedShow Answer

Because of the unique problems in assessing very young children,which of the following would be the BEST practice when attempting to estimate the reliability of tests designed to measure cognitive and motor abilities in infants?

Correct AnswerverifiedShow Answer

One of the problems associated with classical test theory has to do with

Correct AnswerverifiedShow Answer

Use of the Spearman-Brown formula would be inappropriate to

Correct AnswerverifiedShow Answer

An estimate of test-retest reliability is often referred to as a coefficient of stability when the time interval between the test and retest is more than

Correct AnswerverifiedShow Answer

A dichotomous test item is one that

Correct AnswerverifiedShow Answer

Which of the following is the best remedy for QRPs?

Correct AnswerverifiedShow Answer

Test-retest estimates of reliability are referred to as measures of ________,and split-half reliability estimates are referred to as measures of ________.

Correct AnswerverifiedShow Answer

As the confidence interval increases,the range of scores into which a single test score falls is likely to

Correct AnswerverifiedShow Answer

Which BEST conveys the meaning of an inter-scorer reliability estimate of .90?

Correct AnswerverifiedShow Answer

A vice president (VP) of personnel employs a "Corporate Screening Test" in the hiring process.For future testing purposes,the VP maintains records of scores achieved by __________ as opposed to ___________ in order to avoid restriction-of-range effects.

Correct AnswerverifiedShow Answer

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Test-retest estimates of reliability are referred to as measures of ,and split-half reliability estimates are referred to as measures of .

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

A vice president (VP) of personnel employs a "Corporate Screening Test" in the hiring process.For future testing purposes,the VP maintains records of scores achieved by as opposed to _ in order to avoid restriction-of-range effects.

Correct Answer
verified