Validity and Reliability

Start Studying!

Terms

undefined, object

copy deck

If the test looks like it will measure what it's supposed to this is what type of validity?: Face Validity
What's the representativeness of a test in terms of validity?: Content validity
If a test measures what it's supposed to measure this is what type validity?: Content validity
Name two subjective methods for establishing test validity: Face and content
Name the two objective methods for establishing test validity: Predictive and concurrent
What's another name for objective methods?: criterion
If a test accurately predicts future performance what type of validity does it have?: predictive validity
If your performance on a test is consistent with other tests that are well established then it's has what type validity?: concurrent
Name two ways to establish construct validity: Discriminant and convergent
If your test scores correlate well with behaviors related to your study it is said to have what type validity: Convergent validity
If your test scores correlate with behaviors that are unrelated to your study it lacks what?: discriminant validity
What is a common metaphor for test reliability: consistent or dependable
What technique provides a measure of stability: test-retest
What's another term for alternate forms: parallel forms
What provides a measure of equivalence: alternate forms
What's another name for internal consistency?: inter item
What's the goal of experimental research: Strong cause and effect statements
When we establish reliability for a test what are we trying to be able to determine that there is?: Strong positive correlation
Reliability is the metaphor that best reflects which type of validity?: Construct validity
What is the most important issue surrounding research: validity
What is a good metaphor for validity in general?: truthfulness (accuracy)
List three things that affect statistical conclusion validity: sample size, effect size, power and alpha level
Which type of validity is concerned with whether or not there is a relationship between the DV and the IV: internal validity
What is the key factor influencing internal validity: REsearch design
A study with good control has what type validity: internal validity
What question best represents internal validity: Is it true that my IV caused the change in my DV
Which type of validity is concerned with how findings might apply elsewhere: external validity
Did I measure what I wanted to measure? What type of validity is reflected in the previous question: Face validity (subjective validity)
Define experimental realism: How well the study replicates what occurs in the real world
If you are certain you actually measured what you intended to measure, this is what type validity: construct or test or instrument validity
List two things that could affect the external validity of a study: sampling technique and experimental realism
List three ways to assess the reliability of test or instrument: test-retest, alternate forms, inter-item
What is the biggest factor affecting the reliability of a test: number of questions, length of test
What is the most common method of establishing the internal consistency of a test: split-half method
If scores on a test correlate well with the behaviors that should be related to what the test is supposed to measure, which type of validity have you established: convergent
List two types of criterion related validity: predictive and concurrent
What is the most important issue within the field of research: validity
In a study that has good control, what is being controlled: confounding variable
Correlation does not imply what: causation
What is a general metaphor for the 3 types of validity: truthfulness
LIst three things that could affect your conclusion validity: sample size, effect size, alpha level
If Joe's experiment captures the same elements that participants are likely to encounter in the "real world" what factor affecting validity does Joe's experiment possess: experimental realism
How would you describe a test that consistently gives you the same results, even though you know the results are wrong?: reliable but not valid
Joe scored the odd and even questions on his final exam separately to see how well they correlated. What technique was he using: split half
Joe scored the odd and even questions on his final exam separately to see how well they correlated. What type of reliability is he trying to establish: inter-item or internal consistency
What's the most common technique for establishing internal consistency?: split half method
If scores on the GRE correlate highly with success in graduate school, what type of validity have you established?: predictive
The length of a test greatly affects it's reliability. If a test is artificially shortened in an attempt to establish split half reliability, what should be done to adjust the reliability of the test?: Spearman Brown prophecy formula
The average recall for the 100mg group was 8.5 words. The average recall for the 0mg group was 7.9 words. Which type of validity is concerned with whether or not a difference of .6 words is large enough to be meaningful: statistical conclusion validity
The degree to which you are certain you actually measured what you intended to measure is what type validity: construct validity or test validity or instrument validity
THe degree to which you have eliminated alternative explanations is called what?: internal validity
This simply means that your results had a low probability of occurring simply due to chance: statistically significant
What is another name for random sampling: selection
What is the most common technique for establishing internal consistency: split half
What is done in order to get a representative sample: random sampling, large sample
The findings from Joe's study apply well to situations that Joe did not directly examine. What type of validity does Joe's study have: External validity
If your sample represent the population from which it was taken this is what type of validity: sampling validity
If your design eliminated all possible confounding variables, what validity do you have: internal validity
Joe's new test correlates well with an already established test. What type of validity does Joe's test have.: Concurrent validity
What must be done before a hypothetical construct can be studied scientifically: operationally defined
Joe's test always measures the same thing, just not what Joe intended. How would you describe Joe's test?: reliable but not valid
Joe's test accurately determines who will succeed in college while they are still in high school. What type of validity does Joe's test have: Criterion-predictive validity
Unwanted explanations in a study are known as what: confounding variables
Which type of reliability gives two similar but different tests to each person?: alternate or parallel forms
What provides a measure of equivalence?: alternate or parallel forms
A test with only one question would most likely lack what type of validity: Subjective-CONTENT validity
SAmple size greatly affects which type of validity(there are two): sampling validity or statistical conclusion
Which type of validity is greatly affected by sampling techniques: External validity
Love anxiety and intelligence are examples of what: hypothetical constructs
What is another name for construct validity: test or instrument validity
What type of validity is concerned with how well the variables were operationally defined: construct validity
What type of validity is strongly affected by sample size, effect size and power and alpha level: statistical conclusion validity
What's another name for a measure of consistency in test reliability: inter item
What refers to the accuracy of your test?: Test validity
If a test consistently produces the same or similar results it is said to be: reliable
If your test measures what it is supposed to measure then it would be said to be what: valid

Start Studying!

Deck Info

Number of cards 76