If a psychological test measures what it was designed to measure the test has Quizlet

Recommended textbook solutions

Myers' Psychology for AP

2nd EditionDavid G Myers

900 solutions

Myers' Psychology for the AP Course

3rd EditionC. Nathan DeWall, David G Myers

955 solutions

Consumer Behavior: Buying, Having, Being

13th EditionMichael R Solomon

449 solutions

HDEV5

6th EditionSpencer A. Rathus

380 solutions

A Historical Perspective

*the 20th century brought the first tests of abilities such as intelligence
*in 1905 Binet and Simon developed the first intelligence test to identify mentally retarded Pars schoolchildren
*before long, psychological tests were being used on a regular basis in schools, clinics, courts, hospitals and prisons
*WW1 & WW2 brought the need for large scale testing of the intellectual ability of new recruits
*after WW1, psychologists increasingly used tests in large corporations and private organisations

Culture & Assessment

*culture: the socially transmitted behaviour patterns, beliefs and products of work of a particular population, community, or group of people
*professionals in assessment have shown a growing sensitivity to cultural issues with every aspect of test development and use
**early psychological testing of immigrant populations by Henry Goddard was controversial: He found that the majority of immigrant populations were 'feeble-minded'

Concerns of the Profession-Qualifications

*The APA has published many works over the years to delineate ethical, sound practice in the field of psychological testing an assessment

Test user qualification: in 1950 the APA published a report called Ethical Standards of the Distribution of Psychological Tests and Diagnostic Aids: it outlined three levels of tests in terms of exprtise

Test User Qualifications - three levels of tests in terms of expertise:

*Level A - tests or aids that can adequately be administered, scored, and interpreted with the aid of the manual

*Level B - tests or aids that require some technical knowledge of test construction/use and knowledge of psychology and education

*Level C - tests and aids that require substantial understanding of testing and supporting psychological fields together with supervised experience in the use of these decixes

A Historical Perspective

*by the late 1930's, over 4 thousand psychological tests were in print
*the Woodworth Psychoneurotic Inventory was the first widely used self-report personality test
*an advantage of self-report is that respondents are arguably the best qualified people to provide answers about themselves
*a potential disadvantage is that respondents may have poor insight into themselves. people might honestly believe some things about themselves that in reality are not true
*some respondents are unwilling to reveal anything about themselves that is very personal or paints them in a negative light

Testing and Assessment Defined

*Testing: the process of measuring psychology-related variable by means of devices or procedures designed to obtain a sample of behaviour

*Assessment: the gathering and integration of psychology-related data for the purpose of making a psychological evaluation through tools such as tests, interviews, case studies, behavioural observation, and other methods

Testing and Assessment

*the objective of testing is typically to obtain some gauge, usually numerical in nature, with regard to an ability or tribute

*the objective of assessment is typically to answer a referral question, solve a problem or arrive at a decision through the tools of evalutation

Testing and Assessment
Collaborative Psychological Assessment

the assessor and assessee work as partners

Testing and Assessment
Therepeutic Psychological Assessment

therapeutic self-discovery is encouraged through the assessment process

Tools of Psychological Assessment
The Test

*a psychological test is a device or procedure designed to measure variables related to psychology (e.g., intelligence, attitudes, personality, interests etc.)

*psychological tests vary by content, format, administration, scoring, interpretation, and technical quality

Psychological Tests

*content: the subject matter of the test. content depends on the theoretical orientation of test developers and the unique way in which they define the construct of interest

*format: the form, plan, structure, layout of test items, and other considerations (e.g., time limits)

*administration: tests may require certain tasks to be performed, trained observation of performance, or little involvement by the test administrators (e.g., self-report questionnaires)

Psychological Tests cont'

*Technical Quality or Psychometric Soundness: psychometrics is the science of psychological measurement. The psychometric soundness of a test depends on how consistently and accurately the test measures what it purports to measure

*Scoring and Interpretation: scoring of tests may be simple, such as summing responses to items, or may require more elaborate procedures

*some tests results can be interpreted easily, or interpreted by computer, whereas other tests require expertise for proper interpretation

Testing & Assessment Defined

*Testing: process of measuring psychology-related variables by means of devices or procedures designed to obtain a sample of behaviour

*Assessment: the gathering and integration of psychology-related data for the purpose of making a psychological evaluation through tools such as tests, interviews, case studies, behavioural observation, and other methods

Psychological Testing & Assessment Defined

*Psychological Test: standardised measure of behaviour used to predict behaviour and varying levels of skill and knowledge required to administer different tests

*Psychological Assessment: integration of information from various sources. Used to answer questions and make recommendations and high level of skill and experience required

Testing and Assessment

the objective of testing is typically to obtain some gauge, usually numerical in nature, with regard to an ability or attribute

the objective of assessment is typically to answer a referral questions, solve a problem or arrive at a decision through the tools of evaluation

Collaborative Psychological Assessment:

the assessor and assessee work as partners

Therapeutic Psychological Assessment:

therapeutic self-discover is encouraged through the assessment process

Definition of Assessment

*assessment
-often confused with testing
-psychological tests represent only one source
-in fact, encompasses a range of information sources such as interviews and observation
-Case Report is an example of psychological assessment, which includes a test data

Psychological Assessment

skilled professional uses psychological techniques and tools to learn general or specific facts about another person:
-to inform others of how they function now
-to predict their behaviour and functioning in the future

*frequently uses tests
*typically does not involve defined procedures or steps
*contributes to some decision process to some problem
*examiner must consider, evaluate, and integrate the data
*results not evaluated solely on psychometric grounds
*is less routine, more inflexible and individualised

Major Specific Purposes of Testing

*Classification: analyse or describe test results to a specific taxonomic system to arrive at a classification or diagnosis

*Description: analyse or interpret test results to understand strengths and weaknesses

*Prediction: relate or interpret test results to predict future behaviour

*Intervention planning: use test results to determine the appropriateness of different interventions and their relative efficacy within the target population

Some definitions of a Test

A psychological test is:

*a set of items designed to measure characteristics of human beings that pertain to behaviour

*an objective and standardised measure of a sample of behaviour

*a method of describing behaviour with categories and scores

Some definitions of a Test (contd.)

a psychological test is:

*a set of standard items or stimuli, the responses to which form the basis for an inference that goes beyond item content, and for which psychologists accept ethical responsibility in professional use (APS - Guidelines for the use of psychological tests)

Psychological Test
also known as.....

-instrument
-tool
-measure
-inventory

Examples of Uses of Tests

-measurement of thinking and reasoning capacity using intelligence and/or specific cognitive tests

-measurement of disturbed personality, behaviour and thinking and diagnosis of mental disorders/illnesses

-diagnosis of neuropathology

-identification and classification of intellectual disability and learning disorders using WHO standards

-assessment of personal qualities and capacities

Psychological Tests

a device or procedure designed to measure variables related to psychlogy (eg. intelligence, attitudes, personality, interests)

Psychological tests vary by:
-content
-format
-administration
-scoring
-interpretation
-technical quality

Psychological Tests
(Content, Format, Administration)

Content: the subject matter of the test. content depends on the theoretical orientation of test developers and the unique way in which they define the construct of interest

Format: the form, plan, structure, layout of test items, and other considerations (e.g. time limits)

Administration: tests may require certain tasks to be performed, trained observation of performance, or little involvement by the test administrators (e.g., self-report questionnaires)

Psychological Tests
Scoring & Interpretation

Scoring & Interpretation: scoring of tests may be simple, such as summing responses to items, or may require more elaborate procedures

*some tests results can be interpreted easily, or interpreted by computer, whereas other tests require expertise for proper interpretation

Cut Score: a reference point, usually numerical, used to divide data into two or more classifications (e.g., pass or fail
)

Psychological Tests
Technical Quality or Psychometric Soundness

psychometrics is the science of psychological measurement. the psychometric soundness of a test depends on how consistently and accurately the test measures what it purports to measure

*test users are sometimes referred to as psychometrists or psychometricians

The Interview

the interview is a method for gathering information through direct communication involving reciprocal exchange.

Interviews vary as to their purpose, length and nature.

The quality of information obtained in an interview often depends on the skills of the interviewer (e.g., their pacing, rapport, and their ability to convey genuineness, empathy and humor)

Other Tools of Psychological Assessment

*The Portfolio: a file containing the products of one's work. May serve as a sample of one's abilities and accomplishments

*Case History Data: information preserved in records, transcripts, or other forms

*Behavioural Observation: monitoring the actions of people through visual or electronic means.

Other Tools of Psychological Assessment
Cont'

*Role-Play Tests: assessees are directed to act as if they were in a particular situation. Useful in evaluating various skills

*Computer as Tools: computers can assist in test administration, scoring and interpretation

Computers as Tools

*scoring may be done on site (local processing) or at a central location (central processing)

*reports may come in the form of a simple scoring report, extended scoring report, interpretive report, consultative report, or integrative report

*Computer Assisted Psychological Assessment (CAPA) and Computer Adaptive Testing (CAT) have allowed for tailor-made tests with built-in scoring and interpretive capabilities

Computers as Tools Contd.

*Assessment is increasingly conducted via the internet

Advantages of Internet Testing
1. Greater access to potential test users
2. scoring and interpretation tends to be quicker
3. costs tend to be lower
4. facilitates testing otherwise isolated populations and people with disabilities

Who, What, Why, How, and Where?

*Who are the parties?

The Test Developer

The Test Developer: tests are created for research studies, publication (as commercially available instruments), or as modifications of existing tests.

*The Standards for Educational and Psychological Testing coveres issues related to test construction and evaluation, test administration and use, special applications of tests and considerations for linguistic minorities

Who, What, Why, How, and Where?

*Who are the parties?

The Test User

The Test User - tests are used by a wide range of professionals

*The Standards contains guidelines for who should be adminstering psychological tests but many countries have no ethical or legal guidelines for test use

The test-taker - anyone who is the subject of an assessment or evaluation is a test-taker

Test-takers may differ on a number of variables at the time of testing e.g. test anxiety, emotional distress, physical discomfort, aleterness)

Who, What, Why, How, and Where?

*Who are the parties?

Society at Large

Society at lagre: test developers create tests to meet the needs of an evolving society

-laws and court decisions may play a major role in test development, administration, and interpretation

-other parties: organisations, companies, and government agencies sponsor the development of tests

-companies may offer test scoring and interpretation

-researchers may review tests and evaluate their psychometric soundness

What types of settings?
Educational Settings:

students typically undergo school ability tests and achievement tests.

diagnostic tests may be used to identify areas for educational intervention

What types of settings?
Clinical Settings:

includes hospitals, inpatient and outpatient clinics, private-practice consulting rooms, schools and other institutions

-assessment tools are used to help screen for or diagnose behaviour problems

What types of settings?
Counselling Settings:

includes schools, prisons, and governmental or privately owned institutions

-the goal of assessments in this setting is improvements in adjustment, productivity, or related variable

What types of settings?
Geriatric Settings:

assessment primarily evaluates cognitive, psychological, adaptive, or other functioning, at issue is quality of life

What types of settings?
Business & Military Settings:

decisions regarding careers of personnel are made with a variety of achievement, aptitude, interest, motivational, and other tests

What types of settings?
Government & Organisational Credentialing:

includes governmental licensing, certification, or general credentialing of professionals (e.g., attorneys, physicians, and psychologists)

How are Assessments Conducted?

-there are many different methods used
-ethical testers have responsibilities before, during, and after testing
-obligations include:
*familiarity with test materials and procedures
*ensuring that the room in which the test will be conducted is suitable and conducive to the testing
*it is important to establish rapport during test administration

Assessment of People with Disabilities

-the law mandates 'alternate assessment' - the definition of this is up to states or school districts

-accomodations need to be made - the adaptive of a test, procedure, or situation, or the substitution of one test for another, to make the assessment more suitable for an assessee with exceptional needs

Where to go for Information on Tests

-test catalogues

test catalogues:

distributed by publishers of tests. usually brief, an un-critical, description of tests

Where to go for Information on Tests

-test manuals

test manuals:

detailed information concerning the development of a particular test and technical information

Where to go for Information on Tests

-journal articles

journal articles:

contains reviews of a test, updated or independent studies of its psychometric soundness, or examples of how the instrument was used in either research or an applied context

Where to go for Information on Tests

-reference volumes

reference volumes:

reference volumes like the Mental Measurements Yearbook or Tests in Print provide detailed information on many tests

Metal Measurements Yearbook (MMY)

produced by the Buros Centre for Testing at the Uni of Nebrasks

-database provides users with a comprehensive guide to over 3,000 contemporary testing instruments

-contains information for a complete evaluation of test products

*i.e., descriptive information (test purpose, publisher, pricing) and edited reviews written by leading content area experts)

Navigate to USQ Library:
-journals and databases
-browse databases - Letter M
-select mental measurements yearbook
-click on access this e-resource

Historical Considerations: Imperial Examination

*2200BC: chinese emperor examined his officials every third year to determine their fitness for office

*circa 1000BC chinese introduced written tests to help fill civil service positions

-examinations were gruelling and rigorous

History of the Origins of Testing:
Philosophical Roots

*Plato (427-347 B.C.): Rationalism (born with ability to reason)
*Aristotle (384-322 BC): Earliest known
formal study of logic
*René Descartes (1596-1650): 'Father of
Modern Philosophy'
*John Locke (1632-1704): 'Father of Classical Liberalism'

History of the Origins of Testing:
Becoming a Science

*Wilhelm Wundt

* Sir Francis Galton

*James McKeen Cattell

Wilhelm Wundt (1832-1920)

calibrated pendulum to measure
"speed of thought"
observer's task was to note position
of the pendulum when bells sounded
Score = difference between the
observed & actual pendulum
position
used empirical analysis to explain
individual differences

Sir Francis Galton (1822-1911)

"Father of mental testing":
-devised practicable measures of Individual Differences
meaningful scores through standardized procedures

-Thesis: natural ability, eminence, & inheritance

-Evidence:
normal distribution and
family pedigrees
Implications: Eugenics

James McKeen Cattell (1860-1944)

Responsible for many early developments in mental
measurements in the U.S
Whilst studying with Wundt, noted RT diff's and
thought should be studied systematically - then did
receive support whilst studying with Galton
Invented the term "mental test" in his famous paper
entitled "Mental Tests and Measurements"

*first person to receive the title 'Professor of Psychology in the US

History of Intelligence Testing

Alfred Binet
Henry H. Goddard
David Wechsler
Lewis M. Terman
Robert M. Yerkes

Alfred Binet (1857-1911)

Appointed to identify school-readiness
in children
Tests increased in difficulty;
provided 'performance' age
IQ: Mental Age / Chronological Age * 100
E.g., performance at level of 12 yrs by a 10 yr old = IQ of 120
All experimental research should follow 4 steps:
hypothesis, collection of facts, interpretation of data, &
replication
Insistence on scientifically sound methodology
developed new statistical tools
made use of control groups

Henry H. Goddard (1866-1957)

research classification of "feeble-minded" children
translated the Binet-Simon scale for U.S. children
Supported Eugenics movement; intelligence testing of
immigrants revealed were mentally retarded
Held the view that children identified as mentally
deficient should be segregated to prevent
"contaminating society"

Lewis M. Terman (1877-1956)

Produced the Stanford-Binet in 1916, which
became the standard of intelligence testing for
decades
Binet tests + 40 add'l tests trialled on 905 normal
children between ages of 5 - 14
Trained all the examiners to ensure uniformity &
incl clear, well-organized instructions for
administration & scoring
Final v 90 items for use MR & normal children, &
normal & superior adults

Robert M. Yerkes (1876-1956)

Group testing as the US entered WWI in 1917
President of the APA at that time & implemented
ways in which psychology could be of service
Group intelligence test s/be administered to all
recruits for purposes of classification & assignment
Two group tests emerged:
1. Army Alpha
verbal tests for average & high-functioning recruits
2. Army Beta
nonverbal group test for use with illiterates &
recruits whose first language was not English

A Historical Perspective: Self-Report Tests

-by the late 1930's over 4,000 psychological tests were in print

-the Woodworth Psychoneurotic Inventory was the first widely used self-report personality test

-advantage: best qualified to provide answers about self

-disadvantages:
*respondents may have poor insight into themselves
*respondents unwilling to reveal anything about themselves that is very personal or paints them in a negative light

History of Personality Testing

Robert S. Woodworth
Hermann Rorschach
Myers-Briggs
Hathaway (1903-1984) and McKinley (1891-
1950) - Minnesota Multiphasic Personality
Inventory (MMPI)
Criminal Personality Types
Vocational Interest Inventories

Robert S. Woodworth (1869-1962)

Developed the first personality test in history:
The Personal Data Sheet
To detect susceptibility to emotional instability in
WWI Army recruits
116 questions that required the subject to answer Yes
or No to fairly serious symptomatology, e.g.:
"Do you feel sad or low-spirited most of the time?"
"Are you ever bothered with feeling that people are reading
your thoughts?"

Relatively new developments in Testing

Neuropsychological Testing
Computerised Testing

Neuropsychological testing

Specifically designed tasks to measure a psychological
function known to be linked to a particular brain
structure or pathway
Categories of neuropsychological tests
Intelligence
Memory
Language
Executive function
Visuospatial
Dementia specific
Batteries assessing multiple neuropsychological functions

Computerised Testing (aka e-Assessment)

use of information technology for any assessment-related activity
Computerised adaptive testing (CAT)
Computerised classification testing (CCT)
Computerised Structured Interviews
Computer-Based Test Interpretation (CBTI)
Various terms to describe use of computer for assessment purposes:
Computer-Assisted Assessment (CAA)
Computer-Based Assessment (CBA)
online assessment (relies on use of the World Wide Web)

Computer-Based Test Interpretation (CBTI)

Psychiatric Screening
Personality Assessment
Neuropsychology
Personnel Psychology
personnel selection
job performance prediction
selection and classification of military personne

Computerised Testing: Pros and Cons

Better use of professional time-trained
Reduced time lag btwn test administration & results availability
Greater flexibility
Greater accuracy
Greater standardisation
Greater control
Greater utility with special clients or groups
Greater storage efficiency
Cost savings
X Reduces potential for observing the client's behaviour
X Unprofessional, unregulated "psychological testing"
online

Culture and Assessment

Culture: The socially transmitted behavior patterns,
beliefs, and products of work of a particular population,
community, or group of people (Cohen, 1994).
Professionals in assessment have shown a growing
sensitivity to cultural issues with every aspect of test
development and use.
• Early psychological testing of
immigrant populations by Henry
Goddard was controversial: He
found that the majority of
immigrant populations were
"feeble-minded."

Culture and Assessment
cont'

Goddard's findings were largely the result of using a translated
Stanford-Binetintelligence test that overestimated mental
deficiency in native English-speaking populations, let alone
immigrant populations.
Goddard's research sparked a nature vs. nurture debate: Were
IQ results indicative of some underlying native ability or the
extent to which knowledge and skills had been acquired?
In the 1930's and 1940's developers of IQ tests devised
culture-specific tests and clarified that the tests were not
intended for minority cultures. Yet, the tests were used on
individuals belonging to other cultures.
Today, developers of intelligence tests take precautions
against bias.

Culture and Assessment
cont'd

meaning and nuance may be lost in translation
interpreters may not be familiar with mental health
issues - pre-training may be necessary
language deficits may go undetected in written tests
non-verbal signs or body language may vary
may complete tasks at a different pace - problematic
for timed tests

Culture and Assessment:
Standards of Evaluation

Judgments related to certain psychological traits can be
culturally relative.
Cultures differ in regards to gender roles and views of
psychopathology
Cultures vary in terms of collectivist vs. individualist
value.
Collectivist cultures value traits such as conformity,
cooperation, interdependence, and striving toward group
goals
Individualist cultures place value on traits such as self-reliance,
autonomy, independence, uniqueness, and competitiveness.

Culture and Assessment: Group Membership

Conflict arises when groups systematically differ in
terms of scores on a particular test
In vocational assessment, test users are sensitive to
legal and ethical mandates concerning the use of tests
with regard to hiring, firing, and related decision
making
Conflicts may arise from disagreements about the
criteria for performing a particular job

Legal and Ethical Issues: Group Membership

Arthur Jensen's article in the Harvard Educational
Review (1969) - suggested that "genetic factors are
strongly implicated in the average Negro-white
intelligence difference"
Jensen's work caused renewed public concern over
nature vs. nurture and what intelligence tests actually
test
In recent decades, the government has become
extensively involved in various aspects of assessment

Legal and Ethical Issues: Expert Witness

1923 case of Frye v. the United States established that scientific
research is admissible as evidence when the research study or
method enjoys general acceptance. General acceptance could
typically be established by the testimony of experts and by
reference to publications in peer-reviewed journals.
The Daubert ruling by the Supreme Court superseded the longstanding
policy, set forth in Frye, of admitting into evidence only
scientific testimony that had won general acceptance in the
scientific community.
Opposing expert testimony, whether or not such testimony had
won general acceptance in the scientific community, would be
admissible.
The Daubert ruling gave trial judges more leeway in deciding which
expert testimony could be used.

Legal and Ethical Issues: Expert Witness
In Australia

Current High Court authority does not apply Frye or Daubert
style tests to specialised knowledge in an identified area.
Rather, in HG v The Queen, Gaudron J (Gummow J agreeing)
referred to the need, at common law, for the expert's
knowledge or experience to be in an area 'sufficiently
organized or recognized to b

Concerns of the Profession: Test Users

Test user qualifications: In 1950 the APA published a report called
Ethical Standards for the Distribution of Psychological Tests and
Diagnostic Aids. It outlined three levels of tests in terms of
expertise:

*Level A - Tests or aids that can adequately be administered,
scored, and interpreted with the aid of the manual.

*Level B - Tests or aids that require some technical knowledge of
test construction/use and knowledge of psychology and
education.

*Level C - Tests and aids that require substantial understanding of
testing and supporting psychological fields together with
supervised experience in the use of these devices.

Concerns of the Profession: Testing people
with disabilities

Challenges in testing people with disabilities:
1) transforming the test into a form that can be taken
by the testtaker,
2) transforming the responses of the testtaker so that
they are scorable, and
3) meaningfully interpreting the test data.

The Rights of Test-Takers: Informed Consent

a right to know why they are being evaluated,
how the test data will be used, and
what (if any) information will be released to
whom.
With full knowledge of such information, testtakers
give their informed consent.
Information needed for consent must be in language
the test-taker can understand.
Some groups (e.g. people with Alzheimer's Disease)
may not have the capacity, or competency, to provide
informed consent.

The Rights of Test-Takers: Competency

Competency may be defined as:
1) Being able to evidence a choice as to whether one wants to
participate;
2) demonstrating a factual understanding of the issues;
3) being able to reason about the facts of a study, treatment,
or whatever it is to which consent is sought, and
4) appreciating the nature of the situation.
If competency, cannot be provided by the person, a
substitute decision-maker is used (e.g. next of kin).

The Rights of Test-Takers: Test Findings

The right to be informed of test findings:
In the past test-takers were often not told of diagnostic findings
or anything that might hurt their self-image.
Currently, giving information about test performance to
examinees is ethically and legally mandated and may be useful
from a therapeutic perspective as well.
Test-users should sensitively inform test-takers of:
the purpose of the test,
the meaning of the score relative to those of other testtakers, and
the possible limitations and margins of error of the test

The Rights of Test-Takers: Confidentiality

Information provided by clients to psychologists is
NOT considered privileged information.
Psychologists may have to disclose information if
ordered by the courts or the client may harm self or
other.
Another ethical mandate, regarding confidentiality,
pertains to safe-guarding test data.
Covered in this week's tutorial

Summing Up: A Historical Perspective

Historically, psychological assessment has
proceeded along two lines:
1. Academic tradition: Researchers at universities
throughout the world use the tools of assessment to
help advance knowledge and understanding of human
and animal behavior.
2. Applied tradition, the goal is diagnostic (e.g., to select
applicants for various positions on the basis of merit).

Summing Up: Cultural, And Legal/Ethical
Considerations

• In any testing or assessment setting, the test user has the
ultimate responsibility for:
the responsible safeguarding, appropriate selection, and
administration of tests, and
for ensuring that the rights and well-being of the test
taker are at the forefront of the assessment process - this
includes:
- following standardized protocols,
- recognizing, and implementing cultural or other individualspecific
needs during the testing process, and
- ensuring the test taker is aware of how the information will
be used, and the limits to confidentiality of the information
gathered.

What is the ability of a test to measure what it was designed to measure?

What is a measure of a test's ability to measure what it is designed to measure quizlet?

Which of the following types of tests is designed to measure an individual's knowledge of a subject?

What type of test measures what a person has learned?