CPCE: Research and Program Evaluation
Questions with 100% correctly Answers |
Latest Update 2024
Quantitative (Experimental Designs): True Experiment - ✔✔This research is characterized by the use
of experimental and control groups with random assignment to each. Experimental designs are used to
determine cause-and-effect relationships.
For experiments, there are design variations such as:
a. Treatment and control group with posttest only.
b. Treatment and control group with pretest and posttest.
c. Two different treatment groups with control group and posttest, and many other combinations.
For example: Sixty college freshmen are enrolled in an English class. Thirty are randomly assigned to a
one-hour per week writing lab, the others comprise a control group. End-of-semester essay
examination results are analyzed to see if the lab was associated with better writing skills.
Quantitative (Experimental Designs): Quasi-Experiment - ✔✔This research is similar to
experimental research except that randomization of subjects to treatment and control groups is not
possible. It may be that no control or comparison group is available. Results from such research will
not be as unequivocal as results from a true experimental study.
For example: An elementary school has two classrooms of fourth graders. Each classroom of fourth
graders is taught arithmetic by a different method for the school year. In May, arithmetic achievement
is compared for the two classrooms using scores on a national exam. There was no random assignment
of students to the two classrooms and the 'arithmetic teaching methods' were not randomly assigned to
the two classes.
Qualitative Research: Interactive - ✔✔i. Case study in which the case may be a program, activity, or
a set of individuals who are bounded in time and place.
,ii. Ethnography which is a description and interpretation of a cultural or social group or system. Data is
typically collected through observation and interviewing. The issue of observer bias is important.
Qualitative Research: Noninteractive - ✔✔This is analytical research conducted primarily through
document analysis. Examples might be historical analysis (collecting and analyzing documents describing
former events), biographical analysis (written or oral) and legal analysis which focuses on law and court
decisions.
Mixed-Methods Research Design - ✔✔These designs combine quantitative and qualitative
methods in the same research effort. The researcher retains the flexibility to use both types of
designs.
Typically, the designs are used sequentially. For example, quantitative may be gathered first and
then qualitative methods are used to further explain or elaborate on the findings, using perhaps,
surveys, interviews, or focus groups.
Single-Subject Design - ✔✔Studies the effects of a program or treatment on an individual or
group treated as an individual, usually after a baseline has been established.
Action Research - ✔✔Conducted in an attempt to improve services or a program.
This research may often be viewed as having an evaluative function.
Pilot Study - ✔✔A small-scale research effort often used to determine the feasibility of a large
scale effort with emphasis on refining procedures and instrumentation.
Longitudinal Research - ✔✔Consists of collecting data from the same group of individuals over
a period of time. This is also called a panel study.
For example, this author studied the career development of school children beginning when they were
second graders and re-interviewing them every two years until they were high school seniors.
Cross-Sectional Research - ✔✔Consists of collecting data from different groups at the same time
and examining these differences.
, For example, one approach to studying career development is collecting data from each grade
of students, for example from second to twelfth grade, at the same time.
Within-Subjects vs. Between-Subjects - ✔✔Within-subjects: examining what changes occur within
the members of a group.
Between subjects: examining what changes occur between two or more groups.
Meta-Analysis - ✔✔This is research comparing findings across studies, i.e., the results of many
studies are examined simultaneously and one or more research questions answered.
For example, a number of studies have examined what works in various counseling situations. Examining
a number of these studies simultaneously can help determine what counseling techniques work for
what kind of clients, with what kinds of problems, under what conditions.
Internal Validity - ✔✔Experiments are internally valid to the extent that extraneous variables have
been controlled. In other words, to the extent that the treatment variable is the only one producing the
observed changes, the experiment is internally valid.
Threats to Internal Validity: Selection of Subjects - ✔✔Differences in the results between two groups
may not be due to the treatment variable experienced by one group because the composition of the
two groups are different to begin with (probably not randomly selected).
Threats to Internal Validity: Instrumentation - ✔✔Differences in results between two or more
groups may be due to instruments which are unreliable or because the instruments are changed during
the study. Or, perhaps the observers recording data become fatigued or bored and they record
behaviors differently over time.
Threats to Internal Validity: Maturation - ✔✔Results may be due to maturational or other changes
in the subjects and not due to the treatment being applied. This is especially important if research data
is gathered over a long period of time.
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller KenAli. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $12.99. You're not tied to anything after your purchase.