4. Sampling in Quantitative Research
Sampling to generalize about a population
Only a census asks everyone
Random vs Non-Random Sampling … bias
Sample Size and Response Rate is Important
Experiment design and allocation to control/condition groups
6. The Setting
Experimental/Quasi-Experimental or Descriptive design
The need for empirical data
Sampling is key (stratified random or purposive)
Key words are reliability and validity (internal and external)
Significance is important
Eliminate bias
Remember variables – dependent, independent (changing) and
extraneous
8. What to test
Psychometric variables
Biological/Physiological
changes
Educational Changes (IQ etc)
9. Why Test?
Can be just a measure of specific
variables – weight, height, sleep
hours, grey hair
Can be established psychometric
tests (reliable and valid)
Testing before and after an
intervention can show evidence of
change (and the direction of change)
Tests for significance can occur
(ANOVA, Chi Square)
11. How to read
Good statistical analysis will involve samples of 120+
Often test analysis will appear very complex
Remember statistical analysis is trying to
find how close the results (data) are to the
null hypothesis
Always look for p value (probability), the further
away from one, the more significant the result
14. Traps in Questionnaire Design
Ambiguity – unclear questions
Assumptions
Multiple responses when really only one is wanted
Memory stretching
Knowledge demands
Double questions
Leading questions
Presuming questions
Hypothetical questions
Overlapping categories
15. Finding a good survey
A good survey doesn’t require a person to type or write a lot
It uses ticks and clicks
Good surveys allow for a range of opinions with scales (inc. likerts)
Good surveys have responses connected to questions – it just makes
sense
Good surveys always ask one question in one question – they NEVER ask
two questions in one!!!
Good surveys are short (and they are honest on time)
Good surveys are piloted for all the above and for reliability/validity
17. Observation and Interviewing
Observation can have an important
function in quantitative designs
especially experiments and observable
results in descriptive research (eg.
resulting behaviors/conditions)
Interviewing needs to be structured and
tends to be a spoken survey
Experimental most powerful in terms of examining causal linkages
Quasi – next
Most social resaerchers consider that two variables are causally related, that is one causes the other if:
The cause preceeds the effect in time
There is an empirical correlation between them
The relationship is not found to be the result of some third variable effecting the two initally measured variables
Reliability – the extent to which a measure produces consistent result – internal consistency, rides nicely with parallel test, shows in test and re-tests
Can be improved by a careful selection of measures, use of objective criteria, multiple observations, large samples, pilot studies and triangulation
Validity: the extent to which a meaus reflects what it is intended to measure
Internal validity (various types – content is one) – improved by careful selection of measures, real-life situations, good experimental design and control of extraneous variables
External validity (generalisability) improved by representative samples, replication
Observational with a focus on descriping cause – weakest design