Slides from a workshop presented by Prof. Kim Nicholas of Lund University on research design and writing. The workshop was for 45 master's students from many departments and disciplines, hosted by Lund University Social Innovation Centre.
Focuses on the practical aspects of the heart of research: asking and answering questions.
Includes a worksheet for developing your own research design, illustrated by an example from a master's thesis from the LUMES program that was turned into a publication (Clark and Nicholas, 2013, Landscape Ecology).
10. Outline for today
1. Thesis: What and Why?
2. Thesis: How?
1. Practical: Toolbox
2. Theoretical: Epistemology and ontology
(oooh!!)
3. Time management & motivation
10
11. What is research design?
• Make sure evidence gathered allows you to
answer the research question unambiguously
• Research design = a ‘logical’ problem
– don’t jump straight to methods and data
• Seek compelling evidence (be sceptical)
– anticipate & test alternative hypotheses
– design research to try and falsify theory
based on: Chapter 1, de Vaus (2001).
Research Design in Social Research.
Slide from Dr. Charlie Wilson, Tyndall Centre/UEA 11
12. Research Design
12
Topic
Question
Variables
Refine
Operationalize
Collect
Methods
Data
Results
Analyze
Interpret Discussion
Summarize Conclusion
15. Topic
• A place, group of people, technology, theory,
author, buzzword, community of scholars…
• Too general to be researchable
15
16. Topic Question
Food
security,
cities,
ecosystem
services
(other RQs…)
16
Kyle Clark LUMES MSc thesis, 2011; Clark and Nicholas, 2013, Landscape Ecology
17. Urban Food Forestry*
* ‘‘the intentional and strategic use of woody perennial food-producing
species in urban edible landscapes to improve the sustainability and resilience of
urban communities.’’
Clark and Nicholas, 2013, Landscape Ecology
http://urbanfoodforestry.org/
20. Research Questions Aren’t Easy
• “Research is figuring out how to ask and
answer good questions.”
- Chris Field
(When you really get this down, they give you a PhD!
…Only takes 5-7 years )
20
22. A Good Research Question Is…
• NOVEL (no one knows the answer yet!)
• RELEVANT (addresses sustainability challenges
and solutions)
• ANSWERABLE (given the constraints you face)
• VALID (constructs of concepts are valid)
• CONNECTED (related to current issue in
theory, practice, or research)
22
23. Research Questions - Characteristics
Assessing potential research questions
Characteristic
Points
0-1
Answer is not immediately obvious
Could be more than one answer or solution
Realigns accepted notions – forces different view of issue
Controversial – tension and uncertainty about the answer
Calls assumptions into question
Narrow focus area allowing suitably deep exploration
Clear enough for other people to understand
Highlights some sort of inconsistency in an accepted position
or view
Points to an incompleteness or inaccuracy in an accepted
explanation
Indicates missing steps that are critical to an accepted
argument
Identifies an important confusion or ambiguity in a problem
Surfaces issues that are important but ignored in accepted
treatments
Requests new information or old information that can be
presented in a new way
Clear, straightforward & comprehensible
–Researchable– – information available that will help provide
an answer
Poses a problem that–s significant to your reader and
interesting to your audience
Possible to answer in the time available to you
Will sustain your interest for the duration of the project
It asks a question
TOTAL
Research Questions Characteristics Worksheet
23
http://faculty.virginia.edu/capstone/research/
24. Topic Question
Food
security,
cities,
ecosystem
services
What is the
potential
capacity of
urban food
forestry to
meet food
needs?
(other RQs…)
24
Kyle Clark LUMES MSc thesis, 2011; Clark and Nicholas, 2013, Landscape Ecology
26. Construct
• Phenomenon of interest;
what we care about.
• Exist only within our
minds
• Therefore, cannot be
observed directly -> not
researchable!
26
3D image of mouse brain!
Chung et al., 2013, Nature
27. Construct
• Examples:
– Power
– Equity
– Efficiency
– Biodiversity
– Land use change
– Food security
– Climate change
– Sustainability
– Intelligence
– Happiness
– Justice
– Awareness
– Preferences
– Behavior
– Education
– Health
– …
3D image of mouse brain!
Chung et al., 2013, Nature
Image: ebsconsultants.com27
30. From constructs to variables
Operationalize
30
Chung et al., 2013, Nature
Photo: Block Publishing
31. Topic Question Operation
alizing…
Food
security,
cities,
ecosystem
services
What is the
potential
capacity of
urban food
forestry to
meet food
needs?
“capacity
of UFF”->
tons of
apples
produced
Food
Needs ->
calories
demanded
(other RQs…) 31
Kyle Clark LUMES MSc thesis, 2011; Clark and Nicholas, 2013, Landscape Ecology
32. From constructs to variables
Exhaustive
+ Mutually
exclusive
+ Defined
+ Measurable
+ Observable
+ Valid theory
___________
Operationalization
32
33. From constructs to variables
Exhaustive
+ Mutually
exclusive
+ Defined
+ Measurable
+ Observable
+ Valid theory
___________
VARIABLES
Operationalization
Researchable!
33
34. Variables
• Something we measure (categorize), control,
or manipulate in research
• “Something that may or does vary”
• A trait that can change in value from case to
case, or within a case over time
34
35. Topic Question Operation
alizing…
Variables
Food
security,
cities,
ecosystem
services
What is the
potential
capacity of
urban food
forestry to
meet food
needs?
“capacity
of UFF”->
tons of
apples
produced
What trees to
plant?
Available land
for planting trees
Density of
planting
Yield per ha
Food
Needs ->
calories
demanded
Very Food
Insecure calorie
needs
Total population
fruit needs
Tons to calories
(other RQs…) 35
Kyle Clark LUMES MSc thesis, 2011; Clark and Nicholas, 2013, Landscape Ecology
36. Defining a variable
What does it mean to be a “beer drinker”?
Image: artsvegas.com
36
37. Does our definition pass the test?
Precise
+ Defined
+ Measurable
+ Observable
+ Valid theory
___________
VARIABLES
Researchable!
37
38. Research Terminology
• Construct: Phenomenon of interest
• Variables: a trait that captures variation in
concept
• Measure: actual item over which scores will be
measured
• Data: the actual numbers
38
39. Planetary Boundaries operationalize sustainability
Construct Variables Measure Data
Rockström et al., 2009, Nature
“Safe operating space”
39
41. Case selection and description
• What are you studying?
• Selection of the unit of analysis (plots,
countries, people, groups)- criteria for
inclusion/exclusion.
• Who, what, when, where? (“why” was
established in the Intro & by RQs)
41
42. Topic Question Operation
alizing…
Variables How to collect
data?
How to
analyze data?
Food
security,
cities,
ecosystem
services
What is the
potential
capacity of
urban food
forestry to
meet food
needs?
“capacity
of UFF”->
tons of
apples
produced
What trees to
plant?
Lit review
Available land
for planting trees
GIS mapping
Density of
planting
Lit review
Yield per ha Lit review
Food
Needs ->
calories
demanded
Very Food
Insecure calorie
needs
How many
people, how
many calories
Total population
fruit needs
How many
people, how
much fruit
Tons to calories Lit review
(other RQs…) 42
Kyle Clark LUMES MSc thesis, 2011; Clark and Nicholas, 2013, Landscape Ecology
43. Align RQs, variables, methods, analysis
43
How many to plant
X
How much yield per ha
=
Tons of apples
45. 3 planting * 3 yield scenarios
Clark and Nicholas, 2013, Landscape Ecology
VFI deficit met (inner)
46. Urban trees could provide substantial food
Clark and Nicholas, 2013, Landscape Ecology
VFI deficit met (inner)
47. Topic Question Operation
alizing…
Variables How to collect
data?
How to
analyze data?
Food
security,
cities,
ecosystem
services
What is the
potential
capacity of
urban food
forestry to
meet food
needs?
“capacity
of UFF”->
tons of
apples
produced
What trees to
plant?
Lit review Suitable
species
Available land
for planting trees
GIS mapping Classifying &
quantifying
open land
Density of
planting
Lit review Scenarios
Yield per ha Lit review Scenarios
Food
Needs ->
calories
demanded
Very Food
Insecure calorie
needs
How many
people, how
many calories
Calculations
from lit data
Total population
fruit needs
How many
people, how
much fruit
Calculations
from lit data
Tons to calories Lit review Calories per
gram
conversion
(other RQs…)
47
Kyle Clark LUMES MSc thesis, 2011; Clark and Nicholas, 2013, Landscape Ecology
62. Benefits of writing regularly
• 6 year study of 32
people
• 16 regular writers
(30 minutes/day,
consistently)
• 16 binge writers
Boice, Advice for New Faculty62
63. Why does it feel like you know less
now than when you started?
Bianchi et al., 2010, Nature 63