SlideShare a Scribd company logo
1 of 39
Download to read offline
Cortney Copeland• Maritza Munzón
Monterey Institute of International Studies
IEM 8510 Design & Assessment• Dr. Meggan Madden
ASSESSMENT
PROPOSAL
5/8/2014
Assessment of Key Intercultural and Team
Competency Skills
This proposal includes assessment context, purpose, goals, and
objectives justifying the need for an assessment of the pre-
departure training for the Peru Practicum, as well as a sample
survey and accompanying resources.
Assessment Proposal
Page 1
Assessment Proposal
A S S E S S M E N T O F K E Y I N T E R C U L T U R A L A N D T E A M C O M P E T E N C Y
S K I L L S
EXECUTIVE SUMMARY
Context
A cohort of students from the Monterey Institute of International Studies (MIIS) recently participated in a new
international immersive learning program during January (J-term) 2014. The model embeds a three-week field
practicum in between Fall and Spring classes on development policy and analysis. The program is
collaboratively driven by MIIS, the Andean Alliance for Sustainable Development (AASD), and local government
officials in Peru.
The challenge of working in a developing region with NGO and government partners demands that student
teams are well-prepared to work professionally in an unfamiliar international context. However, the 2014
cohort received minimal pre-departure training beyond learning background information about Peru. Therefore,
a new pre-departure training has been designed that emphasizes practical knowledge, intercultural
competency, and team dynamics.
Purpose
The following document is a proposal to evaluate the new pre-departure training program. The purpose of the
proposed evaluation is a formative assessment of how well the newly designed pre-departure training prepares
students to work as a cohesive, professional field team while outside of their familiar cultural context. Skills that
contribute to both intercultural competence and strong team dynamics will be assessed through student surveys
and reflection papers, completed several times throughout Fall and J-term to explore potential changes.
It is hoped that the new program design and its assessment will inform several potential changes to
immersive learning at MIIS:
1) Incorporating pre-departure training into the Peru Practicum as it continues to develop.
2) Focusing on the cultivation of professional teamwork skills as a learning outcome for immersive learning
participants.
3) Advancing the process of creating and implementing pre-departure trainings for all international
immersive learning programs.
Stakeholders
● Monterey Institute of International Studies: Development Practice and Policy (MIIS DPP)
● Andean Alliance for Sustainable Development (AASD)
● Potential practicum participants (DPP graduate students)
Assessment Proposal
Page 2
● Practicum alumni
● MIIS Intercultural Competency Committee (ICC)
● Peru Practicum Steering Committee (MIIS DPP, AASD, officials in Calca, Peru).
Modes of Assessment
The assessment will comprise two components: a time-series survey of both closed-ended and open-ended
questions, to be completed three times by all participants; and reflection papers guided by prompts, to be
completed twice by all participants. Surveys and reflection papers will be assigned random codes by a person
not involved in analyzing the data, and will not include student names. This will protect student anonymity while
tracking which surveys and reflections have been done by the same person, allowing the analysis of changes
over time in individual cases. Survey results will be analyzed both quantitatively, to track mean changes in
answers to close-ended questions, and qualitatively, to explore student experiences as expressed in the open-
ended questions. Reflection papers will be analyzed qualitatively for student thoughts on their own preparation,
and for emerging themes
CONTEXT & STAKEHOLDERS
Context
In January (J-term) 2014, a cohort of MIIS students participated for the first time in a new international immersive
learning program. The year-long model, implemented in partnership with the Andean Alliance for Sustainable
Development (AASD), incorporates a three-week field practicum in Peru embedded between related Fall and
Spring classes on policy research and analysis. MIIS and AASD are working in partnership with local Peruvian
officials to continue shaping an annual immersive learning project that contributes to student learning in
development policy while creating positive impact in the Andean communities of Peru.
The 2014 Peru Practicum drew an uncommonly diverse participant group with a high number of first-year
students. The resulting wide range of international experience, language skills, and professional interests is
considered both a challenge and a potential strength of the program. Because students enroll with varying
levels of confidence working in developing countries, and because working with both NGO and government
personnel demands a high level of performance, it is vital that students are well prepared for their fieldwork.
However, 2014 participants received little pre-departure training beyond basic information about Peru and
their project. A new pre-departure training for the Peru Practicum has been designed to improve student
preparation in three areas: practical knowledge of their destination, intercultural competence, and team
dynamics. As the MIIS Intercultural Competency Committee is considering requiring intercultural training before
all international immersive learning programs, this new program can be considered a small test or pilot run. As
such, it is important that the new training be assessed for effectiveness.
Stakeholders
● Monterey Institute of International Studies: Development Practice and Policy (MIIS DPP)
○ Primary contact: Dr. Jeff Dayton-Johnson, Professor.
Assessment Proposal
Page 3
○ Role in Assessment: Helped inform the program and assessment design. May be involved in
implementing those activities that are scheduled to happen during the course of the Fall
semester. As intended beneficiaries, professors involved in the practicum will be asked for
feedback on how the pre-departure training and assessment function within the practicum
structure.
● Andean Alliance for Sustainable Development (AASD)
○ Primary contact: Adam Stieglitz, Co-Founder
○ Role in Assessment: Helped inform the program and assessment design. May have a role in
implementing additional in-country training as the practicum model develops in the future. As
an intended beneficiary, AASD will be asked for feedback on the usefulness of the practicum
for their organization and on the general quality of student participation while in Peru.
● Potential practicum participants (DPP graduate students)
○ Primary contact: Lis Martinis & Gaelen Hayes, Student Liaisons
○ Role in Assessment: Participate in the pre-departure training and field practicum. All students
who enroll in the Fall pre-practicum class will be asked to complete the surveys, whether or not
they go to Peru. Those who go to Peru will participate in pre-departure activities throughout the
semester and during the pre-departure training workshop. Only these students will be asked to
write reflection papers. As intended beneficiaries, students will be asked for feedback on their
levels of preparation and the usefulness of pre-departure activities.
● Practicum alumni
○ Primary contact: Lis Martinis & Gaelen Hayes, Student Liaisons
○ Role in Assessment: Have offered feedback throughout the program and assessment design
process, in addition to sharing stories and reflections during more general meetings,
presentations, and focus groups about the practicum experience. Several alumni have assisted
by pilot-testing the survey instrument.
● MIIS Intercultural Competency Committee (ICC)
○ Primary Contact: Dr. Lynn Goldstein, Professor.
○ Role in Assessment: Responsible for implementing future pre-departure training programs.
Primary recipients of assessment results (although results will be shared with all stakeholders).
Will provide feedback on the potential of developing the pre-departure training as a tool for
other immersive learning programs.
● Peru Practicum Steering Committee
○ Primary contact: Dr. Jeff Dayton-Johnson, Professor
○ Steering committee includes members from MIIS DPP, AASD, and local officials in Calca and
Lares, Peru.
○ Role in Assessment: Maintain relationship between MIIS, AASD, and Peruvian communities. Direct
and shape the Peru Practicum to maximize both student learning and positive impact in Peru.
While they will not be asked for direct feedback regarding the effects of pre-departure
training, as a group representing all intended beneficiaries, they will provide information
regarding the structure of the Practicum, the kind of projects that students will take on, and the
ways students can have the most positive impact in their work with AASD and local governments
in Peru.
Assessment Proposal
Page 4
PURPOSE, GOALS & OBJECTIVES
Purpose of Assessment
The purpose of the proposed evaluation is a formative assessment of how well the newly designed pre-
departure training for the Peru Practicum prepares students to work as a cohesive, professional field team while
outside of their familiar cultural context.
The following document proposes a means for assessing whether students experience improvement in key skills
related both to intercultural competence and team dynamics, two of the three intended outcomes of the new
pre-departure training. These outcomes have been chosen for assessment in consultation with Dr. Dayton-Johnson
and Adam Stieglitz.
Based on a literature review (see Appendix C), a group of attributes common to both intercultural competence
and strong team dynamics have been identified and categorized into the following dimensions:
1) Understanding of self
2) Understanding of others
3) Shared purpose
4) Communication
5) Resilience
Justification
According to a focus group held at MIIS in Spring 2014, a major goal of immersive learning is to gain real-
world, hands-on experience and to prepare for future careers through “learning by doing”. One component of
this preparation is learning to work in a professional team. Most people will work in teams in their future careers,
to varying degrees, and in the international fields focused on by MIIS students many people will work in
intercultural teams or in international settings. Studies show that many characteristics and skills, such as flexibility,
empathy, and interpersonal communication, contribute both to intercultural competence and to team dynamics.
Studying the development of such traits is therefore a means for simultaneously assessing two of the intended
outcomes of the new pre-departure training.
While intercultural competence is assessed in the general MIIS student population, teamwork skills are not-
despite the fact that group work is a major component of many courses of study. Though MIIS students engage
in a significant amount of group work, there is little formal guidance on cultivating group skills and dynamics in
the process of doing so. The new pre-departure training is one of the few formal opportunities for consciously
cultivating and assessing professional teamwork skills among MIIS students, and is especially relevant since the
teamwork will happen in a challenging international field setting like the ones many students will continue to
encounter in their careers.
Furthermore, this assessment of a new pre-departure training moves one step closer to the goal of MIIS’s
Intercultural Competency Committee, which aims to require pre-departure training for all international immersive
learning programs in coming years.
Assessment Proposal
Page 5
It is hoped that the new program design and its assessment will inform several potential changes to immersive
learning at MIIS:
1) Incorporating pre-departure training into the Peru Practicum as it continues to develop.
2) Focusing on the cultivation of professional teamwork skills as a learning outcome for immersive learning
participants.
3) Advancing the process of creating and implementing pre-departure trainings for all international
immersive learning programs
Goals and Objectives
Goal Objective Intervention Mode of Assessment
Increased
understanding of
self
Students identify
and discuss their own
values, working
styles, and strengths,
and describe them in
discussions with their
teammates.
Individuals complete
assigned modules of
“What’s Up With Culture”
during Fall semester.
Guided discussions and
activities in which students
reflect on their individual
and team working styles,
interpersonal skills, and
intercultural
preparedness.
Time-series survey completed by participants before
pre-departure training, immediately afterward, and
just before return from destination country. Survey
includes Likert-type and open-ended questions.
Survey items will measure:
Students’ confidence identifying and describing their
strengths and skills.
Students’ confidence describing their working styles.
Students’ confidence and perspective on discussing
their values.
Increased
understanding of
Others
Students identify
and discuss the
working styles,
strengths, and values
of their colleagues.
Students are willing
to shift perspective
and behavior in
different cultural
contexts.
In addition to the activities
above:
Students establish duties
and roles within their
teams based on the
strengths and working
styles of team members.
Time-series survey (described above).
Survey items will measure:
The items above, in reference to team members.
Students’ confidence about interacting with locals in
destination country.
Students’ comfort level with changing their behaviors
and perspectives.
Students’ self-assessment of their preparedness for
going to the destination country.
Assessment Proposal
Page 6
Shared Purpose
Among Teams
Students agree on
and can describe
their team’s goals
for their project.
Students express
commitment to their
team and project.
Students collaboratively
write mission statements
for their teams. Each team
will have a mission
statement.
Time-series survey (described above).
Survey items will measure:
Students’ perceptions of team agreement on goals.
Students’ perceptions of team commitment.
Students’ perceptions of their team’s level of
responsibility toward their external partners.
Improved Team
and Intercultural
Communication
Students establish
frameworks for
feedback and
communication within
their teams.
Students reflect on
their ability to
communicate and
understand while in
destination country.
Assigned modules of
“What’s Up With Culture”.
Language practice nights
throughout semester.
Students practice giving
each other both positive
and critical feedback.
Time-series survey (described above).
Survey items will measure:
Students’ perceptions of their ability to get and to
give constructive feedback in their group.
Students’ confidence about their ability to interact
with local people in the destination country.
How students handle interactions or messages they
do not immediately understand.
Team Resilience Students are
confident that their
teams can function
when faced with
internal and/or
external challenges.
Role-playing through
potential disagreements
or conflicts.
“Sick Day” simulation.
Time-series survey (described above).
Survey items will measure:
Students’ perception of their team’s ability to handle
disharmony.
Students’ perception of their team’s ability to
function in unexpected circumstances.
ASSUMPTIONS & RESEARCH QUESTIONS
Assumptions
1) The Peru Practicum will remain connected to a policy class and free of prerequisites for 2015, therefore
drawing a similar body of participants compared to 2014.
2) Increased pre-departure attention to intercultural competence and team dynamics will enable students
to better perform the tasks required on their fieldwork practicum.
3) Students who actively cultivate intercultural competence and team dynamics before departure will
continue cultivating them during their practicum.
4) Because some skills have been identified in literature as relevant to both intercultural competence and
team dynamics, assessing those skills provides insight on both intercultural competence and team
dynamics.
Assessment Proposal
Page 7
5) The proposed training will have some impact on key skills that contribute to both intercultural competence
and team dynamics, when compared to having no such training.
6) The proposed training will not worsen intercultural competence or team dynamics.
7) Team competence will emerge differently for each team, because they are composed of different
members.
Research Question
1) Do the intercultural and team competency skills targeted in the pre-departure training change for
students upon completion of the pre-departure training?
2) Do the intercultural and team competency skills targeted in the pre-departure training change for the
students from the time they complete the pre-departure training to the time they complete the field
component of the practicum?
3) Which pre-departure training activities do students describe as the most useful?
MODES OF ASSESSMENT
Time-Series Survey
The research questions above will all be addressed through a time-series survey. The survey is 30 questions
long, with 20 Likert-type questions and ten open-ended ones in which students can write responses. Survey
questions were designed to measure specific skills or behaviors from each of the five dimensions identified as
components of both team and intercultural competency. The survey instrument has been designed specifically
for this assessment, based on a literature review of existing instruments. The possibility of using an existing
instrument was considered, but the majority of intercultural competency instruments found during the literature
review are not freely accessible. Intercultural instruments such as the well-known Intercultural Development Index
must be administered by certified professionals and are costly to pay for. Additionally, the only instrument
found that addresses both teamwork and intercultural competency (also not freely available) was designed
specifically for assessing executives in a business context, rather than team members of equal status in a
fieldwork context.
Both Likert-type questions and open-ended questions have been included for several reasons: Likert-type
questions make it easy to assign numerical values to responses, facilitating the calculation of means, ranges, and
changes over time for different items. Such calculation also enables statistical tests of significance, to determine
whether any changes that occur are significant as opposed to being the outcome of the random changes that
would occur whether or not students participated in the training. By providing open-ended questions, the survey
allows students to express whether the concepts measured in the Likert-type questions have been relevant in
their experience, and how they have played out.
Using a time-series survey will enable the tracking of any changes that occur from the time it is first administered
to the time students are ready to return from abroad, and will ideally highlight whether any changes occur
immediately after the pre-departure training. The survey will be administered three times: For the first time
during the second half of the Fall semester, after students have been assigned their project teams and had some
time to work with each other; for the second time immediately at the end of the pre-departure training
workshop; for the third and final time while students are still in the destination country, just before they return
Assessment Proposal
Page 8
to the U.S. The reason for administering the survey a third time is to assess whether any changes that result from
pre-departure training carry through students’ experiences on the ground in their destination country.
The first time the survey is administered, it will only have 28 questions. Questions 29 and 30 are open-ended
questions in which students are asked to share their thoughts on the effectiveness of the pre-departure training
program and how it might be improved. These questions will be added to the end of the survey for the second
and third times it is administered.
Reflection Paper
In addition to the survey, students will complete two very short reflection papers (no more than one page long
if typed and double-spaced). The first reflection paper will be completed immediately after the pre-
departure training, and the second paper will be completed just upon return from abroad. In these papers,
students will more generally discuss how prepared they are or were to work in the field, and the skills learned
or required. Reflection papers have been included in the past as part of the immersive learning program,
although they were only completed upon students’ return. Creating a two-part reflection assignment more
specifically focused on the outcomes of the pre-departure training will increase the usefulness of this practice,
while allowing room to see if students change or develop their ideas. Like the surveys, these reflection papers
will be submitted with codes rather than names or identifying information.
Analysis of Data
Survey data will be analyzed both quantitatively and qualitatively. Responses to Likert-type questions will be
converted to numbers, allowing for an ANOVA test for changes of response means from one round of surveys
to the next. Within the ANOVA, pairwise t-tests will reveal the degree of change between the first and second
round, between the second and third round, and between the first and third round, revealing the time period
during which the most significant changes occur (if, indeed there are significant changes). In addition to
comparing the group means of the surveys, changes across individuals can be tracked and will provide a rich
amount of descriptive data. For example, it will be possible to track the percentage of participants who
experienced negative or positive changes on each item. Each individual’s change of responses can be mapped
on a chart, allowing for the plotting of different learning or development patterns. It will also be possible to
calculate the degree of change for each person, which may provide a somewhat more detailed picture than
the group means. All of these calculations can be quickly performed with computer software.
Understanding the patterns of change and learning is where the open-ended data can help complement the
quantitative data. For instance, if it is observed that a number of students actually experienced a reduction in
confidence on a certain item, their qualitative responses may reveal that they realized the matter was more
complex or difficult than originally thought. Responses to open-ended questions will be coded for themes that
can flesh out or explain the results found through quantitative analysis. This qualitative data may also provide
information outside of what was captured in the quantitative data.
Reflection paper data will also be coded for themes. The pre-practicum and post-practicum reflections will be
compared with each other (recall that reflections are matched with each other by their identifying codes, so
they can be analyzed as individual pairs or as a group). The reflection paper data is intended to provide
before and after snapshots of how students assess their own preparedness and their own experience of learning
Assessment Proposal
Page 9
throughout the practicum process. Any common themes in student self-assessment can be compared to the
changes or themes that emerge from the survey data. For instance, it may be interesting to compare students’
reflections on whether their skill levels have changed to any changes calculated from the surveys.
SAMPLING & LOGISTICS
Sampling
The time-series survey is intended to be a Census survey of the entire population of participants in the 2015 J-
term practicum. Participating students are those who are enrolled in the Fall policy class that precedes the J-
term practicum and who have committed to participating in it. If students complete the first survey but then
decide not to continue in the program, they will be invited to complete the additional two surveys anyway. This
necessitates including a survey question that identifies whether the person taking the survey is participating in
the full program or not. Should any students complete the surveys without completing the training and the
immersive learning program, they will comprise something of a comparison group. Additionally, it is possible
that some students from outside of the policy class will decide late in the semester to join the practicum. These
students will be asked to complete all surveys, provided they have joined the program early enough. Otherwise
they may only be able to complete the second two surveys. Only students who participate in the pre-departure
training and the practicum will be asked to write the two short reflection papers.
Maintaining Anonymity
As mentioned, surveys will be identified with codes to maintain the anonymity of respondents. The same codes
will be used for the reflection papers. Respondents will be guided in how to create their own codes, so that
only they know which code belongs to them. Students will be given specific criteria so that they can easily
make the same code for themselves each time they respond to a survey. The instructions to create the code
are included at the beginning of the survey, attached in Appendix A.
Managing Response Rates
Much like a course evaluation, this survey will be considered a component of the class unless students ask to be
exempt. However, because responses are anonymous it is only possible to know how many students have
responded - not which students have responded. Furthermore, ethics require telling students that the survey is
voluntary. There will be no negative consequences for failure to complete it. To encourage response rates,
therefore, students will be encouraged to incentivize each other to all complete the survey by each pledging
an incentive to share with the class if all students complete a round of the survey by the designated deadline.
As currently planned, students will have one week for each of the survey rounds. A Facebook event will be
created for the assessment to send out reminders, to plan incentives such as bringing candy, snacks, or coffee
upon survey completion day, and to thank students for their participation.
Survey Distribution
There are online and paper options for administering the survey. The paper survey is attached to this document.
The online survey is in Google Forms. A link to the online survey can be sent by the student liaisons of the
program to all known program participants via the email they have provided to their professor for
Assessment Proposal
Page 10
correspondence regarding the J-term practicum (generally their MIIS email). Google Forms automatically
generates a spreadsheet of answers, without including the email addresses or other identifying information of
the respondents. Each survey round will remain available for one week provided response rates are high enough
within that time frame to close the survey. However, it may be easier to ensure high response rates by
administering paper surveys while students are in class, next while they are at the pre-departure training, and
finally just before they leave from the destination country. This eliminates potential complications due to lack of
Internet access in the destination country, and also may lead to higher response rates. However, it has the
disadvantage of requiring manual data input, and lacks the automatic summary analysis provided by Google
Forms. Additionally, handwritten answers may be illegible. As the details of the Fall 2015 program emerged,
both paper and online options will be considered. Reflection papers can also be submitted on Google Forms or
on paper.
RESOURCES
Human Resources
The greatest and most available resource at MIIS is its people, and there are many ways to incorporate them
into the assessment process. This assessment proposal and the program it is designed to accompany have both
been created by students in the IEM (International Education Management) Program Design & Assessment class.
It is likely that pre-departure trainings and immersive learning assessments will be created and refined through
several iterations, providing an ongoing opportunity for IEM students to address program design and assessment
needs through the framework of their classes. Much can be accomplished through a partnership between the
IEM department and program stakeholders. Additionally or alternatively, should the ICC move forward with
conducting trainings and assessments for all international immersive learning programs, an internship or work
study position could be created for students who want to work in assessment and collaborate with the ICC
committee to implement and manage the assessment process.
In addition to the significant amount of expertise and personnel available through the IEM program at MIIS,
other departments on campus can participate in training practicum students. In 2014, a professor from
Translation and Interpretation provided a short informational session on how to work with interpreters. This can
be expanded to include practice sessions with T & I students, and perhaps some intercultural communication
workshops incorporating international students. International students, T & I students, and also student clubs can
assist with Spanish-language practice nights for practicum students who wish to improve their Spanish before
departure. A Spanish Conversation club already exists on campus, and the BUILD program of volunteer
language teachers includes Spanish most semesters.
Regarding assessment specifically, the Digital Learning Commons and the MetaLab on campus can both provide
assistance with the gathering and analysis of data. Staff at both places can provide one-on-one or group
workshops, and can also provide space for events.
Many professors on campus have significant experience in assessment and can be consulted for feedback on
assessment design and instrument validity. Professors consulted for this assessment were Meggan Madden, Jeff
Dayton-Johnson, and Kent Glenzer.
Assessment Proposal
Page 11
Scholarly Resources
In addition to the people on campus, much guidance in assessment can be found in existing documents. A full
list of references and recommended readings is provided in Appendix D
Material & Financial Resources
Administering surveys through Google Forms is free of cost. Printing surveys can be done on campus for a price
of $0.05 per page. If surveys are printed, the price will be $0.50/per survey. Based on the total number of
participants, the cost for printing hard copy surveys will range from $30.00 to $67.50. If surveys are printed
hardcopy, this cost could likely be covered by the funds provided to Papercut printing accounts at MIIS.
The Digital Learning Commons and the MetaLab can provide free access to data analysis software. Much of
the analysis for this assessment can be completed in Microsoft Excel or in a basic statistical program such as R
or SPSS.
Assessment Proposal
Page 12
APPENDIX A: THEORETICAL BASIS
Theoretical Basis for the Five Dimensions of Intercultural and Team Competency
1) Understanding of self
2) Understanding of others
3) Shared purpose
4) Communication
5) Resilience
Dimensions identified in literature review
Authors Instrument / Study Dimensions
Hamlin
(2008) citing
Lencioni
(2002)
Five Essential
Functions of a Team
1. Trust
2. Dealing with conflict
3. Commitment
4. Accountability
5. Attention to Results
Spreitzer,
McCall, &
Mahoney
(1997)
The Prospector: Early
Identification of
International
Executive Potential
1. Sensitive to cultural differences 8. Takes risks
2. Business knowledge 9. Seeks feedback
3. Courage 10. Uses feedback
4. Brings out the best in people 11. Is culturally adventurous
5. Integrity 12. Seeks learning opportunities
6. Insightful 13. Open to criticism
7. Committed 14. Flexibility
Van der Zee
& Brinkmann
(2004)
Intercultural Readiness
Check
1. Intercultural sensitivity
2.Intercultural communication
3. Intercultural relationship building
4. Conflict management
5. Leadership
6. Tolerance for ambiguity
Van der Zee
& Brinkmann
(2004)
Multicultural
Personality Check
1. Cultural empathy
2. Open-mindedness
3. Social initiative
4. Emotional stability
5. Flexibility
Assessment Proposal
Page 13
Deardorff
(2006)
Components of
Intercultural
Competence (top 15
of 22 listed)
1. Understanding others’ worldviews 9. Tolerating and engaging
ambiguity
2. Cultural self-awareness and 10. Deep knowledge and
understanding
capacity for self-assessment of culture (one’s own and
others’)
3. Adaptability and adjustment to 11. Respect for other cultures
new cultural environment 12. Cross-cultural empathy
4. Skills to listen and observe 13. Understanding the value of
5. General openness toward cultural diversity
intercultural learning and to 14. Understanding the role and
impact
people from other cultures of culture and the impact of
6. Ability to adapt to varying situational, social, and historical
intercultural communication contexts involved
and learning styles 15. Cognitive flexibility - ability to
7. Flexibility switch frames from emic to etic
and
8. Skills to analyze, interpret, back again
and relate
These many dimensions of team functioning, leadership, and intercultural competence were narrowed down
according to which ones were relevant both to team dynamics/leadership and to intercultural competence.
That initial list yielded the following
Sensitivity to culture
Self-knowledge
Flexibility
Tolerance for Ambiguity
Open-mindedness
Empathy
Courage
Emotional Stability
Willingness to take risks
Listening
Seeks learning opportunities
Social initiative
Relationship building
Attention to results
Problem solving
Conflict management
Commitment
Trust
Shared sense of purpose
Bringing out the best in people
Seeking and giving feedback
Accountability
Assessment Proposal
Page 1
Items from the above list were then grouped into categories:
Understanding self
 Self knowledge
 Emotional stability
Understanding others
 Sensitivity to culture
 Open-mindedness
 Empathy
 Relationship-building
 Social initiative
 Listening
 Bringing out the best in
people
Shared purpose
 Shared sense of purpose
 Commitment
 Attention to results
 Willingness to take risks
Communication
 Seeking and giving
feedback
 Problem solving
 Trust
 Accountability
Resilience
 Flexibility
 Tolerance for ambiguity
 Problem solving
Conflict management
This list was further refined based on two criteria:
Can this dimension be reasonably expected to change in the period of time we are testing?
Is this dimension specifically targeted in the pre-departure training?
This resulted in the elimination of traits that would not likely change in the course of the study timeframe, such
as tolerance for ambiguity, emotional stability, willingness to take risks, and basic problem-solving skills.
Additionally, those dimensions not addressed by pre-departure training were eliminated, such as listening,
social initiative, and attention to results.
Final list of survey items:
Understanding self
 Self knowledge
Understanding others
 Sensitivity to culture
 Open-mindedness
 Empathy
 Bringing out the best in
people
Shared purpose
 Shared sense of purpose
 Commitment
Communication
 Seeking and giving
feedback
 Trust
 Accountability
Resilience
 Flexibility
Conflict management
Assessment Proposal
Page 1
APPENDIX B: REFERENCES & RECOMMENDED READINGS
References
Deardorff, D. (2006). Identification and assessment of intercultural competence as a student outcome of
internationalization. Journal of Studies in International Education, 10(3), 241-266.
Hamlin, J.L. (2008). Team effectiveness: A validation of Lencioni’s Five Functions of a Team. (Unpublished
doctoral dissertation). University of La Verne, California.
Spreitzer, G.M, McCall, M.W., & Mahoney, J.D. (1997). Early identification of international executive
potential. Journal of Applied Psychology, 82(1), 6-29.
Van der Zee, K., & Brinkmann, U. (2004). Construct validity evidence for the Intercultural Readiness Check
against the Multicultural Personality Questionnaire. International Journal of Selection and Assessment,
12(3), 285-290.
Recommended Readings
Braskamp, L.A., Braskamp, D.C., & Engberg, M.E. (2013). Global Perspective Inventory (GPI): Its Purpose,
Construction, Potential Uses, and Psychometric Characteristics. Chicago: Global Perspectives Institute.
Retrieved from https://gpi.central.edu/index.cfm?myAction=Information.
Creswell, J. (2008). Educational Research. Planning, conducting and evaluation of quantitative and
qualitative research, Third edition. Upper Saddle River, NJ: Pearson
Deardorff, D., & Edwards, K. (2012). Framing and assessing students' intercultural competence in service
learning. In Clayton, Bringle, & Hatcher (Eds.) Research on Service Learning. Sterling, VA: Stylus.
Fantini,A. (2006). Assessment tools of intercultural communicative competence. Brattleboro, VT: Fantini.
Additional Resources
Intercultural Communication Institute. http://www.intercultural.org/tools.php
Intercultural Development Inventory. https://idiinventory.com/
Assessment Proposal
Page 2
APPENDIX C: SAMPLE IRB APPLICATION
IRB application Questions
1. Applicants
Principal Investigators
Cortney Copeland : MIIS Student
Maritza Munzón : MIIS Student
Faculty advisor: To be determined by June 1, 2014.
Advisor's Email
Advisor's Department or Program
Advisor's address
Advisor's signature
Please attach an email from your advisor acknowledging that he or she has reviewed and
approved your research plan. The email must be an exact duplicate (PDF, HTML, pict, or jpg
format) of the original email sent from your advisor’s institutional email address and must
contain this (or equivalent) wording:
I have reviewed this research plan and am satisfied that the proposed research design and
the measures proposed for the protection of human subjects are adequate. I certify that all of
the information contained in this proposal is truthful, to the best of my knowledge.
2. Type of application: New Application
3. Type of project: Independent study (500-level)
4. Principal investigator: Cortney Copeland
5. Email: ccopeland@miis.edu
6. Title or year of graduation: 2015
7. Department or Program: IEM/MPA
8. Address:
580 Jefferson St. # 6
Monterey, CA 93940
9. Co-PIs: Maritza Munzón
10. Project title: Assessment of Key Intercultural and Team Competency Skills for MIIS Immersive Learning
Participants
11. Start date: November 15th 2014
12. End date: March 15th 2015
13. External funding (grant or fellowship)?: None
14. Research question: Do MIIS J-term policy practicum students demonstrate changes in key intercultural
and team competency skills as a result of participating in the newly designed pre-departure training
that targets these skills?
15. Target demographic: Please see the “Sampling” section on page 8 of Assessment Proposal
16. Estimated number of subjects: Between 25 and 45
Assessment Proposal
Page 3
17. Subject types you will include
Check all that apply, in whole or in part, to your subject pool.
Children (17 years or younger)
Cognitively impaired persons
Prisoners
Pregnant women
Elected or appointed officials or candidates for public office
None of the groups listed above
If another targeted population, please describe.
18. Study location:
Monterey, CA. Survey is distributed online but subjects will be in Monterey at the time of survey
administration.
19. Cooperating institution: Monterey Institute of International Studies
20. Non-physiological data collection methods
Select all methods of data collection you will use to perform your research.
Survey: you will distribute an electronic or paper survey to subjects.
Please see the “Sampling & Logistics” section on pages 8-9 of the Assessment Proposal. The
“Maintaining Anonymity” section will be of particular relevance to this question.
Student Reflection Papers: We will collect student writing in response to given prompts.
21. Exposures
Will your subjects be exposed to any of the conditions or substances listed here? Check all
that apply.
Clinical drug research of any kind
Exposure to X-rays or microwaves
Use of devices not controlled by the FDA
Ingestion of substances that are outside of FDA food guidelines
None of the exposures listed here.
Other exposure, not listed above.
22. Exercise
Will you require your subjects to perform exercise, and at what level of exertion?
No exercise
Yes, mild exertion
Yes, moderate exertion
Yes, extreme exertion
Assessment Proposal
Page 4
23. Physiological data collection, non-invasive
Check all that apply
Physical sensors on or near the body
Sensory acuity testing
Weight measurements
No non-invasive measurements
Other non-invasive method? Please supply a brief description.
24. Physiological data collection, bodily materials
Deciduous teeth or dental plaque
External secretions
Saliva, urine, or blood samples
Nail or hair clippings
None of the above
Other materials? Please describe the samples you will collect.
25. Will data be collected anonymously?
Anonymous: collected in such a way that it can NEVER be connected to individual persons, and even you
won't know which participant provided which data.
Yes, data will be collected anonymously as detailed in the “Sampling and Logistics” portion of the
Assessment Proposal
26. Will data be collected confidentially?
Confidential: You will protect your subjects' identifying information from access by anyone besides yourself,
your co-PIs, and/or your faculty advisor.
No person apart from the subjects themselves will know the subjects’ identifying information. Subjects
will identify themselves by a code, as described on pages 8-9 of the Assessment Proposal.
27. Will identifiers be removed?
No identifiers other than a code will be included in the data. The code will not include any identifying
information.
28. Will you take video recordings or photos?
No.
29. Will you make voice recordings?
No.
Assessment Proposal
Page 5
30. Personal records
Will you use personal (non-public) records as sources of data? Choose as many options as apply:
Health care records
Educational records
Drug & alcohol records
Psychiatric records
Psychiatric records
No personal non-public records
Other non-public personal records? Describe here.
31. Deception
Will your research require you to deceive your subjects to get the data you want?
No, our research will not require deception.
32. Civil liability
No. The information they are sharing is largely self-assessment of their own skills and competencies at
working in an intercultural team. They will not be directly sharing information about other people, nor
will they be disclosing sensitive information.
33. Criminal liability
No. They are only being asked to fill out a survey about themselves and their experience of the
program, in addition to writing short reflection papers. They will not be asked to do anything illegal or
potentially harmful.
34. Financial or employment risk
No. They are not disclosing any information that could, if traced back to them, jeopardize their
employment or finances. The fact that they have participated in the study will not be shared beyond
the group of people involved in the study. They are not being asked to disclose any information about
employers or potential employers. They are not being asked to disclose any financial information.
35. Social risk
No. Participating in research surveys and evaluations is a common practice at MIIS since many students
and faculty survey students for their research, and since all courses have a required course evaluation.
Students participating in the survey, although they do disclose their general experience of having
worked with their team, are not asked to evaluate specific team members and are not prompted to
disclose negative experiences. Their responses are kept anonymous.
36. Stress
How would you describe the effects of your data collection on your subjects?
A potentially stressful experience
Not at all stressful
Assessment Proposal
Page 6
Because the survey takes time and effort, it may cause some level of stress since students have many
other things to do. We have tried to mitigate this by piloting the survey, ensuring that the questions
make sense, and by eliminating extraneous or vague questions.
37. Protections for vulnerable populations
If you will use subjects from any group that the federal government identifies as "vulnerable" populations
(children, pregnant women, prisoners, cognitively impaired persons), describe the special protections you
will employ. (If no vulnerable subjects, put "N/A.")
N/A
38. Plan to ensure confidentiality
Unless participants explicitly waive their right to privacy, all work with human subjects is presumed to be
confidential. Please describe as specifically as possible what measures you will take to ensure that your data
are not accessible to anyone besides you (and your advisor, if you are a student).
Responses to the survey are automatically entered into a spreadsheet in a password-protected Google
Drive account. The data responses are only available to the primary investigators, who are the only two
parties who have access to the shared Google folder in which the data is stored. Once all responses
are gathered, the data will be downloaded as a CSV file, removed from the Google Drive, and saved
on a password-protected laptop computer belonging to one of the PI’s.
For reflection papers, students will be asked to sign a consent form allowing phrases from their papers
to be quoted and shared in the research results. Reflection papers will be anonymously identified by
codes, using the same method as used to identify surveys. Students who do not wish their paper to be
quoted will include an additional letter in their code to communicate that information. Papers will be
submitted via email and stored on a password-protected laptop computer.
39. Risk analysis
What immediate or long-term risks might participation in your research entail for your subjects? Think
carefully about not only possible physical risks, but also psychological, legal, financial, or social
consequences that could result from either participating or from accidental disclosure of such participation.
The sharing of negative results from the study, should there be findings that students have low levels of
competence or should their textual data describe negative experiences, could cause students some
psychological stress. Students who read the results, if the results are not positive, may feel disappointed,
criticized, or insulted. Any students who recognize their own words quoted may be uncomfortable with
the fact that they have been shared, or with the analysis accompanying them, even if the student has
consented and if the quote is anonymous.
Consideration will be taken when writing up and presenting results to avoid a taking a tone that is
critical of or insulting to students.
Recruiting procedure
All students potentially participating in the Peru J-term program (and, if expanded, the El Salvador
practicum) will be sent an initial email to announce the assessment. The email will be drafted by the PI’s
but sent by the student liaisons for the program. The PI’s will later visit the related Fall class to give a
short informational announcement about the assessment. To distribute the survey, an email with a link to
Assessment Proposal
Page 7
the survey will be sent to all students, again by the student liaisons. For the second round of the survey,
participants will be given time at the end of the pre-departure training to complete it (again via a link
sent to their email). The third round of the survey will be distributed via email.
Reminder emails will be sent to encourage response if not all students respond within the designated
time frame.
40. What subjects will do
What will subjects be asked to do in your study? How long will their participation last? How many parts
will there be to their involvement?
Students will be asked to complete a survey three times over the course of approximately 2.5 months.
It is the same survey each time, with the exception that the first survey will be two questions shorter (it
will not include questions 29 and 30 about the pre-departure training). The survey is 30 questions long,
and consists of 20 Likert-type questions and 10 open-ended questions.
Additionally, students will be asked to write two one-page reflection papers over the course of
approximately 1.5 months. The topic will be the student’s idea of which skills are important for their
field project, their level of preparedness, and how their experience may impact their future.
Attach copies of all tests, questionnaires, or other materials you will use for collecting data to the end of this
application; see question 50
41. Consent
Please indicate how you will obtain your subjects' consent. Informed consent is required from ALL human
subjects. A signed written form is normally expected as evidence that informed consent has been obtained,
but the IRB will consider arguments for using oral consent. If your subjects are unable to give legal consent
themselves (i.e., they are younger than 18 or cognitively impaired), you must get both written consent from
a guardian and oral assent from the subject.
Attach a copy of your consent form or text, your script for obtaining oral consent, or both the written
consent form for guardians and the script for obtaining oral assent to the end of this application; see
question 48.
A paragraph at the beginning of the online survey acknowledges that by filling out the survey, they are
consenting to having the data analyzed and the results shared for purposes of improving the program.
That paragraph is included with the attached copy of the survey questions.
42. Benefits to participants
What benefits, if any, might participants get from your research?
Participants will have the opportunity to process and reflect on their learning experience, which can
deepen learning and memory. They will know that they have contributed to improving the program (this
is stated in the introductory paragraph to the survey). They will also have access to the results of the
assessment, which can provide an additional learning opportunity, and a chance to see a report of any
positive changes in skill levels (a potentially affirming or encouraging experience). If all students
complete the surveys, the group will be provided a small incentive such as candies.
Assessment Proposal
Page 8
43. Benefits to discipline or society
This assessment measures the effectiveness of a new pre-departure training program for students
traveling abroad for a practicum in international development. It will serve as a tool to help improve
such training programs, and, if they are effective, promote them. The assessment will therefore contribute
to the discussion of best practices in international and immersive learning. It will provide important
information to the field of international education by contributing to the body of work regarding
intercultural competence. The approach of assessing both team competence and intercultural
competence is a new approach, and may provide useful insight to MIIS as an institution. Teamwork skills
are vital for graduates who will likely work in teams during their career. Assessing how to cultivate such
skills will help MIIS to do so, better preparing its graduates for the workforce and helping contribute
strong, capable professionals to important international fields such as international development and
international education.
Additionally, practicum students who are interculturally competent and skilled at working in professional
teams will hopefully create a positive impression on the communities they visit in the destination country,
and provide useful services to the social change organizations working there. Improving pre-departure
training for international practicum programs will hopefully improve the impact of the programs
themselves, for students, for partner organizations, and for the communities.
44. Status report (required for all renewals and extensions)
Attach a status report of the project to date, including:
• The number of subjects accrued
none
• A summary of adverse events and any unanticipated problems involving risks to subjects or others and
withdrawal of subjects from the research or complaints about the research since the last review
none
• A summary of any relevant amendments or modifications to the research since the last review
none
• Any other relevant information, especially information about risks associated with the research
none
• A copy of the current informed consent document and any newly proposed consent document
45. Research protocol (required for all projects)
See Assessment Proposal
46. NIH certificate or equivalent (required for all projects)
Attach the certificate you earned by completing NIH's training course in research with human subjects
(http://phrp.nihtraining.com/users/login.php) or documentation of equivalent training.
Assessment Proposal
Page 9
47. Consent materials (required for all projects except those using surveys, restricted databases, or
secondary sources)
Attach a copy of your text for obtaining written informed consent, your script for obtaining oral consent
or assent, or both (as appropriate for your project).
See question 49 below.
48. Survey (required for all surveys)
Please attach an exact final copy of the survey you will use. Your survey should include the following consent
statement:
You have been asked to complete this survey as part of a research project conducted by [NAME OF PI], a
student
[FACULTY/STAFF MEMBER] at Middlebury College. The research project is called [NAME OF PROJECT]
and is designed to [PURPOSE OF RESEARCH]. Your responses are entirely voluntary, and you may refuse
to complete any part or all of this survey. This survey is designed to be anonymous, meaning that there
should be no way to connect your responses with you. Toward that end, please do not sign your name to
the survey or include any information in your responses that makes it easy to identify you. By completing
and submitting the survey, you affirm that you are at least 18 years old and that you give your consent for
[PI] to use your answers in [his/her] research. If you have any questions about this research before or after
you complete the survey, please contact [PI and PI CONTACT INFO]. If you have any concerns or questions
about your rights as a participant in this research, please contact the Chair of the Middlebury College
Institutional Review Board, Michael Sheridan, at 802‐443‐5582 or msherida@middlebury.edu.
49. Interview/Questionnaire (required for all projects that are not surveys or research in restricted
databases/secondary sources)
Attach exact final copies of any written materials you will use to obtain data from your
subjects. If you will use more than one instrument, please combine them into a single document for upload.
50. Institutional permissions (required if your research will take place away from your
home institution)
If you will perform your research through an organization other than your home institution, please attach
an exact duplicate (PDF, HTML, pict, or jpg format) of the original letter or email of permission or support
from the institution where you will do the work.
Examples: If you are a Middlebury student and plan to work with children in the local schools, attach a
letter or email from each school. If you will conduct research on the Middlebury campus during the Language
School session, attach a letter or email from the director of the appropriate school(s). If you will work at a
hospital, on another campus, with an NGO, in a company office, etc., you need this documentation.
N/A
Assessment Proposal
Page 10
51. Grant proposal (required if your project will be funded by an external sponsor)
N/A
52. Other documents
Attach any other documents needed to help the IRB understand what you intend to do and how you intend
to do it.
If you have more than one additional document to attach, please combine them into a single document for
upload.
53. Survey certification (required for surveys only)
I am familiar with the Middlebury College Policy on Protection of Human Subjects and will comply with all
of its ethical requirements. I certify that my research will include no other mechanism for data collection
beyond the anonymous survey attached to this application. I certify that all other information in this
application is truthful, and that I will inform the IRB if I make significant changes to the proposed study.
I have read this certification and, by submitting this application, agree to abide by its terms.
54. Submission certification (required for all other types of data collection)
I am familiar with the Middlebury College Policy on Protection of Human Subjects and will comply with all
of its ethical requirements. I certify that my research will include no other mechanism for data collection
beyond the methods described in, and the materials attached to, this application. I certify that all other
information in this application is truthful, and that I will inform the IRB if I make significant changes to the
proposed study.
I have read this certification and, by submitting this application, agree to abide by its terms.
Assessment Proposal
Page 11
APPENDIX D: REFLECTION PROMPTS
Reflection 1: To be completed upon finishing pre-departure training.
Please describe the skills, attitudes, knowledge, and/or preparation you think will be most useful to you while
in Peru. In what ways might you apply them? In what ways do you think you may be challenged to grow as an
international professional?
Reflection 2: To be completed upon returning to Monterey.
Please describe the skills, attitudes, knowledge, and/or preparation that were most useful to you while in Peru.
In what ways did you apply them? In what ways were you challenged to grow as an international professional?
Assessment Proposal
Page 12
APPENDIX E: SURVEY INSTRUMENTS
Thank you for sharing your thoughts and experiences with us. This survey will be used to help
improve how we prepare students for international immersive learning programs. It is part of our long-
term goal to improve student learning outcomes, while improving impacts for our international community
partners.
You have been asked to complete this survey as part of a research project conducted by Cortney
Copeland and Maritza Munzón, students at the Monterey Institute of International Studies. The research
project is called Assessment of Key Team and Intercultural Competence Skills and is designed to evaluate
the effectiveness of the pre-departure training for the J-term practicum programs in Peru and El Salvador.
Your responses are entirely voluntary, and you may refuse to complete any part or all of this survey. This
survey is designed to be anonymous, meaning that there should be no way to connect your responses
with you. Toward that end, please do not sign your name to the survey or include any information in your
responses that makes it easy to identify you. By completing and submitting the survey, you affirm that you
are at least 18 years old and that you give your consent for Cortney Copeland and Maritza Munzón to use
your answers in their research. If you have any questions about this research before or after you complete
the survey, please contact ccopeland@miis.edu. If you have any concerns or questions about your rights
as a participant in this research, please contact the Chair of the Middlebury College Institutional Review
Board, Michael Sheridan, at 802‐443‐5582 or msherida@middlebury.edu.
You will be asked to complete this survey a total of three times in the next several weeks. No
personally identifying information will be connected to your survey responses. None of your survey
responses will impact your grades for your immersive learning or related classes. Please answer all
questions to the best of your ability. We appreciate the time and energy you are putting in to improving
immersive learning at MIIS. Your input is important.
Anonymity Code - Please create a five-part code to identify your survey. You should create the same code
every time you take this survey.
Example: N152T2
Character 1: The third letter of your mother’s first name. Please enter a capital letter. If you have two mothers
or two fathers, use the name that comes first in alphabetical order.
Character 2: The number of four-legged pets you have ever had. Example: Somebody who has only ever had
an aquarium full of fish would enter “0” since fish do not have four legs. Somebody who has 10 horses would
enter “10”.
Character 3: The number of cars you have ever owned. Yes it counts if somebody else bought the car for you.
Character 4: If you generally prefer drinking coffee, enter “C”. If you generally prefer drinking tea, enter “T”.
If you generally prefer both equally, enter “B”. Please enter a capital letter.
Character 5: The number of countries you have lived in for two months or longer. Example: If you spent your
childhood in Japan, moved to the US, and then spent a college semester studying in Argentina, you would enter
“3”.
Assessment Proposal
Page 13
Section 1: Strengths, working styles, and values
1. I can describe to my colleagues what my working style is like. (Ex: “I like to tackle something right away and
reflect later,” or “I do my best work when I’m by myself first thing in the morning”).
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to describe your working style to your peers?
Very important Somewhat important Not important at all
2. I can articulate to my colleagues the strengths and skills I contribute to our team.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to describe the strengths and skills you contribute to your team?
Very important Somewhat important Not important at all
3. I can describe what my colleagues’ working styles are like.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it to know the working styles of your colleagues?
Very important Somewhat important Not important at all
4. I can describe how each of my colleagues contributes to our team.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it to know how your colleagues contribute to your team?
Very important Somewhat important Not important at all
5. I can discuss personal values with my colleagues, whether or not we share the same ones.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
Assessment Proposal
Page 14
How important is the ability to discuss personal values within your team?
Very important Somewhat important Not important at all
6. I can discuss professional values with my colleagues, whether or not we share the same ones.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to discuss professional values within your team?
Very important Somewhat important Not important at all
7. In working with your team, how important has it been to discuss each other’s values?
Do values play a role in your interactions with your team? Do they affect your team’s work? Please share your
thoughts and experiences.
Assessment Proposal
Page 15
8. How important has understanding your own and your colleagues’ values been while working in the destination
country? How important is it to understand the values of the people you interact with outside of your team? Please
share your thoughts and experiences.
9. How have activities related to your J-term project impacted your understanding of your strengths, working
styles, or values? Those of your teammates? Such activities might include, (among other things), class work, J-
term related social events, individual and group pre-departure training activities, meetings, and in-country
experiences.
Section 2: Purpose and performance
10. My colleagues and I can describe the goals of our project in such a way that we all agree.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it for your team to agree on how to describe project goals?
Assessment Proposal
Page 16
Very important Somewhat important Not important at all
11. I am confident that my colleagues are committed to the decisions we agree upon as a team.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it that your colleagues are committed to team decisions?
Very important Somewhat important Not important at all
12. My team has the ability to handle disharmony.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to handle disharmony in your team?
Very important Somewhat important Not important at all
13. My team can function productively when things do not go as planned or expected.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability of a team to function when things do not go as planned or expected?
Very important Somewhat important Not important at all
14. My team acts with a sense of responsibility toward the organization with which we are working.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it that your team is responsible to your partner organization?
Very important Somewhat important Not important at all
15. My team acts with a sense of responsibility toward the community we are visiting.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it that your team is responsible to the community you are visiting?
Assessment Proposal
Page 17
Very important Somewhat important Not important at all
16. Please share your thoughts/experiences regarding the establishment of and commitment to goals within your
team. What has your team done and discussed throughout this process?
17. How have activities related to your J-term project impacted your team’s ability to function? Such activities
might include, (among other things), class work, J-term related social events, individual and group pre-departure
training activities, team meetings, and in-country experiences.
Section 3: Culture and communication
18. I usually know what my colleagues are working on.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it to know what your colleagues are working on?
Assessment Proposal
Page 18
Very important Somewhat important Not important at all
19. I can get constructive feedback from my colleagues.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to get constructive feedback from your colleagues?
Very important Somewhat important Not important at all
20. I can give constructive feedback to my colleagues.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to give feedback to your colleagues?
Very important Somewhat important Not important at all
21. I am confident in my ability to interact and communicate in culturally appropriate ways with the local people
in my team’s destination country.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it to know the culture and language of people from another country before interacting with
them?
Very important Somewhat important Not important at all
22. I am confident in my ability to adapt my behavior according to different cultural contexts.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it to adapt one’s behavior according to cultural context?
Very important Somewhat important Not important at all
23. I can shift how I view a situation based on how other people might see it.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is the ability to see a situation from other people’s perspectives?
Assessment Proposal
Page 19
Very important Somewhat important Not important at all
24. I feel prepared to live, work and function effectively in another culture.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is your level of preparation before being immersed in another culture?
Very important Somewhat important Not important at all
25. Going out of my way to understand cultural differences enhances my own learning experience.
Strongly agree Somewhat agree Neither agree nor
disagree
Somewhat disagree Strongly disagree
How important is it to make a conscious effort to learn about cultural differences?
Very important Somewhat important Not important at all
26. When people in your team do or say things that don’t make sense to you, how do you feel and what do you
do?
27. When people in the community you’re visiting do or say things that don’t make sense to you, how do you feel
and what do you do?
Assessment Proposal
Page 20
28. How have activities related to your J-term project impacted how you interact with your teammates? How have
they impacted how you might interact or how you did interact with other people in your destination country? Such
activities might include, (among other things), class work, J-term related social events, individual and group pre-
departure training activities, team meetings, and in-country experiences.
29. Which pre-departure activities have been the most useful to you and your team?
Assessment Proposal
Page 21
30. What can we do to make the collection of pre-departure activities better? Please share your thoughts on what
should be included or left out, and how these things should be done.
Assessment Proposal
Page 22
APPENDIX F: SAMPLE RECRUITMENT EMAIL
Hi _________________________
We are working to improve the Team Peru program by creating a new pre-departure training. We
know you’ve answered a number of questions already, and shared a number of stories about your experience
(we have too!). However, your response to a short survey will be extremely helpful to us as we seek to
improve the program.
This is not another satisfaction survey or group share – we are asking for your participation in our
research. We are conducting an assessment of whether our new program helps build team and intercultural
competencies for student participants.
Your response to a survey on team and intercultural skills will give us useful data for our study. As
many of you know, forming a strong professional field team significantly contributes to the student learning
experience. It also impacts the quality of the contributions we make as partners with the Andean Alliance and
the communities of the Sacred Valley.
Please look for an email in the next few days from Team Peru student liaisons, with a link to the
survey. You will have one week from the time the survey opens to complete it. This is a time series survey,
and you will be asked to complete it three times in the next several weeks. Thank you for your participation!
Sincerely,
Cortney Copeland
Maritza Munzón
Assessment Proposal
Page 23
APPENDIX G: NIH CERTIFICATE
Assessment Proposal
Page 24

More Related Content

What's hot

HR Communication In Infosys
HR Communication In InfosysHR Communication In Infosys
HR Communication In InfosysNandita Sadani
 
A study of international human resource management- theories and techniques
A study of international human resource management- theories and techniques A study of international human resource management- theories and techniques
A study of international human resource management- theories and techniques Antara Rabha
 
Impact of welfare facilities on employee satisfaction @ forbes project report
Impact of welfare facilities on employee satisfaction @ forbes project reportImpact of welfare facilities on employee satisfaction @ forbes project report
Impact of welfare facilities on employee satisfaction @ forbes project reportBabasab Patil
 
International HRM case studies
International HRM case studiesInternational HRM case studies
International HRM case studieshassamsaeed3
 
Recruitment process at Bharti Airtel
Recruitment process at Bharti AirtelRecruitment process at Bharti Airtel
Recruitment process at Bharti AirtelSwarupa Rani Sahu
 
SIP PROJECT REPORT
SIP PROJECT REPORTSIP PROJECT REPORT
SIP PROJECT REPORTekta chawla
 
INTERNATIONAL MANAGEMENT - Developing a Global Cadre
INTERNATIONAL MANAGEMENT - Developing a Global CadreINTERNATIONAL MANAGEMENT - Developing a Global Cadre
INTERNATIONAL MANAGEMENT - Developing a Global CadreElena Malkawi
 
Cross culture pptz[1]..
Cross culture pptz[1]..Cross culture pptz[1]..
Cross culture pptz[1]..RMB cafe
 
RightPath Consultants Company Profile.pdf
RightPath Consultants Company Profile.pdfRightPath Consultants Company Profile.pdf
RightPath Consultants Company Profile.pdfRightpath Solution
 

What's hot (10)

HR Communication In Infosys
HR Communication In InfosysHR Communication In Infosys
HR Communication In Infosys
 
A study of international human resource management- theories and techniques
A study of international human resource management- theories and techniques A study of international human resource management- theories and techniques
A study of international human resource management- theories and techniques
 
Impact of welfare facilities on employee satisfaction @ forbes project report
Impact of welfare facilities on employee satisfaction @ forbes project reportImpact of welfare facilities on employee satisfaction @ forbes project report
Impact of welfare facilities on employee satisfaction @ forbes project report
 
International HRM case studies
International HRM case studiesInternational HRM case studies
International HRM case studies
 
Recruitment process at Bharti Airtel
Recruitment process at Bharti AirtelRecruitment process at Bharti Airtel
Recruitment process at Bharti Airtel
 
SIP PROJECT REPORT
SIP PROJECT REPORTSIP PROJECT REPORT
SIP PROJECT REPORT
 
INTERNATIONAL MANAGEMENT - Developing a Global Cadre
INTERNATIONAL MANAGEMENT - Developing a Global CadreINTERNATIONAL MANAGEMENT - Developing a Global Cadre
INTERNATIONAL MANAGEMENT - Developing a Global Cadre
 
Cross culture pptz[1]..
Cross culture pptz[1]..Cross culture pptz[1]..
Cross culture pptz[1]..
 
RightPath Consultants Company Profile.pdf
RightPath Consultants Company Profile.pdfRightPath Consultants Company Profile.pdf
RightPath Consultants Company Profile.pdf
 
International Human Resource Management
International Human Resource ManagementInternational Human Resource Management
International Human Resource Management
 

Similar to Assessment Proposal for Pre-Departure Training

Need analysis for curriculum development.pptx
Need analysis for curriculum development.pptxNeed analysis for curriculum development.pptx
Need analysis for curriculum development.pptxMuhammadHaikal83023
 
Entry exit survey summary
Entry exit survey summaryEntry exit survey summary
Entry exit survey summaryScottish TNE
 
Course evaluation summary report
Course evaluation summary reportCourse evaluation summary report
Course evaluation summary reportScottish TNE
 
Concept proposal quantitative research
Concept proposal quantitative researchConcept proposal quantitative research
Concept proposal quantitative researchJEFFREY PROJO
 
Lived experiences of educators engaged in contintuing professional developmen...
Lived experiences of educators engaged in contintuing professional developmen...Lived experiences of educators engaged in contintuing professional developmen...
Lived experiences of educators engaged in contintuing professional developmen...GlenCortezano1
 
Case Study of Multicultural Teaching Pedagogies Adopted.pptx
Case Study of Multicultural Teaching Pedagogies Adopted.pptxCase Study of Multicultural Teaching Pedagogies Adopted.pptx
Case Study of Multicultural Teaching Pedagogies Adopted.pptxDrNazishAndleeb
 
Syl edld 6368_783_2162_6001041377
Syl edld 6368_783_2162_6001041377Syl edld 6368_783_2162_6001041377
Syl edld 6368_783_2162_6001041377William Kritsonis
 
Enhancing learning and_teaching_in_higher_education_in_northern_ireland
Enhancing learning and_teaching_in_higher_education_in_northern_irelandEnhancing learning and_teaching_in_higher_education_in_northern_ireland
Enhancing learning and_teaching_in_higher_education_in_northern_irelandViewpoints, University of Ulster
 
Navigating Change: Recommendations for Advancing Undergraduate PR Education
Navigating Change: Recommendations for Advancing Undergraduate PR EducationNavigating Change: Recommendations for Advancing Undergraduate PR Education
Navigating Change: Recommendations for Advancing Undergraduate PR EducationSarah Jackson
 
Competency-Based Language learning for EFL.pptx
Competency-Based Language learning for EFL.pptxCompetency-Based Language learning for EFL.pptx
Competency-Based Language learning for EFL.pptxwddiraq
 
Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...
Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...
Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...iosrjce
 
431 assessment part 1
431 assessment part 1   431 assessment part 1
431 assessment part 1 Lauren Griffin
 
Assessment Of Research Faculty Development Program Efficacy In Writing Resear...
Assessment Of Research Faculty Development Program Efficacy In Writing Resear...Assessment Of Research Faculty Development Program Efficacy In Writing Resear...
Assessment Of Research Faculty Development Program Efficacy In Writing Resear...Natasha Grant
 
5000120743 5000277179-1-pb
5000120743 5000277179-1-pb5000120743 5000277179-1-pb
5000120743 5000277179-1-pbMarie Morales
 
The Student Success And Faculty Development Grant Programaacn
The Student Success And Faculty Development Grant ProgramaacnThe Student Success And Faculty Development Grant Programaacn
The Student Success And Faculty Development Grant ProgramaacnClayton State University
 
A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...
A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...
A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...Erica Thompson
 

Similar to Assessment Proposal for Pre-Departure Training (20)

Need analysis for curriculum development.pptx
Need analysis for curriculum development.pptxNeed analysis for curriculum development.pptx
Need analysis for curriculum development.pptx
 
Entry exit survey summary
Entry exit survey summaryEntry exit survey summary
Entry exit survey summary
 
Course evaluation summary report
Course evaluation summary reportCourse evaluation summary report
Course evaluation summary report
 
Concept proposal quantitative research
Concept proposal quantitative researchConcept proposal quantitative research
Concept proposal quantitative research
 
Student’s Preception Of Lecturer Achievement Index In Uhw Perbanas Surabaya W...
Student’s Preception Of Lecturer Achievement Index In Uhw Perbanas Surabaya W...Student’s Preception Of Lecturer Achievement Index In Uhw Perbanas Surabaya W...
Student’s Preception Of Lecturer Achievement Index In Uhw Perbanas Surabaya W...
 
Lived experiences of educators engaged in contintuing professional developmen...
Lived experiences of educators engaged in contintuing professional developmen...Lived experiences of educators engaged in contintuing professional developmen...
Lived experiences of educators engaged in contintuing professional developmen...
 
Case Study of Multicultural Teaching Pedagogies Adopted.pptx
Case Study of Multicultural Teaching Pedagogies Adopted.pptxCase Study of Multicultural Teaching Pedagogies Adopted.pptx
Case Study of Multicultural Teaching Pedagogies Adopted.pptx
 
Syl edld 6368_783_2162_6001041377
Syl edld 6368_783_2162_6001041377Syl edld 6368_783_2162_6001041377
Syl edld 6368_783_2162_6001041377
 
Enhancing learning and_teaching_in_higher_education_in_northern_ireland
Enhancing learning and_teaching_in_higher_education_in_northern_irelandEnhancing learning and_teaching_in_higher_education_in_northern_ireland
Enhancing learning and_teaching_in_higher_education_in_northern_ireland
 
Navigating Change: Recommendations for Advancing Undergraduate PR Education
Navigating Change: Recommendations for Advancing Undergraduate PR EducationNavigating Change: Recommendations for Advancing Undergraduate PR Education
Navigating Change: Recommendations for Advancing Undergraduate PR Education
 
Competency-Based Language learning for EFL.pptx
Competency-Based Language learning for EFL.pptxCompetency-Based Language learning for EFL.pptx
Competency-Based Language learning for EFL.pptx
 
Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...
Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...
Assessment of Prospective Teachers Attitudes towards Teaching Profession: The...
 
431 assessment part 1
431 assessment part 1   431 assessment part 1
431 assessment part 1
 
MDS NEW PROGRAMME(4) fLier
MDS NEW PROGRAMME(4) fLierMDS NEW PROGRAMME(4) fLier
MDS NEW PROGRAMME(4) fLier
 
Mds new programme(4) f lier
Mds new programme(4) f lierMds new programme(4) f lier
Mds new programme(4) f lier
 
Mds new programme(4) f lier
Mds new programme(4) f lierMds new programme(4) f lier
Mds new programme(4) f lier
 
Assessment Of Research Faculty Development Program Efficacy In Writing Resear...
Assessment Of Research Faculty Development Program Efficacy In Writing Resear...Assessment Of Research Faculty Development Program Efficacy In Writing Resear...
Assessment Of Research Faculty Development Program Efficacy In Writing Resear...
 
5000120743 5000277179-1-pb
5000120743 5000277179-1-pb5000120743 5000277179-1-pb
5000120743 5000277179-1-pb
 
The Student Success And Faculty Development Grant Programaacn
The Student Success And Faculty Development Grant ProgramaacnThe Student Success And Faculty Development Grant Programaacn
The Student Success And Faculty Development Grant Programaacn
 
A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...
A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...
A Tracer Study on the Graduates of Bachelor of Secondary Education Major in E...
 

More from Cortney Copeland

Proposed Pre-departure Training for Peru Practicum
Proposed Pre-departure Training for Peru PracticumProposed Pre-departure Training for Peru Practicum
Proposed Pre-departure Training for Peru PracticumCortney Copeland
 
Influences on peruvian education
Influences on peruvian education Influences on peruvian education
Influences on peruvian education Cortney Copeland
 
City of Dharma Realm field research report
City of Dharma Realm field research reportCity of Dharma Realm field research report
City of Dharma Realm field research reportCortney Copeland
 
SmartPak's Smart Advertising
SmartPak's Smart Advertising SmartPak's Smart Advertising
SmartPak's Smart Advertising Cortney Copeland
 
Hypermedia space in the Occupy movement: a sociological analysis
Hypermedia space in the Occupy movement: a sociological analysis Hypermedia space in the Occupy movement: a sociological analysis
Hypermedia space in the Occupy movement: a sociological analysis Cortney Copeland
 
Defining America: media discourse surrounding All-American Muslim
Defining America: media discourse surrounding All-American MuslimDefining America: media discourse surrounding All-American Muslim
Defining America: media discourse surrounding All-American MuslimCortney Copeland
 

More from Cortney Copeland (8)

Proposed Pre-departure Training for Peru Practicum
Proposed Pre-departure Training for Peru PracticumProposed Pre-departure Training for Peru Practicum
Proposed Pre-departure Training for Peru Practicum
 
Influences on peruvian education
Influences on peruvian education Influences on peruvian education
Influences on peruvian education
 
City of Dharma Realm field research report
City of Dharma Realm field research reportCity of Dharma Realm field research report
City of Dharma Realm field research report
 
Résumé
RésuméRésumé
Résumé
 
SmartPak's Smart Advertising
SmartPak's Smart Advertising SmartPak's Smart Advertising
SmartPak's Smart Advertising
 
Hypermedia space in the Occupy movement: a sociological analysis
Hypermedia space in the Occupy movement: a sociological analysis Hypermedia space in the Occupy movement: a sociological analysis
Hypermedia space in the Occupy movement: a sociological analysis
 
Defining America: media discourse surrounding All-American Muslim
Defining America: media discourse surrounding All-American MuslimDefining America: media discourse surrounding All-American Muslim
Defining America: media discourse surrounding All-American Muslim
 
Convocation spring 2012
Convocation spring 2012Convocation spring 2012
Convocation spring 2012
 

Recently uploaded

How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxPoojaSen20
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance  and worth of ideas part 2.pptxJudging the Relevance  and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptxSherlyMaeNeri
 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Jisc
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinojohnmickonozaleda
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup
 

Recently uploaded (20)

How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance  and worth of ideas part 2.pptxJudging the Relevance  and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptx
 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipino
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 

Assessment Proposal for Pre-Departure Training

  • 1. Cortney Copeland• Maritza Munzón Monterey Institute of International Studies IEM 8510 Design & Assessment• Dr. Meggan Madden ASSESSMENT PROPOSAL 5/8/2014 Assessment of Key Intercultural and Team Competency Skills This proposal includes assessment context, purpose, goals, and objectives justifying the need for an assessment of the pre- departure training for the Peru Practicum, as well as a sample survey and accompanying resources.
  • 2. Assessment Proposal Page 1 Assessment Proposal A S S E S S M E N T O F K E Y I N T E R C U L T U R A L A N D T E A M C O M P E T E N C Y S K I L L S EXECUTIVE SUMMARY Context A cohort of students from the Monterey Institute of International Studies (MIIS) recently participated in a new international immersive learning program during January (J-term) 2014. The model embeds a three-week field practicum in between Fall and Spring classes on development policy and analysis. The program is collaboratively driven by MIIS, the Andean Alliance for Sustainable Development (AASD), and local government officials in Peru. The challenge of working in a developing region with NGO and government partners demands that student teams are well-prepared to work professionally in an unfamiliar international context. However, the 2014 cohort received minimal pre-departure training beyond learning background information about Peru. Therefore, a new pre-departure training has been designed that emphasizes practical knowledge, intercultural competency, and team dynamics. Purpose The following document is a proposal to evaluate the new pre-departure training program. The purpose of the proposed evaluation is a formative assessment of how well the newly designed pre-departure training prepares students to work as a cohesive, professional field team while outside of their familiar cultural context. Skills that contribute to both intercultural competence and strong team dynamics will be assessed through student surveys and reflection papers, completed several times throughout Fall and J-term to explore potential changes. It is hoped that the new program design and its assessment will inform several potential changes to immersive learning at MIIS: 1) Incorporating pre-departure training into the Peru Practicum as it continues to develop. 2) Focusing on the cultivation of professional teamwork skills as a learning outcome for immersive learning participants. 3) Advancing the process of creating and implementing pre-departure trainings for all international immersive learning programs. Stakeholders ● Monterey Institute of International Studies: Development Practice and Policy (MIIS DPP) ● Andean Alliance for Sustainable Development (AASD) ● Potential practicum participants (DPP graduate students)
  • 3. Assessment Proposal Page 2 ● Practicum alumni ● MIIS Intercultural Competency Committee (ICC) ● Peru Practicum Steering Committee (MIIS DPP, AASD, officials in Calca, Peru). Modes of Assessment The assessment will comprise two components: a time-series survey of both closed-ended and open-ended questions, to be completed three times by all participants; and reflection papers guided by prompts, to be completed twice by all participants. Surveys and reflection papers will be assigned random codes by a person not involved in analyzing the data, and will not include student names. This will protect student anonymity while tracking which surveys and reflections have been done by the same person, allowing the analysis of changes over time in individual cases. Survey results will be analyzed both quantitatively, to track mean changes in answers to close-ended questions, and qualitatively, to explore student experiences as expressed in the open- ended questions. Reflection papers will be analyzed qualitatively for student thoughts on their own preparation, and for emerging themes CONTEXT & STAKEHOLDERS Context In January (J-term) 2014, a cohort of MIIS students participated for the first time in a new international immersive learning program. The year-long model, implemented in partnership with the Andean Alliance for Sustainable Development (AASD), incorporates a three-week field practicum in Peru embedded between related Fall and Spring classes on policy research and analysis. MIIS and AASD are working in partnership with local Peruvian officials to continue shaping an annual immersive learning project that contributes to student learning in development policy while creating positive impact in the Andean communities of Peru. The 2014 Peru Practicum drew an uncommonly diverse participant group with a high number of first-year students. The resulting wide range of international experience, language skills, and professional interests is considered both a challenge and a potential strength of the program. Because students enroll with varying levels of confidence working in developing countries, and because working with both NGO and government personnel demands a high level of performance, it is vital that students are well prepared for their fieldwork. However, 2014 participants received little pre-departure training beyond basic information about Peru and their project. A new pre-departure training for the Peru Practicum has been designed to improve student preparation in three areas: practical knowledge of their destination, intercultural competence, and team dynamics. As the MIIS Intercultural Competency Committee is considering requiring intercultural training before all international immersive learning programs, this new program can be considered a small test or pilot run. As such, it is important that the new training be assessed for effectiveness. Stakeholders ● Monterey Institute of International Studies: Development Practice and Policy (MIIS DPP) ○ Primary contact: Dr. Jeff Dayton-Johnson, Professor.
  • 4. Assessment Proposal Page 3 ○ Role in Assessment: Helped inform the program and assessment design. May be involved in implementing those activities that are scheduled to happen during the course of the Fall semester. As intended beneficiaries, professors involved in the practicum will be asked for feedback on how the pre-departure training and assessment function within the practicum structure. ● Andean Alliance for Sustainable Development (AASD) ○ Primary contact: Adam Stieglitz, Co-Founder ○ Role in Assessment: Helped inform the program and assessment design. May have a role in implementing additional in-country training as the practicum model develops in the future. As an intended beneficiary, AASD will be asked for feedback on the usefulness of the practicum for their organization and on the general quality of student participation while in Peru. ● Potential practicum participants (DPP graduate students) ○ Primary contact: Lis Martinis & Gaelen Hayes, Student Liaisons ○ Role in Assessment: Participate in the pre-departure training and field practicum. All students who enroll in the Fall pre-practicum class will be asked to complete the surveys, whether or not they go to Peru. Those who go to Peru will participate in pre-departure activities throughout the semester and during the pre-departure training workshop. Only these students will be asked to write reflection papers. As intended beneficiaries, students will be asked for feedback on their levels of preparation and the usefulness of pre-departure activities. ● Practicum alumni ○ Primary contact: Lis Martinis & Gaelen Hayes, Student Liaisons ○ Role in Assessment: Have offered feedback throughout the program and assessment design process, in addition to sharing stories and reflections during more general meetings, presentations, and focus groups about the practicum experience. Several alumni have assisted by pilot-testing the survey instrument. ● MIIS Intercultural Competency Committee (ICC) ○ Primary Contact: Dr. Lynn Goldstein, Professor. ○ Role in Assessment: Responsible for implementing future pre-departure training programs. Primary recipients of assessment results (although results will be shared with all stakeholders). Will provide feedback on the potential of developing the pre-departure training as a tool for other immersive learning programs. ● Peru Practicum Steering Committee ○ Primary contact: Dr. Jeff Dayton-Johnson, Professor ○ Steering committee includes members from MIIS DPP, AASD, and local officials in Calca and Lares, Peru. ○ Role in Assessment: Maintain relationship between MIIS, AASD, and Peruvian communities. Direct and shape the Peru Practicum to maximize both student learning and positive impact in Peru. While they will not be asked for direct feedback regarding the effects of pre-departure training, as a group representing all intended beneficiaries, they will provide information regarding the structure of the Practicum, the kind of projects that students will take on, and the ways students can have the most positive impact in their work with AASD and local governments in Peru.
  • 5. Assessment Proposal Page 4 PURPOSE, GOALS & OBJECTIVES Purpose of Assessment The purpose of the proposed evaluation is a formative assessment of how well the newly designed pre- departure training for the Peru Practicum prepares students to work as a cohesive, professional field team while outside of their familiar cultural context. The following document proposes a means for assessing whether students experience improvement in key skills related both to intercultural competence and team dynamics, two of the three intended outcomes of the new pre-departure training. These outcomes have been chosen for assessment in consultation with Dr. Dayton-Johnson and Adam Stieglitz. Based on a literature review (see Appendix C), a group of attributes common to both intercultural competence and strong team dynamics have been identified and categorized into the following dimensions: 1) Understanding of self 2) Understanding of others 3) Shared purpose 4) Communication 5) Resilience Justification According to a focus group held at MIIS in Spring 2014, a major goal of immersive learning is to gain real- world, hands-on experience and to prepare for future careers through “learning by doing”. One component of this preparation is learning to work in a professional team. Most people will work in teams in their future careers, to varying degrees, and in the international fields focused on by MIIS students many people will work in intercultural teams or in international settings. Studies show that many characteristics and skills, such as flexibility, empathy, and interpersonal communication, contribute both to intercultural competence and to team dynamics. Studying the development of such traits is therefore a means for simultaneously assessing two of the intended outcomes of the new pre-departure training. While intercultural competence is assessed in the general MIIS student population, teamwork skills are not- despite the fact that group work is a major component of many courses of study. Though MIIS students engage in a significant amount of group work, there is little formal guidance on cultivating group skills and dynamics in the process of doing so. The new pre-departure training is one of the few formal opportunities for consciously cultivating and assessing professional teamwork skills among MIIS students, and is especially relevant since the teamwork will happen in a challenging international field setting like the ones many students will continue to encounter in their careers. Furthermore, this assessment of a new pre-departure training moves one step closer to the goal of MIIS’s Intercultural Competency Committee, which aims to require pre-departure training for all international immersive learning programs in coming years.
  • 6. Assessment Proposal Page 5 It is hoped that the new program design and its assessment will inform several potential changes to immersive learning at MIIS: 1) Incorporating pre-departure training into the Peru Practicum as it continues to develop. 2) Focusing on the cultivation of professional teamwork skills as a learning outcome for immersive learning participants. 3) Advancing the process of creating and implementing pre-departure trainings for all international immersive learning programs Goals and Objectives Goal Objective Intervention Mode of Assessment Increased understanding of self Students identify and discuss their own values, working styles, and strengths, and describe them in discussions with their teammates. Individuals complete assigned modules of “What’s Up With Culture” during Fall semester. Guided discussions and activities in which students reflect on their individual and team working styles, interpersonal skills, and intercultural preparedness. Time-series survey completed by participants before pre-departure training, immediately afterward, and just before return from destination country. Survey includes Likert-type and open-ended questions. Survey items will measure: Students’ confidence identifying and describing their strengths and skills. Students’ confidence describing their working styles. Students’ confidence and perspective on discussing their values. Increased understanding of Others Students identify and discuss the working styles, strengths, and values of their colleagues. Students are willing to shift perspective and behavior in different cultural contexts. In addition to the activities above: Students establish duties and roles within their teams based on the strengths and working styles of team members. Time-series survey (described above). Survey items will measure: The items above, in reference to team members. Students’ confidence about interacting with locals in destination country. Students’ comfort level with changing their behaviors and perspectives. Students’ self-assessment of their preparedness for going to the destination country.
  • 7. Assessment Proposal Page 6 Shared Purpose Among Teams Students agree on and can describe their team’s goals for their project. Students express commitment to their team and project. Students collaboratively write mission statements for their teams. Each team will have a mission statement. Time-series survey (described above). Survey items will measure: Students’ perceptions of team agreement on goals. Students’ perceptions of team commitment. Students’ perceptions of their team’s level of responsibility toward their external partners. Improved Team and Intercultural Communication Students establish frameworks for feedback and communication within their teams. Students reflect on their ability to communicate and understand while in destination country. Assigned modules of “What’s Up With Culture”. Language practice nights throughout semester. Students practice giving each other both positive and critical feedback. Time-series survey (described above). Survey items will measure: Students’ perceptions of their ability to get and to give constructive feedback in their group. Students’ confidence about their ability to interact with local people in the destination country. How students handle interactions or messages they do not immediately understand. Team Resilience Students are confident that their teams can function when faced with internal and/or external challenges. Role-playing through potential disagreements or conflicts. “Sick Day” simulation. Time-series survey (described above). Survey items will measure: Students’ perception of their team’s ability to handle disharmony. Students’ perception of their team’s ability to function in unexpected circumstances. ASSUMPTIONS & RESEARCH QUESTIONS Assumptions 1) The Peru Practicum will remain connected to a policy class and free of prerequisites for 2015, therefore drawing a similar body of participants compared to 2014. 2) Increased pre-departure attention to intercultural competence and team dynamics will enable students to better perform the tasks required on their fieldwork practicum. 3) Students who actively cultivate intercultural competence and team dynamics before departure will continue cultivating them during their practicum. 4) Because some skills have been identified in literature as relevant to both intercultural competence and team dynamics, assessing those skills provides insight on both intercultural competence and team dynamics.
  • 8. Assessment Proposal Page 7 5) The proposed training will have some impact on key skills that contribute to both intercultural competence and team dynamics, when compared to having no such training. 6) The proposed training will not worsen intercultural competence or team dynamics. 7) Team competence will emerge differently for each team, because they are composed of different members. Research Question 1) Do the intercultural and team competency skills targeted in the pre-departure training change for students upon completion of the pre-departure training? 2) Do the intercultural and team competency skills targeted in the pre-departure training change for the students from the time they complete the pre-departure training to the time they complete the field component of the practicum? 3) Which pre-departure training activities do students describe as the most useful? MODES OF ASSESSMENT Time-Series Survey The research questions above will all be addressed through a time-series survey. The survey is 30 questions long, with 20 Likert-type questions and ten open-ended ones in which students can write responses. Survey questions were designed to measure specific skills or behaviors from each of the five dimensions identified as components of both team and intercultural competency. The survey instrument has been designed specifically for this assessment, based on a literature review of existing instruments. The possibility of using an existing instrument was considered, but the majority of intercultural competency instruments found during the literature review are not freely accessible. Intercultural instruments such as the well-known Intercultural Development Index must be administered by certified professionals and are costly to pay for. Additionally, the only instrument found that addresses both teamwork and intercultural competency (also not freely available) was designed specifically for assessing executives in a business context, rather than team members of equal status in a fieldwork context. Both Likert-type questions and open-ended questions have been included for several reasons: Likert-type questions make it easy to assign numerical values to responses, facilitating the calculation of means, ranges, and changes over time for different items. Such calculation also enables statistical tests of significance, to determine whether any changes that occur are significant as opposed to being the outcome of the random changes that would occur whether or not students participated in the training. By providing open-ended questions, the survey allows students to express whether the concepts measured in the Likert-type questions have been relevant in their experience, and how they have played out. Using a time-series survey will enable the tracking of any changes that occur from the time it is first administered to the time students are ready to return from abroad, and will ideally highlight whether any changes occur immediately after the pre-departure training. The survey will be administered three times: For the first time during the second half of the Fall semester, after students have been assigned their project teams and had some time to work with each other; for the second time immediately at the end of the pre-departure training workshop; for the third and final time while students are still in the destination country, just before they return
  • 9. Assessment Proposal Page 8 to the U.S. The reason for administering the survey a third time is to assess whether any changes that result from pre-departure training carry through students’ experiences on the ground in their destination country. The first time the survey is administered, it will only have 28 questions. Questions 29 and 30 are open-ended questions in which students are asked to share their thoughts on the effectiveness of the pre-departure training program and how it might be improved. These questions will be added to the end of the survey for the second and third times it is administered. Reflection Paper In addition to the survey, students will complete two very short reflection papers (no more than one page long if typed and double-spaced). The first reflection paper will be completed immediately after the pre- departure training, and the second paper will be completed just upon return from abroad. In these papers, students will more generally discuss how prepared they are or were to work in the field, and the skills learned or required. Reflection papers have been included in the past as part of the immersive learning program, although they were only completed upon students’ return. Creating a two-part reflection assignment more specifically focused on the outcomes of the pre-departure training will increase the usefulness of this practice, while allowing room to see if students change or develop their ideas. Like the surveys, these reflection papers will be submitted with codes rather than names or identifying information. Analysis of Data Survey data will be analyzed both quantitatively and qualitatively. Responses to Likert-type questions will be converted to numbers, allowing for an ANOVA test for changes of response means from one round of surveys to the next. Within the ANOVA, pairwise t-tests will reveal the degree of change between the first and second round, between the second and third round, and between the first and third round, revealing the time period during which the most significant changes occur (if, indeed there are significant changes). In addition to comparing the group means of the surveys, changes across individuals can be tracked and will provide a rich amount of descriptive data. For example, it will be possible to track the percentage of participants who experienced negative or positive changes on each item. Each individual’s change of responses can be mapped on a chart, allowing for the plotting of different learning or development patterns. It will also be possible to calculate the degree of change for each person, which may provide a somewhat more detailed picture than the group means. All of these calculations can be quickly performed with computer software. Understanding the patterns of change and learning is where the open-ended data can help complement the quantitative data. For instance, if it is observed that a number of students actually experienced a reduction in confidence on a certain item, their qualitative responses may reveal that they realized the matter was more complex or difficult than originally thought. Responses to open-ended questions will be coded for themes that can flesh out or explain the results found through quantitative analysis. This qualitative data may also provide information outside of what was captured in the quantitative data. Reflection paper data will also be coded for themes. The pre-practicum and post-practicum reflections will be compared with each other (recall that reflections are matched with each other by their identifying codes, so they can be analyzed as individual pairs or as a group). The reflection paper data is intended to provide before and after snapshots of how students assess their own preparedness and their own experience of learning
  • 10. Assessment Proposal Page 9 throughout the practicum process. Any common themes in student self-assessment can be compared to the changes or themes that emerge from the survey data. For instance, it may be interesting to compare students’ reflections on whether their skill levels have changed to any changes calculated from the surveys. SAMPLING & LOGISTICS Sampling The time-series survey is intended to be a Census survey of the entire population of participants in the 2015 J- term practicum. Participating students are those who are enrolled in the Fall policy class that precedes the J- term practicum and who have committed to participating in it. If students complete the first survey but then decide not to continue in the program, they will be invited to complete the additional two surveys anyway. This necessitates including a survey question that identifies whether the person taking the survey is participating in the full program or not. Should any students complete the surveys without completing the training and the immersive learning program, they will comprise something of a comparison group. Additionally, it is possible that some students from outside of the policy class will decide late in the semester to join the practicum. These students will be asked to complete all surveys, provided they have joined the program early enough. Otherwise they may only be able to complete the second two surveys. Only students who participate in the pre-departure training and the practicum will be asked to write the two short reflection papers. Maintaining Anonymity As mentioned, surveys will be identified with codes to maintain the anonymity of respondents. The same codes will be used for the reflection papers. Respondents will be guided in how to create their own codes, so that only they know which code belongs to them. Students will be given specific criteria so that they can easily make the same code for themselves each time they respond to a survey. The instructions to create the code are included at the beginning of the survey, attached in Appendix A. Managing Response Rates Much like a course evaluation, this survey will be considered a component of the class unless students ask to be exempt. However, because responses are anonymous it is only possible to know how many students have responded - not which students have responded. Furthermore, ethics require telling students that the survey is voluntary. There will be no negative consequences for failure to complete it. To encourage response rates, therefore, students will be encouraged to incentivize each other to all complete the survey by each pledging an incentive to share with the class if all students complete a round of the survey by the designated deadline. As currently planned, students will have one week for each of the survey rounds. A Facebook event will be created for the assessment to send out reminders, to plan incentives such as bringing candy, snacks, or coffee upon survey completion day, and to thank students for their participation. Survey Distribution There are online and paper options for administering the survey. The paper survey is attached to this document. The online survey is in Google Forms. A link to the online survey can be sent by the student liaisons of the program to all known program participants via the email they have provided to their professor for
  • 11. Assessment Proposal Page 10 correspondence regarding the J-term practicum (generally their MIIS email). Google Forms automatically generates a spreadsheet of answers, without including the email addresses or other identifying information of the respondents. Each survey round will remain available for one week provided response rates are high enough within that time frame to close the survey. However, it may be easier to ensure high response rates by administering paper surveys while students are in class, next while they are at the pre-departure training, and finally just before they leave from the destination country. This eliminates potential complications due to lack of Internet access in the destination country, and also may lead to higher response rates. However, it has the disadvantage of requiring manual data input, and lacks the automatic summary analysis provided by Google Forms. Additionally, handwritten answers may be illegible. As the details of the Fall 2015 program emerged, both paper and online options will be considered. Reflection papers can also be submitted on Google Forms or on paper. RESOURCES Human Resources The greatest and most available resource at MIIS is its people, and there are many ways to incorporate them into the assessment process. This assessment proposal and the program it is designed to accompany have both been created by students in the IEM (International Education Management) Program Design & Assessment class. It is likely that pre-departure trainings and immersive learning assessments will be created and refined through several iterations, providing an ongoing opportunity for IEM students to address program design and assessment needs through the framework of their classes. Much can be accomplished through a partnership between the IEM department and program stakeholders. Additionally or alternatively, should the ICC move forward with conducting trainings and assessments for all international immersive learning programs, an internship or work study position could be created for students who want to work in assessment and collaborate with the ICC committee to implement and manage the assessment process. In addition to the significant amount of expertise and personnel available through the IEM program at MIIS, other departments on campus can participate in training practicum students. In 2014, a professor from Translation and Interpretation provided a short informational session on how to work with interpreters. This can be expanded to include practice sessions with T & I students, and perhaps some intercultural communication workshops incorporating international students. International students, T & I students, and also student clubs can assist with Spanish-language practice nights for practicum students who wish to improve their Spanish before departure. A Spanish Conversation club already exists on campus, and the BUILD program of volunteer language teachers includes Spanish most semesters. Regarding assessment specifically, the Digital Learning Commons and the MetaLab on campus can both provide assistance with the gathering and analysis of data. Staff at both places can provide one-on-one or group workshops, and can also provide space for events. Many professors on campus have significant experience in assessment and can be consulted for feedback on assessment design and instrument validity. Professors consulted for this assessment were Meggan Madden, Jeff Dayton-Johnson, and Kent Glenzer.
  • 12. Assessment Proposal Page 11 Scholarly Resources In addition to the people on campus, much guidance in assessment can be found in existing documents. A full list of references and recommended readings is provided in Appendix D Material & Financial Resources Administering surveys through Google Forms is free of cost. Printing surveys can be done on campus for a price of $0.05 per page. If surveys are printed, the price will be $0.50/per survey. Based on the total number of participants, the cost for printing hard copy surveys will range from $30.00 to $67.50. If surveys are printed hardcopy, this cost could likely be covered by the funds provided to Papercut printing accounts at MIIS. The Digital Learning Commons and the MetaLab can provide free access to data analysis software. Much of the analysis for this assessment can be completed in Microsoft Excel or in a basic statistical program such as R or SPSS.
  • 13. Assessment Proposal Page 12 APPENDIX A: THEORETICAL BASIS Theoretical Basis for the Five Dimensions of Intercultural and Team Competency 1) Understanding of self 2) Understanding of others 3) Shared purpose 4) Communication 5) Resilience Dimensions identified in literature review Authors Instrument / Study Dimensions Hamlin (2008) citing Lencioni (2002) Five Essential Functions of a Team 1. Trust 2. Dealing with conflict 3. Commitment 4. Accountability 5. Attention to Results Spreitzer, McCall, & Mahoney (1997) The Prospector: Early Identification of International Executive Potential 1. Sensitive to cultural differences 8. Takes risks 2. Business knowledge 9. Seeks feedback 3. Courage 10. Uses feedback 4. Brings out the best in people 11. Is culturally adventurous 5. Integrity 12. Seeks learning opportunities 6. Insightful 13. Open to criticism 7. Committed 14. Flexibility Van der Zee & Brinkmann (2004) Intercultural Readiness Check 1. Intercultural sensitivity 2.Intercultural communication 3. Intercultural relationship building 4. Conflict management 5. Leadership 6. Tolerance for ambiguity Van der Zee & Brinkmann (2004) Multicultural Personality Check 1. Cultural empathy 2. Open-mindedness 3. Social initiative 4. Emotional stability 5. Flexibility
  • 14. Assessment Proposal Page 13 Deardorff (2006) Components of Intercultural Competence (top 15 of 22 listed) 1. Understanding others’ worldviews 9. Tolerating and engaging ambiguity 2. Cultural self-awareness and 10. Deep knowledge and understanding capacity for self-assessment of culture (one’s own and others’) 3. Adaptability and adjustment to 11. Respect for other cultures new cultural environment 12. Cross-cultural empathy 4. Skills to listen and observe 13. Understanding the value of 5. General openness toward cultural diversity intercultural learning and to 14. Understanding the role and impact people from other cultures of culture and the impact of 6. Ability to adapt to varying situational, social, and historical intercultural communication contexts involved and learning styles 15. Cognitive flexibility - ability to 7. Flexibility switch frames from emic to etic and 8. Skills to analyze, interpret, back again and relate These many dimensions of team functioning, leadership, and intercultural competence were narrowed down according to which ones were relevant both to team dynamics/leadership and to intercultural competence. That initial list yielded the following Sensitivity to culture Self-knowledge Flexibility Tolerance for Ambiguity Open-mindedness Empathy Courage Emotional Stability Willingness to take risks Listening Seeks learning opportunities Social initiative Relationship building Attention to results Problem solving Conflict management Commitment Trust Shared sense of purpose Bringing out the best in people Seeking and giving feedback Accountability
  • 15. Assessment Proposal Page 1 Items from the above list were then grouped into categories: Understanding self  Self knowledge  Emotional stability Understanding others  Sensitivity to culture  Open-mindedness  Empathy  Relationship-building  Social initiative  Listening  Bringing out the best in people Shared purpose  Shared sense of purpose  Commitment  Attention to results  Willingness to take risks Communication  Seeking and giving feedback  Problem solving  Trust  Accountability Resilience  Flexibility  Tolerance for ambiguity  Problem solving Conflict management This list was further refined based on two criteria: Can this dimension be reasonably expected to change in the period of time we are testing? Is this dimension specifically targeted in the pre-departure training? This resulted in the elimination of traits that would not likely change in the course of the study timeframe, such as tolerance for ambiguity, emotional stability, willingness to take risks, and basic problem-solving skills. Additionally, those dimensions not addressed by pre-departure training were eliminated, such as listening, social initiative, and attention to results. Final list of survey items: Understanding self  Self knowledge Understanding others  Sensitivity to culture  Open-mindedness  Empathy  Bringing out the best in people Shared purpose  Shared sense of purpose  Commitment Communication  Seeking and giving feedback  Trust  Accountability Resilience  Flexibility Conflict management
  • 16. Assessment Proposal Page 1 APPENDIX B: REFERENCES & RECOMMENDED READINGS References Deardorff, D. (2006). Identification and assessment of intercultural competence as a student outcome of internationalization. Journal of Studies in International Education, 10(3), 241-266. Hamlin, J.L. (2008). Team effectiveness: A validation of Lencioni’s Five Functions of a Team. (Unpublished doctoral dissertation). University of La Verne, California. Spreitzer, G.M, McCall, M.W., & Mahoney, J.D. (1997). Early identification of international executive potential. Journal of Applied Psychology, 82(1), 6-29. Van der Zee, K., & Brinkmann, U. (2004). Construct validity evidence for the Intercultural Readiness Check against the Multicultural Personality Questionnaire. International Journal of Selection and Assessment, 12(3), 285-290. Recommended Readings Braskamp, L.A., Braskamp, D.C., & Engberg, M.E. (2013). Global Perspective Inventory (GPI): Its Purpose, Construction, Potential Uses, and Psychometric Characteristics. Chicago: Global Perspectives Institute. Retrieved from https://gpi.central.edu/index.cfm?myAction=Information. Creswell, J. (2008). Educational Research. Planning, conducting and evaluation of quantitative and qualitative research, Third edition. Upper Saddle River, NJ: Pearson Deardorff, D., & Edwards, K. (2012). Framing and assessing students' intercultural competence in service learning. In Clayton, Bringle, & Hatcher (Eds.) Research on Service Learning. Sterling, VA: Stylus. Fantini,A. (2006). Assessment tools of intercultural communicative competence. Brattleboro, VT: Fantini. Additional Resources Intercultural Communication Institute. http://www.intercultural.org/tools.php Intercultural Development Inventory. https://idiinventory.com/
  • 17. Assessment Proposal Page 2 APPENDIX C: SAMPLE IRB APPLICATION IRB application Questions 1. Applicants Principal Investigators Cortney Copeland : MIIS Student Maritza Munzón : MIIS Student Faculty advisor: To be determined by June 1, 2014. Advisor's Email Advisor's Department or Program Advisor's address Advisor's signature Please attach an email from your advisor acknowledging that he or she has reviewed and approved your research plan. The email must be an exact duplicate (PDF, HTML, pict, or jpg format) of the original email sent from your advisor’s institutional email address and must contain this (or equivalent) wording: I have reviewed this research plan and am satisfied that the proposed research design and the measures proposed for the protection of human subjects are adequate. I certify that all of the information contained in this proposal is truthful, to the best of my knowledge. 2. Type of application: New Application 3. Type of project: Independent study (500-level) 4. Principal investigator: Cortney Copeland 5. Email: ccopeland@miis.edu 6. Title or year of graduation: 2015 7. Department or Program: IEM/MPA 8. Address: 580 Jefferson St. # 6 Monterey, CA 93940 9. Co-PIs: Maritza Munzón 10. Project title: Assessment of Key Intercultural and Team Competency Skills for MIIS Immersive Learning Participants 11. Start date: November 15th 2014 12. End date: March 15th 2015 13. External funding (grant or fellowship)?: None 14. Research question: Do MIIS J-term policy practicum students demonstrate changes in key intercultural and team competency skills as a result of participating in the newly designed pre-departure training that targets these skills? 15. Target demographic: Please see the “Sampling” section on page 8 of Assessment Proposal 16. Estimated number of subjects: Between 25 and 45
  • 18. Assessment Proposal Page 3 17. Subject types you will include Check all that apply, in whole or in part, to your subject pool. Children (17 years or younger) Cognitively impaired persons Prisoners Pregnant women Elected or appointed officials or candidates for public office None of the groups listed above If another targeted population, please describe. 18. Study location: Monterey, CA. Survey is distributed online but subjects will be in Monterey at the time of survey administration. 19. Cooperating institution: Monterey Institute of International Studies 20. Non-physiological data collection methods Select all methods of data collection you will use to perform your research. Survey: you will distribute an electronic or paper survey to subjects. Please see the “Sampling & Logistics” section on pages 8-9 of the Assessment Proposal. The “Maintaining Anonymity” section will be of particular relevance to this question. Student Reflection Papers: We will collect student writing in response to given prompts. 21. Exposures Will your subjects be exposed to any of the conditions or substances listed here? Check all that apply. Clinical drug research of any kind Exposure to X-rays or microwaves Use of devices not controlled by the FDA Ingestion of substances that are outside of FDA food guidelines None of the exposures listed here. Other exposure, not listed above. 22. Exercise Will you require your subjects to perform exercise, and at what level of exertion? No exercise Yes, mild exertion Yes, moderate exertion Yes, extreme exertion
  • 19. Assessment Proposal Page 4 23. Physiological data collection, non-invasive Check all that apply Physical sensors on or near the body Sensory acuity testing Weight measurements No non-invasive measurements Other non-invasive method? Please supply a brief description. 24. Physiological data collection, bodily materials Deciduous teeth or dental plaque External secretions Saliva, urine, or blood samples Nail or hair clippings None of the above Other materials? Please describe the samples you will collect. 25. Will data be collected anonymously? Anonymous: collected in such a way that it can NEVER be connected to individual persons, and even you won't know which participant provided which data. Yes, data will be collected anonymously as detailed in the “Sampling and Logistics” portion of the Assessment Proposal 26. Will data be collected confidentially? Confidential: You will protect your subjects' identifying information from access by anyone besides yourself, your co-PIs, and/or your faculty advisor. No person apart from the subjects themselves will know the subjects’ identifying information. Subjects will identify themselves by a code, as described on pages 8-9 of the Assessment Proposal. 27. Will identifiers be removed? No identifiers other than a code will be included in the data. The code will not include any identifying information. 28. Will you take video recordings or photos? No. 29. Will you make voice recordings? No.
  • 20. Assessment Proposal Page 5 30. Personal records Will you use personal (non-public) records as sources of data? Choose as many options as apply: Health care records Educational records Drug & alcohol records Psychiatric records Psychiatric records No personal non-public records Other non-public personal records? Describe here. 31. Deception Will your research require you to deceive your subjects to get the data you want? No, our research will not require deception. 32. Civil liability No. The information they are sharing is largely self-assessment of their own skills and competencies at working in an intercultural team. They will not be directly sharing information about other people, nor will they be disclosing sensitive information. 33. Criminal liability No. They are only being asked to fill out a survey about themselves and their experience of the program, in addition to writing short reflection papers. They will not be asked to do anything illegal or potentially harmful. 34. Financial or employment risk No. They are not disclosing any information that could, if traced back to them, jeopardize their employment or finances. The fact that they have participated in the study will not be shared beyond the group of people involved in the study. They are not being asked to disclose any information about employers or potential employers. They are not being asked to disclose any financial information. 35. Social risk No. Participating in research surveys and evaluations is a common practice at MIIS since many students and faculty survey students for their research, and since all courses have a required course evaluation. Students participating in the survey, although they do disclose their general experience of having worked with their team, are not asked to evaluate specific team members and are not prompted to disclose negative experiences. Their responses are kept anonymous. 36. Stress How would you describe the effects of your data collection on your subjects? A potentially stressful experience Not at all stressful
  • 21. Assessment Proposal Page 6 Because the survey takes time and effort, it may cause some level of stress since students have many other things to do. We have tried to mitigate this by piloting the survey, ensuring that the questions make sense, and by eliminating extraneous or vague questions. 37. Protections for vulnerable populations If you will use subjects from any group that the federal government identifies as "vulnerable" populations (children, pregnant women, prisoners, cognitively impaired persons), describe the special protections you will employ. (If no vulnerable subjects, put "N/A.") N/A 38. Plan to ensure confidentiality Unless participants explicitly waive their right to privacy, all work with human subjects is presumed to be confidential. Please describe as specifically as possible what measures you will take to ensure that your data are not accessible to anyone besides you (and your advisor, if you are a student). Responses to the survey are automatically entered into a spreadsheet in a password-protected Google Drive account. The data responses are only available to the primary investigators, who are the only two parties who have access to the shared Google folder in which the data is stored. Once all responses are gathered, the data will be downloaded as a CSV file, removed from the Google Drive, and saved on a password-protected laptop computer belonging to one of the PI’s. For reflection papers, students will be asked to sign a consent form allowing phrases from their papers to be quoted and shared in the research results. Reflection papers will be anonymously identified by codes, using the same method as used to identify surveys. Students who do not wish their paper to be quoted will include an additional letter in their code to communicate that information. Papers will be submitted via email and stored on a password-protected laptop computer. 39. Risk analysis What immediate or long-term risks might participation in your research entail for your subjects? Think carefully about not only possible physical risks, but also psychological, legal, financial, or social consequences that could result from either participating or from accidental disclosure of such participation. The sharing of negative results from the study, should there be findings that students have low levels of competence or should their textual data describe negative experiences, could cause students some psychological stress. Students who read the results, if the results are not positive, may feel disappointed, criticized, or insulted. Any students who recognize their own words quoted may be uncomfortable with the fact that they have been shared, or with the analysis accompanying them, even if the student has consented and if the quote is anonymous. Consideration will be taken when writing up and presenting results to avoid a taking a tone that is critical of or insulting to students. Recruiting procedure All students potentially participating in the Peru J-term program (and, if expanded, the El Salvador practicum) will be sent an initial email to announce the assessment. The email will be drafted by the PI’s but sent by the student liaisons for the program. The PI’s will later visit the related Fall class to give a short informational announcement about the assessment. To distribute the survey, an email with a link to
  • 22. Assessment Proposal Page 7 the survey will be sent to all students, again by the student liaisons. For the second round of the survey, participants will be given time at the end of the pre-departure training to complete it (again via a link sent to their email). The third round of the survey will be distributed via email. Reminder emails will be sent to encourage response if not all students respond within the designated time frame. 40. What subjects will do What will subjects be asked to do in your study? How long will their participation last? How many parts will there be to their involvement? Students will be asked to complete a survey three times over the course of approximately 2.5 months. It is the same survey each time, with the exception that the first survey will be two questions shorter (it will not include questions 29 and 30 about the pre-departure training). The survey is 30 questions long, and consists of 20 Likert-type questions and 10 open-ended questions. Additionally, students will be asked to write two one-page reflection papers over the course of approximately 1.5 months. The topic will be the student’s idea of which skills are important for their field project, their level of preparedness, and how their experience may impact their future. Attach copies of all tests, questionnaires, or other materials you will use for collecting data to the end of this application; see question 50 41. Consent Please indicate how you will obtain your subjects' consent. Informed consent is required from ALL human subjects. A signed written form is normally expected as evidence that informed consent has been obtained, but the IRB will consider arguments for using oral consent. If your subjects are unable to give legal consent themselves (i.e., they are younger than 18 or cognitively impaired), you must get both written consent from a guardian and oral assent from the subject. Attach a copy of your consent form or text, your script for obtaining oral consent, or both the written consent form for guardians and the script for obtaining oral assent to the end of this application; see question 48. A paragraph at the beginning of the online survey acknowledges that by filling out the survey, they are consenting to having the data analyzed and the results shared for purposes of improving the program. That paragraph is included with the attached copy of the survey questions. 42. Benefits to participants What benefits, if any, might participants get from your research? Participants will have the opportunity to process and reflect on their learning experience, which can deepen learning and memory. They will know that they have contributed to improving the program (this is stated in the introductory paragraph to the survey). They will also have access to the results of the assessment, which can provide an additional learning opportunity, and a chance to see a report of any positive changes in skill levels (a potentially affirming or encouraging experience). If all students complete the surveys, the group will be provided a small incentive such as candies.
  • 23. Assessment Proposal Page 8 43. Benefits to discipline or society This assessment measures the effectiveness of a new pre-departure training program for students traveling abroad for a practicum in international development. It will serve as a tool to help improve such training programs, and, if they are effective, promote them. The assessment will therefore contribute to the discussion of best practices in international and immersive learning. It will provide important information to the field of international education by contributing to the body of work regarding intercultural competence. The approach of assessing both team competence and intercultural competence is a new approach, and may provide useful insight to MIIS as an institution. Teamwork skills are vital for graduates who will likely work in teams during their career. Assessing how to cultivate such skills will help MIIS to do so, better preparing its graduates for the workforce and helping contribute strong, capable professionals to important international fields such as international development and international education. Additionally, practicum students who are interculturally competent and skilled at working in professional teams will hopefully create a positive impression on the communities they visit in the destination country, and provide useful services to the social change organizations working there. Improving pre-departure training for international practicum programs will hopefully improve the impact of the programs themselves, for students, for partner organizations, and for the communities. 44. Status report (required for all renewals and extensions) Attach a status report of the project to date, including: • The number of subjects accrued none • A summary of adverse events and any unanticipated problems involving risks to subjects or others and withdrawal of subjects from the research or complaints about the research since the last review none • A summary of any relevant amendments or modifications to the research since the last review none • Any other relevant information, especially information about risks associated with the research none • A copy of the current informed consent document and any newly proposed consent document 45. Research protocol (required for all projects) See Assessment Proposal 46. NIH certificate or equivalent (required for all projects) Attach the certificate you earned by completing NIH's training course in research with human subjects (http://phrp.nihtraining.com/users/login.php) or documentation of equivalent training.
  • 24. Assessment Proposal Page 9 47. Consent materials (required for all projects except those using surveys, restricted databases, or secondary sources) Attach a copy of your text for obtaining written informed consent, your script for obtaining oral consent or assent, or both (as appropriate for your project). See question 49 below. 48. Survey (required for all surveys) Please attach an exact final copy of the survey you will use. Your survey should include the following consent statement: You have been asked to complete this survey as part of a research project conducted by [NAME OF PI], a student [FACULTY/STAFF MEMBER] at Middlebury College. The research project is called [NAME OF PROJECT] and is designed to [PURPOSE OF RESEARCH]. Your responses are entirely voluntary, and you may refuse to complete any part or all of this survey. This survey is designed to be anonymous, meaning that there should be no way to connect your responses with you. Toward that end, please do not sign your name to the survey or include any information in your responses that makes it easy to identify you. By completing and submitting the survey, you affirm that you are at least 18 years old and that you give your consent for [PI] to use your answers in [his/her] research. If you have any questions about this research before or after you complete the survey, please contact [PI and PI CONTACT INFO]. If you have any concerns or questions about your rights as a participant in this research, please contact the Chair of the Middlebury College Institutional Review Board, Michael Sheridan, at 802‐443‐5582 or msherida@middlebury.edu. 49. Interview/Questionnaire (required for all projects that are not surveys or research in restricted databases/secondary sources) Attach exact final copies of any written materials you will use to obtain data from your subjects. If you will use more than one instrument, please combine them into a single document for upload. 50. Institutional permissions (required if your research will take place away from your home institution) If you will perform your research through an organization other than your home institution, please attach an exact duplicate (PDF, HTML, pict, or jpg format) of the original letter or email of permission or support from the institution where you will do the work. Examples: If you are a Middlebury student and plan to work with children in the local schools, attach a letter or email from each school. If you will conduct research on the Middlebury campus during the Language School session, attach a letter or email from the director of the appropriate school(s). If you will work at a hospital, on another campus, with an NGO, in a company office, etc., you need this documentation. N/A
  • 25. Assessment Proposal Page 10 51. Grant proposal (required if your project will be funded by an external sponsor) N/A 52. Other documents Attach any other documents needed to help the IRB understand what you intend to do and how you intend to do it. If you have more than one additional document to attach, please combine them into a single document for upload. 53. Survey certification (required for surveys only) I am familiar with the Middlebury College Policy on Protection of Human Subjects and will comply with all of its ethical requirements. I certify that my research will include no other mechanism for data collection beyond the anonymous survey attached to this application. I certify that all other information in this application is truthful, and that I will inform the IRB if I make significant changes to the proposed study. I have read this certification and, by submitting this application, agree to abide by its terms. 54. Submission certification (required for all other types of data collection) I am familiar with the Middlebury College Policy on Protection of Human Subjects and will comply with all of its ethical requirements. I certify that my research will include no other mechanism for data collection beyond the methods described in, and the materials attached to, this application. I certify that all other information in this application is truthful, and that I will inform the IRB if I make significant changes to the proposed study. I have read this certification and, by submitting this application, agree to abide by its terms.
  • 26. Assessment Proposal Page 11 APPENDIX D: REFLECTION PROMPTS Reflection 1: To be completed upon finishing pre-departure training. Please describe the skills, attitudes, knowledge, and/or preparation you think will be most useful to you while in Peru. In what ways might you apply them? In what ways do you think you may be challenged to grow as an international professional? Reflection 2: To be completed upon returning to Monterey. Please describe the skills, attitudes, knowledge, and/or preparation that were most useful to you while in Peru. In what ways did you apply them? In what ways were you challenged to grow as an international professional?
  • 27. Assessment Proposal Page 12 APPENDIX E: SURVEY INSTRUMENTS Thank you for sharing your thoughts and experiences with us. This survey will be used to help improve how we prepare students for international immersive learning programs. It is part of our long- term goal to improve student learning outcomes, while improving impacts for our international community partners. You have been asked to complete this survey as part of a research project conducted by Cortney Copeland and Maritza Munzón, students at the Monterey Institute of International Studies. The research project is called Assessment of Key Team and Intercultural Competence Skills and is designed to evaluate the effectiveness of the pre-departure training for the J-term practicum programs in Peru and El Salvador. Your responses are entirely voluntary, and you may refuse to complete any part or all of this survey. This survey is designed to be anonymous, meaning that there should be no way to connect your responses with you. Toward that end, please do not sign your name to the survey or include any information in your responses that makes it easy to identify you. By completing and submitting the survey, you affirm that you are at least 18 years old and that you give your consent for Cortney Copeland and Maritza Munzón to use your answers in their research. If you have any questions about this research before or after you complete the survey, please contact ccopeland@miis.edu. If you have any concerns or questions about your rights as a participant in this research, please contact the Chair of the Middlebury College Institutional Review Board, Michael Sheridan, at 802‐443‐5582 or msherida@middlebury.edu. You will be asked to complete this survey a total of three times in the next several weeks. No personally identifying information will be connected to your survey responses. None of your survey responses will impact your grades for your immersive learning or related classes. Please answer all questions to the best of your ability. We appreciate the time and energy you are putting in to improving immersive learning at MIIS. Your input is important. Anonymity Code - Please create a five-part code to identify your survey. You should create the same code every time you take this survey. Example: N152T2 Character 1: The third letter of your mother’s first name. Please enter a capital letter. If you have two mothers or two fathers, use the name that comes first in alphabetical order. Character 2: The number of four-legged pets you have ever had. Example: Somebody who has only ever had an aquarium full of fish would enter “0” since fish do not have four legs. Somebody who has 10 horses would enter “10”. Character 3: The number of cars you have ever owned. Yes it counts if somebody else bought the car for you. Character 4: If you generally prefer drinking coffee, enter “C”. If you generally prefer drinking tea, enter “T”. If you generally prefer both equally, enter “B”. Please enter a capital letter. Character 5: The number of countries you have lived in for two months or longer. Example: If you spent your childhood in Japan, moved to the US, and then spent a college semester studying in Argentina, you would enter “3”.
  • 28. Assessment Proposal Page 13 Section 1: Strengths, working styles, and values 1. I can describe to my colleagues what my working style is like. (Ex: “I like to tackle something right away and reflect later,” or “I do my best work when I’m by myself first thing in the morning”). Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to describe your working style to your peers? Very important Somewhat important Not important at all 2. I can articulate to my colleagues the strengths and skills I contribute to our team. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to describe the strengths and skills you contribute to your team? Very important Somewhat important Not important at all 3. I can describe what my colleagues’ working styles are like. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it to know the working styles of your colleagues? Very important Somewhat important Not important at all 4. I can describe how each of my colleagues contributes to our team. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it to know how your colleagues contribute to your team? Very important Somewhat important Not important at all 5. I can discuss personal values with my colleagues, whether or not we share the same ones. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree
  • 29. Assessment Proposal Page 14 How important is the ability to discuss personal values within your team? Very important Somewhat important Not important at all 6. I can discuss professional values with my colleagues, whether or not we share the same ones. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to discuss professional values within your team? Very important Somewhat important Not important at all 7. In working with your team, how important has it been to discuss each other’s values? Do values play a role in your interactions with your team? Do they affect your team’s work? Please share your thoughts and experiences.
  • 30. Assessment Proposal Page 15 8. How important has understanding your own and your colleagues’ values been while working in the destination country? How important is it to understand the values of the people you interact with outside of your team? Please share your thoughts and experiences. 9. How have activities related to your J-term project impacted your understanding of your strengths, working styles, or values? Those of your teammates? Such activities might include, (among other things), class work, J- term related social events, individual and group pre-departure training activities, meetings, and in-country experiences. Section 2: Purpose and performance 10. My colleagues and I can describe the goals of our project in such a way that we all agree. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it for your team to agree on how to describe project goals?
  • 31. Assessment Proposal Page 16 Very important Somewhat important Not important at all 11. I am confident that my colleagues are committed to the decisions we agree upon as a team. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it that your colleagues are committed to team decisions? Very important Somewhat important Not important at all 12. My team has the ability to handle disharmony. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to handle disharmony in your team? Very important Somewhat important Not important at all 13. My team can function productively when things do not go as planned or expected. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability of a team to function when things do not go as planned or expected? Very important Somewhat important Not important at all 14. My team acts with a sense of responsibility toward the organization with which we are working. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it that your team is responsible to your partner organization? Very important Somewhat important Not important at all 15. My team acts with a sense of responsibility toward the community we are visiting. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it that your team is responsible to the community you are visiting?
  • 32. Assessment Proposal Page 17 Very important Somewhat important Not important at all 16. Please share your thoughts/experiences regarding the establishment of and commitment to goals within your team. What has your team done and discussed throughout this process? 17. How have activities related to your J-term project impacted your team’s ability to function? Such activities might include, (among other things), class work, J-term related social events, individual and group pre-departure training activities, team meetings, and in-country experiences. Section 3: Culture and communication 18. I usually know what my colleagues are working on. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it to know what your colleagues are working on?
  • 33. Assessment Proposal Page 18 Very important Somewhat important Not important at all 19. I can get constructive feedback from my colleagues. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to get constructive feedback from your colleagues? Very important Somewhat important Not important at all 20. I can give constructive feedback to my colleagues. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to give feedback to your colleagues? Very important Somewhat important Not important at all 21. I am confident in my ability to interact and communicate in culturally appropriate ways with the local people in my team’s destination country. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it to know the culture and language of people from another country before interacting with them? Very important Somewhat important Not important at all 22. I am confident in my ability to adapt my behavior according to different cultural contexts. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it to adapt one’s behavior according to cultural context? Very important Somewhat important Not important at all 23. I can shift how I view a situation based on how other people might see it. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is the ability to see a situation from other people’s perspectives?
  • 34. Assessment Proposal Page 19 Very important Somewhat important Not important at all 24. I feel prepared to live, work and function effectively in another culture. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is your level of preparation before being immersed in another culture? Very important Somewhat important Not important at all 25. Going out of my way to understand cultural differences enhances my own learning experience. Strongly agree Somewhat agree Neither agree nor disagree Somewhat disagree Strongly disagree How important is it to make a conscious effort to learn about cultural differences? Very important Somewhat important Not important at all 26. When people in your team do or say things that don’t make sense to you, how do you feel and what do you do? 27. When people in the community you’re visiting do or say things that don’t make sense to you, how do you feel and what do you do?
  • 35. Assessment Proposal Page 20 28. How have activities related to your J-term project impacted how you interact with your teammates? How have they impacted how you might interact or how you did interact with other people in your destination country? Such activities might include, (among other things), class work, J-term related social events, individual and group pre- departure training activities, team meetings, and in-country experiences. 29. Which pre-departure activities have been the most useful to you and your team?
  • 36. Assessment Proposal Page 21 30. What can we do to make the collection of pre-departure activities better? Please share your thoughts on what should be included or left out, and how these things should be done.
  • 37. Assessment Proposal Page 22 APPENDIX F: SAMPLE RECRUITMENT EMAIL Hi _________________________ We are working to improve the Team Peru program by creating a new pre-departure training. We know you’ve answered a number of questions already, and shared a number of stories about your experience (we have too!). However, your response to a short survey will be extremely helpful to us as we seek to improve the program. This is not another satisfaction survey or group share – we are asking for your participation in our research. We are conducting an assessment of whether our new program helps build team and intercultural competencies for student participants. Your response to a survey on team and intercultural skills will give us useful data for our study. As many of you know, forming a strong professional field team significantly contributes to the student learning experience. It also impacts the quality of the contributions we make as partners with the Andean Alliance and the communities of the Sacred Valley. Please look for an email in the next few days from Team Peru student liaisons, with a link to the survey. You will have one week from the time the survey opens to complete it. This is a time series survey, and you will be asked to complete it three times in the next several weeks. Thank you for your participation! Sincerely, Cortney Copeland Maritza Munzón