SlideShare a Scribd company logo
1 of 20
Download to read offline
SCOF:
A Standardised, Customisable
Online Feedback Tool
Dr. Ian Glover
City University London, UK
{ian.glover.1@city.ac.uk}
Outline
• The Problem(s)
• Possible Solutions
• SCOF
• Potential Uses
• Demonstration
• Early Results
• Future Work
Problem - Sector (UK)
• Increasing student demand for meaningful feedback.
• Higher student fees = better ‘value’ needed.
• Reduced government funding = less resources per student.
• National Union of Students Charter on Feedback & Assessment
(Summary)
SCOF: A Standardised, Customisable Online Feedback Tool
Problem - Institution
• Institution-wide feedback timescale (3 weeks max.)
• Increased reliance on PhD students for grading
• Huge pressure to increase research outputs
Problem – School/Faculty
• Wide variety of assessment methods:
• Online, Offline (Hard copy), Situated (Labs)
• Reports, schematics, models, software, presentations, …
• Little exposure to learning technologies or pedagogical
good practice
• Conservative mind-set – resistant to new processes
Possible Solutions
• Quality-focussed solutions
• Formal moderation of all feedback
• Mandatory training in providing good feedback – including periodic
reviews
• Peer review of feedback
• Speed-focussed solutions
• Rubrics/Feedback schema
• Brief audio/video summaries
• Generic feedback for whole cohort
But…
• Rubrics/Schemes trade individuality for speed (Stevens & Levi, 2004)
• Detailed feedback necessarily focuses on errors/problems
• Little time to encourage and praise good work (Nicol & Macfarlane-Dick, 2006)
• Students have mixed reactions to rubrics
• Like the speed of feedback they allow
• Dislike the impersonal text
(Andrade & Du, 2005)
• Yet, standardisation can help students make better use of
feedback (Duncan, 2007)
None ideal,
so a ‘third way’ needed
SCOF: A Standardised, Customisable Online Feedback Tool
SCOF
• Aims to give the speed of
rubrics, but encourage
consistent, high-quality personal
feedback.
• Can include grades for each
feedback item.
• 3-stage process
• Select scheme values
• Customise generated output
• Save final file
Example Scheme in SCOF
Feedback Editing
SCOF
• Produces ‘rich’ electronic
documents with images, links,
styling, etc.
• Output not obviously based on a
rubric
Example Final Output File (PDF)
SCOF
• Intended for use on Tablets (e.g. iPads, Android, etc.) and
Smartphones, as well as PCs.
• Can import gradebook from Moodle for easier
personalisation.
• Though not linked to particular assessment type, or distribution
platform (i.e. VLE).
Potential Uses
• ‘Instant’ feedback, e.g. for presentations
• Support ‘Feedforward’ practices by giving links to extra
resources.
• Provide quality base feedback for use by inexperienced
graders
• Peer review by students
• Focus on common aspects = more time on specifics
Demonstration[Click Here]
Early Results
• Pilots across 4 schools at City (Social Sciences, Health,
Informatics, Engineering)
• Students appreciate the increased speed of receiving
feedback
• Staff like the efficiency increases in producing quality
feedback
• But, some resistance due to having to plan the feedback scheme prior
to grading.
But Don’t Just Take
My Word For It!
Daniel Apau (Pilot User, Lecturer in Health Sciences)
Future Work
• Open Source release
• Feedback bank to enable reuse of existing items
• Save values in database, then statistical analysis of
performance across assessments
• Closer integration with Moodle
• Offline version?
Questions?
http://blogs.city.ac.uk/ted
http://www.flickr.com/photos/irglover/
CC BY-NC-SA 3.0
References
• Andrade, H. & Du, Y. (2005).
Student perspectives on rubric-referenced assessment. Practical Assessment,
Research & Evaluation, 10(5). [Online]
• Duncan, N. (2007). ‘Feed-forward’: improving students’ use of tutors’ comments
. Assessment & Evaluation in Higher Education. 32 (2). [Online]
• Nicol, D. J. & Macfarlane-Dick, D. (2006).
Formative assessment and self-regulated learning: a model and seven principles of g
. Studies in Higher Education, 31 (2). [Online]
• Stevens, D.D. & Levi, A.J. (2004). Introduction to rubrics: An assessment tool to
save grading time, convey effective feedback and promote student learning,
Sterling, VA: Stylus

More Related Content

What's hot

ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017Ed Foster
 
Australian university teacher’s engagement with learning analytics: Still ea...
Australian university teacher’s engagement with learning analytics:  Still ea...Australian university teacher’s engagement with learning analytics:  Still ea...
Australian university teacher’s engagement with learning analytics: Still ea...Blackboard APAC
 
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...Blackboard APAC
 
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Blackboard APAC
 
Ipt syllabus overview_zarkovic
Ipt syllabus overview_zarkovicIpt syllabus overview_zarkovic
Ipt syllabus overview_zarkovicMR Z
 
Audience Response Systems as an instrument of quality assurance in academic t...
Audience Response Systems as an instrument of quality assurance in academic t...Audience Response Systems as an instrument of quality assurance in academic t...
Audience Response Systems as an instrument of quality assurance in academic t...Zentrum für digitales Lehren und Lernen
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Blackboard APAC
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyEd Foster
 
13:1, may the odds be forever in our favour - Valerie Innes, University of th...
13:1, may the odds be forever in our favour - Valerie Innes, University of th...13:1, may the odds be forever in our favour - Valerie Innes, University of th...
13:1, may the odds be forever in our favour - Valerie Innes, University of th...Association of University Administrators
 
John McInerney 2014 - Training assessors
John McInerney 2014 - Training assessorsJohn McInerney 2014 - Training assessors
John McInerney 2014 - Training assessorsePortfolios Australia
 
4 reasons why you need online assessments
4 reasons why you need online assessments4 reasons why you need online assessments
4 reasons why you need online assessmentsTotus Tabaque
 
HEIT Presentation
HEIT PresentationHEIT Presentation
HEIT Presentationmcdclaire
 
Using Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student EngagementUsing Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student EngagementDave Shields
 
Rob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboardRob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboardRob Howe
 
ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...
ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...
ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...ePortfolios Australia
 

What's hot (20)

ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017
 
Australian university teacher’s engagement with learning analytics: Still ea...
Australian university teacher’s engagement with learning analytics:  Still ea...Australian university teacher’s engagement with learning analytics:  Still ea...
Australian university teacher’s engagement with learning analytics: Still ea...
 
CoLT 2017 - Prof. Dr. Vishna Devi Nadarajah
CoLT 2017 - Prof. Dr. Vishna Devi NadarajahCoLT 2017 - Prof. Dr. Vishna Devi Nadarajah
CoLT 2017 - Prof. Dr. Vishna Devi Nadarajah
 
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
 
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
 
Ipt syllabus overview_zarkovic
Ipt syllabus overview_zarkovicIpt syllabus overview_zarkovic
Ipt syllabus overview_zarkovic
 
Audience Response Systems as an instrument of quality assurance in academic t...
Audience Response Systems as an instrument of quality assurance in academic t...Audience Response Systems as an instrument of quality assurance in academic t...
Audience Response Systems as an instrument of quality assurance in academic t...
 
Ian Scott and Roger Grew - Module Evaluation at Oxford Brookes
Ian Scott and Roger Grew - Module Evaluation at Oxford BrookesIan Scott and Roger Grew - Module Evaluation at Oxford Brookes
Ian Scott and Roger Grew - Module Evaluation at Oxford Brookes
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of Derby
 
Intro Examus
Intro ExamusIntro Examus
Intro Examus
 
13:1, may the odds be forever in our favour - Valerie Innes, University of th...
13:1, may the odds be forever in our favour - Valerie Innes, University of th...13:1, may the odds be forever in our favour - Valerie Innes, University of th...
13:1, may the odds be forever in our favour - Valerie Innes, University of th...
 
Challenges of Quality in Teaching and Learning - Gwen van der velden
Challenges of Quality in Teaching and Learning - Gwen van der veldenChallenges of Quality in Teaching and Learning - Gwen van der velden
Challenges of Quality in Teaching and Learning - Gwen van der velden
 
John McInerney 2014 - Training assessors
John McInerney 2014 - Training assessorsJohn McInerney 2014 - Training assessors
John McInerney 2014 - Training assessors
 
4 reasons why you need online assessments
4 reasons why you need online assessments4 reasons why you need online assessments
4 reasons why you need online assessments
 
HEIT Presentation
HEIT PresentationHEIT Presentation
HEIT Presentation
 
HE Course and Module Evaluation Conference - Paul bennet
HE Course and Module Evaluation Conference - Paul bennet HE Course and Module Evaluation Conference - Paul bennet
HE Course and Module Evaluation Conference - Paul bennet
 
Using Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student EngagementUsing Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student Engagement
 
Rob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboardRob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboard
 
ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...
ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...
ePortfolio for work integrated learning - Jessica Tsai & Christine Slade (Uni...
 

Similar to SCOF: A Standardised, Customisable Online Feedback Tool

Rob howe - assessment strategies in a digital age
Rob howe   - assessment strategies in a digital ageRob howe   - assessment strategies in a digital age
Rob howe - assessment strategies in a digital ageRob Howe
 
Presentation at the conference ecdea.org, 8 of June 2018
Presentation at the conference ecdea.org, 8 of June 2018Presentation at the conference ecdea.org, 8 of June 2018
Presentation at the conference ecdea.org, 8 of June 2018Mats Brenner
 
Introduction to e-submission July 2016
Introduction to e-submission July 2016Introduction to e-submission July 2016
Introduction to e-submission July 2016Bunyan Nick
 
Changing current practice to meet the needs of learners and society
Changing current practice to meet the needs of learners and societyChanging current practice to meet the needs of learners and society
Changing current practice to meet the needs of learners and societyJisc
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEABlackboardEMEA
 
Introduction to e-submission
Introduction to e-submission Introduction to e-submission
Introduction to e-submission Bunyan Nick
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...ExamSoft
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Redesigning assessment and feedback - landscape review and areas for development
Redesigning assessment and feedback - landscape review and areas for developmentRedesigning assessment and feedback - landscape review and areas for development
Redesigning assessment and feedback - landscape review and areas for developmentJisc
 
Carlton Wood | Operational Processes, Technolgy and Support.pptx
Carlton Wood | Operational Processes, Technolgy and Support.pptxCarlton Wood | Operational Processes, Technolgy and Support.pptx
Carlton Wood | Operational Processes, Technolgy and Support.pptxEADTU
 
Designing and Conducting Formative Evaluations
Designing and Conducting Formative EvaluationsDesigning and Conducting Formative Evaluations
Designing and Conducting Formative Evaluationscloder6416
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackjisc-elearning
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfASMZahidKausar
 
Introduction to e-submission at the University of Liverpool
Introduction to e-submission at the University of LiverpoolIntroduction to e-submission at the University of Liverpool
Introduction to e-submission at the University of LiverpoolAlex Spiers
 
Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...
Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...
Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...Lisa D'Adamo-Weinstein
 
Introduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey ResearchIntroduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey ResearchCaroline Jarrett
 
Klaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentKlaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentEADTU
 
Woolley final presentation
Woolley final presentationWoolley final presentation
Woolley final presentationabwoolley
 

Similar to SCOF: A Standardised, Customisable Online Feedback Tool (20)

Rob howe - assessment strategies in a digital age
Rob howe   - assessment strategies in a digital ageRob howe   - assessment strategies in a digital age
Rob howe - assessment strategies in a digital age
 
Presentation at the conference ecdea.org, 8 of June 2018
Presentation at the conference ecdea.org, 8 of June 2018Presentation at the conference ecdea.org, 8 of June 2018
Presentation at the conference ecdea.org, 8 of June 2018
 
Introduction to e-submission July 2016
Introduction to e-submission July 2016Introduction to e-submission July 2016
Introduction to e-submission July 2016
 
Changing current practice to meet the needs of learners and society
Changing current practice to meet the needs of learners and societyChanging current practice to meet the needs of learners and society
Changing current practice to meet the needs of learners and society
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEA
 
Introduction to e-submission
Introduction to e-submission Introduction to e-submission
Introduction to e-submission
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Redesigning assessment and feedback - landscape review and areas for development
Redesigning assessment and feedback - landscape review and areas for developmentRedesigning assessment and feedback - landscape review and areas for development
Redesigning assessment and feedback - landscape review and areas for development
 
Carlton Wood | Operational Processes, Technolgy and Support.pptx
Carlton Wood | Operational Processes, Technolgy and Support.pptxCarlton Wood | Operational Processes, Technolgy and Support.pptx
Carlton Wood | Operational Processes, Technolgy and Support.pptx
 
Designing and Conducting Formative Evaluations
Designing and Conducting Formative EvaluationsDesigning and Conducting Formative Evaluations
Designing and Conducting Formative Evaluations
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedback
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
 
Introduction to e-submission at the University of Liverpool
Introduction to e-submission at the University of LiverpoolIntroduction to e-submission at the University of Liverpool
Introduction to e-submission at the University of Liverpool
 
Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...
Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...
Suny empire-dean-of-academic-and-instructional-services-presentation -d'adamo...
 
OBE_An_overview.pdf
OBE_An_overview.pdfOBE_An_overview.pdf
OBE_An_overview.pdf
 
Introduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey ResearchIntroduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey Research
 
Klaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentKlaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessment
 
Woolley final presentation
Woolley final presentationWoolley final presentation
Woolley final presentation
 
OBE pdf [Autosaved].ppt
OBE pdf [Autosaved].pptOBE pdf [Autosaved].ppt
OBE pdf [Autosaved].ppt
 

More from Ian Glover

Digital Places: Location-based Digital Practices in Higher Education using Bl...
Digital Places: Location-based Digital Practices in Higher Education using Bl...Digital Places: Location-based Digital Practices in Higher Education using Bl...
Digital Places: Location-based Digital Practices in Higher Education using Bl...Ian Glover
 
Exploring the Educational Potential of the Internet of Things (Internet of Th...
Exploring the Educational Potential of the Internet of Things (Internet of Th...Exploring the Educational Potential of the Internet of Things (Internet of Th...
Exploring the Educational Potential of the Internet of Things (Internet of Th...Ian Glover
 
Making Connections - Students' Use of Past Feedback
Making Connections - Students' Use of Past FeedbackMaking Connections - Students' Use of Past Feedback
Making Connections - Students' Use of Past FeedbackIan Glover
 
Teaching Approaches Menu Workshop - SEDA conference 2014
Teaching Approaches Menu Workshop - SEDA conference 2014Teaching Approaches Menu Workshop - SEDA conference 2014
Teaching Approaches Menu Workshop - SEDA conference 2014Ian Glover
 
Developing a Menu of Teaching Approaches to Encourage Deeper Engagement with TEL
Developing a Menu of Teaching Approaches to Encourage Deeper Engagement with TELDeveloping a Menu of Teaching Approaches to Encourage Deeper Engagement with TEL
Developing a Menu of Teaching Approaches to Encourage Deeper Engagement with TELIan Glover
 
Open Badges (Contemporary Approaches to Teaching workshop)
Open Badges (Contemporary Approaches to Teaching workshop)Open Badges (Contemporary Approaches to Teaching workshop)
Open Badges (Contemporary Approaches to Teaching workshop)Ian Glover
 
Building Resources to Encourage Innovation in Teaching Practice
Building Resources to Encourage Innovation in Teaching PracticeBuilding Resources to Encourage Innovation in Teaching Practice
Building Resources to Encourage Innovation in Teaching PracticeIan Glover
 
Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...
Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...
Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...Ian Glover
 
Open Badges in Higher Education - Perception and Potential
Open Badges in Higher Education - Perception and Potential Open Badges in Higher Education - Perception and Potential
Open Badges in Higher Education - Perception and Potential Ian Glover
 
Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...
Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...
Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...Ian Glover
 
Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...
Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...
Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...Ian Glover
 
The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...
The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...
The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...Ian Glover
 
A Tale of One City: Intra-institutional Variations in Migrating VLE Platform
A Tale of One City: Intra-institutional Variations in Migrating VLE PlatformA Tale of One City: Intra-institutional Variations in Migrating VLE Platform
A Tale of One City: Intra-institutional Variations in Migrating VLE PlatformIan Glover
 
Yo! YouTube wraps!
Yo! YouTube wraps!Yo! YouTube wraps!
Yo! YouTube wraps!Ian Glover
 
Open Badges: Supporting Learning and Employability by Recognising Skills Deve...
Open Badges: Supporting Learning and Employability by Recognising Skills Deve...Open Badges: Supporting Learning and Employability by Recognising Skills Deve...
Open Badges: Supporting Learning and Employability by Recognising Skills Deve...Ian Glover
 
Play as You Learn: Gamification as a Technique for Motivating Learners
Play as You Learn: Gamification as a Technique for Motivating LearnersPlay as You Learn: Gamification as a Technique for Motivating Learners
Play as You Learn: Gamification as a Technique for Motivating LearnersIan Glover
 

More from Ian Glover (16)

Digital Places: Location-based Digital Practices in Higher Education using Bl...
Digital Places: Location-based Digital Practices in Higher Education using Bl...Digital Places: Location-based Digital Practices in Higher Education using Bl...
Digital Places: Location-based Digital Practices in Higher Education using Bl...
 
Exploring the Educational Potential of the Internet of Things (Internet of Th...
Exploring the Educational Potential of the Internet of Things (Internet of Th...Exploring the Educational Potential of the Internet of Things (Internet of Th...
Exploring the Educational Potential of the Internet of Things (Internet of Th...
 
Making Connections - Students' Use of Past Feedback
Making Connections - Students' Use of Past FeedbackMaking Connections - Students' Use of Past Feedback
Making Connections - Students' Use of Past Feedback
 
Teaching Approaches Menu Workshop - SEDA conference 2014
Teaching Approaches Menu Workshop - SEDA conference 2014Teaching Approaches Menu Workshop - SEDA conference 2014
Teaching Approaches Menu Workshop - SEDA conference 2014
 
Developing a Menu of Teaching Approaches to Encourage Deeper Engagement with TEL
Developing a Menu of Teaching Approaches to Encourage Deeper Engagement with TELDeveloping a Menu of Teaching Approaches to Encourage Deeper Engagement with TEL
Developing a Menu of Teaching Approaches to Encourage Deeper Engagement with TEL
 
Open Badges (Contemporary Approaches to Teaching workshop)
Open Badges (Contemporary Approaches to Teaching workshop)Open Badges (Contemporary Approaches to Teaching workshop)
Open Badges (Contemporary Approaches to Teaching workshop)
 
Building Resources to Encourage Innovation in Teaching Practice
Building Resources to Encourage Innovation in Teaching PracticeBuilding Resources to Encourage Innovation in Teaching Practice
Building Resources to Encourage Innovation in Teaching Practice
 
Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...
Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...
Open Badges: Using 'Lightweight' Rewards and Credentials to Increase Motivati...
 
Open Badges in Higher Education - Perception and Potential
Open Badges in Higher Education - Perception and Potential Open Badges in Higher Education - Perception and Potential
Open Badges in Higher Education - Perception and Potential
 
Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...
Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...
Investigating Perceptions and Potential of Open Badges in Formal Higher Educa...
 
Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...
Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...
Integrating Flickr-based Images into Moodle to Increase Visual Appeal and Dyn...
 
The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...
The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...
The Distributed, Web 2.0 VLE? Incorporating External Content Platforms into ...
 
A Tale of One City: Intra-institutional Variations in Migrating VLE Platform
A Tale of One City: Intra-institutional Variations in Migrating VLE PlatformA Tale of One City: Intra-institutional Variations in Migrating VLE Platform
A Tale of One City: Intra-institutional Variations in Migrating VLE Platform
 
Yo! YouTube wraps!
Yo! YouTube wraps!Yo! YouTube wraps!
Yo! YouTube wraps!
 
Open Badges: Supporting Learning and Employability by Recognising Skills Deve...
Open Badges: Supporting Learning and Employability by Recognising Skills Deve...Open Badges: Supporting Learning and Employability by Recognising Skills Deve...
Open Badges: Supporting Learning and Employability by Recognising Skills Deve...
 
Play as You Learn: Gamification as a Technique for Motivating Learners
Play as You Learn: Gamification as a Technique for Motivating LearnersPlay as You Learn: Gamification as a Technique for Motivating Learners
Play as You Learn: Gamification as a Technique for Motivating Learners
 

Recently uploaded

VIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfVIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfArthyR3
 
BBA 205 BUSINESS ENVIRONMENT UNIT I.pptx
BBA 205 BUSINESS ENVIRONMENT UNIT I.pptxBBA 205 BUSINESS ENVIRONMENT UNIT I.pptx
BBA 205 BUSINESS ENVIRONMENT UNIT I.pptxProf. Kanchan Kumari
 
Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...
Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...
Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...gdgsurrey
 
2024.03.16 How to write better quality materials for your learners ELTABB San...
2024.03.16 How to write better quality materials for your learners ELTABB San...2024.03.16 How to write better quality materials for your learners ELTABB San...
2024.03.16 How to write better quality materials for your learners ELTABB San...Sandy Millin
 
DLL Catch Up Friday March 22.docx CATCH UP FRIDAYS
DLL Catch Up Friday March 22.docx CATCH UP FRIDAYSDLL Catch Up Friday March 22.docx CATCH UP FRIDAYS
DLL Catch Up Friday March 22.docx CATCH UP FRIDAYSTeacherNicaPrintable
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollDr. Bruce A. Johnson
 
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...AKSHAYMAGAR17
 
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxMetabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxDr. Santhosh Kumar. N
 
3.12.24 Freedom Summer in Mississippi.pptx
3.12.24 Freedom Summer in Mississippi.pptx3.12.24 Freedom Summer in Mississippi.pptx
3.12.24 Freedom Summer in Mississippi.pptxmary850239
 
Plant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptxPlant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptxHimansu10
 
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17Celine George
 
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in PharmacyASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in PharmacySumit Tiwari
 
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfPHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfSumit Tiwari
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...Nguyen Thanh Tu Collection
 
Quantitative research methodology and survey design
Quantitative research methodology and survey designQuantitative research methodology and survey design
Quantitative research methodology and survey designBalelaBoru
 
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptxAUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptxiammrhaywood
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudDr. Bruce A. Johnson
 
The OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita AnandThe OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita AnandDr. Sarita Anand
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptxmary850239
 

Recently uploaded (20)

VIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfVIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdf
 
BBA 205 BUSINESS ENVIRONMENT UNIT I.pptx
BBA 205 BUSINESS ENVIRONMENT UNIT I.pptxBBA 205 BUSINESS ENVIRONMENT UNIT I.pptx
BBA 205 BUSINESS ENVIRONMENT UNIT I.pptx
 
Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...
Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...
Certification Study Group - Professional ML Engineer Session 3 (Machine Learn...
 
2024.03.16 How to write better quality materials for your learners ELTABB San...
2024.03.16 How to write better quality materials for your learners ELTABB San...2024.03.16 How to write better quality materials for your learners ELTABB San...
2024.03.16 How to write better quality materials for your learners ELTABB San...
 
DLL Catch Up Friday March 22.docx CATCH UP FRIDAYS
DLL Catch Up Friday March 22.docx CATCH UP FRIDAYSDLL Catch Up Friday March 22.docx CATCH UP FRIDAYS
DLL Catch Up Friday March 22.docx CATCH UP FRIDAYS
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community Coll
 
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
 
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxMetabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
 
3.12.24 Freedom Summer in Mississippi.pptx
3.12.24 Freedom Summer in Mississippi.pptx3.12.24 Freedom Summer in Mississippi.pptx
3.12.24 Freedom Summer in Mississippi.pptx
 
Plant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptxPlant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptx
 
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
 
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in PharmacyASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
 
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfPHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
 
Problems on Mean,Mode,Median Standard Deviation
Problems on Mean,Mode,Median Standard DeviationProblems on Mean,Mode,Median Standard Deviation
Problems on Mean,Mode,Median Standard Deviation
 
Quantitative research methodology and survey design
Quantitative research methodology and survey designQuantitative research methodology and survey design
Quantitative research methodology and survey design
 
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptxAUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced Stud
 
The OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita AnandThe OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx
 

SCOF: A Standardised, Customisable Online Feedback Tool

  • 1. SCOF: A Standardised, Customisable Online Feedback Tool Dr. Ian Glover City University London, UK {ian.glover.1@city.ac.uk}
  • 2. Outline • The Problem(s) • Possible Solutions • SCOF • Potential Uses • Demonstration • Early Results • Future Work
  • 3. Problem - Sector (UK) • Increasing student demand for meaningful feedback. • Higher student fees = better ‘value’ needed. • Reduced government funding = less resources per student. • National Union of Students Charter on Feedback & Assessment (Summary)
  • 5. Problem - Institution • Institution-wide feedback timescale (3 weeks max.) • Increased reliance on PhD students for grading • Huge pressure to increase research outputs
  • 6. Problem – School/Faculty • Wide variety of assessment methods: • Online, Offline (Hard copy), Situated (Labs) • Reports, schematics, models, software, presentations, … • Little exposure to learning technologies or pedagogical good practice • Conservative mind-set – resistant to new processes
  • 7. Possible Solutions • Quality-focussed solutions • Formal moderation of all feedback • Mandatory training in providing good feedback – including periodic reviews • Peer review of feedback • Speed-focussed solutions • Rubrics/Feedback schema • Brief audio/video summaries • Generic feedback for whole cohort
  • 8. But… • Rubrics/Schemes trade individuality for speed (Stevens & Levi, 2004) • Detailed feedback necessarily focuses on errors/problems • Little time to encourage and praise good work (Nicol & Macfarlane-Dick, 2006) • Students have mixed reactions to rubrics • Like the speed of feedback they allow • Dislike the impersonal text (Andrade & Du, 2005) • Yet, standardisation can help students make better use of feedback (Duncan, 2007)
  • 9. None ideal, so a ‘third way’ needed
  • 11. SCOF • Aims to give the speed of rubrics, but encourage consistent, high-quality personal feedback. • Can include grades for each feedback item. • 3-stage process • Select scheme values • Customise generated output • Save final file Example Scheme in SCOF Feedback Editing
  • 12. SCOF • Produces ‘rich’ electronic documents with images, links, styling, etc. • Output not obviously based on a rubric Example Final Output File (PDF)
  • 13. SCOF • Intended for use on Tablets (e.g. iPads, Android, etc.) and Smartphones, as well as PCs. • Can import gradebook from Moodle for easier personalisation. • Though not linked to particular assessment type, or distribution platform (i.e. VLE).
  • 14. Potential Uses • ‘Instant’ feedback, e.g. for presentations • Support ‘Feedforward’ practices by giving links to extra resources. • Provide quality base feedback for use by inexperienced graders • Peer review by students • Focus on common aspects = more time on specifics
  • 16. Early Results • Pilots across 4 schools at City (Social Sciences, Health, Informatics, Engineering) • Students appreciate the increased speed of receiving feedback • Staff like the efficiency increases in producing quality feedback • But, some resistance due to having to plan the feedback scheme prior to grading.
  • 17. But Don’t Just Take My Word For It! Daniel Apau (Pilot User, Lecturer in Health Sciences)
  • 18. Future Work • Open Source release • Feedback bank to enable reuse of existing items • Save values in database, then statistical analysis of performance across assessments • Closer integration with Moodle • Offline version?
  • 20. References • Andrade, H. & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation, 10(5). [Online] • Duncan, N. (2007). ‘Feed-forward’: improving students’ use of tutors’ comments . Assessment & Evaluation in Higher Education. 32 (2). [Online] • Nicol, D. J. & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: a model and seven principles of g . Studies in Higher Education, 31 (2). [Online] • Stevens, D.D. & Levi, A.J. (2004). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback and promote student learning, Sterling, VA: Stylus

Editor's Notes

  1. Feedback charter has 10 principles: 1. Formative assessment and feedback should be used throughout the programme 2. Students should have access to face-to-face feedback for at least the first priece of assessent each academic year 3. Receiving feedback should not be exclusive to certain forms of assessment 4. Feedback should be timely 5. Students should be provided with a variety of assessment methods 6. There should be anonymous marking for all summative assessment 7. Students should be able to submit assessment electronically 8. Students should be supported to critique their own work 9. Programme induction should include information on assessment practices and undersatning marking criteria 10. Students should be given a choice of format for feedback
  2. Scof derived from Scoff – Eat lots quickly.
  3. http://www.staff.city.ac.uk/~sbbf700/scof-demo/final/prepareToFeedback.html
  4. 0.30 – 0.48 4.44