This presentation explains the new method (based on attainment level) of Course Outcome and Program Outcome Calculation. (with reference to National Board of Accreditation new SAR)
Course Outcome and Program Outcome Calculation(new method)
1. National Board of
Accreditation
Course Outcome and Program
Outcome Calculations
(New method Based on Attainment Level)
-By Ravikumar Tiwari,
Assistant Professor,
G.H.Raisoni College of Engineering, Nagpur
e- rravik.tiwari@gmail.com
@RaviTiwari90
3. Few definitions
Mapping Factor(Correlation Level)
It indicates to what extent a
certain component(either
assessment method to CO or
CO to PO or PO to PEO & PSO)
3-indicates Substantial (high)
mapping (high contribution
towards attainment)
2-indicates Moderate
(medium) mapping (medium
contribution towards
attainment)
1-indicates Slight (low)
mapping (some contribution
towards attainment)
Level of Attainment:
This is just discretization of
percent attainment
To not get confused with
mapping factor, will indicate
this by labels as
HH(3)- High level of
attainment
MM(2)- Medium level of
attainment
LL(1)- Low level of
attainment
NA(0)- No attainment
4. CO-PO mapping (example)
PO 1 PO 2 PO 3 PO 4 PO 5
PO
6
PO
7
PO
8
PO
9
PO
10
PO
11
PO
12
SEM
NBA
COD
E
SUB
CODE
Course
COURSE
OUTCO
MES
COURSE OUTCOMES
Statement
Thir
d
C203
BEXX2
01
Course
name
C203.1
.
3 3 2 2 - - 3 3 2 2 1 -
C203.2 - - - - - - 3 3 3 2 1 -
C203.3 - - - - - - 3 2 2 2 1 -
C203.4 - - - - - - 3 2 2 2 1 -
C203.5 - - - - - - 2 2 2 2 1 -
C203.6 - - - - - - 2 2 2 2 1 -
This is example for one course, the same to be done for all course of
program including courses taught in first year
1: Slight (Low) 2: Moderate (Medium) 3: Substantial (High) “-” : no correlation
5. Level of attainment
Scale of levels can be defined by program coordinator or
Head of department
Here 3 levels of attainment is taken as 1-Low; 2-medium; 3-
High
3 levels of attainment can be defined as
HH(3) :- 70% students scoring more than average marks or set
target marks in an assessment method
MM(3):- 60% students scoring more than average marks or set
target marks in an assessment method
LL (1) :- 50% students scoring more than average marks or set
target marks in an assessment method
NA(0):- Less than 50% students scoring more than average
marks or set target marks in an assessment method
6. Course Outcome Calculations
If targets are achieved then all the course outcomes are attained
for that year Program is expected to set higher targets for the
following years as a part of continuous improvement
Also if scale of 3 levels is used in one year, and if higher level is
attained then scale of 5 levels can be used following year. Scale of
5 level may be defined as follows:
HH(5) :- 80% students scoring more than average marks or set target
marks in an assessment method
HM(4):- 70% students scoring more than average marks or set target
marks in an assessment method
MM (3) :- 60% students scoring more than average marks or set target
marks in an assessment method
ML (2) :- 50% students scoring more than average marks or set target
marks in an assessment method
LL (1) :- 40% students scoring more than average marks or set target
marks in an assessment method
NA(0):- Less than 40% students scoring more than average marks or set
target marks in an assessment method
If targets are not achieved then instead of lowering target; program
should put in place an action plan to attain the target in
subsequent years
7. Target Setting for each
assessment method
For setting up target average; average marks of last
three exam must be taken into consideration and it
should be kept as target average marks
If average marks of last exams are not available then
current average marks can also be considered as
target attainment
This would be different for each assessment method
(e.g. Internal assessment: assignment1, assignment2,
class test1, class test2 etc. External assessment: End sem
exam/university exam, Practical external exam)
To be noted here last three exam should be taken into
account i.e. to say one course may be offered in even
and odd both sem as under CBCS
8. Mapping of CO with Assessment
methods (example)
Internal Component
External
Component
Teacher Assignment Class Test Practical
examination
(if there for
the course)
End Sem
Exam
Course
Name
Course
Outcome
T1 T2 T3 T4 T5 C1 C2 C3
Course:
C301
(Course
Name)
C301.1
2 - - - - 3 - - 3 3
C301.2
1 - - 2 - 3 - - 3 3
C301.3
- 3 1 - 2 - 3 - 3 3
C301.4
3 - - - 1 - 3 - 3 3
C301.5
- 1 - - - - - 3 3 3
C301.6
- - 3 - 3 - - 3 3 3
1: Slight (Low) 2: Moderate (Medium) 3: Substantial (High) “-” : no correlation
9. Justification of Mapping
Proper justification for course outcomes with assessment must be
provided.
For internal assessment like teacher assignment and class test,
one can design the assessment based on Course Outcomes
For example, Class Test-1 is based on CO1 and CO2 with equal
weightage given to both COs and that is why CO1 & CO2 both
mapped with C1 with mapping factor of 3 (refer previous slide).
Same for Class Test-2(C2) & C3 is done.
While in practical examination, if you have practical's based on
COs and assessment is available practical-wise then mapping
can be done CO-wise or else equal contribution to all COs can
be considered as done here (mapping factor 3 with all COs)
Same for end semester/University exam, if questions are based
on COs and also evaluation is available question-wise then COs
to be mapped question-wise or else equal contribution to all
COs can be considered as done here (mapping factor 3 with all
COs)
10. CO based practical's and
end sem questions (for TIER-I)
For TIER-I category institutes (Autonomous college and deemed
university), where all exams are taken by institute; they can
have list of practical's designed keeping Course Outcome in
mind. Also evaluation should be done CO-wise.
Same with End-Sem(term) exam, questions should be so
deigned based to assess Course Outcome
For example, (considering six CO), Six practical's each
specifically for each CO. Also the internal ERP software can be
so designed where marks for each CO to be inserted and then it
can be converted out of (25/50)
For end sem too, marks of each CO based question should be
inserted and then total marks can be calculated
This will really helpful for assessing Course Outcomes when all
marks of COs are available separately
11. Definition of attainment
Attainment can be defined as what percentage of students
have above set target marks
Example, if 140 students appeared in an end semester exam
(60 marks) and you have set target marks as 30 (last three
exam average to be considered while deciding target marks)
THEN attainment can be calculated as:
% Attainment= (No. of students scoring 30 or above marks /
140)*100
Let’s say 104 students scored 30 or above marks Then %
attainment would be
% Attainment= (104/140)*100 =74.28%
Therefore, level of attainment for end sem exam is “3” as
scale is defined
12. Assigning levels to assessment
method
Teacher Assignment(4) Class Test(20) Pr(25) ESE
Marks
(60)
T1 T2 T3 T4 T5 C1 C2 C3 Practical
Average
(current
exam)
3 4 4 3 4 9.2 11.9 10.5 21 28.0
Target
average(avg
. of last 3
exam)
4 4 4 4 4 10 9 10 20 25
%
Attainment
51 76.1 77.5 55.1 74 51 74.6 61 78 55
Level
LL HH HH LL HH LL HH MM HH LL
Levels
HH(3) :- Above 70%
MM(2):- Above 60%
LL (1) :- Above 50%
NA (0) :- less than 50%
**This are actual calculation done
for my subject
17. Analogy to Credit Grade
System
It is just like the Grading system where we defined cut-off of
marks
Here cut-off are nothing but the Target level of attainment
which we have defined as
HH(3) :- 70% students scoring more than average marks or set
target marks in an assessment method
MM(3):- 60% students scoring more than average marks or set
target marks in an assessment method
LL (1) :- 50% students scoring more than average marks or set
target marks in an assessment method
NA(0):- Less than 50% students scoring more than average marks
or set target marks in an assessment method
18. Analogy to Credit Grade
System
Students who just gets more than cut-off marks pass
the exam but with lower grades
Same in this method too, even if the level of
attainment is just “1” , we can say that Course
Outcome is attained
If Level of attainment is less than “1” then Course
Outcome is not attained and then proper Gap
Analysis to be done
If similar method is used for Outcome calculation of
previous exam then we can set the Target for Level
Attainment or else during mid of term seeing
performance of students in internal component,
Teacher can set target
19. Target for Level Attainment
and Gap Analysis
Couse
Outcome
Attainmen
t Level for
last exam
Target
for
current
exam
Attainment
Level of
current
exam
Gap Gap Analysis
C301.1 1.2 2 1.30 0.70 Performance of
students in end
semester exam is
not as expected
C301.2 1.4 2 1.27 0.73
C301.3 1.5 2 1.67 0.33
C301.4 1.8 2 1.48 0.52
C301.5 1.4 2 1.63 0.37
C301.6 1.3 2 1.50 0.50
*Target should be kept based on the performance of students in first and
second Class Test but before term ends, so that Teacher will have sufficient
time to work on delivery (if performance is on lower side)
23. Program Outcome
Calculation
For Calculation of Program Outcome, we can use two method:
(i)Direct Method (ii)Indirect Method
Direct Method: In direct method, we take CO attainment of all
courses contributing to particular Program Outcomes and then
calculate the attainment based on mapping (as per course
articulation matrix)
Indirect Method: In indirect method, surveys from current passing out
students (program exit survey), survey from employer (during
placement), survey from industry person (if students are working as
intern for some industry) to be taken.
All this survey needs to be quantified [put questions like rate our students
in the scale of 5 (5-excellent, 1-not satisfactory)]
Indirect method too should be based on predefined levels
Example; Level-3: 80% or above survey takers giving 4 or 5 marks
Level-2: 70% or above survey takers giving 4 or 5 marks
Level-1: 60% or above survey takers giving 4 or 5 marks
29. Graphs and Charts
2.24
2.52
2.24
2.36
2.43
2.12
2.20 2.21
1.94
2.48
2.04
2.65
2.28
2.36 2.40
0.00
0.50
1.00
1.50
2.00
2.50
3.00
PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2 PSO3
Overall Attainment: Program Outcomes and Program Specific
Outcomes
30. Few points to remember
Outcome calculation can not be rigid, that is to say one
can have ‘n’ number of methods to calculate
Only thing to remember is method should be properly
justified
Also the method described in this presentation is
completely based on my understanding. I have tried to
addressed all explanation of calculation with proper
justification.
Also if someone disagrees with the method, I am up for
suggestion but no debate
For workshop or session on NBA outcome accreditation,
send me e-mail on rravik.tiwari@gmail.com
31. Consultancy for Software
firm/company
The software companies who are into education
software business , if wants to develops a software/
web portal for Course Outcome and Program
Outcome Calculation, I can consult for developing
algorithm and method
Write an e-mail to me(on title slide) for such work.