A quiz was developed by Diana Quinn to support staff who were implementing
the University's online course evaluation instrument (CEI) for the first time.
The issues and considerations associated with setting up the CEI were presented
as an online quiz to assist then locating the information that was most
relevant to their course delivery mode. A decision tree for 6 major issues was
prepared and the items sequenced logically.
The quiz was developed such that no answer was correct. For each answer
alternate, the appropriate feedback (for example, the action they needed to
take) was explained, thus contextualising the information for the learners own
unique situation.
|
Question 1
All courses need to be evaluated in some way each time they are taught,
however it is essential that a CEI be used if your course is part of program
deemed to be under review in that year. A CEI can also be used even if the
program is not in review.
Do you need, or want to, create a CEI for your course?
a) Yes
b) No
|
|
Feedback to option a
Good. The rest of this quiz will guide you through the issues that need to be
considered. Please continue onto the next question.
Remember however, that the CEI is only one type of evaluation tool that looks
at student perceptions of your course. Other types of evaluation are
possible. These could include the use of a TellUs2 online survey as an
evaluation tool. Peer review, such as allowing colleagues to attend and
critically review your teaching, is another possibility. Focus groups with
stakeholders (students, employers, and professional societies) are other
options.
|
|
Feedback to option b
You will still need to evaluate your course if it is being offered this year.
Other types of evaluation could include the use of TellUs 2 online surveys as
an evaluation tool. Peer review, such as allowing colleagues to attend and
critically review your teaching is another possibility. Focus groups with stakeholders
(students, employers, and professional societies) are other options.
You do not need to proceed any further with this quiz.
|
|
Question 2
Is your course offered in more than one mode (internal, external and/or
offshore)?
a) Yes, it has more than one mode.
b) No, it is only offered in one mode.
|
|
Feedback to option a
A CEI needs to be created for each mode of course. So if you offer an
internal and external offering of your course, then 2 CEI surveys will need
to be created for each semester it is offered.
|
|
Feedback to option b
As this course has only one mode, you will need to create only one CEI per
semester.
|
|
Question 3
Are you the only person involved with teaching the course?
a) Yes
b) No
|
|
Feedback to option a
When groups of people are involved in teaching courses a decision will need
to be made about who actually creates the CEI.
The designated course co-ordinator, as recorded in the Medici databases, only
has this ability in the first instance.
|
|
Feedback to option b
When groups of people are involved in teaching courses a decision will need
to be made about who actually creates the CEI. It is advisable that the team
discuss this and nominate who will build the online survey, in which
semester, and for which mode. Another issue is the composition of the CEI
questions. There are 10 standard questions (Lickert agree/disagree) and up to
10 additional Lickert questions and 3 additional text response questions can
be used. Will these additional questions suit all the student groups that
will use this CEI? The course team, especially those teams that go across
campus (eg Magill and Whyalla) need to come to a decision about who will be
responsible for the course's CEI.
The Medici database is where the CEI allocates who can set up a CEI. The
designated course co-ordinator in Medici only has this ability.
|
|
Question 4
The Student Evaluation of Teaching (SET) is a survey of student perceptions
of the teacher. The data it gathers can be used to reflect on and evaluate
the effectiveness of any of the individual teachers within a course. It
comprises 10 core Lickert questions and 2 optional text response questions.
If any of the teaching team members are intending to apply for promotion,
they will need to have SET data available for the Promotions Panel. The SET
is added onto the CEI so that those students can provide feedback on the
course and the teacher within the same survey.
Do you, or any of the course team members, require a SET survey attached to
the CEI?
a) No. Neither I, nor any of my course team members, require a SET to
be added onto the CEI.
b) Yes. I, and/or one of my course team members, require a SET to be
added onto the CEI.
|
|
Feedback to option a
Move on to the next question.
|
|
Feedback to option b
The SET is added onto the CEI. The person who is being evaluated by the SET
is the only person who can activate it. The course co-ordinator will need to
extend access to the CEI/SET tool to the person requiring a SET to allow them
to create and activate it for access by the relevant students.
SETs can be added to CEIs as they are created, or after creation if it is
prior to the survey being activated (i.e. start date passed and students
entering data).
When you create a SET you will need to know the students who form their
classes (eg. members of tutorial groups, lecture groups etc) that they teach.
The person who requires the SET must decide whether or not they wish to
include optional questions in addition to the 10 core questions, and what the
questions will be.
|
|
Question 5
All staff who have their names linked as course co-ordinators of a course
offering through Medici, are automatically able to author a CEI for a course,
and view the collated results. View only access is available for Program
directors who, if the program is in review, will need to collate your CEI
data with that of the other courses, and generate a report.
Are there any other staff members who will need to author and/or view the
data collected from a CEI questionnaire?
a) Yes
b) No
c) I teach in this course but the CEI survey will not let me create a CEI.
d) We plan to do our CEI by pencil and paper and have one of our
general staff members enter in the student data
into the online CEI for us - they will need to have access.
|
|
Feedback to option a
You will need to add their name to the CEI for that course.
Enter the CEI menu.
Select "Providing Staff Access"
Enter person's name, press SUBMIT
Their name will appear in the table at the top of the refreshed page.
|
|
Feedback to option b
You will not need to add permissions.
|
|
Feedback to option c
The staff members associated with your course was collected from the data
within Medici. Your school is responsible for keeping this information
correct. Please check with your School Administrator to ensure the Medici
database is correct (Principal instructors on Medici are automatically able
to set up CEIs).
|
|
Feedback to option d
You will need to enter this staff members details to the CEI when it is created.
Remember, only one data entry staff member is allowed to enter data per CEI.
When published manually, return to the table of CEIs and not that there now
is an M in the table under "Publish".
Select the CEI, by clicking on Select at the end of the row.
Select view the questionnaire.
At this point you will be able to nominate the person who can enter data from
paper-based surveys.
Once survey data is returned, the person entering data enters the CEI site as
an Administrator (UniSA home page, Services for staff, Evaluation of
University courses and Programs, CEI, CEI, Administration, Log in).
|
|
Question 6
All CEIs need to be created online. However, you have an option or whether to
allow your students to access the CEI online, or provide them with a pencil
and paper based CEI. There are several considerations for each, that are
listed below:
Online CEI Considerations:·
·
Makes use of
popular technology
·
Immediate response
·
Quick turnaround
time
·
No human resources
required
·
No handling of
forms
·
Increased flexibility
in when and where student can respond
·
Includes students
not attending class on a particular day
·
Potential for low
participation rate
Paper CEI
Considerations:
·
Increased cost -
human resources to administer paper based questionnaires
·
Increased cost -
human resources for data entry
·
Delay in responses
·
Slow turnaround
time
·
Time/place specific
access for students
·
Potential for high
participation rate
Which mode of CEI
delivery best suits your course?
a) Paper-based CEI delivery
b) Online CEI delivery
|
|
Feedback to option a
You have selected paper-based delivery of your CEI.
You will now need to generate your CEI. This is always done online.
·
Go to UniSA home
page, Services for Staff, Select Evaluation of Courses and Programs, and
select CEI.
·
Allocate access to
other authors.
·
Allocate other
viewers of the data.
·
Determine when, and
for how long, you would like the evaluation to be available for your
independent staff member to enter data in.
·
"Publish"
your questionnaire by clicking on "Manual Process".
·
Print out the
'Paper-based' version of the CEI.
·
Duplicate the
questionnaire.
·
Organise for
independent person to administer the CEI to identified student groups.
·
Administer the
questionnaire.
Enter data entry
person's details into CEI (this can only be done after publishing manually -
M appears in CEI table -, Click on 'Select", then view the
questionnaire. At the top of the page is a link to allow you to add the name
of the people authorised to do the data entry. Use the 'Submit button".
Independent person then enters data into online CEI.
·
The CEI tool will
collate results and provide data (graphs, downloadable data) for
·
the teacher to
review their SET
·
Course coordinator
and other teachers to view CEI
·
Program directors
to collate multiple CEI and produce report
·
Head of School to
view responses
|
|
Feedback to option b
You have selected online delivery of your CEI.
You will now need to generate your CEI. This is always done online.
·
Go to UniSA home
page, Services for Staff, Select Evaluation of Courses and Programs, and
select CEI.
·
Allocate access to
other authors.
·
Allocate other
viewers of the data.
·
Determine when, and
for how long, you would like the evaluation to be available to students.
·
Publish your questionnaire
to the web (generates a URL, or web address)
·
Promote the CEI's
URL to students, and the time frame that it is available for them to provide
their feedback.
The CEI tool will
collate results and provide data (graphs, downloadable data) for
·
the teacher to
review their SET and CEI
·
Course coordinator
and other teachers to view CEI
·
Program directors
to collate multiple CEI and produce report
·
Head of School to
view responses
|