It took Wing Ling four weeks to implement
her project. She is now at the project evaluation
stage. It needs a set of standards or criteria
to evaluate any project. In Wing Ling's case,
her criteria should be set concerning these
aspects of her project:
the problem
the methods used in problem analysis
the project objective
the project hypothesis
the project rationale
the project design
the stages and details of project implementation
the methods used in project implementation
the results obtained from the project implementation
the methods used to obtain the results
These factors are universal in the sense
that they should be properly considered
for any project evaluation, including yours.
The problem
The crucial question to be asked is: Is
the problem a researchable one? Note
that the notion of being researchable is
relative to the investigator. Let's take
Wing Ling's case. We want to know if her
problem is a researchable one to her. In
other words, given the resources, the time,
the expertise Wing Ling has, can she launch
a project to solve it?
The methods used in problem analysis
The crucial question to be asked is: Are
the methods used to analyze the problem
acceptable, suitable to it and properly
applied? Wing Ling used the analytic
method, Socratic dialogue, cause analysis,
and questionnaire. These are all
acceptable methods suitable to her problem.
She also used them properly.
The project objective
The crucial question to be asked is: Is
the project objective realistic? That
is, can it be achieved, given the time,
the resources and the expertise? (The project
objective is related to whether the problem
is researchable or not.)
Wing Ling's project objective -- to enhance
learners' interest in pair work -- is realistic.
The project hypothesis
The crucial question to be asked is: Is
the project hypothesis provable? In
other words, can it be proved to be wrong?
If a hypothesis cannot be proved to be wrong
(remember technically termed falsified?),
it is a bad hypothesis. A good and workable
hypothesis must be able to be put to verification
or falsification.
Wing Ling's hypothesis -- Learners' interest
in pair work is increased by better-designed
pair work exercises -- is provable. She
has found that her students' interest in
pair work has indeed been increased after
she used the newly designed pair work exercises.
The project rationale
The crucial question to be asked is: Does
the project have a sound basis? In other
words we examine the reasons for the project,
and the theoretical or rational assumptions
the investigator makes.
Wing Ling's project was based on the four
theoretical assumptions which are valid
and sound.
The project design
The crucial questions to be asked include:
Has the investigator defined his or her
project objective?
Has the investigator defined his or her
project hypothesis?
Has the investigator stated his or her
project rationale?
Has the investigator worked out the details
for project implementation?
Has the investigator planned the stages
and the timetable for the project implementation?
Wing Ling has fulfilled all these requirements.
The stages and details of project implementation
The crucial questions to be asked include:
Are the stages necessary and complete?
Are the implementation details properly
maintained?
In Wing Ling's case, she is assessed on
the following items:
Week 1
Teaching notes
Students' handout
Diary-keeping
Audio-recording
Week 2
Teaching notes
Students' handout
Diary-keeping
Audio-recording
Week 3
Teaching notes
Students' handout
Diary-keeping
Audio-recording
Week 4
Teaching notes
Students' handout
Diary-keeping
Audio-recording
The methods used in project implementation
The crucial question to be asked is: In
what way has the project been implemented?
In Wing Ling's case, she first set up control
and target groups and used the classroom
teaching.
The methods used to obtain the results
The crucial questions to be asked are:
In what way has the investigator obtained
the project results? Is it acceptable, suitable
and properly used?
Wing Ling used observations, diary-keeping,
audio-taping and questionnaire to obtain
the project results. They are all acceptable,
suitable to the task and properly used.
Table 1 summarizes the methods Wing Ling
has used in her project:
The results obtained from the project
implementation
The crucial question to be asked is: Has
the project hypothesis been proved or disproved
or partially proved or suspended?
Wing Ling's hypothesis has been proved
to be correct.
|