Practical Project Design > Unit 5 > Demo section

Wing Ling's Project

  Task Set up factors for project evaluation
 
 
It took Wing Ling four weeks to implement her project. She is now at the project evaluation stage. It needs a set of standards or criteria to evaluate any project. In Wing Ling's case, her criteria should be set concerning these aspects of her project:

the problem
the methods used in problem analysis
the project objective
the project hypothesis
the project rationale
the project design
the stages and details of project implementation
the methods used in project implementation
the results obtained from the project implementation
the methods used to obtain the results

These factors are universal in the sense that they should be properly considered for any project evaluation, including yours.

The problem

The crucial question to be asked is: Is the problem a researchable one? Note that the notion of being researchable is relative to the investigator. Let's take Wing Ling's case. We want to know if her problem is a researchable one to her. In other words, given the resources, the time, the expertise Wing Ling has, can she launch a project to solve it?

The methods used in problem analysis

The crucial question to be asked is: Are the methods used to analyze the problem acceptable, suitable to it and properly applied? Wing Ling used the analytic method, Socratic dialogue, cause analysis, and questionnaire. These are all acceptable methods suitable to her problem. She also used them properly.

The project objective

The crucial question to be asked is: Is the project objective realistic? That is, can it be achieved, given the time, the resources and the expertise? (The project objective is related to whether the problem is researchable or not.)

Wing Ling's project objective -- to enhance learners' interest in pair work -- is realistic.

The project hypothesis

The crucial question to be asked is: Is the project hypothesis provable? In other words, can it be proved to be wrong? If a hypothesis cannot be proved to be wrong (remember technically termed falsified?), it is a bad hypothesis. A good and workable hypothesis must be able to be put to verification or falsification.

Wing Ling's hypothesis -- Learners' interest in pair work is increased by better-designed pair work exercises -- is provable. She has found that her students' interest in pair work has indeed been increased after she used the newly designed pair work exercises.

The project rationale

The crucial question to be asked is: Does the project have a sound basis? In other words we examine the reasons for the project, and the theoretical or rational assumptions the investigator makes.

Wing Ling's project was based on the four theoretical assumptions which are valid and sound.

The project design

The crucial questions to be asked include:
Has the investigator defined his or her project objective?
Has the investigator defined his or her project hypothesis?
Has the investigator stated his or her project rationale?
Has the investigator worked out the details for project implementation?
Has the investigator planned the stages and the timetable for the project implementation?

Wing Ling has fulfilled all these requirements.

The stages and details of project implementation

The crucial questions to be asked include: Are the stages necessary and complete? Are the implementation details properly maintained?

In Wing Ling's case, she is assessed on the following items:

Week 1
Teaching notes
Students' handout
Diary-keeping
Audio-recording

Week 2
Teaching notes
Students' handout
Diary-keeping
Audio-recording

Week 3
Teaching notes
Students' handout
Diary-keeping
Audio-recording

Week 4
Teaching notes
Students' handout
Diary-keeping
Audio-recording

The methods used in project implementation

The crucial question to be asked is: In what way has the project been implemented?

In Wing Ling's case, she first set up control and target groups and used the classroom teaching.

The methods used to obtain the results

The crucial questions to be asked are: In what way has the investigator obtained the project results? Is it acceptable, suitable and properly used?

Wing Ling used observations, diary-keeping, audio-taping and questionnaire to obtain the project results. They are all acceptable, suitable to the task and properly used.

Table 1 summarizes the methods Wing Ling has used in her project:

Stages of the Project
The methods Used
Problem analysis analytic method
Socratic dialogue
cause analysis
questionnaire
Project design brainstorming
control and target groups
Project implementation observation
diary-keeping
audio-taping
questionnaire

The results obtained from the project implementation

The crucial question to be asked is: Has the project hypothesis been proved or disproved or partially proved or suspended?

Wing Ling's hypothesis has been proved to be correct.