RUBRICS FOR GRANDING AN OPEN QUESTIONS

A rubric for grading an open question by using the SOLO taxonomy

 

Excellent
Good
Adequate
Marginal

I.  Able to explain" why" and "how" in a coherent way, including details and giving his/her own opinion, point of view, using his/her own words. Able to link the use of COSMIC with real-life professional contexts.

II.  Able to explain" why" and "how" in a coherent way, including details and giving his/her own opinion, point of view, using his/her own words

III.  Able to explain" why" and "how" giving few details and using words and expressions provided in class.

IV.  Able to briefly write about "why" and/or "how" the method is used in the software development process

A+, A, A-

B+, B, B-

C+, C, C-

D

Table 1:

Rubric for an open question (adapted from [9]).

By using the SOLO taxonomy, an analysis of possible answers provided by students to the open question  of the Final Exam ( AT5-2-1: Final Exam - Open question ) is presented next:

Question:   Explain why and how the COSMIC method is used in the software development process.

Answer 1: COSMIC is a method that measures the functionality of the software. This is why this method can be used to measure the size of a piece of software based on the functional user requirements.

Analysis of answer 1:

Level of understanding: Unistructural 

Explanation: The student’s answer is incomplete because it only refers to a brief definition of the COSMIC method. The student excludes the explanation of the connection of COSMIC with the software development process.

In the rubric: Marginal

Answer 2: COSMIC is used for software developers because it is a method that measures the functionality of software.  The method only considers functional user requirements and not technical or quality aspects of the software. COSMIC was created to overcome the weaknesses of the existing Function Points methods which were designed to measure only business software. Any kind of software can be measured with the COSMIC method: business, real-time and embedded software.
In COSMIC, the functional user requirements (FUR) are represented by one or more functional processes which are also represented by four data movements: entry, exit, read and write. Each data movement is equivalent to one CFP (COSMIC Function Point), which is the standard unit of measurement in COSMIC. COSMIC can be used to measure FURs in any phase of the software development process. In addition, the method is also useful to measure software at any level of decomposition, this means: as a whole or components or sub components; and in any layer of multi-layer software architecture.
The applicability of the method to a variety of types of software may be one of the reasons why it has been adopted worldwide by software developers. This adoption might be considered as beneficial for software developers since it is possible for them, for example, to submit their data to a repository of software projects. One of the well known repositories is ISBSG and based on the data in the repository, they can do benchmarking with respect to other projects with similar characteristics. Finally, the whole software community can benefit from the COSMIC method since the data from measured projects can be used by software measurement researchers to develop estimation models.

Analysis of answer 2:

Level of understanding: Extended abstract
This answer meets the inquiries of the question and gives the notion that the student can hypothesize (very high level of understanding) about the benefits of using COSMIC.

In the rubric: Excellent

A rubric for granding the exercise

Complete

Partial

Minimal

Null

Able to identify all the triggering events, functional processes, data groups and more than 80% of the data movements.

Able to identify a considerable number of triggering events, functional processes, data groups (75%) and can distinguish the different types of data movements.

Able to identify some triggering events, functional process and data groups (up to 50%). Struggle identifying data movements.

Able to identify few triggering events, functional process and data groups (up to 25%). Not able to identify data movements correctly.

A+, A, A-

B+, B, B-

C+, C, C-

D

Table 2:

Rubric for functional size measurement