Internet Learning Volume 3, Number 1, Spring 2014 | Page 44

Measuring Online Course Design
Course A
Students reported that the course met all of the essential standards except Standards
7.1, 7.2, and 8.1 as measured by the instrument developed by the research team. The
review results conducted by the three certified peer reviewers (none of the peer reviewers
served as an SME on this review) also indicate that the course met most of the essential
standards except Standards 2.1, 2,2, 2.4, 3.3, and 8.1.
Table 1 Student and Peer Reviewer Results on the Essential Standards
Essential Student Peer Reviewer Items
Standards Results Results
1.1 YES YES 2
1.2 YES YES 1
2.1 YES NO 4
2.2 YES NO 5
2.4 YES NO 6
3.1 YES YES 14
3.2 YES YES 15
3.3 YES/YES NO 7, 16
4.1 YES YES 8
5.1 YES YES 13
5.2 YES YES 12
6.1 YES YES 20
6.3 YES YES 21
7.1 NO YES 22
7.2 NO YES 24
8.1 NO NO 25
No statistical differences were detected regarding the standards, with the exception
of Standards 2.1, 2.4, and 3.3. The two groups differed significantly regarding Standard 2.1
U = 1.000, Z = -5.192, p = .000, Standard 2.4 U = 7.500, Z = -3.393, p = .001, and Standard
3.3 (Item 7) U = 22.000, Z = -2.819, p = .005. See Fig. 4 below.
Figure 4. Mann-Whitney U test statistics
43