International Journal of Fuzzy Logic and Intelligent Systems 2022; 22(2): 202-212
Published online June 25, 2022
https://doi.org/10.5391/IJFIS.2022.22.2.202
© The Korean Institute of Intelligent Systems
Songlin Yang1;2, Ting Xu1, and Yongcun Shao1
1Wenzheng College of Soochow University, Suzhou, China
2Soochow College, Soochow University, Suzhou, China
Correspondence to :
Songlin Yang (songliny@suda.edu.cn)
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted noncommercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
To investigate the credibility of online examinations, we randomly chose 30 engineering students in Wenzheng College of Soochow University as a sample and established an information system S. According to pedagogy theory, students’scores are related to their intelligence levels, course basis, learning methods, and learning time. Therefore, in the information system S, “score of early semester,” “average score of class quizzes,” “completion ratio of watching videos,” and “completion grade of homework” were taken as the condition attributes, and “score of final exam” was taken as the decision attribute. We applied the three-way decision rules theory to provide positive, negative, and boundary decision rules for this information system S. Furthermore, we obtained confidence in the decision rules. The results of this study validate the credibility of online examinations and have certain guiding significance for online teaching and learning.
Keywords: Three-way decision rules, Information systems, Condition attributes, Decision attributes, Confidence, Online learning, Online teaching
The coronavirus disease 2019 (COVID-19) pandemic has disrupted the original offline teaching mode in colleges and universities. Under the background of “suspending classes without stopping teaching, suspending classes without stopping learning,” we developed an online teaching mode of calculus courses using the Superstar network teaching platform and successfully completed the online teaching process including lesson preparation, teaching, and examinations. We found some problems in the system during online teaching, for example, in “brush the lesson” learning [1,2]. We know that some students just wanted to complete their study tasks; they opened the course videos and did other things after signing in. Some students used the so-called “lesson brush artifact” to complete their study tasks. We also found that there are some problems in the online examinations; for example, as there are no monitors, some students may copy the answers or cheat in other ways. Therefore, it is important to evaluate online learning and student satisfaction. In [3–5], the authors evaluated the impact of shifting from traditional learning to online learning during the COVID-19 pandemic on undergraduate students and examined the positive and negative aspects of online learning from the students’ perspectives. Thom et al. [6] examined the lessons learned in online learning during the COVID-19 pandemic. However, it is also necessary to evaluate the credibility of online examinations. In this study, we investigated the credibility of the online examination for the calculus course we had developed. According to pedagogy theory [7], students’ scores are related to the following factors: intelligence level, course basis, psychological state, learning method, and learning time. In particular, we focused on the following four aspects: students’ proficiency in the course, appropriate learning methods, degree of class attendance, and completion of homework.
To investigate the credibility of the online examination, we randomly selected 30 engineering students at Wenzheng College of Soochow University as a sample and established an information system
“Score of Early Semester” in Table 1 refers to the students’ calculus (1) course scores in the last semester. “Average Score of Class Quizzes” is a weighted average of the students’ scores from six class quizzes and two chapter quizzes during this semester; three or four problems in the class quiz are completed in 15 to 20 minutes. Then, the student signs in with the student number and name within the allotted time and uploads the completed quiz to the teacher. These quizzes can appropriately reflect the students’ learning situation. “Completion Ratio of Watching Videos” is the average completion ratio of students watching the teaching videos in this semester; “Completion Grade of Homework” refers to the students’ completion grade of homework in this semester. “Score of Final Exam” is the student’s final exam score in this semester.
From Table 1, which combines the queries mentioned earlier, the following question arises.
Does Table 1 accurately reflect the score of the final exam derived from the “Score of Early Semester,” “Average Score of Class Exercise,” “Completion Ratio of Watching Video,” and “Grade of Homework” completion?
To discuss Question 1.2 theoretically, useful information hidden in Table 1 must be extracted. This leads us to establish an information system
Let
Our discussion is based around Questions 1.2 and 1.3. We apply the three-way decision rules to the information system
The basic concepts for rough-set theory and decision rule can be found in [8,13,14,16,18,19].
(1) For a finite set
(2) For a collection
(1)
(2)
(3)
To apply the three-way decision rules for the theoretical analysis of online learning data of the calculus course (2), we must establish an information system
(1) Let
(2) Let
(3) Let
According to the general rule of statistical grouping (e.g., refer to [20]), we divide the condition attributes into four groups. For condition attributes
where
(i) For the condition attribute
(ii) For the condition attribute
(iii) For the condition attribute
(iv) For the condition attribute
(v) For the decision attribute
We now define the information function
From (i)-(v), an information system
Now, we provide some simple results that are useful for our discussion.
An information system
Let
(1) For
(2) ∧{
Let
Let
(1)
(2)
Let
(1)
(2)
Let
(1) POS(
(2)
(3)
Let
(1) If a rule allows us to accept
(2) If a rule allows us to reject
(3) If a rule allows us to make an uncertain decision about whether we accept
Here, the positive, negative, and boundary decision rules are called the three-way decision rules.
In an information system
Let
(1) If
(2) If
(3) If
We provide an easier method to derive the positive, negative, and boundary decision rules.
Let
(1)
(2)
(3)
The following theorem can be obtained from Lemmas 3.8 and 3.9.
Let
(1) If
(2) If
(3) If
The confidence of three-way decision rules on an information system was introduced by Yao and his colleague [12,15].
Let
Then,
We have the following proposition:
Let
(1)
(2)
(3)
In the following sections, the information system
In this section, we discuss three-way decision rules for
The following partitions of
(1)
(2)
From Proposition 4.1, we get some conditional attribute granules in
The following conditional attribute granules hold for
(1)
(2)
Let
The following upper and lower approximations of
(1)
(2)
(3)
(4)
Now, by Definition 3.6 and Proposition 4.3, we discuss the three-way decision rules for
The following positive, negative, and boundary regions of
(1) POS(
NEG(
BND(
(2) POS(
NEG(
BND(
(3) POS(
NEG(
BND(
(3) POS(
NEG(
BND(
By Theorems 3.10 and 4.4, we can easily obtain the three-way decision rules for
The three-way decision rules for
Thus, we have confidence in the three-way decision rules on
Tables 3 and 4 give the three-way decision rules on
In this section, we focus on Question 1.2. First, we provide a remark on the three-way decision rules on
The following are some semantic interpretations for the three-way decision rules on
(1) For
(2) For
(3) For
From Table 3 (or Table 4) and Remark 5.1, we have the following more detailed explanations of the three-way decision rules on
The following are true for
(1) For
(2) For
(3) For
(4) For
(5) For
(6) For
(7) For
(8) For
(9) For
(10) For
(11) For
(12) For
(13) For
(14) For
(15) For
(16) For
(17) For
(18) For
(19) For
(20) For
(21) For
(22) For
(23) For
(24) For
(25) For
(26) For
(27) For
(28) For
(29) For
(30) For
For online teaching data of calculus (2), the final scores of most students are credible.
For students: 2019488007, 2019488008, 2019488009, 2019 488011, 2019488013, 2019488022, 2019488027, 2019488028, 2019488032 2019488034, 2019488036, 2019488038, 2019488 039, 2019488040, 2019488041, 2019488045, 2019488049, 201 9488050, 2019488054, 2019488057 and 2019488060, their scores are credible. For students: 2019488002, 2019488005 2019488014, 2019488015, 2019488020, 2019488025, 201948 8030, 2019488046 and 2019488055, their scores are uncertain.
Thus, the scores of the online exam are mostly credible. This provides a theoretical basis for online teaching and examinations.
Although this paper focuses on the theoretical analysis of online learning data of calculus (2), it still has practical significance for other online courses. However, a more practical analysis is required to determine whether this theory is suitable for investigating other problems.
The data in
No potential conflict of interest relevant to this article was reported.
Table 1. Online learning data of calculus (2) course.
Order | Student number | Score of Early Semester | Average Score of Class Quizzes | Completion Ratio of Watching Videos(%) | Grade of Completion Homework | Score of Final Exam |
---|---|---|---|---|---|---|
1 | 2019488002 | 56 | 35 | 53 | C | 67 |
2 | 2019488005 | 79 | 45 | 85 | A | 87 |
3 | 2019488007 | 81 | 25 | 70 | C | 83 |
4 | 2019488008 | 84 | 50 | 45 | B | 74 |
5 | 2019488009 | 77 | 45 | 21 | B | 81 |
6 | 2019488011 | 68 | 35 | 52 | D | 56 |
7 | 2019488013 | 86 | 35 | 45 | A | 90 |
8 | 2019488014 | 84 | 50 | 95 | A | 74 |
9 | 2019488015 | 81 | 50 | 89 | A | 78 |
10 | 2019488020 | 91 | 45 | 88 | A | 84 |
11 | 2019488022 | 67 | 35 | 43 | A | 73 |
12 | 2019488025 | 69 | 35 | 50 | C | 68 |
13 | 2019488027 | 81 | 35 | 90 | B | 84 |
14 | 2019488028 | 63 | 80 | 96 | B | 73 |
15 | 2019488030 | 69 | 35 | 57 | C | 66 |
16 | 2019488032 | 65 | 55 | 94 | C | 62 |
17 | 2019488034 | 69 | 55 | 85 | A | 74 |
18 | 2019488036 | 84 | 55 | 42 | A | 85 |
19 | 2019488038 | 56 | 45 | 72 | D | 51 |
20 | 2019488039 | 42 | 25 | 71 | C | 49 |
21 | 2019488040 | 53 | 35 | 98 | D | 41 |
22 | 2019488041 | 74 | 50 | 81 | B | 91 |
23 | 2019488045 | 81 | 70 | 99 | A | 71 |
24 | 2019488046 | 65 | 35 | 51 | C | 57 |
25 | 2019488049 | 69 | 50 | 39 | B | 86 |
26 | 2019488050 | 74 | 45 | 83 | B | 79 |
27 | 2019488054 | 73 | 40 | 97 | B | 81 |
28 | 2019488055 | 95 | 50 | 94 | A | 91 |
29 | 2019488057 | 80 | 45 | 37 | B | 79 |
30 | 2019488060 | 77 | 50 | 90 | B | 90 |
Table 2. Decision table.
Table 3. Three-way decision rules on
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = |
Table 4. Confidence of the three-way decision rules on
E-mail: songliny@suda.edu.cn
E-mail: tingxu_wz@sina.com
E-mail: wzj015@suda.edu.cn
International Journal of Fuzzy Logic and Intelligent Systems 2022; 22(2): 202-212
Published online June 25, 2022 https://doi.org/10.5391/IJFIS.2022.22.2.202
Copyright © The Korean Institute of Intelligent Systems.
Songlin Yang1;2, Ting Xu1, and Yongcun Shao1
1Wenzheng College of Soochow University, Suzhou, China
2Soochow College, Soochow University, Suzhou, China
Correspondence to:Songlin Yang (songliny@suda.edu.cn)
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted noncommercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
To investigate the credibility of online examinations, we randomly chose 30 engineering students in Wenzheng College of Soochow University as a sample and established an information system S. According to pedagogy theory, students’scores are related to their intelligence levels, course basis, learning methods, and learning time. Therefore, in the information system S, “score of early semester,” “average score of class quizzes,” “completion ratio of watching videos,” and “completion grade of homework” were taken as the condition attributes, and “score of final exam” was taken as the decision attribute. We applied the three-way decision rules theory to provide positive, negative, and boundary decision rules for this information system S. Furthermore, we obtained confidence in the decision rules. The results of this study validate the credibility of online examinations and have certain guiding significance for online teaching and learning.
Keywords: Three-way decision rules, Information systems, Condition attributes, Decision attributes, Confidence, Online learning, Online teaching
The coronavirus disease 2019 (COVID-19) pandemic has disrupted the original offline teaching mode in colleges and universities. Under the background of “suspending classes without stopping teaching, suspending classes without stopping learning,” we developed an online teaching mode of calculus courses using the Superstar network teaching platform and successfully completed the online teaching process including lesson preparation, teaching, and examinations. We found some problems in the system during online teaching, for example, in “brush the lesson” learning [1,2]. We know that some students just wanted to complete their study tasks; they opened the course videos and did other things after signing in. Some students used the so-called “lesson brush artifact” to complete their study tasks. We also found that there are some problems in the online examinations; for example, as there are no monitors, some students may copy the answers or cheat in other ways. Therefore, it is important to evaluate online learning and student satisfaction. In [3–5], the authors evaluated the impact of shifting from traditional learning to online learning during the COVID-19 pandemic on undergraduate students and examined the positive and negative aspects of online learning from the students’ perspectives. Thom et al. [6] examined the lessons learned in online learning during the COVID-19 pandemic. However, it is also necessary to evaluate the credibility of online examinations. In this study, we investigated the credibility of the online examination for the calculus course we had developed. According to pedagogy theory [7], students’ scores are related to the following factors: intelligence level, course basis, psychological state, learning method, and learning time. In particular, we focused on the following four aspects: students’ proficiency in the course, appropriate learning methods, degree of class attendance, and completion of homework.
To investigate the credibility of the online examination, we randomly selected 30 engineering students at Wenzheng College of Soochow University as a sample and established an information system
“Score of Early Semester” in Table 1 refers to the students’ calculus (1) course scores in the last semester. “Average Score of Class Quizzes” is a weighted average of the students’ scores from six class quizzes and two chapter quizzes during this semester; three or four problems in the class quiz are completed in 15 to 20 minutes. Then, the student signs in with the student number and name within the allotted time and uploads the completed quiz to the teacher. These quizzes can appropriately reflect the students’ learning situation. “Completion Ratio of Watching Videos” is the average completion ratio of students watching the teaching videos in this semester; “Completion Grade of Homework” refers to the students’ completion grade of homework in this semester. “Score of Final Exam” is the student’s final exam score in this semester.
From Table 1, which combines the queries mentioned earlier, the following question arises.
Does Table 1 accurately reflect the score of the final exam derived from the “Score of Early Semester,” “Average Score of Class Exercise,” “Completion Ratio of Watching Video,” and “Grade of Homework” completion?
To discuss Question 1.2 theoretically, useful information hidden in Table 1 must be extracted. This leads us to establish an information system
Let
Our discussion is based around Questions 1.2 and 1.3. We apply the three-way decision rules to the information system
The basic concepts for rough-set theory and decision rule can be found in [8,13,14,16,18,19].
(1) For a finite set
(2) For a collection
(1)
(2)
(3)
To apply the three-way decision rules for the theoretical analysis of online learning data of the calculus course (2), we must establish an information system
(1) Let
(2) Let
(3) Let
According to the general rule of statistical grouping (e.g., refer to [20]), we divide the condition attributes into four groups. For condition attributes
where
(i) For the condition attribute
(ii) For the condition attribute
(iii) For the condition attribute
(iv) For the condition attribute
(v) For the decision attribute
We now define the information function
From (i)-(v), an information system
Now, we provide some simple results that are useful for our discussion.
An information system
Let
(1) For
(2) ∧{
Let
Let
(1)
(2)
Let
(1)
(2)
Let
(1) POS(
(2)
(3)
Let
(1) If a rule allows us to accept
(2) If a rule allows us to reject
(3) If a rule allows us to make an uncertain decision about whether we accept
Here, the positive, negative, and boundary decision rules are called the three-way decision rules.
In an information system
Let
(1) If
(2) If
(3) If
We provide an easier method to derive the positive, negative, and boundary decision rules.
Let
(1)
(2)
(3)
The following theorem can be obtained from Lemmas 3.8 and 3.9.
Let
(1) If
(2) If
(3) If
The confidence of three-way decision rules on an information system was introduced by Yao and his colleague [12,15].
Let
Then,
We have the following proposition:
Let
(1)
(2)
(3)
In the following sections, the information system
In this section, we discuss three-way decision rules for
The following partitions of
(1)
(2)
From Proposition 4.1, we get some conditional attribute granules in
The following conditional attribute granules hold for
(1)
(2)
Let
The following upper and lower approximations of
(1)
(2)
(3)
(4)
Now, by Definition 3.6 and Proposition 4.3, we discuss the three-way decision rules for
The following positive, negative, and boundary regions of
(1) POS(
NEG(
BND(
(2) POS(
NEG(
BND(
(3) POS(
NEG(
BND(
(3) POS(
NEG(
BND(
By Theorems 3.10 and 4.4, we can easily obtain the three-way decision rules for
The three-way decision rules for
Thus, we have confidence in the three-way decision rules on
Tables 3 and 4 give the three-way decision rules on
In this section, we focus on Question 1.2. First, we provide a remark on the three-way decision rules on
The following are some semantic interpretations for the three-way decision rules on
(1) For
(2) For
(3) For
From Table 3 (or Table 4) and Remark 5.1, we have the following more detailed explanations of the three-way decision rules on
The following are true for
(1) For
(2) For
(3) For
(4) For
(5) For
(6) For
(7) For
(8) For
(9) For
(10) For
(11) For
(12) For
(13) For
(14) For
(15) For
(16) For
(17) For
(18) For
(19) For
(20) For
(21) For
(22) For
(23) For
(24) For
(25) For
(26) For
(27) For
(28) For
(29) For
(30) For
For online teaching data of calculus (2), the final scores of most students are credible.
For students: 2019488007, 2019488008, 2019488009, 2019 488011, 2019488013, 2019488022, 2019488027, 2019488028, 2019488032 2019488034, 2019488036, 2019488038, 2019488 039, 2019488040, 2019488041, 2019488045, 2019488049, 201 9488050, 2019488054, 2019488057 and 2019488060, their scores are credible. For students: 2019488002, 2019488005 2019488014, 2019488015, 2019488020, 2019488025, 201948 8030, 2019488046 and 2019488055, their scores are uncertain.
Thus, the scores of the online exam are mostly credible. This provides a theoretical basis for online teaching and examinations.
Although this paper focuses on the theoretical analysis of online learning data of calculus (2), it still has practical significance for other online courses. However, a more practical analysis is required to determine whether this theory is suitable for investigating other problems.
Table 1 . Online learning data of calculus (2) course.
Order | Student number | Score of Early Semester | Average Score of Class Quizzes | Completion Ratio of Watching Videos(%) | Grade of Completion Homework | Score of Final Exam |
---|---|---|---|---|---|---|
1 | 2019488002 | 56 | 35 | 53 | C | 67 |
2 | 2019488005 | 79 | 45 | 85 | A | 87 |
3 | 2019488007 | 81 | 25 | 70 | C | 83 |
4 | 2019488008 | 84 | 50 | 45 | B | 74 |
5 | 2019488009 | 77 | 45 | 21 | B | 81 |
6 | 2019488011 | 68 | 35 | 52 | D | 56 |
7 | 2019488013 | 86 | 35 | 45 | A | 90 |
8 | 2019488014 | 84 | 50 | 95 | A | 74 |
9 | 2019488015 | 81 | 50 | 89 | A | 78 |
10 | 2019488020 | 91 | 45 | 88 | A | 84 |
11 | 2019488022 | 67 | 35 | 43 | A | 73 |
12 | 2019488025 | 69 | 35 | 50 | C | 68 |
13 | 2019488027 | 81 | 35 | 90 | B | 84 |
14 | 2019488028 | 63 | 80 | 96 | B | 73 |
15 | 2019488030 | 69 | 35 | 57 | C | 66 |
16 | 2019488032 | 65 | 55 | 94 | C | 62 |
17 | 2019488034 | 69 | 55 | 85 | A | 74 |
18 | 2019488036 | 84 | 55 | 42 | A | 85 |
19 | 2019488038 | 56 | 45 | 72 | D | 51 |
20 | 2019488039 | 42 | 25 | 71 | C | 49 |
21 | 2019488040 | 53 | 35 | 98 | D | 41 |
22 | 2019488041 | 74 | 50 | 81 | B | 91 |
23 | 2019488045 | 81 | 70 | 99 | A | 71 |
24 | 2019488046 | 65 | 35 | 51 | C | 57 |
25 | 2019488049 | 69 | 50 | 39 | B | 86 |
26 | 2019488050 | 74 | 45 | 83 | B | 79 |
27 | 2019488054 | 73 | 40 | 97 | B | 81 |
28 | 2019488055 | 95 | 50 | 94 | A | 91 |
29 | 2019488057 | 80 | 45 | 37 | B | 79 |
30 | 2019488060 | 77 | 50 | 90 | B | 90 |
Table 2 . Decision table.
Table 3 . Three-way decision rules on
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = | |
Λ = | Λ = | Λ = | Λ = |
Table 4 . Confidence of the three-way decision rules on
Minyoung Kim
Int. J. Fuzzy Log. Intell. Syst. 2015; 15(3): 145-152 https://doi.org/10.5391/IJFIS.2015.15.3.145