blob: 9aa53c450316346f4f033713788db6f1eb963b20 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
|
Comparing:
REFERENCE:sum-1.txt
CURRENT: sum-2.txt
` +---------+---------+
o RUN STATUS: | REF | RES |
+------------------------------------------+---------+---------+
| Passes [PASS] | 6 | 11 |
| Unexpected fails [FAIL] | 7 | 10 |
| Unexpected passes [XPASS] | 5 | 9 |
| Expected fails [XFAIL] | 5 | 9 |
| Unresolved [UNRESOLVED] | 5 | 1 |
| Unsupported [UNSUPPORTED] | 5 | 1 |
| Untested [UNTESTED] | 5 | 1 |
+------------------------------------------+---------+---------+
REF PASS ratio: 0.29
RES PASS ratio: 0.48
***** WARNING: REF PASS ratio is abnormally low *****
***** WARNING: RES PASS ratio is abnormally low *****
***** ERROR: No REF execution test PASSed. Check execution engine configuration. *****
***** WARNING: No RES execution test FAILed. Check execution engine configuration. *****
o REGRESSIONS:
+------------------------------------------+---------+
| PASS now FAIL [PASS => FAIL] | 1 |
| XPASS now FAIL [XPASS=> FAIL] | 1 |
| PASS disappears [PASS => ] | 1 |
| XPASS disappears [XPASS=> ] | 1 |
| FAIL appears [ => FAIL] | 1 |
| XPASS appears [ =>XPASS] | 1 |
| PASS now XPASS [PASS =>XPASS] | 1 |
| XFAIL now FAIL [XFAIL=> FAIL] | 1 |
| XFAIL disappears [XFAIL=> ] | 1 |
| UNSUPPORTED now FAIL [UNSUP=> FAIL] | 1 |
| UNSUPPORTED now XPASS [UNSUP=>XPASS] | 1 |
| UNTESTED now FAIL [UNTES=> FAIL] | 1 |
| UNTESTED now XPASS [UNTES=>XPASS] | 1 |
| UNRESOLVED now FAIL [UNRES=> FAIL] | 1 |
| UNRESOLVED now XPASS [UNRES=>XPASS] | 1 |
+------------------------------------------+---------+
| TOTAL_REGRESSIONS | 15 |
+------------------------------------------+---------+
o MINOR TO BE CHECKED:
+------------------------------------------+---------+
| XFAIL appears [ =>XFAIL] | 1 |
| FAIL now XFAIL [FAIL =>XFAIL] | 1 |
| PASS now XFAIL [PASS =>XFAIL] | 1 |
| XPASS now XFAIL [XPASS=>XFAIL] | 1 |
| FAIL disappears [FAIL => ] | 1 |
| XPASS now PASS [XPASS=> PASS] | 1 |
| XFAIL now PASS [XFAIL=> PASS] | 1 |
| XFAIL now XPASS [XFAIL=>XPASS] | 1 |
| FAIL now PASS [FAIL => PASS] | 2 |
| FAIL now XPASS [FAIL =>XPASS] | 1 |
| New PASS [ => PASS] | 1 |
| UNSUPPORTED now PASS [UNSUP=> PASS] | 1 |
| UNSUPPORTED now XFAIL [UNSUP=>XFAIL] | 1 |
| UNSUPPORTED disappears [UNSUP=> ] | 1 |
| UNTESTED now PASS [UNTES=> PASS] | 1 |
| UNTESTED now XFAIL [UNTES=>XFAIL] | 1 |
| UNTESTED disappears [UNTES=> ] | 1 |
| UNRESOLVED now PASS [UNRES=> PASS] | 1 |
| UNRESOLVED now XFAIL [UNRES=>XFAIL] | 1 |
| UNRESOLVED disappears [UNRES=> ] | 1 |
+------------------------------------------+---------+
| TOTAL_MINOR_TO_BE_CHECKED | 21 |
+------------------------------------------+---------+
|
