View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0032095 | Open CASCADE | OCCT:Tests | public | 2021-01-29 10:12 | 2021-02-21 11:44 |
| Reporter | kgv | Assigned To | bugmaster | ||
| Priority | normal | Severity | minor | ||
| Status | closed | Resolution | fixed | ||
| Product Version | 7.5.0 | ||||
| Target Version | 7.6.0 | Fixed in Version | 7.6.0 | ||
| Summary | 0032095: Tests - drop comparison in unstable perf/ncollection group | ||||
| Description | Test case perf/ncollection/A1 regularly fails due to instabilities in test system. By it's nature test case was first created to compare performance of similar STL and OCCT collections in common operations and then collected numbers have been put into test in attempt to detect possible performance degradation in OCCT collections. Obviously, as there are many different STL implementations (at least one per compiler), these implementation evolve and debug/release/optimization flags dramatically affect performance, it is practically impossible to embed meaningful numbers into test case itself. Several attempts have been already tried to adjust numbers and extend comparison tolerance, but test grid remains unstable on Jenkins. Therefore, it is proposed to not report test case failures and just report deviations as warnings. | ||||
| Steps To Reproduce | perf/ncollection/A1 | ||||
| Tags | No tags attached. | ||||
| Test case number | Not required | ||||
|
|
Branch CR32095 has been created by kgv. SHA-1: 96037b1bd51a5445a29a333e990c157a6efef483 Detailed log of new commits: Author: kgv Date: Fri Jan 29 10:24:36 2021 +0300 0032095: Tests - drop comparison in unstable perf/ncollection group Mark performance deviations compared to STL collections as warnings instead of errors. |
|
|
Branch CR32095 has been updated forcibly by kgv. SHA-1: 8ce4f205c57cc265628a7578b90afcc23fe1cead |
|
|
Branch CR32095 has been updated forcibly by kgv. SHA-1: 3d098e54bd3622dae3e7a7d3bda0e50af46085c2 |
|
|
Proposed patch is ready for review (putting these failures to IGNORE rule) - OCCT branch: CR32095. |
|
|
No remarks, please integrate |
|
|
Combination - OCCT branch : IR-2021-02-12 master SHA - fb68dbdbd6810ee27f9398c749c5740b7bea7818 a87b7ddc8cb44606b91e3f37113847c3f5f50fdc Products branch : IR-2021-02-12 SHA - 94205f40e685a70c77e547147d90c09e0a21c461 was compiled on Linux, MacOS and Windows platforms and tested in optimize mode. Number of compiler warnings: No new/fixed warnings Regressions/Differences/Improvements: No regressions/differences CPU differences: Debian80-64: OCCT Total CPU difference: 17805.430000000237 / 17802.420000000013 [+0.02%] Products Total CPU difference: 11513.250000000124 / 11523.070000000105 [-0.09%] Windows-64-VC14: OCCT Total CPU difference: 19375.296875 / 19372.265625 [+0.02%] Products Total CPU difference: 12857.265625 / 12882.921875 [-0.20%] Image differences : No differences that require special attention Memory differences : No differences that require special attention |
|
|
Branch CR32095 has been deleted by inv. SHA-1: 3d098e54bd3622dae3e7a7d3bda0e50af46085c2 |
|
occt: master 9779ff75 2021-01-29 07:24:36 Committer: bugmaster Details Diff |
0032095: Tests - drop comparison in unstable perf/ncollection group Mark performance deviations compared to STL collections as warnings instead of errors. |
Affected Issues 0032095 |
|
| mod - tests/perf/ncollection/A2 | Diff File | ||
| mod - tests/perf/ncollection/A3 | Diff File | ||
| mod - tests/perf/parse.rules | Diff File | ||
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2021-01-29 10:12 | kgv | New Issue | |
| 2021-01-29 10:12 | kgv | Assigned To | => kgv |
| 2021-01-29 10:13 | kgv | Relationship added | child of 0023880 |
| 2021-01-29 10:23 | git | Note Added: 0098499 | |
| 2021-01-29 11:00 | git | Note Added: 0098502 | |
| 2021-01-29 11:02 | git | Note Added: 0098503 | |
| 2021-01-29 11:03 | kgv | Note Added: 0098504 | |
| 2021-01-29 11:03 | kgv | Assigned To | kgv => abv |
| 2021-01-29 11:03 | kgv | Status | new => resolved |
| 2021-02-08 19:54 |
|
Note Added: 0098780 | |
| 2021-02-08 19:54 |
|
Assigned To | abv => bugmaster |
| 2021-02-08 19:54 |
|
Status | resolved => reviewed |
| 2021-02-13 11:10 | bugmaster | Note Added: 0098859 | |
| 2021-02-13 11:10 | bugmaster | Status | reviewed => tested |
| 2021-02-13 11:13 | bugmaster | Test case number | => Not required |
| 2021-02-13 11:29 | bugmaster | Changeset attached | => occt master 9779ff75 |
| 2021-02-13 11:29 | bugmaster | Status | tested => verified |
| 2021-02-13 11:29 | bugmaster | Resolution | open => fixed |
| 2021-02-21 11:44 | git | Note Added: 0099047 |
