0030602: Tests - testdiff does not report known unstable cases properly

View Issue Details [ Jump to Notes ]

[ Issue History ] [ Print ]

Project

Category

View Status

Date Submitted

Last Update

0030602

Open CASCADE

[OCCT] OCCT:Tests

public

2019-03-25 09:01

2020-09-11 17:05

Reporter

kgv

Assigned To

inv

Priority

normal

Severity

minor

Status

new

Resolution

open

Platform

OS Version

Product Version

[OCCT] 7.3.0

Target Version

[OCCT] 7.6.0*

Fixed in Version

Summary

0030602: Tests - testdiff does not report known unstable cases properly

Description

Test system supports "TODO ?" syntax marking known instabilities to be ignored.

puts "TODO ?OCC30012 Linux: Error: 10 curves are expected but 9 ones are found."

In general, this is a bad practice marking test cases in such way.
But anyway, testdiff report doesn't properly reports such cases.
In particular:
- Information about total amount of test cases with such "TODO ?".
  These are BAD cases, which should pay more attention than others.
- Information about cases, where "TODO ?" doesn't hit.
  Currently, it is impossible tracking if instability marked by "TODO ?"
  still happen or has been fixed by some patch.

Tags

No tags attached.

Test case number

Attached Files

Relationships

Notes
(0083213) git (administrator) 2019-03-25 09:12	Branch CR30602 has been created by kgv. SHA-1: 35a381fd036e716d439d047697bdcb51f9f5f41f Detailed log of new commits: Author: kgv Date: Mon Mar 25 09:07:02 2019 +0300 0030602: Tests - testdiff does not report known unstable cases properly Comment TODOs

Issue History
Date Modified	Username	Field	Change
2019-03-25 09:01	kgv	New Issue
2019-03-25 09:01	kgv	Assigned To	=> apn
2019-03-25 09:12	git	Note Added: 0083213
2019-07-19 17:06	apn	Target Version	7.4.0 => 7.5.0
2020-09-11 17:01	utverdov	Assigned To	apn => inv
2020-09-11 17:05	utverdov	Target Version	7.5.0 => 7.6.0*