Tidy up test coverage in preparation of production release

[wgip]

(using testQuick too)

• should we run some jobs automatically every 8 hours or so so that the state of things is always validated?

• Test / test

• CMake / test

  • Should we move this off to GitHub shared build rather run on ve clusters to free up resources?
  • On CI, we get this (fixed in [stringhole] Limit the range of delimiters for InStringHoleEvaluation #468)
    

• VectorEngine / test (vh001 & aurora06 = ok; com.nec.ve.ExchangeOnLocalSpec might fail if running concurrently with another process)

  • Failing on CI, due to Spark permissions or so:
    

• TPC / testOnly *TPC*VE* in Failfast off by default #463 --> Failfast off by default #463 (comment) --> ( https://www.sparkcyclone.io/tpc-html/20220201081217/ )

  • Query 16 - unknown reason
  • Query 15/17 /22- Q15/Q17/Q22 - remove exact check #471
  • Query 7, 8, 9 --> Query 7/8/9 failing due to decoding #470 --> most likely an issue in the test definition itself
  • Other queries failing due to correctness, exchangeOnVe = false <- seems to fix this
    • Query 4 -- expected --> List((1-URGENT,10594), (3-MEDIUM,10410), (5-LOW,10487)), got --> List((1-URGENT,10594), (2-HIGH,10476), (3-MEDIUM,10410), (4-NOT SPECIFIED,10556), (5-LOW,10487))
    • Query 5 -- [info] List((CHINA,5.372449425659998E7), (INDIA,5.203551200020002E7), (INDONESIA,5.550204116970004E7), (JAPAN,4.5410175695400015E7)) did not equal List((CHINA,5.372449425660001E7), (INDIA,5.2035512000199996E7), (INDONESIA,5.5502041169699915E7), (JAPAN,4.5410175695400015E7), (VIETNAM,5.529508699669991E7)) (TPCHSqlCSpec.scala:580) (on eg_remove_impstring branch and main branch)
    • Query 6
    • Query 10
    • Query 11
    • Query 13
    • Query 21