Skip to content

Training Rules clarification - handling retired benchmarks #847

@ShriyaRishab

Description

@ShriyaRishab

From HPE "Currently there is no method for submitting results for a retired benchmark, and if the need arises, submitters are prevented from doing so even if submitting to the Open division. There is confused wording in the rules for Open which appear to allow retired benchmarks if using a retired reference instead of an active reference as described in the following rules sections, specifically sections 4.2 and 6.5. However, a submitter was prevented from an Open division submission in v5.1 when trying to apply these rules to a retired benchmark submission for the BERT NLP reference"

Metadata

Metadata

Assignees

No one assigned

    Labels

    Fix for v6.0Issues from v5.1 result review meetings

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions