From ee09618e3963b230d79427595a81248a289cd969 Mon Sep 17 00:00:00 2001 From: dave-siq <255972059+dave-siq@users.noreply.github.com> Date: Tue, 20 Jan 2026 12:47:09 -0600 Subject: [PATCH 1/6] Rename COUNTER Validation Tool to COUNTER Validator (#313) --- CHANGELOG.rst | 2 +- ...3-counter-report-common-attributes-and-elements.rst | 4 ++-- source/09-audit/01-the-audit-process.rst | 4 ++-- source/09-audit/03-timelines.rst | 2 +- source/09-audit/04-counter-validation-tool.rst | 10 +++++----- source/09-audit/05-inclusion-in-registry.rst | 2 +- source/appendices/a-glossary-of-terms.rst | 6 +++--- .../02-general-tests.rst | 6 +++--- 8 files changed, 18 insertions(+), 18 deletions(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 7f1d8948..490a4903 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -182,7 +182,7 @@ Release 5.0.2 * Provide guidance on how to deal with specific error conditions `#81 `_ [sushi] * Update description for Data_Type Journal `#25 `_ [documentation] * Clarify required file formats for tabular COUNTER reports `#33 `_ [documentation] -* Update recommendations and add error level information for the Validation Tool `#39 `_ [documentation] +* Update recommendations and add error level information for the COUNTER Validator `#39 `_ [documentation] * Clarify rules for using custom Exceptions `#53 `_ [documentation] * Use Requested in place of Optional for columns/elements only included when requested `#55 `_ [documentation] * Add note to appendixes that in case of conflicts the main document takes precedence `#94 `_ [documentation] diff --git a/source/03-specifications/03-counter-report-common-attributes-and-elements.rst b/source/03-specifications/03-counter-report-common-attributes-and-elements.rst index 5cee3924..fc718324 100644 --- a/source/03-specifications/03-counter-report-common-attributes-and-elements.rst +++ b/source/03-specifications/03-counter-report-common-attributes-and-elements.rst @@ -382,7 +382,7 @@ Table 3.p (below): List of Data_Type Values PR_P1 * - Unspecified - - Content that cannot be classified by any of the other Data_Types due to lack of sufficient information. Note that report providers are expected to make all reasonable efforts to classify the content. Using Unspecified will give rise to a Warning in the Validation Tool. + - Content that cannot be classified by any of the other Data_Types due to lack of sufficient information. Note that report providers are expected to make all reasonable efforts to classify the content. Using Unspecified will give rise to a Warning in the COUNTER Validator. - A&I_Database\ |br|\ |lb| Aggregated_Full_Content\ |br|\ |lb| Data_Repository\ |br|\ |lb| @@ -972,4 +972,4 @@ The value for an element might be missing or unknown, for example a title might For clarity, values such as “unknown”, “n/a” or “-” MUST NOT be used. -If a non-empty value is required for an element and the value is empty or the element is omitted, the COUNTER Validation Tool reports a (Critical) Error which would cause the report to fail an audit. If Title, Item or Publisher is empty or Data_Type Unspecified is used, the COUNTER Validation Tool reports a Warning which might affect the result of an audit. See :numref:`validation-tool` for details on the error levels used by the Validation Tool. +If a non-empty value is required for an element and the value is empty or the element is omitted, the COUNTER Validator reports a (Critical) Error which would cause the report to fail an audit. If Title, Item or Publisher is empty or Data_Type Unspecified is used, the COUNTER Validator reports a Warning which might affect the result of an audit. See :numref:`validation-tool` for details on the error levels used by the COUNTER Validator. diff --git a/source/09-audit/01-the-audit-process.rst b/source/09-audit/01-the-audit-process.rst index d7f56444..7e7aef22 100644 --- a/source/09-audit/01-the-audit-process.rst +++ b/source/09-audit/01-the-audit-process.rst @@ -29,8 +29,8 @@ Stages of the Audit Process Audits follow a five-stage process. -* **Stage one** - pre-flight preparation. Report providers SHOULD run all of their COUNTER reports (JSON and tabular) through the COUNTER Validation Tool. Report providers SHOULD also seek feedback from large report consumers (e.g. JUSP) in respect of issues they have identified with the reports. Report providers SHOULD fix any problems that are discovered and re-run the Validation Tool before proceeding to Stage two. -* **Stage two** - audit initiation. Auditor and report provider agree on the scope of the audit, which MUST include all COUNTER Reports and Standard Views of COUNTER Reports required by the Code of Practice but SHOULD include all COUNTER Reports and Standard Views of COUNTER Reports offered by the report provider. COUNTER’s Executive Director will adjudicate if the auditor and report provider cannot agree on the audit scope. Report providers MUST provide pre-flight documentation to the auditor, using the template provided in :ref:`Appendix E `. If Stage one has been followed, report providers MUST provide the Validation Tool results to the auditor. +* **Stage one** - pre-flight preparation. Report providers SHOULD run all of their COUNTER reports (JSON and tabular) through the COUNTER Validator. Report providers SHOULD also seek feedback from large report consumers (e.g. JUSP) in respect of issues they have identified with the reports. Report providers SHOULD fix any problems that are discovered and re-run the COUNTER Validator before proceeding to Stage two. +* **Stage two** - audit initiation. Auditor and report provider agree on the scope of the audit, which MUST include all COUNTER Reports and Standard Views of COUNTER Reports required by the Code of Practice but SHOULD include all COUNTER Reports and Standard Views of COUNTER Reports offered by the report provider. COUNTER’s Executive Director will adjudicate if the auditor and report provider cannot agree on the audit scope. Report providers MUST provide pre-flight documentation to the auditor, using the template provided in :ref:`Appendix E `. If Stage one has been followed, report providers MUST provide the COUNTER Validator results to the auditor. * **Stage three** - seeding, audit begins. In this stage the auditors perform actions on the audited platforms in line with :ref:`Appendix E `. Seeding takes a full calendar month. * **Stage four** - report reconciliation. The auditors reconcile the COUNTER reports generated by the report provider with the seeding actions they undertook in Stage three. The outputs from this stage may be an Interim Report or a Pass Report, which MUST be shared with the COUNTER Executive Director. If an Interim Report is issued, diff --git a/source/09-audit/03-timelines.rst b/source/09-audit/03-timelines.rst index 77f78659..deb1bb06 100644 --- a/source/09-audit/03-timelines.rst +++ b/source/09-audit/03-timelines.rst @@ -50,7 +50,7 @@ Extensions Report providers may request extensions to the usual timelines under the following circumstances. -* **Delayed seeding** - where a report provider is able to demonstrate that they have run the COUNTER Validation Tool and are in the process of fixing problems identified by the tool before commencing an audit, they may apply for up to three months delay in the seeding process. +* **Delayed seeding** - where a report provider is able to demonstrate that they have run the COUNTER Validator and are in the process of fixing problems identified by the validator before commencing an audit, they may apply for up to three months delay in the seeding process. * **Extension to the fix period** - where an Interim Report has identified significant problems with COUNTER reports, the report provider may apply for an extension of the fix period from three to up to six months. Applications for extensions MUST be sent to both the Executive Director (code@countermetrics.org) and the auditor, and will be considered on a case-by-case basis. Only one extension of each type will be granted for any audit, and all extensions will be tracked in the Registry. diff --git a/source/09-audit/04-counter-validation-tool.rst b/source/09-audit/04-counter-validation-tool.rst index 5ad2aca4..038c9c73 100644 --- a/source/09-audit/04-counter-validation-tool.rst +++ b/source/09-audit/04-counter-validation-tool.rst @@ -2,14 +2,14 @@ is licensed under CC BY 4.0. To view a copy of this license, visit https://creativecommons.org/licenses/by/4.0/ -.. _validation-tool: +.. _counter-validator: -COUNTER Validation Tool ------------------------ +COUNTER Validator +----------------- -The `COUNTER Validation Tool `_ allows report providers and auditors to quickly perform compliance checks related to format and consistency of both JSON and tabular reports. Report providers SHOULD use this free tool to check their reports and COUNTER API implementation and fix issues detected by the tool before they begin the audit. It is recommended to use the tool not just when preparing for the audit, but to integrate the testing in the regular QA processes or at least test regularly to make sure the reports stay compliant. We recommend testing reports using the Validation Tool once every four months at a minimum, and monthly where possible. +The `COUNTER Validator `_ allows report providers and auditors to quickly perform compliance checks related to format and consistency of both JSON and tabular reports. Report providers SHOULD use this free validator to check their reports and COUNTER API implementation and fix issues detected by the validator before they begin the audit. It is recommended to use the validator not just when preparing for the audit, but to integrate the testing in the regular QA processes or at least test regularly to make sure the reports stay compliant. We recommend testing reports using the COUNTER Validator once every four months at a minimum, and monthly where possible. -The COUNTER Validation Tool uses the following error levels to report issues with different severity: +The COUNTER Validator uses the following error levels to report issues with different severity: * **Fatal error** - Validation was aborted because an unrecoverable error was encountered, for example a missing or invalid Reporting_Period. The fatal error MUST be fixed before the report can be fully validated. * **Critical error** - Validation has detected a serious error that MUST be fixed, for example inconsistent data like a title with more Unique_Item_Requests than Total_Item_Requests or missing data. A critical error indicates that there could be a serious issue that would cause the audit to fail. diff --git a/source/09-audit/05-inclusion-in-registry.rst b/source/09-audit/05-inclusion-in-registry.rst index 3134280b..2c5b9697 100644 --- a/source/09-audit/05-inclusion-in-registry.rst +++ b/source/09-audit/05-inclusion-in-registry.rst @@ -7,7 +7,7 @@ Application for inclusion in the COUNTER Registry The Registry of report providers and their platforms for which COUNTER-compliant usage reports are available is maintained by COUNTER and publicly available at `Registry `_. -Report providers may apply to the Executive Director (code@countermetrics.org) for their products to be included on the Registry. Report providers will have to provide proof of initial compliance by including the results of COUNTER Validation Tool tests showing compliance for each reports, including testing both the upload of the tabular reports and COUNTER API (formerly sushi) harvesting of the same reports. Upon receipt of the application and proof of compliance, report providers MUST allow at least one large report consumer (e.g. JUSP) to evaluate their usage reports. +Report providers may apply to the Executive Director (code@countermetrics.org) for their products to be included on the Registry. Report providers will have to provide proof of initial compliance by including the results of COUNTER Validator tests showing compliance for each reports, including testing both the upload of the tabular reports and COUNTER API (formerly SUSHI) harvesting of the same reports. Upon receipt of the application and proof of compliance, report providers MUST allow at least one large report consumer (e.g. JUSP) to evaluate their usage reports. When the reports are deemed to comply with the COUNTER Code of Practice, the report provider will be asked to sign a Declaration of COUNTER Compliance (:ref:`Appendix C `), to be sent to the Executive Director, after which the report provider and its platforms will be added to the Registry. These report providers may then use the designation “COUNTER Compliance Pending”. diff --git a/source/appendices/a-glossary-of-terms.rst b/source/appendices/a-glossary-of-terms.rst index 9eff0827..6070a3d4 100644 --- a/source/appendices/a-glossary-of-terms.rst +++ b/source/appendices/a-glossary-of-terms.rst @@ -249,7 +249,7 @@ Note: The main Code of Practice document takes precedence in the case of any con - Status of a vendor who is currently not compliant but whose audit is in progress or scheduled. - - * - COUNTER Report Validation Tool + * - COUNTER Validator - An online tool to validate COUNTER reports in JSON and tabular format. - @@ -953,8 +953,8 @@ Note: The main Code of Practice document takes precedence in the case of any con - An umbrella term. Includes publishers, aggregators and others who directly provide access to content, as well as organizations that provide specialist reporting services on behalf of one or more organizations. - Science Direct, Clarivate, JSTOR, ScholarlyIQ - * - Report validation tool - - See COUNTER Report Validation Tool. + * - Report validator + - See COUNTER Validator. - * - Reporting period\ |br|\ |lb| diff --git a/source/appendices/e-audit-requirements-and-tests/02-general-tests.rst b/source/appendices/e-audit-requirements-and-tests/02-general-tests.rst index 1d84656e..df51705d 100644 --- a/source/appendices/e-audit-requirements-and-tests/02-general-tests.rst +++ b/source/appendices/e-audit-requirements-and-tests/02-general-tests.rst @@ -8,10 +8,10 @@ E.2 General Audit Tests This section of the appendix outlines tests that MUST be run during all audits, and which are not specific to a particular COUNTER Report. -E.2.1 Validation Tool -""""""""""""""""""""" +E.2.1 COUNTER Validator +""""""""""""""""""""""" -Once reports are available for testing (i.e. up to 28 days after the end of the seeding month), auditors MUST run the COUNTER Reports and Standard Views of COUNTER Reports that are within the scope of the audit through the Validation Tool. This test must include all attributes report providers are required to support, including attributes that are included only if called for. +Once reports are available for testing (i.e. up to 28 days after the end of the seeding month), auditors MUST run the COUNTER Reports and Standard Views of COUNTER Reports that are within the scope of the audit through the COUNTER Validator. This test must include all attributes report providers are required to support, including attributes that are included only if called for. Where report providers have elected to follow the pre-flight preparation step outlined in :numref:`audit` of the Code of Practice, this audit test should not result in any errors. From d4504a6e53b625743702a5db890088a5b7843842 Mon Sep 17 00:00:00 2001 From: dave-siq <255972059+dave-siq@users.noreply.github.com> Date: Tue, 20 Jan 2026 12:54:04 -0600 Subject: [PATCH 2/6] Fix additional validator references --- .../03-counter-report-common-attributes-and-elements.rst | 2 +- ...{04-counter-validation-tool.rst => 04-counter-validator.rst} | 0 source/09-audit/index.rst | 2 +- 3 files changed, 2 insertions(+), 2 deletions(-) rename source/09-audit/{04-counter-validation-tool.rst => 04-counter-validator.rst} (100%) diff --git a/source/03-specifications/03-counter-report-common-attributes-and-elements.rst b/source/03-specifications/03-counter-report-common-attributes-and-elements.rst index fc718324..aaa98031 100644 --- a/source/03-specifications/03-counter-report-common-attributes-and-elements.rst +++ b/source/03-specifications/03-counter-report-common-attributes-and-elements.rst @@ -972,4 +972,4 @@ The value for an element might be missing or unknown, for example a title might For clarity, values such as “unknown”, “n/a” or “-” MUST NOT be used. -If a non-empty value is required for an element and the value is empty or the element is omitted, the COUNTER Validator reports a (Critical) Error which would cause the report to fail an audit. If Title, Item or Publisher is empty or Data_Type Unspecified is used, the COUNTER Validator reports a Warning which might affect the result of an audit. See :numref:`validation-tool` for details on the error levels used by the COUNTER Validator. +If a non-empty value is required for an element and the value is empty or the element is omitted, the COUNTER Validator reports a (Critical) Error which would cause the report to fail an audit. If Title, Item or Publisher is empty or Data_Type Unspecified is used, the COUNTER Validator reports a Warning which might affect the result of an audit. See :numref:`counter-validator` for details on the error levels used by the COUNTER Validator. diff --git a/source/09-audit/04-counter-validation-tool.rst b/source/09-audit/04-counter-validator.rst similarity index 100% rename from source/09-audit/04-counter-validation-tool.rst rename to source/09-audit/04-counter-validator.rst diff --git a/source/09-audit/index.rst b/source/09-audit/index.rst index b9768258..fffa1631 100644 --- a/source/09-audit/index.rst +++ b/source/09-audit/index.rst @@ -19,5 +19,5 @@ COUNTER will recognize an audit carried out by any Certified Public Accountant ( 01-the-audit-process 02-categories-of-audit-result 03-timelines - 04-counter-validation-tool + 04-counter-validator 05-inclusion-in-registry From c37921c817444bf912aa2894477b081e2569c779 Mon Sep 17 00:00:00 2001 From: dave-siq <255972059+dave-siq@users.noreply.github.com> Date: Tue, 20 Jan 2026 13:00:16 -0600 Subject: [PATCH 3/6] Fix a few more tool references --- source/appendices/a-glossary-of-terms.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/source/appendices/a-glossary-of-terms.rst b/source/appendices/a-glossary-of-terms.rst index 6070a3d4..9acfb491 100644 --- a/source/appendices/a-glossary-of-terms.rst +++ b/source/appendices/a-glossary-of-terms.rst @@ -250,7 +250,7 @@ Note: The main Code of Practice document takes precedence in the case of any con - * - COUNTER Validator - - An online tool to validate COUNTER reports in JSON and tabular format. + - An online service to validate COUNTER reports in JSON and tabular format. - * - COUNTER Reports @@ -601,7 +601,7 @@ Note: The main Code of Practice document takes precedence in the case of any con - * - ISBN (International Standard Book Number) - - A unique standard identifier (ISO 2108) used to identify monographic publications (books). The format ISBN-13, with hyphens, is required. E-ISBN is the expected value, with print ISBNs provided only where E-ISBN is not available. Inclusion of an ISBN-10, or an incorrectly formatted ISBN-13, will be flagged as an error by the Validation Tool. + - A unique standard identifier (ISO 2108) used to identify monographic publications (books). The format ISBN-13, with hyphens, is required. E-ISBN is the expected value, with print ISBNs provided only where E-ISBN is not available. Inclusion of an ISBN-10, or an incorrectly formatted ISBN-13, will be flagged as an error by the COUNTER Validatior. - * - ISBN-13 From 9147dcd399863899e58946f6324be6810cf2656b Mon Sep 17 00:00:00 2001 From: dave-siq <255972059+dave-siq@users.noreply.github.com> Date: Mon, 2 Feb 2026 12:50:18 -0600 Subject: [PATCH 4/6] Fix spelling --- source/appendices/a-glossary-of-terms.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/appendices/a-glossary-of-terms.rst b/source/appendices/a-glossary-of-terms.rst index 9acfb491..2de222ce 100644 --- a/source/appendices/a-glossary-of-terms.rst +++ b/source/appendices/a-glossary-of-terms.rst @@ -601,7 +601,7 @@ Note: The main Code of Practice document takes precedence in the case of any con - * - ISBN (International Standard Book Number) - - A unique standard identifier (ISO 2108) used to identify monographic publications (books). The format ISBN-13, with hyphens, is required. E-ISBN is the expected value, with print ISBNs provided only where E-ISBN is not available. Inclusion of an ISBN-10, or an incorrectly formatted ISBN-13, will be flagged as an error by the COUNTER Validatior. + - A unique standard identifier (ISO 2108) used to identify monographic publications (books). The format ISBN-13, with hyphens, is required. E-ISBN is the expected value, with print ISBNs provided only where E-ISBN is not available. Inclusion of an ISBN-10, or an incorrectly formatted ISBN-13, will be flagged as an error by the COUNTER Validator. - * - ISBN-13 From fa3b0055f1a2fb1c2e93b1a54ad19bdad9aff66b Mon Sep 17 00:00:00 2001 From: dave-siq <255972059+dave-siq@users.noreply.github.com> Date: Mon, 2 Feb 2026 12:52:45 -0600 Subject: [PATCH 5/6] Revert sushi to lower case --- source/09-audit/05-inclusion-in-registry.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/09-audit/05-inclusion-in-registry.rst b/source/09-audit/05-inclusion-in-registry.rst index 2c5b9697..5f7c221a 100644 --- a/source/09-audit/05-inclusion-in-registry.rst +++ b/source/09-audit/05-inclusion-in-registry.rst @@ -7,7 +7,7 @@ Application for inclusion in the COUNTER Registry The Registry of report providers and their platforms for which COUNTER-compliant usage reports are available is maintained by COUNTER and publicly available at `Registry `_. -Report providers may apply to the Executive Director (code@countermetrics.org) for their products to be included on the Registry. Report providers will have to provide proof of initial compliance by including the results of COUNTER Validator tests showing compliance for each reports, including testing both the upload of the tabular reports and COUNTER API (formerly SUSHI) harvesting of the same reports. Upon receipt of the application and proof of compliance, report providers MUST allow at least one large report consumer (e.g. JUSP) to evaluate their usage reports. +Report providers may apply to the Executive Director (code@countermetrics.org) for their products to be included on the Registry. Report providers will have to provide proof of initial compliance by including the results of COUNTER Validator tests showing compliance for each reports, including testing both the upload of the tabular reports and COUNTER API (formerly sushi) harvesting of the same reports. Upon receipt of the application and proof of compliance, report providers MUST allow at least one large report consumer (e.g. JUSP) to evaluate their usage reports. When the reports are deemed to comply with the COUNTER Code of Practice, the report provider will be asked to sign a Declaration of COUNTER Compliance (:ref:`Appendix C `), to be sent to the Executive Director, after which the report provider and its platforms will be added to the Registry. These report providers may then use the designation “COUNTER Compliance Pending”. From 453f958a10f953651ead121434c58db77244cbe8 Mon Sep 17 00:00:00 2001 From: dave-siq <255972059+dave-siq@users.noreply.github.com> Date: Mon, 16 Feb 2026 12:28:53 -0600 Subject: [PATCH 6/6] Revert Change Log update --- CHANGELOG.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 490a4903..7f1d8948 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -182,7 +182,7 @@ Release 5.0.2 * Provide guidance on how to deal with specific error conditions `#81 `_ [sushi] * Update description for Data_Type Journal `#25 `_ [documentation] * Clarify required file formats for tabular COUNTER reports `#33 `_ [documentation] -* Update recommendations and add error level information for the COUNTER Validator `#39 `_ [documentation] +* Update recommendations and add error level information for the Validation Tool `#39 `_ [documentation] * Clarify rules for using custom Exceptions `#53 `_ [documentation] * Use Requested in place of Optional for columns/elements only included when requested `#55 `_ [documentation] * Add note to appendixes that in case of conflicts the main document takes precedence `#94 `_ [documentation]