-
Notifications
You must be signed in to change notification settings - Fork 43
Open
Description
Hello,
I am using EasyTPP to train and evaluate the S2P2 model. To verify this is not a dataset-specific issue, I tested on your provided Taxi dataset (from the EasyTPP benchmark) using the example configuration from examples/configs/experiment_config.yaml.
When I add metrics: ['acc', 'rmse'] to the S2P2 training config, the model trains successfully but no accuracy or RMSE values are reported in the logs — only loglike is shown. This behavior is consistent across both the Taxi dataset and my custom dataset.
For comparison, RMTPP, NHP, and THP all correctly report acc and rmse during training and evaluation.
My questions:
- Is it possible to compute
accandrmsefor S2P2 using the thinning algorithm, similar to other models? - If yes, what is the correct configuration or code change needed to enable this?
- If not, is this a known limitation of the current S2P2 implementation in EasyTPP, and are there plans to support it?
Thank you!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels