- Introduce the
E_loofunction for computing weighted expectations (means, variances, quantiles).
pareto_k_tableandpareto_k_idsconvenience functions for quickly identifying problematic observations- pareto k values now grouped into
(-Inf, 0.5],(0.5, 0.7],(0.7, 1],(1, Inf)(didn't used to include 0.7) - warning messages are now issued by
psislwinstead ofprint.loo print.looshows a table of pareto k estimates (if any k > 0.7)- Add argument to
compareto allow loo objects to be provided in a list rather than in'...' - Update references to point to published paper
- GitHub repository moved from @jgabry to @stan-dev
- Better error messages from
extract_log_lik - Fix example code in vignette (thanks to GitHub user @krz)
- Add warnings if any p_waic estimates are greather than 0.4
- Improve line coverage of tests to 100%
- Update references in documentation
- Remove model weights from
compare.
In previous versions of loo model weights were also reported bycompare. We have removed the weights because they were based only on the point estimate of the elpd values ignoring the uncertainty. We are currently working on something similar to these weights that also accounts for uncertainty, which will be included in future versions of loo.
This update makes it easier for other package authors using loo to write
tests that involve running the loo function. It also includes minor bug
fixes and additional unit tests. Highlights:
- Don't call functions from parallel package if
cores=1. - Return entire vector/matrix of smoothed weights rather than a summary statistic when
psislwfunction is called in an interactive session. - Test coverage > 80%
This update provides several important improvements, most notably an alternative method for specifying the pointwise log-likelihood that reduces memory usage and allows for loo to be used with larger datasets. This update also makes it easier to to incorporate loo's functionality into other packages.
- Add Ben Goodrich as contributor
- S3 generics and
matrixandfunctionmethods for bothlooandwaic. The matrix method provide the same functionality as in previous versions of loo (taking a log-likelihood matrix as the input). The function method allows the user to provide a function for computing the log-likelihood from the data and posterior draws (which are also provided by the user). The function method is less memory intensive and should make it possible to use loo for models fit to larger amounts of data than before. - Separate
plotandprintmethods.plotalso provideslabel_pointsargument, which, ifTRUE, will label any Paretokpoints greater than 1/2 by the index number of the corresponding observation. The plot method also now warns aboutInf/NA/NaNvalues ofkthat are not shown in the plot. comparenow returns model weights and accepts more than two inputs.- Allow setting number of cores using
options(loo.cores = NUMBER).
- Updates names in package to reflect name changes in the accompanying paper.
- Better handling of special cases
- Deprecates
loo_and_waicfunction in favor of separate functionslooandwaic - Deprecates
loo_and_waic_diff. Usecompareinstead.
- Initial release