Bits of Confidence
Quantify the information provided by confidence judgments about stimulus states, and distinguish information available in the categorical response from additional information carried by confidence.
Methods · Measurement · Open research
Measuring cognition in bits.
Information-theoretic approaches provide a common language for quantifying what decisions, confidence reports, and response times reveal about psychological processes. This page introduces the measures developed and used in my research and will host documented analysis code.
Each resource will connect a scientific question to the relevant measure, a methodological reference, and—when released—code and a worked example. Code is not yet available on this page; the entries below describe the research rather than promising a working download.
Quantify the information provided by confidence judgments about stimulus states, and distinguish information available in the categorical response from additional information carried by confidence.
Assess metacognitive information beyond first-order responses, including conditional mutual information measures used to examine metacognitive efficiency in face matching.
Describe the uncertainty of response-time distributions using cumulative residual entropy (CRE), an information-theoretic statistic designed for nonnegative continuous variables.
A developing framework for quantifying the information obtained through additional search and the relationship between uncertainty, evidence gathering, and confidence-based decisions.
As code becomes available, each tool will include a versioned script or repository, an example dataset, expected output, a citation, and usage notes. For now, please consult the cited papers for precise definitions and estimators.
Interested in applying one of these measures to your own data? Get in touch ↗