raw potencies, papers up to 2013Inconclusive
Insufficient evidence to reach a conclusion. Median rank correlation: 0.113. Uncertainty interval unavailable. Fewer-edits baseline: 0.225. Evaluated 4 papers and 87 measurements.
p = 0.009 · needed ≤ 2.7e−5
What was tested
Train on papers up to a cut-off year, then rank the compounds in later papers.
raw potencies, papers up to 2015Inconclusive
Insufficient evidence to reach a conclusion. Median rank correlation: 0.0913. Uncertainty interval unavailable. Fewer-edits baseline: 0.425. Evaluated 3 papers and 59 measurements.
p = 0.082 · needed ≤ 2.5e−5
What was tested
Train on papers up to a cut-off year, then rank the compounds in later papers.
raw potencies, papers up to 2018Inconclusive
Insufficient evidence to reach a conclusion. Median rank correlation: -0.131. Uncertainty interval unavailable. Fewer-edits baseline: 0.195. Evaluated 1 papers and 48 measurements.
p = 1.000 · needed ≤ 2.3e−5
What was tested
Train on papers up to a cut-off year, then rank the compounds in later papers.
potencies relative to the native peptide, papers up to 2013Inconclusive
Insufficient evidence to reach a conclusion. Median rank correlation: 0.222. Uncertainty interval unavailable. Fewer-edits baseline: 0.267. Evaluated 2 papers and 35 measurements.
p = 0.345 · needed ≤ 2.1e−5
What was tested
Train on papers up to a cut-off year, then rank the compounds in later papers.
potencies relative to the native peptide, papers up to 2015Inconclusive
Insufficient evidence to reach a conclusion. Median rank correlation: 0.577. Uncertainty interval unavailable. Fewer-edits baseline: 0.577. Evaluated 1 papers and 8 measurements.
p = 0.716 · needed ≤ 1.9e−5
What was tested
Train on papers up to a cut-off year, then rank the compounds in later papers.
potencies relative to the native peptide, papers up to 2018Inconclusive
Insufficient evidence to reach a conclusion.
What was tested
Train on papers up to a cut-off year, then rank the compounds in later papers.
raw potencies, papers up to 2013Inconclusive
Insufficient evidence to reach a conclusion.
What was tested
Check whether the edits reported most often before a cut-off year are the edits used in later papers.
raw potencies, papers up to 2015Threshold not met
Did not clear the corrected threshold; this does not establish that an effect is absent. 9 of 15 edits reappeared; 5 expected under the random-draw baseline. This measures literature reuse, not biological efficacy. No uncertainty interval is estimated for this count.
p = 0.004 · needed ≤ 4.1e−5
What was tested
Check whether the edits reported most often before a cut-off year are the edits used in later papers.
raw potencies, papers up to 2018Cleared threshold
Cleared the corrected threshold. 13 of 15 edits reappeared; 5.54 expected under the random-draw baseline. This measures literature reuse, not biological efficacy. No uncertainty interval is estimated for this count.
p = 3.3e−5 · needed ≤ 3.6e−5
What was tested
Check whether the edits reported most often before a cut-off year are the edits used in later papers.
raw potenciesThreshold not met
Did not clear the corrected threshold; this does not establish that an effect is absent.
p = 0.178 · needed ≤ 0.006
What was tested
Ask Jev which of two compounds measured side by side is more potent, in both orders, and check its calibration.
papers held out from all tuningInconclusive
Insufficient evidence to reach a conclusion.
What was tested
Repeat a development win on papers held out from all tuning.