Carson Stacy

Carson Stacy

Postdoctoral Research Fellow at RCSI, Dublin. Statistical modeling, machine learning, and reproducible data analysis for genomics.

Posts by Tags

DataViz

RNA-seq

alignment

bbduk

bbmap

bbtools

bioinformatics

calibration

Accuracy Is a Bad Way to Judge a Predictor

6 minute read

Published:

If your accuracy score can be improved by a model that is calibrated worse, the score is broken. Proportion classified correctly is exactly such a score. It is not a minor imperfection to note in the discussion section. It is a metric that will, given the chance, hand you the wrong model and a straight face.

classification

Your Classifier Is Answering the Wrong Question

7 minute read

Published:

A classifier forces a choice. A probability model quantifies a tendency and hands the choice back to whoever is actually equipped to make it. In most of the problems I work on, the second thing is what I want, and the first thing is what I built by accident.

data visualization

dotplot

fun

genomics

Accuracy Is a Bad Way to Judge a Predictor

6 minute read

Published:

If your accuracy score can be improved by a model that is calibrated worse, the score is broken. Proportion classified correctly is exactly such a score. It is not a minor imperfection to note in the discussion section. It is a metric that will, given the chance, hand you the wrong model and a straight face.

Your Classifier Is Answering the Wrong Question

7 minute read

Published:

A classifier forces a choice. A probability model quantifies a tendency and hands the choice back to whoever is actually equipped to make it. In most of the problems I work on, the second thing is what I want, and the first thing is what I built by accident.

ggplot2

machine-learning

Accuracy Is a Bad Way to Judge a Predictor

6 minute read

Published:

If your accuracy score can be improved by a model that is calibrated worse, the score is broken. Proportion classified correctly is exactly such a score. It is not a minor imperfection to note in the discussion section. It is a metric that will, given the chance, hand you the wrong model and a straight face.

Your Classifier Is Answering the Wrong Question

7 minute read

Published:

A classifier forces a choice. A probability model quantifies a tendency and hands the choice back to whoever is actually equipped to make it. In most of the problems I work on, the second thing is what I want, and the first thing is what I built by accident.

model-evaluation

Accuracy Is a Bad Way to Judge a Predictor

6 minute read

Published:

If your accuracy score can be improved by a model that is calibrated worse, the score is broken. Proportion classified correctly is exactly such a score. It is not a minor imperfection to note in the discussion section. It is a metric that will, given the chance, hand you the wrong model and a straight face.

prediction

Your Classifier Is Answering the Wrong Question

7 minute read

Published:

A classifier forces a choice. A probability model quantifies a tendency and hands the choice back to whoever is actually equipped to make it. In most of the problems I work on, the second thing is what I want, and the first thing is what I built by accident.

statistics

Accuracy Is a Bad Way to Judge a Predictor

6 minute read

Published:

If your accuracy score can be improved by a model that is calibrated worse, the score is broken. Proportion classified correctly is exactly such a score. It is not a minor imperfection to note in the discussion section. It is a metric that will, given the chance, hand you the wrong model and a straight face.

Your Classifier Is Answering the Wrong Question

7 minute read

Published:

A classifier forces a choice. A probability model quantifies a tendency and hands the choice back to whoever is actually equipped to make it. In most of the problems I work on, the second thing is what I want, and the first thing is what I built by accident.

tutorial