Yesterday I wrote that the computer is not the lesson. A tool can be useful without being the reason a child learned something.
The same problem shows up when we talk about data.
A number can be accurate. The explanation attached to it can still be wrong.
That distinction ought to matter in schools, because the explanation is usually where the next decision begins.
A score goes down. Now we have to decide what happened. Did the child misunderstand the material? Did the assessment ask something different from what was taught? Was the child tired? Is this a pattern, or one result? What else do we know?
Those are different questions. They can lead to different actions.
Putting the score into a dashboard does not answer them. Turning the dashboard red does not answer them either. It makes the number easier to see.
I spent 22 years inside public schools. I am not arguing that teachers should ignore evidence or that professional judgment means doing whatever feels right.
Good judgment has to explain itself. It should be informed by evidence, open to challenge, and willing to change when the evidence changes.
But somebody still has to exercise it.
Imagine a school adds an intervention. The next assessment improves. That is a result worth examining. It is not yet an explanation of what caused the improvement.
The intervention may have helped. So may the teacher, additional practice, a different assessment, or something happening outside school. More than one thing may have changed.
A responsible conclusion needs to be proportionate to what the evidence actually establishes.
That does not mean every classroom needs a research department before a teacher can try something useful. It means we should be careful about the distance between what we observed and what we announced.
Especially when the announcement justifies another purchase, another program, or another demand on the people doing the work.
The question is not whether the district has data. The question is what the district is entitled to conclude from it.
What did you measure? Why that measure? What would count as a meaningful change? What other explanations did you consider? What will you do if the expected change never arrives?
And who owns that decision?
A teacher can describe what happened in the classroom. A principal can examine the conditions around the work. A district can explain the program it chose and the resources it supplied. Those responsibilities overlap, but they are not interchangeable.
We cannot put every result beside a child's name and pretend that tells us which adult decision worked.
Nor can we put every result beside a teacher's name and pretend the teacher controlled everything that produced it.
If accountability is going to mean anything useful, the person being asked to answer needs a responsibility they can identify, authority they actually possess, and a fair account of the conditions in which they worked.
Otherwise the number becomes a convenient place to stop asking questions.
The child has a score. The teacher has a rating. The district has a chart. Everybody has something to report, and we still may not have explained the problem.
That is the question behind the title of my public conversation with Dr. Jana Lee: When Did Data Replace Judgment?
The full conversation is linked below. This piece is my argument, not a quotation from her or a claim that we agree on every point.
I want schools to use evidence. I want the people making decisions to be able to explain what the evidence shows, what it does not show, and why their next step makes sense.
The data should make the conversation more honest. It should give us better questions and a way to check whether our decisions helped.
It should not become a substitute for the conversation.
The dashboard cannot take responsibility.
The adults still have to.
