Did DPI Break the Law?
To make choice schools look bad, it manipulated state test data.
The Department of Public Instruction appears to have violated state law in order to obscure the performance of students participating in Wisconsin’s school choice programs. Specifically, DPI withheld from timely release data showing a favorable comparison between school choice students and students at public schools.
The applicable law is unambiguous (emphasis added):
s. 119.23(11)(d) When the department publicly releases data related to enrollment of, standardized test results for, applications submitted by, waiting lists for pupils participating in or seeking to participate in the program under this section, release the data all at the same time, uniformly, and completely.
DPI’s misconduct, as described further below, normally would be lost in the dark caverns of bureaucratic mischief. Not this time. School Choice Wisconsin (SCW) and the Wisconsin Institute for Law and Liberty (WILL) have filed a formal complaint seeking judicial accountability.
Here’s the chronology that prompted the SCW/WILL legal action:
Early September. DPI notified the media that there would be an embargoed release of assessment data available on September 10 with the “public” release on September 11. Media were required to register for a conference call in order to obtain the data. (SCW/WILL argue that releasing data to the media is the same as releasing it to the public.)
September 11. DPI issued a press release under embargo that used limited data and misleading calculations. Its objective — which it achieved — was statewide media coverage of the incomplete information early in the September 11 news cycle.
September 12. The DPI belatedly activated a link to more complete data on school choice test scores. As reporters already had filed stories on September 11, DPI correctly believed the delay would curtail complete coverage.
The staggered and selective release of data is, on its face, at odds with the statutory requirement that DPI “release the data all at the same time, uniformly and completely,”
Here is the chart that DPI issued on September 10 as part of the embargoed press release:
The comparison of choice students with all other students violates well-established social science norms. Because students in the state’s Parental Choice Programs are from low- and moderate-income families, an appropriate comparison would involve students in the districts and schools where choice students live.
Internal emails at DPI show that there were concerns over the use of the averaging of Parental Choice Programs into a single number well in advance of the September release:
From: Somasundaram, Visalakshi DPI < Visalakshi.Somasundaram@dpi.wi.gov > >
Sent: Friday, August 16, 2019 10:13 AM
To: Straw, Melissa M. DPI < Melissa.Straw@dpi.wi.gov > >
Cc: Tomev, Elizabeth A. DPI < Elizabeth.Tomev@dpi.wi.gov > >
Subject: Combining Public and choice dataGood morning Melissa,
We ran out of time yesterday to discuss the redaction concerns with releasing the statewide combined, public only and choice only data in the press release. This way of PR display has been an ask from the previous Exec. Committee and therefore, the data was reported in this manner during the past couple of years. Can you please let me know the specific concerns with combining the groups so that we can run this by the Exec. Group again?
(While I don’t have access to how Melissa Straw responded to this email, it’s clear that any internal “concerns” about the misleading comparison were disregarded. Noteworthy: DPI had made similar misleading comparisons in prior years — over the objection of School Choice Wisconsin.)
To illustrate how DPI achieved its objective, consider this report on September 11 from Corrinne Hess of Wisconsin Public Radio (emphasis added):
According to the DPI, 39.3 percent of students statewide are proficient in English language arts and 40.1 percent are proficient in math. As for Wisconsin students attending public school, 40.1 percent are proficient in English language arts and 41 percent are proficient in math. Test scores for students enrolled in private or choice schools were much lower with 20.7 percent of students proficient in English language arts, and 17.8 percent proficient in math.
When complete data were released (belatedly), SCW disaggregated the information to make multiple comparisons of school choice and public school students. One such table, below, compares of students and various public-school counterparts on college-readiness ACT tests.
ACT Exam Results for 2018-19 – Average Scores | |||
MPCP | MPS – Low Income | MPS – Full Income | |
Composite Score | 16.8 | 14.9 | 15.5 |
ELA | 16.5 | 13.5 | 14.2 |
MATH | 17.6 | 15.5 | 15.8 |
Science | 17.6 | 15.1 | 15.6 |
RPCP | RUSD – Low Income | RUSD – Full Income | |
Composite Score | 17.6 | 15.3 | 16.9 |
ELA | 17.0 | 13.5 | 15.3 |
MATH | 17.0 | 15.5 | 16.6 |
Science | 17.7 | 15.6 | 17.3 |
WPCP | State – Low Income* | State – Full Income* | |
Composite Score | 20.6 | 16.7 | 19.6 |
ELA | 19.3 | 15.1 | 18.0 |
MATH | 19.8 | 16.9 | 19.4 |
Science | 21.5 | 17.2 | 19.9 |
The comparisons above are NOT readily apparent in the full data sets belatedly released by the DPI. Rather, School Choice Wisconsin needed to independently disaggregate DPI data to reveal the (positive) comparisons.
In a similar vein, SCW also compared results on the state’s Forward proficiency exams. The results conflict directly with the DPI narrative that public school students outperform choice students. Depending on the type of test, there are 30 different ways to compare public and voucher data. Voucher students out-performed low-income public students on 29 of 30 measures. Even more notable, voucher students out-performed public students on 24 of 30 measures.
Did DPI know of such comparisons? Clearly, it did. Through open records requests, SCW learned that DPI specifically sought and was aware of the data presented in SCW tables. For example, here is a September 6 internal email:
From: Tomev, Elizabeth A. DPI <Elizabeth.Tomev@dpi.wi.gov>
Sent: Friday, September 6, 2019 11:28 AM
To: Somasundaram, Visalakshi DPI <Visalakshi.Somasundaram@dpi.wi.gov>
Subject: AssessmentsHi Viji,
Couple of questions that came up at ERT:
Could you provide a side-by-side comparison between Milwaukee/Racine Public Schools and Choice schools in the Milwaukee Parental Choice Program?
And confirming choice results are results of all choice students who took the tests including non-voucher students?
Elizabeth Tomev
Director of Communications
Wisconsin Department of Pubic Ins.
In summary, DPI specifically highlighted a flawed average calculation and knowingly delayed the full release of data that would allow for a meaningful analysis — one that went contrary to its agenda.
Where has the Journal Sentinel been in all of this? MIA. It dutifully followed DPI’s initial narrative and has never, to my knowledge, reported on the more accurate and more favorable comparisons. I asked the paper’s education reporter, Annysa Johnson, if she or the paper had provided readers with such information. She declined to respond.
If not for SCW and WILL effectively doing the job of the newspaper, DPI’s willful violation of state law would occur without accountability. Fortunately, there will be a “day in court” to address the actions of a rogue agency.
The Contrarian
-
Parents May ‘Break Up’ MPS
Feb 8th, 2022 by George Mitchell -
School Choice Key Issue in Governor Race
Sep 1st, 2021 by George Mitchell -
Jill Underly Flunks School Choice 101
Feb 22nd, 2021 by George Mitchell
This is just more of a political spin from someone who made a living promoting the choice program while demonizing public education. When compared to their public school peers, choice students don’t do so well. Is this worth the $350,000,000 that the taxpayers are paying for this program?