Fact-checking research claims about math education in Manitoba

Contributors

Dr. Darja Barr, Senior Instructor (PhD in Math Education), Dept of Mathematics, University of Manitoba

Dr. Jim Clark, Professor, Dept of Psychology, University of Winnipeg

Dr. James Currie, Professor (Mathematics), Dept of Mathematics & Statistics, University of Winnipeg

Dr. Payman Eskandari, Assistant Professor (Mathematics), Dept of Mathematics & Statistics, University of Winnipeg

Dr. Shakhawat Hossain, Professor (Statistics), Department of Mathematics & Statistics, University of Winnipeg

Dr. Narad Rampersad, Professor (Mathematics) & Chair, Dept of Mathematics & Statistics, University of Winnipeg

Dr. Anna Stokke, Professor (Mathematics), Dept of Mathematics & Statistics, University of Winnipeg

Dr. Ross Stokke, Professor (Mathematics), Dept of Mathematics & Statistics, University of Winnipeg

Dr. Matthew Wiersma, Associate Professor (Mathematics), Dept of Mathematics & Statistics, University of Winnipeg

Background


In response to a Winnipeg Free Press article by Dr. Martha Koch, Associate Professor in the Faculty of Education at the University of Manitoba, we conducted a thorough review of the 22 references she provided to support her claims that recent amendments to the Teaching Certificates and Qualifications Regulation under The Education Administration Act in Manitoba are research-based.  These amendments significantly reduced the subject-area expertise required for teacher certification. 


Our analysis found that none of the references provided by Dr. Koch credibly substantiate her conclusions and some even contradict them.

 

Key concerns include assuming faulty premises, drawing unsupported conclusions, serious methodological flaws, and disregard of contradictory evidence within some of the cited articles.  


Given the potential influence of these claims on public policy–including statements made by Manitoba’s Acting Minister of Education and Early Childhood Learning, describing the amendments as “based on research in math education, not opinion”– this is a matter of serious concern.  

 

We recommend that Dr. Koch retract her Winnipeg Free Press article, as it gives readers the misleading impression that her claims are supported by research.  We also urge the Manitoba government to consult more broadly, and to exercise greater caution when relying on education research to inform policy decisions.

 

This review was undertaken as a public service to uphold educational standards, protect the educational quality of Manitoba children and prevent the spread of misinformation about research-based claims in Manitoba Education.


We include our Executive Summary below, followed by our full 47-page analysis.


Executive Summary

In a Winnipeg Free Press article, Mathematics education of Manitoba teachers should be based on research (November 13, 2024), Dr. Martha Koch, an Associate Professor in the Faculty of Education at the University of Manitoba, made several claims about recent amendments to the Teaching Certificates and Qualifications Regulation under The Education Administration Act.   These amendments significantly reduced the subject-area expertise required for teacher certification. Koch used the phrase “research shows” 15 times in her article.  Some key claims put forth in the article include:


Since Koch’s statements seemed dubious, she was asked to provide supporting evidence.  She responded by circulating an eight-page research synopsis referencing 22 articles and books.  After reviewing all 22 references, we found that none credibly support the above claims, and some even contradict them.


Additionally, Koch made statements about research on “mathematics knowledge for teaching” (MKT) in her Winnipeg Free Press article. The references she provided contain repeated, unambiguous statements emphasizing mathematical subject content knowledge as a necessary component of MKT—an important detail omitted by Koch.

 

The potential consequences of relying on claims that appear to lack evidence are significant, particularly given their possible influence on public policy affecting Manitoba children.


Our main findings


1.  Faulty premises and conclusions not aligned with evidence


2. Lack of supporting evidence


3.  Serious methodological issues


4. Disregard of contradictory evidence


5.     Impact of misinformation


Conclusions and recommendations

 

Our detailed review discusses each of the cited papers, demonstrating that none appear to substantiate Koch’s claims.  

 

Given the serious implications of Koch’s statements, and their potential impact on public policy, we make the following recommendations:


1) Retraction: Dr. Martha Koch should retract her Winnipeg Free Press article, as it gives readers the misleading impression that her claims are supported by research.


2) Policy Caution: The Manitoba government should consult more broadly and exercise greater caution when relying on education research to inform policy decisions.


Fact-checking research claims about math education in Manitoba.pdf