--- title: MIND Submits Public Comments on IES Proposed Priorities description: MIND’s comment encourages educators to expect more from edtech research, and offers recommendations on the ESSA tier system and the What Works Clearinghouse. image: https://2024.mindresearch.org/hubfs/MIND%20Research%20Institute/MINDResearchInstitute_Feb2017/Graphics/Photos/image-MRI_STMath02.jpg --- [![](https://2024.mindresearch.org/hs-fs/hubfs/MIND-logo-2018.jpg?width=1701&height=623&name=MIND-logo-2018.jpg)](http://www.mindresearch.org/) [![mind logo](https://2024.mindresearch.org/hubfs/graphics/logos/MIND-logos-color2.svg)](https://www.mindeducation.org/) [![mind white logo](https://2024.mindresearch.org/hubfs/graphics/logos/MIND-logos-white2.svg)](https://www.mindeducation.org/) - [Our Approach](https://2024.mindresearch.org/our-approach) - [Why MIND?](https://2024.mindresearch.org/why-math-education) - [Our Research](https://2024.mindresearch.org/our-research) - [Our Patents](https://2024.mindresearch.org/patents) - [Our Impact](https://2024.mindresearch.org/impact) - [Our Partners](https://2024.mindresearch.org/partners) - [Partner Stories](https://2024.mindresearch.org/partner-stories) - Our Programs - [ST Math](http://www.stmath.com/) - [InsightMath](http://www.insightmath.com/) - [MathMINDs](https://www.mindresearch.org/mathminds) - [Life at MIND](https://2024.mindresearch.org/careers) - Resources - [Blog](https://2024.mindresearch.org/blog) - [Math Discourse](https://2024.mindresearch.org/puzzletalks) - [Podcast](https://2024.mindresearch.org/edtech-podcast) - [News](https://2024.mindresearch.org/news) - [Activities](https://2024.mindresearch.org/stem-resources) - [Donate](https://store.mindresearch.org/pages/donate) **Student privacy****:** learn more about our commitment to keeping students safe [Read More](https://www.mindresearch.org/privacy-policy) ![MIND-on-Math_Blog-Header-5](https://2024.mindresearch.org/hs-fs/hubfs/graphics/headers/_blog-headers/MIND-on-Math_Blog-Header-5.png?width=2000&height=667&name=MIND-on-Math_Blog-Header-5.png "MIND-on-Math_Blog-Header-5") Category Community Teaching & Learning Technology & Games Research & Outcomes Neuroscience Celebrations & Successes [![Subscribe](https://no-cache.hubspot.com/cta/default/237516/a35fb57d-2960-4554-a0f3-e7bb5946fc70.png)](https://cta-redirect.hubspot.com/cta/redirect/237516/a35fb57d-2960-4554-a0f3-e7bb5946fc70) [Research & Outcomes](https://2024.mindresearch.org/blog/topic/research-outcomes) # MIND Submits Public Comments on IES Proposed Priorities By [Liz Neiman](https://2024.mindresearch.org/blog/author/liz-neiman) - - - - - [mailto:?subject=MIND%20Submits%20Public%20Comments%20on%20IES%20Proposed%20Priorities&body=MIND%20Submits%20Public%20Comments%20on%20IES%20Proposed%20Priorities%20https://2024.mindresearch.org/blog/public-comments-on-ies-priorities](mailto:?subject=MIND%20Submits%20Public%20Comments%20on%20IES%20Proposed%20Priorities&body=MIND%20Submits%20Public%20Comments%20on%20IES%20Proposed%20Priorities%20https://2024.mindresearch.org/blog/public-comments-on-ies-priorities) - On March 28, 2019, the [U.S. Department of Education](https://www.ed.gov/) (DOE) [Institute of Education Sciences](https://ies.ed.gov/) (IES) published a notice (84 FR 11755) in the [*Federal Register*](https://www.federalregister.gov/documents/2019/03/28/2019-05970/proposed-priorities-for-the-institute-of-education-sciences-and-request-for-comment) seeking public comment on IES’s proposed priorities. The stated [mission of the IES](https://ies.ed.gov/aboutus/) is to "provide scientific evidence on which to ground education practice and policy and to share this information in formats that are useful and accessible to educators, parents, policymakers, researchers, and the public." The director of IES is required to propose priorities for IES, which must be submitted to its board for review after a period of public comment. [MIND Research Institute](https://www.mindresearch.org/) has submitted [its comments](https://2024.mindresearch.org/hubfs/Blog/PDFs/MIND-IEScomments-052219.pdf), which will also be available on the docket ([ED-2019-IES-0017](https://www.regulations.gov/docket?D=ED-2019-IES-0017)) along with comments submitted by other organizations, agencies, and entities. Comments are due by May 28, 2019. MIND’s comments focus on the following proposed IES goals: - Better measurement and understanding of the effectiveness of education programs, - Disseminating research, statistics, and evaluations in ways that are accessible and understandable, - Enhancing the experience of [What Works Clearinghouse](https://ies.ed.gov/ncee/wwc/) (WWC) users, and - Developing and refining education research methods. “Edtech effectiveness research is tricky to navigate but is coming off as deceptively simple,” said Andrew Coulson, Chief Data Science Officer at MIND Research Institute. “Well intentioned regulations and non-regulatory guidance have, in practice, created a simple checkbox mentality. If a product has ‘one good study,’ the box is considered checked, and the decision maker moves on." But at MIND, we believe that educators shouldn’t rely solely on one piece of evidence, even under the [ESSA tier system](https://www2.ed.gov/policy/elsec/leg/essa/index.html). An edtech program could have been rated as having "strong" evidence based on a single randomized control trial, done many years ago, on a version of a product that no longer exists. [![edtech-evaluations-ebook-tablet](https://2024.mindresearch.org/hs-fs/hubfs/Landing%20Pages/images/edtech-evaluations-ebook-tablet.png?width=250&name=edtech-evaluations-ebook-tablet.png)](https://blog.mindresearch.org/blog/demanding-more-from-edtech-evaluations)To change this dynamic, MIND’s comment suggests that educator decision makers should be empowered to expect more from edtech research - to not only look to see that one study exists, but also to take a deeper look at what the research is really saying, and whether the studied solution will make an impact for their students. The MIND comment further asserts that rather than relying on one “gold standard” study, we should be looking at a large number of studies, using recent program versions, garnering repeatable results, over many varied districts. “Under the current ESSA tier system, only a randomized control trial (RCT) carries the weight of tier 1 ‘strong’ evidence,” said Coulson. “But quasi-experimental studies - tier 2 ‘moderate’ evidence - make it possible to conduct a vast number of studies, and therefore provide extremely valuable data for decision makers. With more studies, educators can evaluate repeatability, and identify consistent patterns over multiple years, across grade levels, and especially across different types of districts and assessments.” At MIND, we also believe there needs to be much more non-academic conversation and education about research, and that all formal research findings can and should should be unpacked and translated to become useful to decision makers. For more about our methodology, visit [stmath.com/impact](https://www.stmath.com/impact). ## Additional Resources - [Free Ebook: Demanding More from Edtech Evaluations](https://blog.mindresearch.org/blog/demanding-more-from-edtech-evaluations) - [Why You Need More Than “One Good Study” To Evaluate EdTech](https://blog.mindresearch.org/blog/edtech-evaluation-rubric) - [Podcast: A New Paradigm for EdTech Evaluation](https://blog.mindresearch.org/blog/new-paradigm-for-edtech-evaluation) - [Video: What Is Effect Size?](https://2024.mindresearch.org/blog/what-is-effect-size) - [EdSurge: "Debunking the ‘Gold Standard’ Myths in Edtech Efficacy"](https://www.edsurge.com/news/2019-05-21-debunking-the-gold-standard-myths-in-edtech-efficacy) ![Liz Neiman](https://2024.mindresearch.org/hubfs/2018_S2/meet-the-team/elizabeth-neiman.jpg) ### About the Author Liz Neiman is Vice President of Engagement at MIND, leading the marketing team's plans and activities to promote MIND's initiatives and impact. Besides education and gaming, her interests include music of all kinds (from musical theater to heavy metal), cooking and baking, and fashion. Follow her on Twitter [@lizneiman](https://twitter.com/lizneiman). ### Comment #### [Sharing our STEM Career Stories with Girls](https://2024.mindresearch.org/blog/sharing-stem-career-stories-with-girls) [STEMconnector Releases Input to Impact Report at Annual Summit](https://2024.mindresearch.org/blog/stemconnector-input-to-impact-report) ### Search Result By: ![feature image](https://2024.mindresearch.org/hubfs/Blog/Images/Inside-our-Minds-logo-teal-800x800.png) [Featured Podcast](https://2024.mindresearch.org/blog/topic/featured-podcast) ### [Rethinking Attendance in Edtech](https://2024.mindresearch.org/blog/rethinking-attendance-in-edtech) [Listen Now](https://2024.mindresearch.org/blog/rethinking-attendance-in-edtech) ##### LATEST PODCAST EPISODES ###### BY MIND RESEARCH INSTITUTE - [Rethinking Attendance in Edtech](https://2024.mindresearch.org/blog/rethinking-attendance-in-edtech) - [People, Process, and Penguins: Designing Math Experiences](https://2024.mindresearch.org/blog/people-process-penguins) - [Bridging STEM Gaps with STEMconnector CEO Jo Webber](https://2024.mindresearch.org/blog/bridging-stem-gaps-with-stemconnector-ceo-jo-webber) - [The EdTech Genome Project: Talking Implementation with Elizabeth Birie](https://2024.mindresearch.org/blog/edtech-genome-project) - [From Meeting the Moment to Foundational Change](https://2024.mindresearch.org/blog/from-meeting-the-moment-to-foundational-change) ##### [See all podcasts](https://www.mindresearch.org/edtech-podcast) ## Interested in Contributing? [![Read Our Blog Guidelines](https://no-cache.hubspot.com/cta/default/237516/a5ccc223-4d16-4ac9-b049-55259b5fa0fc.png)](https://cta-redirect.hubspot.com/cta/redirect/237516/a5ccc223-4d16-4ac9-b049-55259b5fa0fc) ## Join Our Newsletter - [Speakers](https://2024.mindresearch.org/speakers) - [Partners](https://2024.mindresearch.org/partners) - [Patents](https://2024.mindresearch.org/patents) - [Resources](http://blog.mindresearch.org/resources) - [Equity](https://2024.mindresearch.org/equity) - [Accessibility](https://www.mindresearch.org/accessibility) - [Blog](https://2024.mindresearch.org/blog) - [Math Discourse](https://2024.mindresearch.org/math-puzzle-talks) - [Podcast](https://2024.mindresearch.org/edtech-podcast) - [News](https://2024.mindresearch.org/news) - [ST Math](http://STMath.com) - [MathMINDs](https://2024.mindresearch.org/mathminds) - [Careers](https://2024.mindresearch.org/careers) - [MIND Marketplace](https://store.mindresearch.org/) - [FAQs](https://2024.mindresearch.org/faq) - [Contact Us](https://2024.mindresearch.org/contact-us) - [Site Map](https://2024.mindresearch.org/site-map) [![DONATE](https://no-cache.hubspot.com/cta/default/237516/c729ff2c-0758-4634-bf2d-46c915ce5cba.png)](https://cta-redirect.hubspot.com/cta/redirect/237516/c729ff2c-0758-4634-bf2d-46c915ce5cba) - [*facebook*](https://www.facebook.com/MindEduORG) - [*twitter*](https://x.com/MINDEduOrg) - [*youtube*](https://www.youtube.com/user/mindresearch/) - [*pinterest*](https://www.instagram.com/mindeducationorg/) - [*linkedin*](https://www.linkedin.com/company/mind-research-institute/) [![DONATE](https://no-cache.hubspot.com/cta/default/237516/c729ff2c-0758-4634-bf2d-46c915ce5cba.png)](https://cta-redirect.hubspot.com/cta/redirect/237516/c729ff2c-0758-4634-bf2d-46c915ce5cba) Copyright © 2024 MIND Education®. All rights reserved. [Terms of Use](https://2024.mindresearch.org/terms-of-use) | [Privacy Policy](https://2024.mindresearch.org/privacy-policy) Search: Jump to: Category Community Jump to: Most Recent Most Popular Most Recent Most Popular