{"id":500146,"date":"2022-10-12T00:02:15","date_gmt":"2022-10-11T21:02:15","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/natural-language-processing-software-evaluates-middle-school-science-essays\/"},"modified":"2022-10-12T00:02:15","modified_gmt":"2022-10-11T21:02:15","slug":"natural-language-processing-software-evaluates-middle-school-science-essays","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/natural-language-processing-software-evaluates-middle-school-science-essays\/","title":{"rendered":"#Natural language processing software evaluates middle school science essays"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a28149c51fd2\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a28149c51fd2\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/natural-language-processing-software-evaluates-middle-school-science-essays\/#%E2%80%9CNatural_language_processing_software_evaluates_middle_school_science_essays%E2%80%9D\" >&#8220;Natural language processing software evaluates middle school science essays&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CNatural_language_processing_software_evaluates_middle_school_science_essays%E2%80%9D\"><\/span>&#8220;Natural language processing software evaluates middle school science essays&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2019\/68-artificialin.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2019\/68-artificialin.jpg\" data-sub-html=\"Credit: CC0 Public Domain\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2019\/68-artificialin.jpg\" alt=\"artificial intelligence\" title=\"Credit: CC0 Public Domain\" width=\"800\" height=\"530\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: CC0 Public Domain<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>Students may soon have another teacher in the classroom, but from an unlikely source: artificial intelligence (AI). In two recent papers, computer scientists at Penn State vetted the effectiveness of a form of AI known as natural language processing for assessing and providing feedback on students&#8217; <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a> essays. They detailed their results in the publishing arm of the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/repository.isls.org\/\">International Society for the Learning Sciences Conference<\/a> (ISLS) and in the Proceedings of the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/link.springer.com\/chapter\/10.1007\/978-3-031-11644-5_64\">International Conference on Artificial Intelligence in Education<\/a> (AIED).<\/p>\n<p>                                                                                Natural language processing is a subfield of computer science where researchers convert the written or spoken word into computable data, according to principal investigator Rebecca Passonneau, Penn State professor of computer science and engineering.<\/p>\n<p>Led by Passonneau, the researchers who worked on the ISLS paper extended the abilities of an existing natural language processing tool called <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/aclanthology.org\/K19-1038\/\">PyrEval<\/a> to assess ideas in student writing based on predetermined, computable rubrics. They named the new software PyrEval-CR.<\/p>\n<p>&#8220;PyrEval-CR can provide middle school students im<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">media<\/a>te feedback on their science essays, which offloads much of the burden of assessment from the teacher, so that more writing assignments can be integrated into middle school science curricula,&#8221; Passonneau said. &#8220;Simultaneously, the software generates a summary report on topics or ideas present in the essays from one or more classrooms, so teachers can quickly determine if students have genuinely understood a science lesson.&#8221;<\/p>\n<p>The beginnings of PyrEval-CR date back to 2004, when Passonneau worked with collaborators to develop the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/1233912.1233913\">Pyramid method<\/a>, where researchers annotate source documents manually to reliably rank written ideas by their importance. Starting in 2012, Passonneau and her graduate students worked to automate Pyramid, which led to the creation of the fully automated PyrEval, the precursor of PyrEval-CR. <\/p>\n<p>The researchers tested the functionality and reliability of PyrEval-CR on hundreds of real middle school science essays from public schools in Wisconsin. Sadhana Puntambekar, professor of educational psychology at the University of Wisconsin-Madison and a collaborator on both papers, recruited the science teachers and developed the science curriculum. She also provided historical student essay data that was needed to develop PyrEval-CR before deploying it in classrooms.<br \/>\n                                            <!-- Google middle Adsense block --><\/p>\n<p>&#8220;In PyrEval-CR, we created the same kind of model that PyrEval would create from a few passages by expert writers but extended it to align with whatever rubric makes sense for a particular essay prompt,&#8221; Passonneau said. &#8220;We did a lot of experiments to fine-tune the software, then confirmed that the software&#8217;s assessment correlated very highly with an assessment from a manual rubric developed and <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lied by Puntambekar&#8217;s lab.&#8221;<\/p>\n<p>In the AIED paper, researchers relay the technical details on how they adapted the PyrEval software to create PyrEval-CR. According to Passonneau, most software is designed as a set of modules, or building blocks, each of which has a different function.\u202f <\/p>\n<p>One of PyrEval&#8217;s modules automatically creates the assessment model, called a pyramid, from four to five reference texts written to the same prompt as the student essays. In the new PyrEval-CR, the assessment model, or computable rubric, is created semi-automatically before students even receive an essay prompt. <\/p>\n<p>&#8220;PyrEval-CR makes things easier for teachers in actual classrooms who use rubrics, but who usually don&#8217;t have the resources to create their own rubric and test whether it can be used by different people and achieve the same assessment of student work,&#8221; Passonneau said.<\/p>\n<p>To evaluate essays, students&#8217; sentences must first be broken down into individual clauses and then converted to fixed-length sequences of numbers, known as vectors, according to Passonneau. To capture the meaning of clauses in their conversion to vectors, an algorithm called weighted text matrix factorization is used. Passonneau said the algorithm captured the essential similarities of meaning better than other tested methods.<\/p>\n<p>Researchers adapted another algorithm, known as weighted maximal independent set, to ensure PyrEval-CR selects the best analysis of a given sentence. <\/p>\n<p>&#8220;There are many ways to break down a sentence, and each sentence may be a complex or a simple statement,&#8221; Passonneau said. &#8220;Humans know if two sentences are similar by reading them. To simulate this human skill, we convert each rubric idea to vectors, and construct a graph where each node represents matches of a student vector to rubric vectors, so that the software can find the optimal interpretation of the student essay.&#8221;<\/p>\n<p>Eventually, researchers hope to deploy the assessment software in classrooms to make assigning and assessing science essays more practical for teachers. <\/p>\n<p>&#8220;Through this research, we hope to scaffold student learning in science classes, to give them just enough support and feedback and then back off so they can learn and achieve on their own,&#8221; Passonneau said. &#8220;The goal is to allow STEM teachers to easily implement writing assignments in their curricula.&#8221;<\/p>\n<p>In addition to Passonneau and Puntambekar, the other contributors to the ISLS paper are: Purushartha Singh and ChanMin Kim, Penn State School of Electrical Engineering and Computer Science; and Dana Gnesdilow, Samantha Baker, Xuesong Cang and William Goss, University of Wisconsin-Madison. In addition to Passonneau and Puntambekar, the other contributors to the AIED paper are Mohammad Wasih, Penn State School of Electrical Engineering and Computer Science; Singh, Kim and Cang.\n                                                                                                                        <\/p>\n<hr\/>\n<div class=\"article-main__explore my-4 d-print-none\">\n<p>                                            <a rel=\"nofollow noopener\" target=\"_blank\" class=\"text-medium text-info mt-2 d-inline-block\" href=\"https:\/\/phys.org\/news\/2016-09-essay-genome-algorithmic-analysis.html\">Essay Genome Project applies algorithmic analysis to writing<\/a>\n                                        <\/div>\n<hr class=\"mb-4\"\/>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Purushartha Singh et al, Automated Support to Scaffold Students&#8217; Written Explanations in Science, <i>Artificial Intelligence in Education<\/i> (2022).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1007\/978-3-031-11644-5_64\">DOI: 10.1007\/978-3-031-11644-5_64<\/a><\/p><\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Pennsylvania State University<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.psu.edu\/\"><br \/>\n                                                        <svg>\n                                                            <use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/>\n                                                        <\/svg><br \/>\n                                                    <\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                 <strong>Citation<\/strong>:<br \/>\n                                                 Natural language processing software evaluates middle school science essays (2022, October 11)<br \/>\n                                                 retrieved 11 October 2022<br \/>\n                                                 from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2022-10-natural-language-software-middle-school.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2022-10-natural-language-software-middle-school.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Natural language processing software evaluates middle school science essays&#8221; Credit: CC0 Public Domain Students may soon have another teacher in the classroom, but from an unlikely source: artificial intelligence (AI). In two recent papers, computer scientists at Penn State vetted the effectiveness of a form of AI known as natural language processing for assessing and&#8230;<\/p>\n","protected":false},"author":1,"featured_media":500147,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2019\/68-artificialin.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-500146","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/500146","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=500146"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/500146\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/500147"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=500146"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=500146"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=500146"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}