{"id":563812,"date":"2023-03-15T06:47:18","date_gmt":"2023-03-15T03:47:18","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/chatgpt-v4-aces-the-bar-sats-and-can-identify-exploits-in-eth-contracts\/"},"modified":"2023-03-15T06:47:18","modified_gmt":"2023-03-15T03:47:18","slug":"chatgpt-v4-aces-the-bar-sats-and-can-identify-exploits-in-eth-contracts","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/chatgpt-v4-aces-the-bar-sats-and-can-identify-exploits-in-eth-contracts\/","title":{"rendered":"# ChatGPT V4 aces the bar, SATs and can identify exploits in ETH contracts"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a279b0416efd\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a279b0416efd\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/chatgpt-v4-aces-the-bar-sats-and-can-identify-exploits-in-eth-contracts\/#%E2%80%9D_ChatGPT_V4_aces_the_bar_SATs_and_can_identify_exploits_in_ETH_contracts_%E2%80%9C\" >&#8221; ChatGPT V4 aces the bar, SATs and can identify exploits in ETH contracts &#8220;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9D_ChatGPT_V4_aces_the_bar_SATs_and_can_identify_exploits_in_ETH_contracts_%E2%80%9C\"><\/span>&#8221; ChatGPT V4 aces the bar, SATs and can identify exploits in ETH contracts &#8220;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div class=\"post-content\" data-v-48054ca8>GPT-4, the latest version of the Artificial Intelligence (AI) chatbot, ChatGPT, can pass high school tests and law school exams with scores ranking in the 90th percentile and has new processing capabilities that were not possible with the prior version. <\/p>\n<p>The figures from GPT-4\u2019s test scores were <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/openai.com\/research\/gpt-4\">shared<\/a> on March 14 by its creator OpenAI revealing it can also convert image, audio and video inputs to text in addition to handling \u201cmuch more nuanced instructions\u201d more creatively and reliably.<\/p>\n<p>\u201cIt passes a simulated bar exam with a score around the top 10% of test takers,\u201d OpenAI added. \u201cIn contrast, GPT-3.5\u2019s score was around the bottom 10%.\u201d<\/p>\n<p>The figures show that GPT-4 achieved a score of 163 in the 88th percentile on the LSAT exam \u2014 the test college students need to pass in the United States to be admitted into law school.<\/p>\n<figure><img decoding=\"async\" src=\"https:\/\/s3.cointelegraph.com\/uploads\/2023-03\/53da928c-c1c6-4ea3-b470-0700cbccc829.jpg\"><figcaption style=\"text-align: center;\"><em>Exam results of GPT-4 and GPT-3.5 on a range of recent U.S. exams. Source: <\/em><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/openai.com\/research\/gpt-4\"><em>OpenAI<\/em><\/a><\/figcaption><\/figure>\n<p>GPT4\u2019s score would put it in a good position to be admitted into a top 20 law school and is only a few marks short of the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/magoosh.com\/lsat\/lsat-scores-top-100-law-schools\/\">reported<\/a> scores needed for acceptance to prestigious schools such as Harvard, Stanford, Princeton or Yale.<\/p>\n<p>The prior version of ChatGPT only scored 149 on the LSAT\u2019s putting it in the bottom 40%.<\/p>\n<p>GPT-4 also scored 298 out of 400 in the Uniform Bar Exam \u2014 a test undertaken by recently graduated law students permitting them to practice as a lawyer in any U.S. jurisdiction.<\/p>\n<figure><img decoding=\"async\" src=\"https:\/\/s3.cointelegraph.com\/uploads\/2023-03\/201fc01e-f924-4b85-ad6b-66ab05770eba.jpg\"><figcaption style=\"text-align: center;\"><em>UBE scores needed to be admitted to practice law in each U.S. jurisdiction. Source: <\/em><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.ncbex.org\/exams\/ube\/score-portability\/minimum-scores\/\"><em>National Conference of Bar Examiners<\/em><\/a><\/figcaption><\/figure>\n<p>The old version of ChatGPT struggled in this test, finishing in the bottom 10% with a score of 213 out of 400.<\/p>\n<p>As for the SAT Evidence-Based Reading &amp; Writing and SAT Math exams taken by U.S. high school students to measure their college readiness, GPT-4 scored in the 93rd and 89th percentile respectively. <\/p>\n<p>GPT-4 excelled in the \u201chard\u201d <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a>s too, posting well above average percentile scores in AP Biology (85-100%), Chemistry (71-88%) and Physics 2 (66-84%).<\/p>\n<figure><img decoding=\"async\" src=\"https:\/\/s3.cointelegraph.com\/uploads\/2023-03\/bbbfc9f2-2c95-4a0e-8f56-57f05a1853d9.jpg\"><figcaption style=\"text-align: center;\"><em>Exam results of GPT-4 and GPT-3.5 on a range of recent U.S. Exams. <\/em><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/openai.com\/research\/gpt-4\"><em>Source: OpenAI.<\/em><\/a><\/figcaption><\/figure>\n<p>However its AP Calculus score was fairly average, ranking in the 43r to 59th percentile.<\/p>\n<p>Another area where GPT-4 lacked was in English Literature exams, posting scores in the 8th to 44th percentile across two separate tests.<\/p>\n<p>OpenAI said GPT-4 and GPT-3.5 took these tests from the 2022-2023 practice exams, and that \u201cno specific training\u201d was taken by the language processing tools:<\/p>\n<blockquote><p>\u201cWe did no specific training for these exams. A minority of the problems in the exams were seen by the model during training, but we believe the results to be representative.\u201d<\/p><\/blockquote>\n<p>The results prompted fear in the <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">Twitter<\/a> community too.<\/p>\n<p><strong><em>Related: <\/em><\/strong><strong><em>How will ChatGPT affect the Web3 space? Industry answers<\/em><\/strong><\/p>\n<p>Nick Almond, the founder of FactoryDAO <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/DrNickA\/status\/1635697178969505808\">told<\/a> his 14,300 Twitter followers on March 14 that GPT4 is going to \u201cscare people\u201d and it will \u201ccollapse\u201d the global education system. <\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">Assessment theory was a big chunk of my life for several years. I was banging on about this day coming many years ago. I literally sounded like the resident crank at the time. <\/p>\n<p>But\u2026 really this means that anything but invigilated assessment is over from this point on.<\/p>\n<p>\u2014 drnick \ufe0f\u00b2 (@DrNickA) <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/DrNickA\/status\/1635708178435276816?ref_src=twsrc%5Etfw\">March 14, 2023<\/a><\/p><\/blockquote>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<p>Former Coinbase director, Conor Grogan, said he inserted a live Ethereum smart contract into GPT-4 and instantly pointed to several \u201csecurity vulnerabilities\u201d and outlined how the code can be exploited:<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">I dumped a live Ethereum contract into GPT-4. <\/p>\n<p>In an instant, it highlighted a number of security vulnerabilities and pointed out surface areas where the contract could be exploited. It then verified a specific way I could exploit the contract <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/t.co\/its5puakUW\">pic.twitter.com\/its5puakUW<\/a><\/p>\n<p>\u2014 Conor (@jconorgrogan) <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/jconorgrogan\/status\/1635695064692273161?ref_src=twsrc%5Etfw\">March 14, 2023<\/a><\/p><\/blockquote>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<p>Earlier smart contract audits on ChatGPT found that its first version was also capable at spotting out code bugs to a reasonable degree too. <\/p>\n<p>Rowan Cheung, the founder of AI <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter \u201cThe Rundown\u201d shared a video of GPT transcribing a hand drawn fake website on a piece of paper into code.<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">I just watched GPT-4 turn a hand-drawn sketch into a functional website.<\/p>\n<p>This is insane. <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/t.co\/P5nSjrk7Wn\">pic.twitter.com\/P5nSjrk7Wn<\/a><\/p>\n<p>\u2014 Rowan Cheung (@rowancheung) <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/rowancheung\/status\/1635744529587359756?ref_src=twsrc%5Etfw\">March 14, 2023<\/a><\/p><\/blockquote>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><template data-name=\"subscription_form\" data-type=\"crypto_biz\"><\/template><\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more News articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/general\/\" target=\"_blank\" rel=\"noopener\">General category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/cointelegraph.com\/news\/chatgpt-v4-aces-the-bar-sats-and-can-identify-exploits-in-eth-contracts\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8221; ChatGPT V4 aces the bar, SATs and can identify exploits in ETH contracts &#8220; GPT-4, the latest version of the Artificial Intelligence (AI) chatbot, ChatGPT, can pass high school tests and law school exams with scores ranking in the 90th percentile and has new processing capabilities that were not possible with the prior version&#8230;.<\/p>\n","protected":false},"author":1,"featured_media":563813,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/images.cointelegraph.com\/cdn-cgi\/image\/format=auto,onerror=redirect,quality=90,width=1200\/https:\/\/s3.cointelegraph.com\/uploads\/2023-03\/9f7bf35a-900a-4fb9-8886-3f23b353593c.jpg","fifu_image_alt":"","footnotes":""},"categories":[1],"tags":[77337,75434,74355,117,4965,32740],"class_list":["post-563812","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general","tag-ai","tag-smart-contracts","tag-adoption","tag-business","tag-technology","tag-test"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/563812","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=563812"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/563812\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/563813"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=563812"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=563812"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=563812"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}