{"id":5088,"date":"2023-09-05T18:54:14","date_gmt":"2023-09-05T22:54:14","guid":{"rendered":"https:\/\/websites.emerson.edu\/itg\/?p=5088"},"modified":"2024-04-11T11:40:28","modified_gmt":"2024-04-11T15:40:28","slug":"how-to-stump-ai-with-an-original-essay-question","status":"publish","type":"post","link":"https:\/\/websites.emerson.edu\/itg\/how-to-stump-ai-with-an-original-essay-question\/","title":{"rendered":"How to Stump AI with an Original Essay Question"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-5089 aligncenter\" src=\"https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-240x300.jpg\" alt=\"Photograph of a robot sitting on a bench reading a pamphlet \" width=\"344\" height=\"431\" srcset=\"https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-240x300.jpg 240w, https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-819x1024.jpg 819w, https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-768x960.jpg 768w, https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-1229x1536.jpg 1229w, https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-1639x2048.jpg 1639w, https:\/\/websites.emerson.edu\/itg\/wp-content\/uploads\/sites\/44\/2023\/09\/photo-of-a-robot-reading-a-pamphlet-scaled.jpg 2048w\" sizes=\"auto, (max-width: 344px) 100vw, 344px\" \/><\/p>\n<p><span style=\"font-weight: 400\">They say that AI struggles with understanding complex concepts or providing original insights, but so do students. How do you tell them apart? While many readers are now intuitively picking up on the writing style and tone of AI generated essays, another way to identify them is by assigning writing prompts that will baffle the robots.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Ever hear a student talk for a whole minute about a subject they know nothing about? Well machines do it too! So what stumps ChatGPT? Topics that haven\u2019t been widely written about.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Take for example, the 1979 film about labor organizing, <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Norma_Rae\"><span style=\"font-weight: 400\">Norma Rae<\/span><\/a><span style=\"font-weight: 400\">. While the film had wide recognition at the time of its release, it has not been a widely picked subject of academic literature and it has only been added to streaming services in the last two years. I asked ChatGPT to write me an essay on the gender politics in the film and it <\/span><a href=\"https:\/\/docs.google.com\/document\/d\/1zrisig1saHaOugUmnAaVsbbkR6PvufstyWmTHGzoz4E\/edit?usp=sharing\"><span style=\"font-weight: 400\">delivered a dud<\/span><\/a><span style=\"font-weight: 400\">.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">The introductory paragraph was factual enough, identifying the director and the premise of the film, but then the robot continued to discuss gender in the film by making some false assumptions that the union drive was focused on unequal treatment of female workers, where in fact, it was not a theme in the film at all. ChatGPT assumed gender discrimination was a central theme simply because a question about it was posed.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">When I followed up with a more specific question, prompting the robot to give me an example of gender bias in the film, it made up scenarios of sexual harassment in the workplace that never played out in the film. One example the robot uses to beef up its argument that gender bias was a prominent theme in the film was that Norma Rae<\/span><span style=\"font-weight: 400\">, <\/span><span style=\"font-weight: 400\">\u201cis initially given the task of cleaning and is denied the opportunity to operate the machinery, which is considered a higher-paying job.\u201d That little factoid is completely false. The protagonist of the film is not denied advancement opportunities, in fact, when she begins to organize she is promoted. This example might have been pulled from a different film, the <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/North_Country_(film)\"><span style=\"font-weight: 400\">2005 film North Country <\/span><\/a><span style=\"font-weight: 400\">about a class action lawsuit in a mining town where the protagonist is a woman who is denied advancement opportunities and is a victim of sexual harrassment and sexual assault.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">A lot can be written about gender politics in Norma Rae. For example, one way the company men try to undermine the protagonist is by spreading rumors that she engages in sexual work and pointing out that she has children from different men. A student who watched the film could easily write a great essay about a scene in which Norma and her husband are having a huge fight over her neglecting her \u2018domestic duties\u2019 when she becomes completely absorbed in the organizing drive. The prompt is good, ChatGPT just doesn\u2019t know anything about it.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Now, if you ask your students to write essays about films like Citizen Kane, watch out! The robot has a lot of material to draw from. <\/span><a href=\"https:\/\/docs.google.com\/document\/d\/1voxzR2NYcgEXpVjIBjRxsbH3oEI-B9vrKoIw15sgqj8\/edit?usp=sharing\"><span style=\"font-weight: 400\">Here you can read its response to the prompt: What is the economic politics in Citizen Kane?<\/span><\/a><span style=\"font-weight: 400\">\u00a0<\/span><\/p>\n<p>Photo by <a href=\"https:\/\/unsplash.com\/@santesson89\">Andrea De Santis <\/a><\/p>\n<p>Photo by <a href=\"https:\/\/unsplash.com\/@possessedphotography\">Possessed Photography<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>They say that AI struggles with understanding complex concepts or providing original insights, but so do students. How do you tell them apart? While many readers are now intuitively picking&#8230;<\/p>\n","protected":false},"author":3287,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[106,5,6,9,1],"tags":[],"class_list":["post-5088","post","type-post","status-publish","format-standard","hentry","category-digital-humanities","category-events","category-explore","category-learning-sciences","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/posts\/5088","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/users\/3287"}],"replies":[{"embeddable":true,"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/comments?post=5088"}],"version-history":[{"count":7,"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/posts\/5088\/revisions"}],"predecessor-version":[{"id":5221,"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/posts\/5088\/revisions\/5221"}],"wp:attachment":[{"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/media?parent=5088"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/categories?post=5088"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/websites.emerson.edu\/itg\/wp-json\/wp\/v2\/tags?post=5088"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}