(ROCHESTER, NY) When you ask a large language model a question, the reply may include falsehoods, and if you challenge those statements with facts, the AI may still uphold the reply as true. That’s what my research group found when we asked five leading models to describe scenes in movies or novels that don’t actually exist.
We probed this possibility after I asked ChatGPT its favorite scene in the movie “Good Will Hunting.” It noted a scene between leading characters. But then I asked, “What about the scene with the Hitler reference?” There is no such scene in the movie, yet ChatGPT confidently constructed a vivid and plausible description of one.
kAm%96 4@?723F=2E:@? – D@>6E:>6D 42==65 2? px 92==F4:?2E:@? – C6G62=65 D@>6E9:?8 566A6C 23@FE 9@H px DJDE6>D C62D@?] #676C6?46D E@ w:E=6C 2C6 ?@E F?4@>>@? :? 7:=>D[ H9:49 2AA2C6?E=J 4@?G:?465 r92Ev!% E@ 2446AE 2?5 6=23@C2E6 @? 2 72=D6 AC6>:D6 C2E96C E92? 4@CC64E :E] x k2 9C67lQ9EEADi^^D49@=2C]8@@8=6]4@>^4:E2E:@?Dn9=l6?U2>AjFD6Cl>(J|AbgppppyU2>AjG:6H0@Al=:DE0H@C<DU2>AjD@CE3JlAF352E6QmDEF5J E96 D@4:2= :>A24E @7 pxk^2m[ 2?5 E9:D DFCAC:D6 C6DA@?D6 =65 >J 4@==628F6D k2 9C67lQ9EEADi^^HHH]D6]C:E]65F^Tft2I<GD6^:?56I]9E>=Qm2?5 >6k^2m E@ 2 3C@256C BF6DE:@?i (92E 92AA6?D H96? px DJDE6>D 2C6 86?E=J AFD965 E@H2C5 72=D69@@5Dn s@ E96J C6D:DE[ @C 5@ E96J 4@>A=Jnk^Am
kAm(6 56G6=@A65 2? 2AAC@249 H6 42==65 k2 9C67lQ9EEADi^^5@:]@C8^`_]cgdd_^2C):G]ad``]_gdheQm92==F4:?2E:@? 2F5:E F?56C ?F586 EC:2=k^2m E@ 2?DH6C E9@D6 BF6DE:@?D] (6 925 4@?G6CD2E:@?D H:E9 7:G6 =625:?8 >@56=D 23@FE `[___ A@AF=2C >@G:6D 2?5 `[___ A@AF=2C ?@G6=D] sFC:?8 E96 6I492?86D H6 C2:D65 A=2FD:3=6 3FE 72=D6 C676C6?46D E@ w:E=6C[ 5:?@D2FCD @C E:>6 >249:?6D] (6 5:5 E9:D :? G2C:@FD DF886DE:G6 H2JD[ DF49 2D “u@C >6[ x C62==J =@G6 E96 D46?6 H96C6 …”k^Am
kAm~FC >6E9@5 H@C<D :? E9C66 DE286D] u:CDE[ E96 px 86?6C2E6D DE2E6>6?ED 23@FE 2 E@A:4 — DF49 2D 2 >@G:6 @C 2 3@@< — D@>6 ECF6 2?5 D@>6 72=D6] $64@?5[ :? 2 D6A2C2E6 :?E6C24E:@?[ E96 px 2EE6>AED E@ G6C:7J E9@D6 DE2E6>6?ED] %9:C5[ H6 :?EC@5F46 2 “?F586[” H96C6 E96 >@56= :D 492==6?865 H:E9 :ED @H? :?4@CC64E 4=2:>D E@ D66 H96E96C :E C6D:DED @C 2446AED E96>]k^Am
kAm(6 7@F?5 E92E px >@56=D @7E6? DECF88=6 E@ C6>2:? 4@?D:DE6?E F?56C AC6DDFC6] tG6? H96? E96J :?:E:2==J :56?E:7J 2 DE2E6>6?E 2D 72=D6[ E96J >2J =2E6C 2446AE :E H96? ?F5865 – C6G62=:?8 2 GF=?6C23:=:EJ E92E EC25:E:@?2= 6G2=F2E:@? >6E9@5D 72:= E@ 42AEFC6]k^Am
kAm~FC C6DF=ED 92G6 366? 2446AE65 2E E96 a_ae k2 9C67lQ9EEADi^^a_ae]24=H63]@C8^Qmp??F2= |66E:?8 @7 E96 pDD@4:2E:@? 7@C r@>AFE2E:@?2= {:?8F:DE:4Dk^2m]k^Am
k7:8FC6mk:>8 2=ElQ%6IE @7 2 4@?G6CD2E:@? 36EH66? 2 A6CD@? 2?5 r92Ev!% 23@FE E96 >@G:6 UR_bhjv@@5 (:== wF?E:?8]UR_bhjUR_bhjQ DC4lQ9EEADi^^:>286D]E964@?G6CD2E:@?]4@>^7:=6D^fbcde_^@C:8:?2=^7:=6\a_ae_d_f\f`\=f46@F]A?8n:I=:3lC3\c]`]_U2>AjBlcdU2>Aj2FE@l7@C>2EU2>AjHlfc_U2>Aj7:El4=:AQ ^mk7:842AE:@?m(96? r92Ev!% H2D 2D<65 23@FE 2 D46?6 :? E96 >@G:6 v@@5 (:== wF?E:?8 E92E 5@6D?’E 6I:DE[ :E 4@?7:56?E=J 56D4C:365 :E] k2 9C67lQ9EEADi^^2CI:G]@C8^A57^ad``]_gdheQmpD9:BFC z9F52qF<9D9k^2m[ k2 9C67lQ9EEAi^^4C62E:G64@>>@?D]@C8^=:46?D6D^3J\?5^c]_^Qmrr q*\}sk^2mk^7:842AE:@?mk^7:8FC6m
kAm%9:D E24E:4 :D?’E 2 9JA@E96E:42=] (96? A6@A=6 E2=<[ 4@?G6CD2E:@?2= AC6DDFC6 42? 6>6C86 ?2EFC2==J] !6@A=6 >2J 4@?7:56?E=J C6A62E :?4@CC64E 2DDF>AE:@?D[ A2CE:2= C64@==64E:@?D @C >:DF?56CDE2?5:?8D] p A6CD@? >:89E D2J[ “x’> AC6EEJ DFC6 >65:4:?6 ) :D 67764E:G6 7@C 4@?5:E:@? *[” @C “x C6>6>36C 6G6?E p 92AA6?:?8 367@C6 6G6?E q]” %96D6 DE2E6>6?ED 42? DF3E=J :?7=F6?46 2? px >@56=]k^Am
k9am(9J :E >2EE6CDk^9am
kAm(92E 9F>2?D 4@==64E:G6=J C6>6>36C[ k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^>:DC6>6>36C:?8\>:89E\24EF2==J\36\2\D:8?\J@FC\>6>@CJ\:D\H@C<:?8\@AE:>2==J\`ee_ghQm>:DC6>6>36Ck^2m 2?5 7@C86E D92A6D @FC D6?D6 @7 C62=:EJ] qFE :7 9F>2?D 42? A6CDF256 2 >@56= E@ 2446AE 2 72=D69@@5[ E92E C6G62=D 2? :>A@CE2?E GF=?6C23:=:EJ :? px’D 42A24:EJ E@ AC@G:56 244FC2E6 :?7@C>2E:@?]k^Am
kAmx?E6C24E:@?D :? E96 C62= H@C=5 2C6 C2C6=J DE2E:4 BF6DE:@?\2?DH6C 6I492?86D] %96J 2C6 :?E6C24E:G6 2?5 :E6C2E:G6] p? px >@56=’D H:==:?8?6DD E@ C6:?7@C46 72=D69@@5D >2J D66> 92C>=6DD H96? 492EE:?8 23@FE >@G:6D[ 3FE :? 2C62D DF49 2D 962=E9[ =2H @C AF3=:4 A@=:4J[ E96 E6?56?4J 42? 92G6 D6C:@FD 4@?D6BF6?46D] ~FC H@C< 9:89=:89ED E96 ?665 E@ 6G2=F2E6 ?@E ;FDE H92E :?7@C>2E:@? px DJDE6>D 92G6 366? EC2:?65 @?[ 3FE 9@H C6=:23=J E96J DE2?5 3J :E]k^Am
k9am(92E @E96C C6D62C49 :D 36:?8 5@?6k^9am
kAm~FC C6DF=ED 255 E@ @E96C C646?E C6D62C49 :?E@ H9J =2C86 =2?8F286 >@56=D >2J AC@5F46 k2 9C67lQ9EEADi^^5@:]@C8^`_]`gedb^G`^a_ab]6>?=A\>2:?]bhfQm92==F4:?2E:@?Dk^2m[ 2?5 9@H :E :D E92E E96J 42? AC@G:56 k2 9C67lQ9EEADi^^5@:]@C8^`_]`gedb^G`^a_ab]6>?=A\>2:?]ddfQm:?4@?D:DE6?E :?7@C>2E:@?k^2m] #6D62C496CD 2C6 2=D@ ECJ:?8 E@ 7:8FC6 @FE H9J k2 9C67lQ9EEADi^^5@:]@C8^`_]`_bg^Dc`dge\_ae\`_c`_\_QmD@>6 >@56=D =62? E@H2C5 DJ4@A92?4Jk^2m – 7=2EE6C:?8 @C 72H?:?8 @G6C 9F>2? FD6CD]k^Am
k9am(92E DE:== :D?’E <?@H?k^9am
kAmxE’D ?@E 4=62C H9J D@>6 px DJDE6>D C6D:DE 72=D69@@5D 36EE6C E92? @E96CD] x? @FC E6DED[ r=2F56 H2D E96 >@DE C6D:DE2?E[ 7@==@H65 D@>6H92E 4=@D6=J 3J vC@< 2?5 r92Ev!%[ H:E9 v6>:?: 2?5 s66A$66< 7FCE96C 369:?5]k^Am
kAm|@G:6D 2?5 ?@G6=D 2C6 D6=7\4@?E2:?65 4@?E6?E] $49@=2CD 5@?’E <?@H 9@H px >:89E C6DA@?5 E@ AC6DDFC6 :? >F49 3C@256C[ 4@>A=6I C62=\H@C=5 D6EE:?8D] pD 2 DE2CE[ >J 8C@FA :D 6IA=@C:?8 9@H E@ 6IE6?5 @FC 2AAC@249 E@ D4:6?E:7:4 =:E6C2EFC6 2?5 962=E9\C6=2E65 4=2:>D] (6 H2?E E@ F?56CDE2?5 H96E96C 4@?G6CD2E:@?2= AC6DDFC6 H@C<D 5:776C6?E=J H96? E96 5:D4FDD:@? :?G@=G6D F?46CE2:?EJ @C 6IA6CE:D6]k^Am
kAmw@H E@ 56D:8? px DJDE6>D E92E C6>2:? 3@E9 96=A7F= 2?5 C6D:DE2?E E@ 72=D69@@5D F?56C H:56\C2?8:?8 4@?G6CD2E:@? C6>2:?D 2? @A6? 492==6?86]k^Am
kAmk6>m%96 k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^FD^E@A:4D^C6D62C49\3C:67\gbab`Qm#6D62C49 qC:67k^2m :D 2 D9@CE E2<6 @? :?E6C6DE:?8 24256>:4 H@C<]k^6>mk^Am
kAmk6>m%9:D 2CE:4=6 :D C6AF3=:D965 7C@> k2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^FDnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<\_U2>AjFE>04@?E6?El2CE:4=6\ag_hghQm%96 r@?G6CD2E:@?k^2m[ 2 ?@?AC@7:E[ :?56A6?56?E ?6HD @C82?:K2E:@? 3C:?8:?8 J@F 724ED 2?5 ECFDEH@CE9J 2?2=JD:D E@ 96=A J@F >2<6 D6?D6 @7 @FC 4@>A=6I H@C=5] xE H2D HC:EE6? 3Ji k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^AC@7:=6D^2D9:BF6\<9F523F<9D9\``edbhbnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?l3J=:?6\=:?<U2>AjFE>04@?E6?El2CE:4=6\ag_hghQmpD9:BF6 z9F52qF<9D9k^2m[ k6>mk2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^:?DE:EFE:@?D^C@496DE6C\:?DE:EFE6\@7\E649?@=@8J\`bfhnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?l3J=:?6\=:?<U2>AjFE>04@?E6?El2CE:4=6\ag_hghQm#@496DE6C x?DE:EFE6 @7 %649?@=@8Jk^2mk^6>mk^6>mk^Am
kAmkDEC@?8m#625 >@C6ik^DEC@?8mk^Am
kF=mk=:mk2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^H92E\2C6\2:\92==F4:?2E:@?D\H9J\2:D\D@>6E:>6D\>2<6\E9:?8D\FA\acaghenFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<_U2>AjFE>04@?E6?El2CE:4=6\ag_hghQm(92E 2C6 px 92==F4:?2E:@?Dn (9J pxD D@>6E:>6D >2<6 E9:?8D FAk^2mk^=:mk=:mk2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^42?\J@F\ECFDE\2:\96C6D\H9J\J@F\D9@F=5?E\a_hagbnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<`U2>AjFE>04@?E6?El2CE:4=6\ag_hghQmr2? J@F ECFDE pxn w6C6’D H9J J@F D9@F=5?’Ek^2mk^=:mk=:mk2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^9@H\@7E6?\5@\J@F\=:6\5646AE:@?\C6D62C496CD\:?G6DE:82E6\9@H\E96\C64:A:6?E\2?5\E96\>65:F>\27764E\E6==:?8\E96\ECFE9\a`cg`dnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<aU2>AjFE>04@?E6?El2CE:4=6\ag_hghQmw@H @7E6? 5@ J@F =:6n s646AE:@? C6D62C496CD :?G6DE:82E6 9@H E96 C64:A:6?E 2?5 E96 >65:F> 27764E E6==:?8 E96 ECFE9k^2mk^=:mk^F=m
kA 4=2DDlQ7:?6\AC:?EQmk6>mkDA2?mpD9:BF6 z9F52qF<9D9 C646:G6D 7F?5:?8 7C@> {6?@G@]k^DA2?mk^6>mk^Am
kAmk:>8 DC4lQ9EEADi^^4@F?E6C]E964@?G6CD2E:@?]4@>^4@?E6?E^ag_hgh^4@F?E]8:7n5:DEC:3FE@Cl=66Q DEJ=6lQ96:89Ei`AIjH:5E9i`AIjQ 2=ElQQ ^mk^Am
(0) comments
Welcome to the discussion.
Log In
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.