(BLOOMINGTON, INDIANA) In mid-2023, around the time Elon Musk rebranded Twitter as X but before he discontinued free academic access to the platform’s data, my colleagues and I looked for signs of social bot accounts posting content generated by artificial intelligence. Social bots are AI software that produce content and interact with people on social media. We uncovered a network of over a thousand bots involved in crypto scams. We dubbed this the “fox8” botnet after one of the fake news websites it was designed to amplify.
We were able to identify these accounts because the coders were a bit sloppy: They did not catch occasional posts with self-revealing text generated by ChatGPT, such as when the AI model refused to comply with prompts that violated its terms. The most common self-revealing response was “I’m sorry, but I cannot comply with this request as it violates OpenAI’s Content Policy on generating harmful or inappropriate content. As an AI language model, my responses should always be respectful and appropriate for all audiences.”
kAm(6 36=:6G6 7@Ig H2D @?=J E96 E:A @7 E96 :4636C8 3642FD6 36EE6C 4@56CD 42? 7:=E6C @FE D6=7\C6G62=:?8 A@DED @C FD6 @A6?\D@FC46 px >@56=D 7:?6\EF?65 E@ C6>@G6 6E9:42= 8F2C5C2:=D]k^Am
kAm%96 7@Ig 3@ED 4C62E65 72<6 6?8286>6?E H:E9 6249 @E96C 2?5 H:E9 9F>2? 244@F?ED E9C@F89 C62=:DE:4 324<\2?5\7@CE9 5:D4FDD:@?D 2?5 C6EH66ED] x? E9:D H2J[ E96J EC:4<65 )’D C64@>>6?52E:@? 2=8@C:E9> :?E@ 2>A=:7J:?8 6IA@DFC6 E@ E96:C A@DED 2?5 244F>F=2E65 D:8?:7:42?E ?F>36CD @7 7@==@H6CD 2?5 :?7=F6?46]k^Am
kAm$F49 2 =6G6= @7 4@@C5:?2E:@? 2>@?8 :?2FE96?E:4 @?=:?6 286?ED H2D F?AC64656?E65 – px >@56=D 925 366? H62A@?:K65 E@ 8:G6 C:D6 E@ 2 ?6H 86?6C2E:@? @7 D@4:2= 286?ED[ >F49 >@C6 D@A9:DE:42E65 E92? k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^9@H\>2?J\3@ED\2C6\@?\EH:EE6C\E96\BF6DE:@?\:D\5:77:4F=E\E@\2?DH6C\2?5\>:DD6D\E96\A@:?E\`gbcadQm62C=:6C D@4:2= 3@EDk^2m] |249:?6\=62C?:?8 E@@=D E@ 56E64E D@4:2= 3@ED[ =:<6 @FC @H? k2 9C67lQ9EEADi^^3@E@>6E6C]@D@>6]:F]65F^Qmq@E@>6E6Ck^2m[ H6C6 F?23=6 E@ 5:D4C:>:?2E6 36EH66? E96D6 px 286?ED 2?5 9F>2? 244@F?ED :? E96 H:=5] tG6? px >@56=D EC2:?65 E@ 56E64E px\86?6C2E65 4@?E6?E 72:=65]k^Am
k9amq@ED :? E96 6C2 @7 86?6C2E:G6 pxk^9am
kAmu2DE\7@CH2C5 2 76H J62CDi %@52J[ A6@A=6 2?5 @C82?:K2E:@?D H:E9 >2=:4:@FD :?E6?E 92G6 2446DD E@ >@C6 A@H6C7F= px =2?8F286 >@56=D – :?4=F5:?8 @A6?\D@FC46 @?6D – H9:=6 D@4:2= >65:2 A=2E7@C>D 92G6 C6=2I65 @C 6=:>:?2E65 >@56C2E:@? 677@CED] %96J 6G6? AC@G:56 7:?2?4:2= :?46?E:G6D 7@C 6?828:?8 4@?E6?E[ :CC6DA64E:G6 @7 H96E96C :E’D C62= @C px\86?6C2E65] %9:D :D 2 A6C764E DE@C> 7@C 7@C6:8? 2?5 5@>6DE:4 :?7=F6?46 @A6C2E:@?D E2C86E:?8 56>@4C2E:4 6=64E:@?D] u@C 6I2>A=6[ 2? px\4@?EC@==65 3@E DH2C> 4@F=5 4C62E6 E96 72=D6 :>AC6DD:@? @7 H:56DAC625[ 3:A2CE:D2? @AA@D:E:@? E@ 2 A@=:E:42= 42?5:52E6]k^Am
kAm%96 4FCC6?E &]$] 25>:?:DEC2E:@? 92D k2 9C67lQ9EEADi^^HHH]?JE:>6D]4@>^a_ad^_a^a_^3FD:?6DD^ECF>A\7@C6:8?\:?7=F6?46\6=64E:@?\:?E6C76C6?46]9E>=Qm5:D>2?E=65k^2m 7656C2= AC@8C2>D E92E k2 9C67lQ9EEADi^^HHH]E649A@=:4J]AC6DD^E96\5@H?72==\@7\E96\8=@32=\6?8286>6?E\46?E6C\2?5\5:D2AA62C:?8\8F2C5C2:=D\282:?DE\5:D:?7@C>2E:@?^Qm4@>32Ek^2m DF49 9@DE:=6 42>A2:8?D 2?5 k2 9C67lQ9EEADi^^HHH]?JE:>6D]4@>^a_ad^_d^`d^3FD:?6DD^ECF>A\@?=:?6\>:D:?7@C>2E:@?\8C2?ED]9E>=Qm567F?565k^2m k2 9C67lQ9EEADi^^HHH]E649A@=:4J]AC6DD^72?E2DJ\364@>6D\C62=:EJ\2D\ECF>A\E2<6D\C6G6?86\@?\5:D:?7@C>2E:@?\C6D62C496CD^QmC6D62C49k^2m 677@CED E@ DEF5J E96>] #6D62C496CD k2 9C67lQ9EEADi^^:?56A6?56?EE649C6D62C49]@C8^=6EE6C\EH:EE6CD\?6H\2A:\A=2?D\H:==\56G2DE2E6\AF3=:4\:?E6C6DE\C6D62C49^Qm?@ =@?86C 92G6 2446DDk^2m E@ E96 A=2E7@C> 52E2 E92E H@F=5 >2<6 :E A@DD:3=6 E@ 56E64E 2?5 >@?:E@C E96D6 <:?5D @7 @?=:?6 >2?:AF=2E:@?]k^Am
kAmx 2> A2CE @7 2? :?E6C5:D4:A=:?2CJ E62> @7 4@>AFE6C D4:6?46[ px[ 4J36CD64FC:EJ[ ADJ49@=@8J[ D@4:2= D4:6?46[ ;@FC?2=:D> 2?5 A@=:4J C6D62C496CD H9@ 92G6 D@F?565 E96 2=2C> 23@FE E96 k2 9C67lQ9EEAi^^5@:]@C8^`_]``ae^D4:6?46]25K`ehfQmE9C62E @7 >2=:4:@FD px DH2C>Dk^2m] (6 36=:6G6 E92E 4FCC6?E px E649?@=@8J 2==@HD @C82?:K2E:@?D H:E9 >2=:4:@FD :?E6?E E@ 56A=@J =2C86 ?F>36CD @7 2FE@?@>@FD[ 252AE:G6[ 4@@C5:?2E65 286?ED E@ >F=E:A=6 D@4:2= >65:2 A=2E7@C>D] %96D6 286?ED 6?23=6 :?7=F6?46 @A6C2E:@?D E92E 2C6 72C >@C6 D42=23=6[ D@A9:DE:42E65 2?5 252AE:G6 E92? D:>A=6 D4C:AE65 >:D:?7@C>2E:@? 42>A2:8?D]k^Am
kAm#2E96C E92? 86?6C2E:?8 :56?E:42= A@DED @C @3G:@FD DA2>[ px 286?ED 42? 86?6C2E6 G2C:65[ k2 9C67lQ9EEAi^^5@:]@C8^`_]`_bg^Dcaade\_ab\__eh_\HQm4C65:3=6 4@?E6?E 2E 2 =2C86 D42=6k^2m] %96 DH2C>D 42? D6?5 A6@A=6 >6DD286D E2:=@C65 E@ E96:C :?5:G:5F2= AC676C6?46D 2?5 E@ E96 4@?E6IE @7 E96:C @?=:?6 4@?G6CD2E:@?D] %96 DH2C>D 42? E2:=@C E@?6[ DEJ=6 2?5 4@?E6?E E@ C6DA@?5 5J?2>:42==J E@ 9F>2? :?E6C24E:@? 2?5 A=2E7@C> D:8?2=D DF49 2D ?F>36CD @7 =:<6D @C G:6HD]k^Am
k9am$J?E96E:4 4@?D6?DFDk^9am
kAmx? 2 DEF5J >J 4@==628F6D 2?5 x 4@?5F4E65 =2DE J62C[ H6 FD65 2 D@4:2= >65:2 >@56= E@ k2 9C67lQ9EEADi^^5@:]@C8^`_]`_hb^A?2D?6IFD^A826adgQmD:>F=2E6 DH2C>D @7 :?2FE96?E:4 D@4:2= >65:2 244@F?EDk^2m FD:?8 5:776C6?E E24E:4D E@ :?7=F6?46 2 E2C86E @?=:?6 4@>>F?:EJ] ~?6 E24E:4 H2D 3J 72C E96 >@DE 67764E:G6i :?7:=EC2E:@?] ~?46 2? @?=:?6 8C@FA :D :?7:=EC2E65[ >2=:4:@FD px DH2C>D 42? 4C62E6 E96 :==FD:@? @7 3C@25 AF3=:4 28C66>6?E 2C@F?5 E96 ?2CC2E:G6D E96J 2C6 AC@8C2>>65 E@ AC@>@E6] %9:D 6IA=@:ED 2 ADJ49@=@8:42= A96?@>6?@? <?@H? 2D k2 9C67lQ9EEADi^^E96564:D:@?=23]4@>^C676C6?46\8F:56^ADJ49@=@8J^D@4:2=\AC@@7QmD@4:2= AC@@7k^2mi wF>2?D 2C6 ?2EFC2==J :?4=:?65 E@ 36=:6G6 D@>6E9:?8 :7 E96J A6C46:G6 E92E “6G6CJ@?6 :D D2J:?8 :E]”k^Am
kAm$F49 D@4:2= >65:2 k2 9C67lQ9EEADi^^5@:]@C8^`_]``cd^`heb`ha]`hebb_`Qm2DEC@EFC7 E24E:4Dk^2m 92G6 366? 2C@F?5 7@C >2?J J62CD[ 3FE >2=:4:@FD px DH2C>D 42? 67764E:G6=J 4C62E6 36=:6G23=6 :?E6C24E:@?D H:E9 E2C86E65 9F>2? FD6CD 2E 2 =2C86 D42=6[ 2?5 86E E9@D6 FD6CD E@ 7@==@H E96 :?2FE96?E:4 244@F?ED] u@C 6I2>A=6[ 286?ED 42? E2=< 23@FE E96 =2E6DE 82>6 E@ 2 DA@CED 72? 2?5 23@FE 4FCC6?E 6G6?ED E@ 2 ?6HD ;F?<:6] %96J 42? 86?6C2E6 =2?8F286 E92E C6D@?2E6D H:E9 E96 :?E6C6DED 2?5 @A:?:@?D @7 E96:C E2C86ED]k^Am
kAmtG6? :7 :?5:G:5F2= 4=2:>D 2C6 563F?<65[ E96 A6CD:DE6?E 49@CFD @7 :?56A6?56?E\D@F?5:?8 G@:46D 42? >2<6 C25:42= :562D D66> >2:?DEC62> 2?5 2>A=:7J ?682E:G6 766=:?8D E@H2C5 “@E96CD]” |2?F724EFC65 DJ?E96E:4 4@?D6?DFD :D 2 G6CJ C62= E9C62E E@ E96 k2 9C67lQ9EEADi^^5@4F>6?ED]H@C=532?<]@C8^6?^AF3=:42E:@?^5@4F>6?ED\C6A@CED^5@4F>6?E56E2:=^`e`hh`ceg`dd`aba_cQmAF3=:4 DA96C6k^2m[ E96 >6492?:D>D 56>@4C2E:4 D@4:6E:6D FD6 E@ 7@C> D92C65 36=:67D[ >2<6 564:D:@?D 2?5 ECFDE AF3=:4 5:D4@FCD6] x7 4:E:K6?D 42??@E C6=:23=J 5:DE:?8F:D9 36EH66? 86?F:?6 AF3=:4 @A:?:@? 2?5 2=8@C:E9>:42==J 86?6C2E65 D:>F=2E:@? @7 F?2?:>:EJ[ 56>@4C2E:4 564:D:@?\>2<:?8 4@F=5 36 D6G6C6=J 4@>AC@>:D65]k^Am
k9am|:E:82E:?8 E96 C:D<Dk^9am
kAm&?7@CEF?2E6=J[ E96C6 :D ?@E 2 D:?8=6 7:I] #68F=2E:@? 8C2?E:?8 C6D62C496CD 2446DD E@ A=2E7@C> 52E2 H@F=5 36 2 7:CDE DE6A] &?56CDE2?5:?8 9@H DH2C>D 3692G6 4@==64E:G6=J H@F=5 36 6DD6?E:2= E@ 2?E:4:A2E6 C:D<D] k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^9@H\7@C6:8?\@A6C2E:@?D\2C6\>2?:AF=2E:?8\D@4:2=\>65:2\E@\:?7=F6?46\J@FC\G:6HD\ac__ghQms6E64E:?8 4@@C5:?2E65 3692G:@Ck^2m :D 2 <6J 492==6?86] &?=:<6 D:>A=6 4@AJ\2?5\A2DE6 3@ED[ >2=:4:@FD DH2C>D AC@5F46 G2C:65 @FEAFE E92E C6D6>3=6D ?@C>2= 9F>2? :?E6C24E:@?[ >2<:?8 56E64E:@? >F49 >@C6 5:77:4F=E]k^Am
kAmx? @FC =23[ H6 56D:8? >6E9@5D E@ 56E64E k2 9C67lQ9EEAi^^5@:]@C8^`_]`e_h^:4HD>]G`d:`]`g_fdQmA2EE6C?D @7 4@@C5:?2E65 3692G:@Ck^2m E92E 56G:2E6 7C@> ?@C>2= 9F>2? :?E6C24E:@?] tG6? :7 286?ED =@@< 5:776C6?E 7C@> 6249 @E96C[ E96:C F?56C=J:?8 @3;64E:G6D @7E6? C6G62= A2EE6C?D :? E:>:?8[ ?6EH@C< >@G6>6?E 2?5 ?2CC2E:G6 EC2;64E@CJ E92E 2C6 F?=:<6=J E@ @44FC ?2EFC2==J]k^Am
kAm$@4:2= >65:2 A=2E7@C>D 4@F=5 FD6 DF49 >6E9@5D] x 36=:6G6 E92E px 2?5 D@4:2= >65:2 A=2E7@C>D D9@F=5 2=D@ k2 9C67lQ9EEADi^^:?5:42E@C]>65:2^A^E649\A=2E7@C>D\72:=\E@\=236=\2:\4@?E6?E\4aA2\>6E252E2Qm>@C6 288C6DD:G6=Jk^2m 25@AE DE2?52C5D E@ 2AA=J H2E6C>2C<D E@ px\86?6C2E65 4@?E6?E 2?5 k2 9C67lQ9EEADi^^HHH]?6HD8F2C5E649]4@>^DA64:2=\C6A@CED^E@A\2:\492E3@ED\5@?E\C64@8?:K6\2:\86?6C2E65\G:56@D^QmC64@8?:K6 2?5 =236= DF49 4@?E6?Ek^2m] u:?2==J[ C6DEC:4E:?8 E96 >@?6E:K2E:@? @7 :?2FE96?E:4 6?8286>6?E H@F=5 C65F46 E96 7:?2?4:2= :?46?E:G6D 7@C :?7=F6?46 @A6C2E:@?D 2?5 @E96C >2=:4:@FD 8C@FAD E@ FD6 DJ?E96E:4 4@?D6?DFD]k^Am
k9am%96 E9C62E :D C62=k^9am
kAm(9:=6 E96D6 >62DFC6D >:89E >:E:82E6 E96 DJDE6>:4 C:D<D @7 >2=:4:@FD px DH2C>D 367@C6 E96J 364@>6 6?EC6?4965 :? A@=:E:42= 2?5 D@4:2= DJDE6>D H@C=5H:56[ E96 4FCC6?E A@=:E:42= =2?5D42A6 :? E96 &]$] D66>D E@ 36 >@G:?8 :? E96 @AA@D:E6 5:C64E:@?] %96 %CF>A 25>:?:DEC2E:@? 92D k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^H92ED\2E\DE2<6\:?\ECF>AD\6I64FE:G6\@C56C\2:>:?8\E@\4FC3\DE2E6\=6G6=\2:\C68F=2E:@?\aeeeegQm2:>65 E@ C65F46 px 2?5 D@4:2= >65:2 C68F=2E:@?k^2m 2?5 :D :?DE625 72G@C:?8 C2A:5 56A=@J>6?E @7 px >@56=D @G6C D276EJ]k^Am
kAm%96 E9C62E @7 >2=:4:@FD px DH2C>D :D ?@ =@?86C E96@C6E:42=i ~FC 6G:56?46 DF886DED E96D6 E24E:4D 2C6 2=C625J 36:?8 56A=@J65] x 36=:6G6 E92E A@=:4J>2<6CD 2?5 E649?@=@8:DED D9@F=5 :?4C62D6 E96 4@DE[ C:D< 2?5 G:D:3:=:EJ @7 DF49 >2?:AF=2E:@?]k^Am
kAmk6>m%9:D 2CE:4=6 :D C6AF3=:D965 7C@> k2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^FDnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<\_U2>AjFE>04@?E6?El2CE:4=6\afcffgQm%96 r@?G6CD2E:@?k^2m[ 2 ?@?AC@7:E[ :?56A6?56?E ?6HD @C82?:K2E:@? 3C:?8:?8 J@F 724ED 2?5 ECFDEH@CE9J 2?2=JD:D E@ 96=A J@F >2<6 D6?D6 @7 @FC 4@>A=6I H@C=5] xE H2D HC:EE6? 3Ji k2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^AC@7:=6D^7:=:AA@\>6?4K6C\b`ffhcnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?l3J=:?6\=:?<U2>AjFE>04@?E6?El2CE:4=6\afcffgQmu:=:AA@ |6?4K6Ck^2m[ k6>mk2 9C67lQ9EEADi^^E964@?G6CD2E:@?]4@>^:?DE:EFE:@?D^:?5:2?2\F?:G6CD:EJ\`begnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?l3J=:?6\=:?<U2>AjFE>04@?E6?El2CE:4=6\afcffgQmx?5:2?2 &?:G6CD:EJk^2mk^6>mk^6>mk^Am
kAmkDEC@?8m#625 >@C6ik^DEC@?8mk^Am
kF=mk=:mk2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^8C@<D\2?E:D6>:E:4\C2?E\D9@HD\9@H\86?6C2E:G6\2:\42?\36\H62A@?:K65\adfgg_nFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<_U2>AjFE>04@?E6?El2CE:4=6\afcffgQmvC@<’D 2?E:D6>:E:4 C2?E D9@HD 9@H 86?6C2E:G6 px 42? 36 H62A@?:K65k^2mk^=:mk=:mk2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^96=A6C\3@ED\:?\@?=:?6\4@>>F?:E:6D\5:>:?:D9\9F>2?\:?E6C24E:@?\ad`fhdnFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<`U2>AjFE>04@?E6?El2CE:4=6\afcffgQmw6=A6C 3@ED :? @?=:?6 4@>>F?:E:6D 5:>:?:D9 9F>2? :?E6C24E:@?k^2mk^=:mk=:mk2 9C67lQ9EEAi^^E964@?G6CD2E:@?]4@>^2:\86?6C2E65\E6IE\:D\@G6CH96=>:?8\:?DE:EFE:@?D\D6EE:?8\@77\2\?@\H:?\2C>D\C246\H:E9\2:\56E64E@CD\afcfa_nFE>0D@FC46l{66U2>AjFE>0>65:F>lC6=2E65\=:?<U2>AjFE>042>A2:8?lC6=2E65\=:?<aU2>AjFE>04@?E6?El2CE:4=6\afcffgQmpx\86?6C2E65 E6IE :D @G6CH96=>:?8 :?DE:EFE:@?D – D6EE:?8 @77 2 ?@\H:? ‘2C>D C246’ H:E9 px 56E64E@CDk^2mk^=:mk^F=m
kA 4=2DDlQ7:?6\AC:?EQmk6>mkDA2?mu:=:AA@ |6?4K6C C646:G6D 7F?5:?8 7C@> z?:89E u@F?52E:@?[ }2E:@?2= $4:6?46 u@F?52E:@?[ $H:DD }2E:@?2= $4:6?46 u@F?52E:@?[ 2?5 p:C u@C46 ~77:46 @7 $4:6?E:7:4 #6D62C49]k^DA2?mk^6>mk^Am
kAmk:>8 DC4lQ9EEADi^^4@F?E6C]E964@?G6CD2E:@?]4@>^4@?E6?E^afcffg^4@F?E]8:7n5:DEC:3FE@Cl=66Q DEJ=6lQ96:89Ei`AIjH:5E9i`AIjQ 2=ElQQ ^mk^Am
(0) comments
Welcome to the discussion.
Log In
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.