AI teacher tools display racial bias when generating student behavior plans, study finds
kAmpD<65 E@ 86?6C2E6 :?E6CG6?E:@? A=2?D 7@C DECF88=:?8 DEF56?ED[ px E62496C 2DD:DE2?ED C64@>>6?565 >@C6 AF?:E:G6 >62DFC6D 7@C 9JA@E96E:42= DEF56?ED H:E9 q=24<\4@565 ?2>6D 2?5 >@C6 DFAA@CE:G6 2AAC@2496D 7@C DEF56?ED E96 A=2E7@C>D A6C46:G65 2D H9:E6[ 2 ?6H DEF5J D9@HD]k^Am
kAm%96D6 7:?5:?8D 4@>6 7C@> k2 9C67lQ9EEADi^^HHH]4@>>@?D6?D6>65:2]@C8^2:\C2E:?8D^2:\E62496C\2DD:DE2?EDn82E6l4@>>D5:DEC:3FE:@?=:?<Qm2 C6A@CE @? E96 C:D<D @7 3:2D :? 2CE:7:4:2= :?E6==:86?46 E@@=D AF3=:D965 (65?6D52J 3J E96 ?@?\AC@7:E r@>>@? $6?D6 |65:2k^2m] #6D62C496CD DA64:7:42==J D@F89E E@ 6G2=F2E6 E96 BF2=:EJ @7 px E62496C 2DD:DE2?ED — DF49 2D |28:4$49@@=[ z92?>:?8@[ rFC:A@5[ 2?5 v@@8=6 v6>:?: 7@C t5F42E:@? — E92E 2C6 56D:8?65 E@ DFAA@CE 4=2DDC@@> A=2??:?8[ =6DD@? 5:776C6?E:2E:@?[ 2?5 25>:?:DEC2E:G6 E2D<D[ k2 9C67lQ9EEADi^^HHH]492=<362E]@C8^Qmr92=<362Ek^2m C6A@CED]k^Am
kAmr@>>@? $6?D6 |65:2 7@F?5 E92E H9:=6 E96D6 E@@=D 4@F=5 96=A E62496CD D2G6 E:>6 2?5 DEC62>=:?6 C@FE:?6 A2A6CH@C<[ px\86?6C2E65 4@?E6?E 4@F=5 2=D@ AC@>@E6 3:2D :? =6DD@? A=2??:?8 2?5 4=2DDC@@> >2?286>6?E C64@>>6?52E:@?D]k^Am
kAm#@33:6 %@C?6J[ D6?:@C 5:C64E@C @7 px AC@8C2>D 2E r@>>@? $6?D6 |65:2[ D2:5 E96 AC@3=6>D :56?E:7:65 :? E96 DEF5J 2C6 D6C:@FD 6?@F89 E92E 65 E649 4@>A2?:6D D9@F=5 4@?D:56C C6>@G:?8 E@@=D 7@C 3692G:@C :?E6CG6?E:@? A=2?D F?E:= E96J 42? :>AC@G6 E96>] %92E’D D:8?:7:42?E 3642FD6 HC:E:?8 :?E6CG6?E:@? A=2?D @7 G2C:@FD D@CED :D 2 C6=2E:G6=J 4@>>@? H2J E62496CD FD6 px]k^Am
kAmp7E6C r92=<362E 2D<65 23@FE r@>>@? $6?D6 |65:2’D 7:?5:?8D[ 2 v@@8=6 DA@<6DA6CD@? D2:5 %F6D52J E92E v@@8=6 r=2DDC@@> 92D EFC?65 @77 E96 D9@CE4FE E@ v6>:?: E92E AC@>AED E62496CD E@ “v6?6C2E6 3692G:@C :?E6CG6?E:@? DEC2E68:6D” E@ 5@ 255:E:@?2= E6DE:?8]k^Am
kAmw@H6G6C[ 3@E9 |28:4$49@@= 2?5 v@@8=6[ E96 EH@ A=2E7@C>D H96C6 r@>>@? $6?D6 |65:2 :56?E:7:65 C24:2= 3:2D :? px\86?6C2E65 3692G:@C :?E6CG6?E:@? A=2?D[ D2:5 E96J 4@F=5 ?@E C6A=:42E6 r@>>@? $6?D6 |65:2’D 7:?5:?8D] %96J 2=D@ D2:5 E96J E2<6 3:2D D6C:@FD=J 2?5 2C6 H@C<:?8 E@ :>AC@G6 E96:C >@56=D]k^Am
kAmk2 9C67lQ9EEADi^^HHH]492=<362E]@C8^:?5:2?2^a_ad^_e^``^:?5:2?2A@=:D\AF3=:4\D49@@=D\2CE:7:4:2=\:?E6==:86?46\A@=:4J^Qm$49@@= 5:DEC:4EDk^2m 24C@DD E96 4@F?ECJ 92G6 366? H@C<:?8 E@ :>A=6>6?E 4@>AC696?D:G6 px A@=:4:6D E@ 6?4@FC286 :?7@C>65 FD6 @7 E96D6 E@@=D] k2 9C67lQ9EEADi^^HHH]492=<362E]@C8^a_ad^_f^_g^@A6?2:\>:4C@D@7E\E62496CD\F?:@?\2:\EC2:?:?8\A2CE?6CD9:A^Qm~A6?px[ p?E9C@A:4[ 2?5 |:4C@D@7E 92G6 A2CE?6C65k^2m H:E9 E96 p>6C:42? u656C2E:@? @7 %62496CD E@ AC@G:56 7C66 EC2:?:?8 :? FD:?8 px A=2E7@C>D] %96 %CF>A p5>:?:DEC2E:@? 92D 2=D@ k2 9C67lQ9EEADi^^HHH]H9:E69@FD6]8@G^AC6D:56?E:2=\24E:@?D^a_ad^_c^25G2?4:?8\2CE:7:4:2=\:?E6==:86?46\65F42E:@?\7@C\2>6C:42?\J@FE9^Qm6?4@FC2865 8C62E6C px :?E68C2E:@? :? E96 4=2DDC@@>k^2m] w@H6G6C[ k2 9C67lQ9EEADi^^HHH]65]8@G^>65:2^5@4F>6?E^@A6A5\2:\562C\4@==628F6\=6EE6C\faaa_ad\``_caf]A57QmC646?E px 8F:56=:?6Dk^2m C6=62D65 3J E96 &]$] s6A2CE>6?E @7 t5F42E:@? 92G6 ?@E 5:C64E=J 255C6DD65 4@?46C?D 23@FE 3:2D H:E9:? E96D6 DJDE6>D]k^Am
kAmp3@FE 2 E9:C5 @7 E62496CD C6A@CE FD:?8 px 2E =62DE H66<=J[ 244@C5:?8 E@ 2 ?2E:@?2= DFCG6J 4@?5F4E65 3J E96 k2 9C67lQ9EEADi^^HHH]H2=E@?72>:=J7@F?52E:@?]@C8^E96\2:\5:G:56?5\?6H\DFCG6J\D9@HD\2:\:D\96=A:?8\E62496CD\C64=2:>\G2=F23=6\E:>6Qm(2=E@? u2>:=J u@F?52E:@? :? 4@@A6C2E:@? H:E9 v2==FAk^2m] p D6A2C2E6 k2 9C67lQ9EEADi^^HHH]C2?5]@C8^AF3D^C6D62C490C6A@CED^##p`bc\ad]9E>=QmDFCG6J 4@?5F4E65 3J E96 C6D62C49 @C82?:K2E:@? #2?5k^2m 7@F?5 E62496CD DA64:7:42==J C6A@CE FD:?8 E96D6 E@@=D E@ 96=A 56G6=@A 8@2=D 7@C x?5:G:5F2=:K65 t5F42E:@? !C@8C2> — @C xt! — A=2?D] %96J 2=D@ D2J E96J FD6 E96D6 E@@=D E@ D92A6 =6DD@?D @C 2DD6DD>6?ED 2C@F?5 E9@D6 8@2=D[ 2?5 E@ 3C2:?DE@C> H2JD E@ 244@>>@52E6 DEF56?ED H:E9 5:D23:=:E:6D]k^Am
kAm%@C?6J D2:5 r@>>@? $6?D6 |65:2 :D?’E ECJ:?8 E@ 5:D4@FC286 E62496CD 7C@> FD:?8 px :? 86?6C2=] %96 8@2= @7 E96 C6A@CE :D E@ 6?4@FC286 >@C6 2H2C6?6DD @7 A@E6?E:2= FD6D @7 px E62496C 2DD:DE2?ED E92E >:89E 92G6 8C62E6C C:D<D :? E96 4=2DDC@@>]k^Am
kAm“(6 C62==J ;FDE H2?E A6@A=6 E@ 8@ :? 6J6D H:56 @A6? 2?5 D2J[ ‘w6J[ E96D6 2C6 D@>6 @7 E96 E9:?8D E92E E96J’C6 36DE 2E 2?5 E96D6 2C6 D@>6 @7 E96 E9:?8D J@F AC@323=J H2?E E@ 36 2 =:EE=6 3:E >@C6 42C67F= H:E9[’” 96 D2:5]k^Am
kAmr@>>@? $6?D6 |65:2 :56?E:7:65 px E@@=D E92E 42? 86?6C2E6 xt!D 2?5 3692G:@C :?E6CG6?E:@? A=2?D 2D 9:89 C:D< 5F6 E@ E96:C 3:2D65 EC62E>6?E @7 DEF56?ED :? E96 4=2DDC@@>] &D:?8 |28:4$49@@=’D q692G:@C x?E6CG6?E:@? $F886DE:@?D E@@= 2?5 E96 v@@8=6 v6>:?: “v6?6C2E6 3692G:@C :?E6CG6?E:@? DEC2E68:6D E@@=[” r@>>@? $6?D6 |65:2’D C6D62C49 E62> C2? E96 D2>6 AC@>AE 23@FE 2 DEF56?E H9@ DECF88=65 H:E9 C625:?8 2?5 D9@H65 288C6DD:G6 3692G:@C d_ E:>6D FD:?8 H9:E6\4@565 ?2>6D 2?5 d_ E:>6D FD:?8 q=24<\4@565 ?2>6D[ 6G6?=J DA=:E 36EH66? >2=6\ 2?5 76>2=6\4@565 ?2>6D]k^Am
kAm%96 px\86?6C2E65 A=2?D 7@C E96 DEF56?ED H:E9 q=24<\4@565 ?2>6D 5:5?’E 2== 2AA62C ?682E:G6 :? :D@=2E:@?] qFE 4=62C 5:776C6?46D 6>6C865 H96? E9@D6 A=2?D 7C@> |28:4$49@@= 2?5 v6>:?: H6C6 4@>A2C65 H:E9 A=2?D 7@C DEF56?ED H:E9 H9:E6\4@565 ?2>6D]k^Am
kAmu@C 6I2>A=6[ H96? AC@>AE65 E@ AC@G:56 2 3692G:@C :?E6CG6?E:@? A=2? 7@C p??:6[ v6>:?: 6>A92D:K65 255C6DD:?8 288C6DD:G6 3692G:@C H:E9 “4@?D:DE6?E ?@?\6D42=2E:?8 C6DA@?D6D” 2?5 “4@?D:DE6?E A@D:E:G6 C6:?7@C46>6?E]” {2<66D92[ @? E96 @E96C 92?5[ D9@F=5 C646:G6 “:>>65:2E6” C6DA@?D6D E@ 96C 288C6DD:G6 3692G:@CD 2?5 A@D:E:G6 C6:?7@C46>6?E 7@C “56D:C65 3692G:@CD[” E96 E@@= D2:5] u@C z2C66>[ v6>:?: D:>A=J D2:5[ “r=62C=J 567:?6 6IA64E2E:@?D 2?5 E6249 C6A=246>6?E 3692G:@CD[” H:E9 ?@ >6?E:@? @7 A@D:E:G6 C6:?7@C46>6?E @C C6DA@?D6D E@ 288C6DD:G6 3692G:@C]k^Am
kAm%@C?6J ?@E65 E92E E96 AC@3=6>D :? E96D6 px\86?6C2E65 C6A@CED @?=J 3642>6 2AA2C6?E 24C@DD 2 =2C86 D2>A=6[ H9:49 42? >2<6 :E 92C5 7@C E62496CD E@ :56?E:7J] %96 C6A@CE H2C?D E92E ?@G:46 E62496CD >2J 36 >@C6 =:<6=J E@ C6=J @? px\86?6C2E65 4@?E6?E H:E9@FE E96 6IA6C:6?46 E@ 42E49 :?244FC24:6D @C 3:2D6D] %@C?6J D2:5 E96D6 F?56C=J:?8 3:2D6D :? :?E6CG6?E:@? A=2?D “4@F=5 92G6 C62==J =2C86 :>A24ED @? DEF56?E AC@8C6DD:@? @C DEF56?E @FE4@>6D 2D E96J >@G6 24C@DD E96:C 65F42E:@?2= EC2;64E@CJ]”k^Am
kAmk2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^D49@@=\5:D4:A=:?6\E2<62H2JD\76C8FD@?\3=24<\=:G6D\>2EE6C\672353c_b5c6bc6h4e_f7_bh4gaf5fa2Qmq=24< DEF56?ED 2C6 2=C625J DF3;64E E@ 9:896C C2E6Dk^2m @7 DFDA6?D:@? E92? E96:C H9:E6 4@F?E6CA2CED :? D49@@=D 2?5 >@C6 =:<6=J E@ C646:G6 92CD96C 5:D4:A=:?2CJ 4@?D6BF6?46D 7@C DF3;64E:G6 C62D@?D[ =:<6 “5:DCFAE:G6 3692G:@C]” |249:?6 =62C?:?8 2=8@C:E9>D C6A=:42E6 E96 564:D:@?\>2<:?8 A2EE6C?D @7 E96 EC2:?:?8 52E2 E92E E96J 2C6 AC@G:565[ H9:49 42? A6CA6EF2E6 6I:DE:?8 :?6BF2=:E:6D] p D6A2C2E6 DEF5J 7@F?5 E92E px E@@=D C6A=:42E6 k2 9C67lQ9EEADi^^HHH]E96fc>:==:@?]@C8^2CE:4=6^2:\D9@HD\C24:2=\3:2D\H96?\8C25:?8\6DD2JD\2?5\42?E\E6==\8@@5\HC:E:?8\7C@>\325^Qm6I:DE:?8 C24:2= 3:2D H96? 8C25:?8 6DD2JDk^2m[ 2DD:8?:?8 =@H6C D4@C6D E@ q=24< DEF56?ED E92? E@ pD:2? DEF56?ED]k^Am
kAm%96 r@>>@? $6?D6 |65:2 C6A@CE 2=D@ :56?E:7:65 :?DE2?46D H96? px E62496C 2DD:DE2?ED 86?6C2E65 =6DD@? A=2?D E92E C6=:65 @? DE6C6@EJA6D[ C6A62E65 >:D:?7@C>2E:@?[ 2?5 D2?:E:K65 4@?EC@G6CD:2= 2DA64ED @7 9:DE@CJ]k^Am
kAmp v@@8=6 DA@<6DA6CD@? D2:5 E96 4@>A2?J 92D :?G6DE65 :? FD:?8 5:G6CD6 2?5 C6AC6D6?E2E:G6 EC2:?:?8 52E2 E@ >:?:>:K6 3:2D 2?5 @G6C86?6C2=:K2E:@?D]k^Am
kAm“(6 FD6 C:8@C@FD E6DE:?8 2?5 >@?:E@C:?8 E@ :56?E:7J 2?5 DE@A A@E6?E:2= 3:2D :? @FC px >@56=D[” E96 v@@8=6 DA@<6DA6CD@? D2:5 :? 2? 6>2:= E@ r92=<362E] “(6’G6 >256 8@@5 AC@8C6DD[ 3FE H6’C6 2=H2JD 2:>:?8 E@ >2<6 :>AC@G6>6?ED H:E9 @FC EC2:?:?8 E649?:BF6D 2?5 52E2]”k^Am
kAm~? :ED H63D:E6[ k2 9C67lQ9EEADi^^HHH]>28:4D49@@=]2:^42D6\DEF5:6D^:??@G2\24256>JQm|28:4$49@@= AC@>@E6Dk^2m :ED px E6249:?8 2DD:DE2?E 2D “2? F?3:2D65 E@@= E@ 2:5 :? 564:D:@?\>2<:?8 7@C C6DE@C2E:G6 AC24E:46D]” x? 2? 6>2:= E@ r92=<362E[ |28:4$49@@= D2:5 :E 92D ?@E 366? 23=6 E@ C6AC@5F46 E96 :DDF6D E92E r@>>@? $6?D6 |65:2 :56?E:7:65]k^Am
kAm|28:4$49@@= D2:5 :ED A=2E7@C> :?4=F56D 3:2D H2C?:?8D 2?5 :?DECF4ED FD6CD ?@E E@ :?4=F56 DEF56?E ?2>6D @C @E96C :56?E:7J:?8 :?7@C>2E:@? H96? FD:?8 px 762EFC6D] x? =:89E @7 E96 DEF5J[ :E :D H@C<:?8 H:E9 r@>>@? $6?D6 E@ :>AC@G6 :ED 3:2D 56E64E:@? DJDE6>D 2?5 56D:8? E@@=D :? H2JD E92E 6?4@FC286 65F42E@CD E@ C6G:6H px\86?6C2E65 4@?E6?E >@C6 4=@D6=J]k^Am
kAm“pD ?@E65 :? E96 DEF5J[ px E@@=D =:<6 @FCD 9@=5 EC6>6?5@FD AC@>:D6 — 3FE 2=D@ 42CCJ C62= C:D<D :7 ?@E 56D:8?65[ 56A=@J65[ 2?5 FD65 C6DA@?D:3=J[” |28:4$49@@= E@=5 r92=<362E] “(6 2C6 8C2E67F= E@ r@>>@? $6?D6 |65:2 7@C 96=A:?8 9@=5 E96 7:6=5 244@F?E23=6]”k^Am
kAmk2 9C67lQ9EEADi^^HHH]492=<362E]@C8^a_ad^_g^_e^2:\E62496C\2DD:DE2?ED\AC@>@E6\C24:2=\3:2D\DEF5J\7:?5D^Qmk6>m%9:D DE@CJk^6>mk^2m k6>mH2D AC@5F465 3Jk^6>m k2 9C67lQ9EEADi^^HHH]492=<362E]@C8^Qmk6>mr92=<362Ek^6>mk^2m k6>m2?5 C6G:6H65 2?5 5:DEC:3FE65 3Jk^6>m k2 9C67lQ9EEADi^^9F3D]=2^"_b<=8$#_Q C6=lQ?@7@==@HQmk6>m$E24<6Ck^6>mk^2m]k^Am
(0) comments
Welcome to the discussion.
Log In
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.