FOLLOW US

Westfield High School in New Jersey is reeling as students learn that one of their peers allegedly harnessed artificial intelligence (AI) technology to generate explicit images without the consent of their fellow female classmates. The use of AI to create these disturbing deepfakes has the student body demanding action.

Francesca Mani, a student at Westfield stumbled upon deepfake images of herself and other students. 

Strange Outcomes: The Potential for AI’s “Superhuman Persuasion” - USA Herald

Virginia Judge rules Teacher Shot by 6-Year-Old Student to Proceed with $40M Lawsuit - USA Herald

Disney Marvel’s Strategy: Embracing Talent Over Woke Writers - USA Herald

Online Deepfakes 

A male classmate had exploited a genuine photograph of her, utilizing an AI app to craft explicit content, as reported by local news outlet WNYW. To make matters worse, the creation of these deepfakes allegedly took place during the summer, but students only became aware of them in October.

Mani, who was one of the victims, expressed her dismay, stating, "I never thought, being like a student, AI didn't even come to my mind. I just thought it would be like creeps on the internet." Fearing for her privacy and those of her fellow classmates, she promptly reported the incident to the school principal.

The school's response did little to ease the concerns of the affected students. While the perpetrator was reportedly suspended for a few days, he eventually returned to school, causing further distress among the female students. Mani voiced the collective sentiment, saying, "All the other girls agree with me, they don't want him in this school. They are very scared."

The School's Reaction

The school principal issued an email addressing the matter, assuring the affected students that an investigation was underway. 

The email stated, "At this time, we believe that any created images have been deleted and are not being circulated. This is a very serious incident. We are continuing to investigate and will inform individuals and families of students involved once the investigation is complete."

To support the affected students, the school has made counseling available, and the Westfield Police Department has been engaged in the investigation.

 In the same email, the principal also warned parents about the importance of discussing technology usage and responsible online behavior with their children. They emphasized that modern technology enables the manipulation of images, emphasizing the need for students to understand the potential harm and consequences of such actions.

Educational Response

CBS reported a statement from Westfield Superintendent Dr. Raymond González, who acknowledged the broader issue of technological challenges within school districts. He emphasized the importance of educating students about the responsible use of technology, coupled with clear guidelines to prevent its misuse.

The incident at Westfield High School underscores the urgent need for schools and educators to prioritize digital literacy and the responsible use of technology. It is critical for students to understand the implications of their actions, both in terms of their own privacy and the potential harm they may cause to others.

Deepfakes Legal Implications

The legal landscape surrounding pornographic 'deepfakes' remains a complex and evolving issue. In May, Rep. Joe Morelle, D-N.Y., introduced legislation aimed at making the non-consensual sharing of altered or 'deepfake' explicit images online illegal, while also providing legal recourse for victims targeted by such images. 

On Congressman Morelle’s website: “The spread of A.I.-generated and altered images can cause irrevocable emotional, financial, and reputational harm—and unfortunately, women are disproportionately impacted.”

SAG-AFTRA President Fran Drescher added, "I applaud Congressman Morelle for introducing the Preventing Deepfakes of Intimate Images Act against sexualized non-consensual digital replicas and ‘deepfakes'. This bill will help curb an incredibly destructive practice that strikes at the heart of personal privacy, safety and autonomy. Sexual abuse, whether occurring physically or digitally, should never be excused or permitted as ‘personal expression’, and it should never be tolerated. 

Meanwhile, the Justice Department has affirmed that AI-generated sexually explicit images of children are illegal under federal law.

The misuse of AI to create explicit 'deepfakes' raises concerns about privacy, consent, and the need for stronger digital literacy education. It also underscores the importance of continued efforts to establish clear guidelines and legal safeguards to prevent such incidents and protect the well-being of students.