In a shocking incident highlighting the perils of AI misuse, the identity of a homemaker from Dibrugarh, Assam, was exploited to create a fictitious social media sensation named Babydoll Archi. The case came to light after Sanchi's brother reported the unauthorized use of her images, resulting in her ex-boyfriend, Pratim Bora, being arrested. He allegedly used AI tools to morph Sanchi's likeness for an Instagram account that attracted over a million followers and generated substantial income.

Sanchi's life took a harrowing turn when Bora's vengeful actions resulted in the creation of deepfake photos and videos featuring a fabricated persona that gained notoriety online. Local police officer Sizal Agarwal, who is leading the investigation, confirmed the evidence found on Bora's devices included proof of financial gain from the account. He reportedly earned around 300,000 rupees in just days before being apprehended.

Despite the account's removal, the implications of this incident have sparked conversations about the risks faced by women in the digital age, especially as deepfake technology becomes more accessible. Experts like Meghna Bal, AI lawyer, note that while mobile regulations exist, the nuanced challenges posed by generative AI demand more robust measures.

In light of the rising occurrences of such digital identity theft, there is increasing pressure for reforms to better safeguard individuals from corresponding emotional and reputational damage. With laws addressing sexual harassment, defamation, and cybercrime already in place, the ongoing debate calls for careful consideration of new regulations to address the unique challenges presented by AI-created content without infringing on rights to free speech. As Sanchi and her family seek support, this case serves as a poignant reminder of the vulnerabilities inherent in our interconnected, digital lives.