🚀 Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. 🔥

Startup Showcase

Premium Content

Try our Valuation Calculator →

News on Medial

TikTok, Snapchat and others sign pledge to tackle AI-generated child sex abuse images

Economic Times

Economic Times · 1y ago

TikTok, Snapchat and others sign pledge to tackle AI-generated child sex abuse images

Tech companies like TikTok and Snapchat have signed a joint statement to combat child sex abuse images generated by AI. The statement, backed by governments including the US, Germany, and Australia, aims to ensure responsible AI is used to tackle the threat and prevent it from becoming insurmountable. The decision comes in the wake of data from the Internet Watch Foundation, which revealed the sharing of almost 3,000 images of AI-generated child sexual abuse material on a dark web forum.

Related News

The AI-Generated Child Abuse Nightmare Is Here

Wired · 1y ago

The AI-Generated Child Abuse Nightmare Is Here

An alarming rise in the use of generative AI models to create ultrarealistic and illegal child sexual abuse images is being reported. Offenders are customizing AI models using datasets of abuse images and selling subscriptions to AI-generated child sexual abuse material. The Internet Watch Foundation found nearly 3,000 AI-generated images of child abuse on a dark web forum. The images include the rape of babies and toddlers, famous preteen children being abused, and BDSM content featuring teenagers. Research suggests that AI technology could facilitate the creation of new and undetectable abusive images, posing a significant challenge for law enforcement.

Social media giants 'big, bad monsters': US Families suing Big Tech

Economic Times

Economic Times · 1y ago

Social media giants 'big, bad monsters': US Families suing Big Tech

Hundreds of American families are suing social media giants including TikTok, Snapchat, YouTube, and Meta (parent company of Instagram and Facebook) over claims of addiction and harm caused to teenagers. The plaintiffs argue that the tech companies have created a "youth mental health crisis" and spread child sex abuse material. The case highlights the potential harms faced by teenagers, citing the example of Molly Russell, a British schoolgirl who died after viewing online content related to suicide and depression. A federal court recently rejected the motion to dismiss the lawsuits filed against these social media companies.

Wisconsin Assembly passes bills regulating AI use in elections, outlawing AI-produced child porn

Economic Times

Economic Times · 1y ago

Wisconsin Assembly passes bills regulating AI use in elections, outlawing AI-produced child porn

Wisconsin lawmakers have passed bills to regulate artificial intelligence (AI) use in elections and to outlaw AI-produced child pornography. The bipartisan measure requires political candidates and groups to include disclaimers in AI-generated ads, while manufacturing and possessing AI-created child sexual abuse images will become a felony punishable by up to 25 years in prison. The state also approved a bill for auditors to review how state agencies use AI. These efforts aim to provide transparency, combat disinformation, and find efficiencies rather than replacing human workers with AI. Several states have already taken steps to regulate AI in recent years.

Senator tells Mark Zuckerberg his product is 'killing people' at child safety hearing

Business Insider

Business Insider · 1y ago

Senator tells Mark Zuckerberg his product is 'killing people' at child safety hearing

During a heated Senate hearing on online child safety, Meta CEO Mark Zuckerberg was told by Senator Lindsey Graham that their product is "killing people." Graham accused Zuckerberg and other tech companies of having "blood on their hands" and highlighted the case of a man whose son died by suicide after being targeted in a "sex extortion ring" on Instagram. The hearing also addressed the issue of online abuse and child exploitation on Meta's platforms, with the New Mexico Attorney General filing a lawsuit against the company for facilitating child pornography and soliciting minors for sex.

UK to become first country to criminalise AI child abuse tools

Economic Times

Economic Times · 6m ago

UK to become first country to criminalise AI child abuse tools

The UK will become the first nation to criminalize AI tools used to create child sexual abuse images, introducing laws that make it illegal to possess, create, or distribute such tools, with penalties up to five years in prison. The legislation also targets AI manuals teaching abuse methods, punishable by three years in prison. These measures aim to protect children from predators using evolving technologies, as new AI sexual abuse offenses are established under the Crime and Policing Bill.

Google vows more transparency on ads as new EU rules kick in

Economic Times

Economic Times · 1y ago

Google vows more transparency on ads as new EU rules kick in

The DSA will go into effect on Friday and requires companies to do more to tackle child sexual abuse material and disinformation, be more transparent on their algorithmic processes, bots and targeted advertisements and to remove illegal, unsafe or counterfeit products sold on their platforms.

Why Telegram chief's arrest raises 'red flags' for tech bosses

Economic Times

Economic Times · 11m ago

Why Telegram chief's arrest raises 'red flags' for tech bosses

France has charged Pavel Durov, the founder of Telegram, with complicity in running a platform that enabled illegal activity, including illicit transactions and child sex abuse images. Experts believe that the case against Durov could set a precedent for holding tech platform owners accountable for user actions. However, it is unlikely that other tech bosses like Elon Musk or Mark Zuckerberg would face similar charges in Europe. Key differences, such as Durov's French citizenship and Telegram's refusal to comply with government takedown orders, distinguish the case. However, concerns persist about the implications for other encrypted services in the future.

What is the UK 'grooming gangs' scandal seized on by Elon Musk?

Economic Times

Economic Times · 7m ago

What is the UK 'grooming gangs' scandal seized on by Elon Musk?

Elon Musk has recently criticized UK Labour Party leader Keir Starmer, accusing him of enabling "grooming gangs," despite inaccuracies in Musk's claims. The grooming gangs scandal refers to child sex abuse cases by predominantly British Pakistani men, primarily in Rotherham. Investigations revealed failures by authorities. Starmer, as former chief prosecutor, had overseen prosecutions, earning praise for his handling. Despite multiple inquiries, organized child exploitation remains a concern in the UK. Musk's comments have reignited debate.

US receives thousands of reports of AI-generated child abuse content in growing risk

Reuters · 1y ago

US receives thousands of reports of AI-generated child abuse content in growing risk

The U.S. National Center for Missing and Exploited Children (NCMEC) received 4,700 reports in 2023 about child sexual exploitation content generated by AI technology. This reflects a growing concern as generative AI, which can create text and images, poses a risk for online exploitation of children. The NCMEC serves as a clearinghouse to report such content and is working with AI companies to address the issue. Child safety experts have raised alarm about the potential for abusers to use generative AI to create new images matching a child's likeness.

TikTok to label AI-generated content from OpenAI and elsewhere

Economic Times

Economic Times · 1y ago

TikTok to label AI-generated content from OpenAI and elsewhere

TikTok announced plans to label images and videos on its platform that are generated using artificial intelligence (AI) with a digital watermark called Content Credentials. This move comes in response to concerns about AI-generated content being used to interfere in US elections. TikTok already labels AI-generated content created within its app, but the new feature will also apply to content generated outside the platform. The Content Credentials technology, led by the Coalition for Content Provenance and Authenticity, has been adopted by companies like OpenAI, YouTube, and Meta Platforms.

Trackers

Active Indian VC’s

OG Capital Email

With a hands-on approach, OG Capital aims to invest in over 20 promising...

Accel Partners Email

Early and growth-stage investments in disruptive technology companies with...

Early-stage venture capital firm investing in technology startups in India. Focus on...

Access All Trackers

Startup Showcase Winners

June 2025

Helping your parents when you are miles away

The Pit Stop Your Cravings Deserve

The next generation E-commerce platform

Enter Ongoing Startup Showcase

Top Users

Trending News on Medial

30 Startups To Watch: Startups Th ...

GitHub's CEO Drops a Bombshell: " ...

Validation, loneliness, insecurit ...

Download the medial app to read full posts, comements and news.