🚀 Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. 🔥

Startup Showcase

Premium Content

Try our Valuation Calculator →

News on Medial

OpenAI forms a new team to study child safety

Startup News FYI

Startup News FYI · 1y ago

OpenAI forms a new team to study child safety

OpenAI has established a Child Safety team to address concerns regarding the potential misuse or abuse of its AI tools by children. The team will collaborate with internal and external partners to manage incidents and reviews relating to underage users. OpenAI is currently seeking a child safety enforcement specialist to apply policies related to AI-generated content and sensitive material involving children. This move reflects OpenAI's commitment to comply with regulations pertaining to minors' use of AI and indicates a focus on avoiding negative publicity. The increasing use of AI tools by kids and teens for personal and academic purposes has spurred calls for guidelines on their safe usage.

Related News

Google DeepMind forms a new org focused on AI safety | TechCrunch

TechCrunch · 1y ago

Google DeepMind forms a new org focused on AI safety | TechCrunch

Google's AI R&D division, DeepMind, has formed a new organization called AI Safety and Alignment, which will focus on AI safety and preventing the spread of disinformation. The organization will include a team dedicated to safety regarding artificial general intelligence (AGI), and will work alongside DeepMind's existing research team in London. The new organization will also develop safeguards for Google's Gemini models to ensure child safety, prevent amplification of bias, and reduce the spread of inaccurate medical advice. Anca Dragan, a former Waymo research scientist, will lead the team.

OpenAI assigns new project to AI safety leader Aleksander Madry in revamp

Economic Times

Economic Times · 1y ago

OpenAI assigns new project to AI safety leader Aleksander Madry in revamp

OpenAI's AI safety leader, Aleksander Madry, is reportedly working on a new research project while the startup reshapes its preparedness team. Madry will transition into a bigger role within the research organization, with OpenAI executives Joaquin Quinonero Candela and Lilian Weng taking over the preparedness team temporarily. The team evaluates the readiness of OpenAI's AI models for artificial general intelligence. The company's chatbots, capable of human-like conversations and generating multimedia content, have raised concerns about safety. OpenAI recently established a Safety and Security Committee to address these concerns.

OpenAI dissolves high-profile safety team after chief scientist Ilya Sutskever’s exit

Economic Times

Economic Times · 1y ago

OpenAI has disbanded its superalignment team, tasked with ensuring the safety of future AI systems, following the departure of its leaders, including co-founder Ilya Sutskever. Instead of maintaining the team as a separate entity, OpenAI plans to integrate its members across its research efforts. This decision comes amidst concerns about the balance between speed and safety in developing AI. Several other members of the superalignment team have also left the company recently. OpenAI appointed Jakub Pachocki as the new chief scientist, succeeding Sutskever, and emphasized its commitment to progress in AGI development.

OpenAI’s Sora Turbo launches: From text to video in seconds

Livemint

Livemint · 8m ago

OpenAI’s Sora Turbo launches: From text to video in seconds

OpenAI has unveiled Sora Turbo, an upgraded version of its AI video generation model. Sora Turbo offers faster video creation, improved video quality, and enhanced user interface. It supports resolutions of up to 1080p and allows users to create videos lasting up to 20 seconds in different aspect ratios. Sora Turbo is available to ChatGPT Plus and Pro users, and OpenAI is committed to ensuring ethics, safety, and transparency in its deployment. The release of Sora Turbo aims to promote creativity and explore new forms of visual storytelling.

Roblox introduces new safeguards for teens, including age estimation tech | TechCrunch

TechCrunch · 1m ago

Roblox introduces new safeguards for teens, including age estimation tech | TechCrunch

Roblox has introduced new safety features for users aged 13-18, aiming to improve child safety and parental oversight. The platform now includes "Trusted Connections" for easier communication with known contacts, monitored for critical harm. Users must verify their age using selfie video technology or ID for access. Parents gain tools to monitor their teen's interactions and time spent on Roblox. These updates respond to increased scrutiny over child safety issues on the platform.

Apple broadens App Store's age-rating system | TechCrunch

TechCrunch · 1m ago

Apple broadens App Store's age-rating system | TechCrunch

Apple has updated its App Store age-rating system, adding new categories of 13+, 16+, and 18+ while removing the 12+ and 17+ ranges. Developers will answer new questions to determine app content sensitivity, aiming to enhance child safety and provide parents with better guidance. The system aligns with broader child safety initiatives and will influence app visibility. The updated ratings are part of upcoming software releases in the beta phases, set for public release in September.

OpenAI's former executive Jan Leike joins its rival Anthropic days after quitting over safety concerns

Business Insider

Business Insider · 1y ago

OpenAI's former executive Jan Leike joins its rival Anthropic days after quitting over safety concerns

Jan Leike, formerly of OpenAI, has joined its competitor Anthropic, which is backed by a $4 billion investment from Amazon. Leike, who co-led OpenAI's Superalignment team, criticized his former employer for prioritizing "shiny products" over safety culture. He called for others to join him at Anthropic in continuing the mission of ensuring AI alignment and safety. Several other employees, including OpenAI co-founder Ilya Sutskever, have also left the company recently. OpenAI has established a safety committee and is testing its "next frontier model."

Louisiana sues Roblox game platform over child safety - The Economic Times

Economic Times

Economic Times · 12d ago

Louisiana sues Roblox game platform over child safety - The Economic Times

Louisiana has filed a lawsuit against the online game platform Roblox, accusing it of enabling child exploitation by facilitating the distribution of child sexual abuse material. The lawsuit claims that Roblox prioritizes user growth and profits over child safety. Roblox, hosting nearly 82 million daily users, half of whom are under 18, rejected the allegations, asserting that it continuously works to maintain a safe online environment and has implemented safety upgrades.

k-ID launches a solution that helps game developers comply with ever-changing child safety regulations

TechCrunch · 1y ago

k-ID launches a solution that helps game developers comply with ever-changing child safety regulations

K-ID, a technology company co-founded by attorney Kieran Donovan, aims to simplify compliance with child safety laws for game developers. Donovan's experience in advising tech and gaming companies on global compliance forms the foundation for k-ID's solution. The company offers a framework that helps protect publishers and developers from non-compliance issues, such as regulatory sanctions and reputational risks. By using k-ID's APIs or SDK, game developers can customize the game experience to comply with age restrictions, consent requirements, and other regulations specific to each market. The service also provides access to a database focused on gaming industry compliance and offers a family portal functionality for parents.

OpenAI on the defensive after multiple PR setbacks in one week

Arstechnica

Arstechnica · 1y ago

OpenAI on the defensive after multiple PR setbacks in one week

OpenAI has faced a week of negative attention and criticism following the preview of its flirty AI assistant with a voice similar to Scarlett Johansson's. The company received ridicule from The Daily Show and a mention on Saturday Night Live. As a result, OpenAI announced it would pause the use of the voice. On top of that, two key safety researchers, Ilya Sutskever and Jan Leike, resigned from the company's Superalignment team, accusing OpenAI of prioritizing "shiny products" over safety research. OpenAI's CEO acknowledged the need for improvement in alignment research and safety culture. Critics like Yann LeCun argue that controlling AI systems smarter than humans requires careful engineering and iterative refinements.

Trackers

Active Indian VC’s

OG Capital Email

With a hands-on approach, OG Capital aims to invest in over 20 promising...

Accel Partners Email

Early and growth-stage investments in disruptive technology companies with...

Early-stage venture capital firm investing in technology startups in India. Focus on...

Access All Trackers

Startup Showcase Winners

June 2025

Helping your parents when you are miles away

The Pit Stop Your Cravings Deserve

The next generation E-commerce platform

Enter Ongoing Startup Showcase

Top Users

Trending News on Medial

Just Months After Promotion, Open ...

Exclusive: Robotics startup Miko ...

“Your Phone Is Outdated”: Sam Alt ...

Download the medial app to read full posts, comements and news.