SDSignal Desk

OpenAI’s $2 million for children’s AI safety research matters for one promise: publishing bad news

· Updated · Signal Desk newsroom

Analysis of reporting by OpenAI. How we work

Image: OpenAI

At the Paris Peace Forum, OpenAI signed a children’s AI safety charter and pledged $2 million to shared measurement tools. The sum is modest. The commitment that researchers control their conclusions, and negative results get published, is what to hold it to.

Key takeaways

  • OpenAI signed the Charter of Engagement for Safer AI for Children and committed $2 million to the research network of the Coalition for Children’s Rights and Protection in the Age of AI.
  • The money funds shared measurement tools for studying AI’s risks and opportunities for children.
  • Research teams keep control of their conclusions, and findings, including negative or inconclusive ones, will be published.
  • OpenAI backs youth safety legislation with age-appropriate defaults, parental tools and risk assessments, and plans to engage on the EU Kids Act.

What OpenAI committed

At the Paris Peace Forum, OpenAI signed the Charter of Engagement for Safer AI for Children and committed $2 million to the research network under the Coalition for Children’s Rights and Protection in the Age of AI. The money goes toward shared measurement: tools researchers can use to study AI’s risks and opportunities for children. The charter sets principles for age-appropriate AI plus a research program with independence safeguards. Research teams keep control of their conclusions, and findings will be published, including negative or inconclusive results.

OpenAI says this builds on its earlier call for global youth AI safety standards. It backs legislation with age-appropriate defaults, parental tools, regular risk assessments and accountability, and plans to engage European policymakers as the EU Kids Act develops. Earlier, it offered up to $5 million in grants for independent research on AI and teens aged 13 to 17 (our coverage).

Why measurement is the right focus

Most public argument about kids and chatbots runs on anecdotes, lawsuits and worst-case headlines on one side, and glossy product promises on the other. What’s missing are shared, credible ways to measure what these systems do to young people over time. Funding that plumbing is less glamorous than a new safety feature and more durable. It complements OpenAI’s new violence and teen safeguards, which raise their own questions about age prediction and appeals (our analysis), and Common Sense Media’s finding that ChatGPT’s teen mode falls short (coverage).

The promise to hold OpenAI to

A commitment to publish negative results is easy to write and hard to honor when the results concern your own product. If this network eventually produces findings that hurt and they’re published intact, the pledge will have meant something. The same independence question hangs over OpenAI’s approach to third-party safety assessments, where it wants scoped claims and room to remediate before publication (our analysis).

Keep the scale in perspective

Two million dollars is small next to what frontier labs spend on compute or marketing. This is a contribution to a coalition, not a solution. OpenAI is also advocating for youth safety legislation that preserves access to its tools, a reasonable position that also serves its business. Both can be true.

The upside is real: AI tutoring, creative tools and help for kids who lack other support. So is the harm: dependency, inappropriate content, manipulation and developmental effects no one yet understands. If AI becomes a default companion for a generation before the evidence exists, the damage will be studied after the fact. Building the evidence now is the better order. More in our research coverage and OpenAI coverage.

Who feels it

Researchers
New funding and shared tools, with stated protections for independent conclusions.
Parents and educators
Better evidence could eventually replace today’s patchwork of anecdotes and product claims.
Policymakers
OpenAI positions itself as a constructive partner as the EU Kids Act takes shape.
Other AI companies
Pressure to sign on and fund comparable independent research.

What to watch

  1. Which other AI companies sign the charter or fund the network.
  2. The first published findings, especially negative ones about major products.
  3. How the EU Kids Act balances access and safeguards for minors.
  4. Whether the measurement tools become shared standards.

FAQ

What did OpenAI commit at the Paris Peace Forum?

It signed the Charter of Engagement for Safer AI for Children and pledged $2 million to a research network building shared tools to measure AI’s effects on children.

Will negative findings about AI and kids be published?

The charter says research teams keep control of their conclusions and that findings, including negative or inconclusive ones, will be published.

What is the EU Kids Act?

Developing European legislation on protecting minors online; OpenAI says it plans to engage policymakers as it takes shape.

Read the original

Continue at the source.

OpenAI

Companies: OpenAI

More on OpenAI

All OpenAI coverage →