Campbell Brown, a prominent figure in the media landscape and former news chief at Meta, is on a mission to enhance the accuracy of information consumed through artificial intelligence. With her new venture, Forum AI, she aims to address the challenges posed by AI in delivering reliable information.
In a recent discussion with TechCrunch's Tim Fernholz, Brown explained that Forum AI evaluates the performance of foundational AI models on what she refers to as "high-stakes topics." These include complex areas such as geopolitics, mental health, finance, and hiring, where straightforward answers are often elusive.
To achieve this, Brown has assembled a team of distinguished experts, including Niall Ferguson, Fareed Zakaria, and former Secretary of State Tony Blinken, who help establish benchmarks for AI evaluation. The objective is for AI systems to reach approximately 90% consensus with these human experts, a milestone that Forum AI has reportedly achieved.
Brown's journey with Forum AI began 17 months ago in New York, sparked by her experience during the launch of ChatGPT. She recognized the potential of AI as a primary conduit for information, yet was alarmed by its shortcomings. "My kids are going to be really dumb if we don't figure out how to fix this," she recalled, highlighting the urgency of the situation.
Her frustrations stem from the prevalent lack of emphasis on accuracy within the AI industry, which often prioritizes coding and mathematical precision over the complexities of news and information. Brown noted that initial evaluations of leading AI models revealed concerning biases and inaccuracies, including instances where AI drew information from unreliable sources.
Despite these challenges, Brown remains hopeful that AI can transcend its current limitations. She believes that the demand from enterprises for accurate AI-driven decisions in areas like lending and hiring could lead to a shift towards prioritizing truthfulness in AI outputs. "Right now it could go either way," she stated, emphasizing the potential for AI to either cater to user desires or uphold integrity and honesty.
Forum AI is banking on this enterprise demand, although Brown acknowledges the hurdles of transforming compliance interests into sustainable revenue. She criticized the existing compliance landscape as inadequate, emphasizing the need for genuine evaluation that considers not just obvious scenarios but also edge cases that could lead to significant issues.
In the past, Brown witnessed the consequences of platforms optimizing for engagement over accuracy, which often resulted in misinformation. Her insights suggest that the AI industry must learn from these experiences to foster a more informed society.
As Forum AI progresses, Brown's vision underscores a crucial turning point in the evolution of AI. If successful, this initiative could redefine how information is disseminated, paving the way for a future where technology and truth coexist harmoniously.