Close Menu
Sedona.Biz – The Voice of Sedona and The Verde ValleySedona.Biz – The Voice of Sedona and The Verde Valley
    Sedona.Biz – The Voice of Sedona and The Verde ValleySedona.Biz – The Voice of Sedona and The Verde Valley
    • Home
    • Sedona
      • Mind and Body
      • Real Estate
      • Sedona News
    • About
    • Advertise
    • Gift Guide
    • Sedona’s Best
    Sedona.Biz – The Voice of Sedona and The Verde ValleySedona.Biz – The Voice of Sedona and The Verde Valley
    Home » AI Safety: Why LLMs Benchmarks or Evaluations May Not Decide Alignment, AGI
    Sedona News

    AI Safety: Why LLMs Benchmarks or Evaluations May Not Decide Alignment, AGI

    July 3, 2024No Comments
    Facebook Twitter Pinterest LinkedIn Email Reddit WhatsApp
    AI Safety: Why LLMs Benchmarks or Evaluations May Not Decide Alignment, AGI
    Share
    Facebook Twitter LinkedIn Pinterest Email Reddit WhatsApp

    By David Stephen

    Advances for AI safety are not currently a problem of evaluations or benchmarks for models, since new benchmarks alone are unlikely to solve the current problems of misinformation and deepfakes—images, audios and videos. There are several present risks with AI that new evaluation methods may do little or nothing to solve.

    How is it possible to trace the AI source of some misinformation or voice cloning for deception? How can a post-guardrail AI model that produces a problematic output be penalized for its actions?

    Already there are several benchmark and evaluation rankings for LLMs. While they measure certain criteria, they do not solve some current problems, nor do they provide a sure way to determine what is or when artificial general intelligence [AGI] or artificial superintelligence [ASI] may arrive.

    There is a recent feature on WIRED, We’re Still Waiting for the Next Big Leap in AI, with the quotes, “Gauging the rate of progress in AI using conventional benchmarks like those touted by Anthropic for Claude can be misleading. AI developers are strongly incentivized to design their creations to score highly in these benchmarks, and the data used for these standardized tests can be swept into their training data. Benchmarks within the research community are riddled with data contamination, inconsistent rubrics and reporting, and unverified annotator expertise.”

    Anthropic just announced, A new initiative for developing third-party model evaluations, stating that, “We’re introducing a new initiative to fund evaluations developed by third-party organizations that can effectively measure advanced capabilities in AI models. We are interested in sourcing three key areas of evaluation development: AI Safety Level assessments; Advanced capability and safety metrics; Infrastructure, tools, and methods for developing evaluations

    How would this counter general misinformation? How would they prevent deepfake videos, audios and images, outside scrutinized areas like politics and elections? There are several AI tools in search results that make several misuses possible. How can there be a collective safety approach against some of their outputs?

    How can AGI or ASI be determined or measured with comparison to how human intelligence works? If human intelligence is based in the human mind, how does the human mind mechanize intelligence? AI already has access to lots of memory. It can make inferences about the world through language without self-experience. If it were the human mind, with access to resources on things, without experience, how does AI currently compare

    There are several detection tools for AI outputs, with varying levels of accuracy, but knowing that something came by AI, may not matter if the thing is already used to cause harm. How can outputs around certain keywords be tracked, across AI outputs indexed on search engines, using web crawling and scraping?

    If an AI model is misused, how can it begin to lose access to some of its parameters, as a consequence for its actions? There are directions that some AI safety and alignment research are going that may not be helpful for current risks—or existential risks. There are also benchmarks that are sought for AGI, without exploring the human mind.

    The threats and risks of AI exceed the safety of individual frontier models. The capabilities of AI exceed its limitation to language. Approaching answers from extended angles would make a better case for the common purpose.

     

     

    Stay with Sedona.biz

    The week's Sedona and Verde Valley news in your inbox every Monday. Free.

    Free. One email a week. Unsubscribe any time.

    • Follow Sedona.biz on Google News so our stories show up in your feed.
    • Check live road conditions for SR 89A, SR 179 and Oak Creek Canyon.
    • See what's on this week in Sedona and the Verde Valley.

    Comments are closed.

    Related Coverage

    Verde Valley Sanctuary to host charity golf event at Sedona's exclusive Seven Canyons Golf Club in 2027

    Verde Valley Sanctuary to host charity golf event at Sedona’s exclusive Seven Canyons Golf Club in 2027

    November 20, 2026
    Bringing Jazz Back to Sedona: A New Chapter Begins with the Flavor of New Orleans

    Bringing Jazz Back to Sedona: A New Chapter Begins with the Flavor of New Orleans

    November 15, 2026
    Sedona Celebrates Polish Christmas Traditions with Holiday Brunch and Carol Concert

    Sedona Celebrates Polish Christmas Traditions with Holiday Brunch and Carol Concert

    November 14, 2026
    Sedona Verde Valley UPLIFT! -Flood Recovery Fundraiser Festival

    Sedona Verde Valley UPLIFT! -Flood Recovery Fundraiser Festival

    November 14, 2026
    Sedona Airport Advances Three Capital Projects Representing More Than $5 Million in Safety Improvements

    Sedona Airport Advances Three Capital Projects Representing More Than $5 Million in Safety Improvements

    November 13, 2026
    Jeffrey Lazos Ferns, Chef and Artist Featured at KSB Speaker Series on Wednesday, November 18, 2026

    Jeffrey Lazos Ferns, Chef and Artist Featured at KSB Speaker Series on Wednesday, November 18, 2026

    November 12, 2026
    Sedona Realtor
    In The Living Room Music Series

    In The Living Room Music Series at the Mary D. Fisher Theatre (advertisement)

    Every other Monday, the Mary D. Fisher Theatre transforms into your living room for a FUN, intimate, interactive night of music and conversation! Enjoy LIVE music and ask the artist your questions during the concert. Epic music. Real conversations. Unforgettable Mondays. Click the photo to claim your seat!

    In The Living Room Music Series: tickets and dates

     

    Sedona’s Backstage Pass

     

    Sedona's Backstage Pass podcast logo

    Tune in weekly for Shondra’s behind-the-scenes conversations with the Creators, Curators, and Visionaries who are the heartbeat of Sedona’s Creativity. Spotify Click HERE. Apple Podcast Click HERE.

    Sedona's Backstage Pass podcast sponsor banner

     

     

    Recent Comments
    • Jill Dougherty on The Midterm Massacre: What Happened?
    • JB on The Midterm Massacre: What Happened?
    • JB on The Midterm Massacre: What Happened?
    • JB on The Midterm Massacre: What Happened?
    • JB on One Click Away from Chaos
    • Jill Dougherty on VVREO Publishes Consolidated Flood Emergency Resource
    • JB on One Click Away from Chaos
    • Steve Segner on Who Got Paid When the Neighborhood Changed?
    • STR Suck! on Who Got Paid When the Neighborhood Changed?
    • Doc jones on Bringing Jazz Back to Sedona: A New Chapter Begins with the Flavor of New Orleans
    Don’t miss a beat – signup for our weekly newsletter

    Free. One email a week. Unsubscribe any time.

    Cactus Quill
    The Cactus Quill
    Categories
    Your ad could be here
    Advertise on Sedona.biz: your ad could be here
    The Voice of Sedona and The Verde Valley

    News

    • Sedona News
    • Verde Valley News
    • Editorials/Opinion
    • Letter to The Editor
    • Road Conditions and Weather
    • Events This Week

    Community

    • Arts and Culture
    • Mind and Body
    • Spiritual
    • Community Events
    • Sedona Restaurants

    More

    • Weekly Newsletter
    • Sedona Real Estate
    • Gift Guide
    • Advertise
    • About
    • Contact
    • Editorial Policy

    Connect

    f X ▶
    Get the best of Sedona delivered to your inbox.

    Free. One email a week. Unsubscribe any time.

    Our Network: TheSedonan.com • SedonaBest.com
    © 2026 Sedona.Biz · Privacy Policy · Editorial Policy · Contact

    Type above and press Enter to search. Press Esc to cancel.