Le Lézard
Classified in: Health, Science and technology
Subject: SVY

Vero AI Evaluates 10 Leading Generative AI Models Using Its Comprehensive VIOLET Framework to Gauge Responsible AI


Report shows notable Gen AI tools scored high in effectiveness at an average of 81%, while there is noticeable room for improvement in optimization, rated at only 69%

CHAPEL HILL, N.C., April 16, 2024 /PRNewswire/ -- Vero AI, a first-of-its-kind analytical engine and scoreboard that helps enterprises fully harness the potential of advanced technology including artificial intelligence while minimizing risk, announced the findings of its inaugural "Generating Responsibility: Assessing AI Using AI" report. Vero AI's report provides a comprehensive assessment with measurable scores of 10 prominent generative AI models, to help enterprises understand how these tools align with responsible AI standards as determined by Vero AI's VIOLET Impact Modeltm. The model was created by I/O psychologists and AI technology veterans.

"As generative AI continues to rapidly evolve, organizations are increasingly challenged to grasp its benefits and potential risks," said Eric Sydell, PhD., CEO and co-founder. "Although there have been some attempts to quantify and assess components of popular generative AI models for fairness and compliance, the criteria in these studies have been too narrow in scope to provide valuable recommendations. To fully harness AI in a responsible manner, especially with the emergence of new AI regulations, a broad approach accompanied by a scientific method of measuring AI systems at scale is needed."

Using its AI-powered analytical engine Iristm, combined with human experts, Vero AI evaluated publicly available documentation of some of the more popular LLMs and generative models, including Google's Gemini, Open AI's GPT-4, Meta's LLAMA2, and more. Iris allows for automatic processing of vast amounts of unstructured information. The models were then assigned scores based on key components of the VIOLET Impact Model, including Visibility, Integrity, Optimization, Legislative Preparedness, Effectiveness, and Transparency. Vero AI's VIOLET Impact Model is a holistic, human-centered framework of elements and methodologies that provide a comprehensive and objective view of the impact of algorithms and advanced AI architectures.

The generative AI models analyzed showed varying strengths and weaknesses according to the criteria evaluated

Generative AI models are aiming for a responsible approach to AI, but the task at hand is large

There is a clear path forward to achieving responsible AI, prioritizing evaluation and transparency
There are many AI frameworks across the globe, even the top generative AI models did not score perfectly on the VIOLET Impact Model and demonstrated room for growth. Responsible AI results in the equitable and beneficial use and downstream effects of AI for all of humanity. As companies contemplate integrating AI into their operations, Vero AI makes the following recommendations:

Derived from a global approach to AI ethics and regulation, incorporating best practice frameworks and legislation from across a variety of countries and cultures along with scientific practices, VIOLET ensures that both business effectiveness and human interests are served.

There is a full list of scores for each of the 10 generative AI models in the report. Vero AI is also offering a full version of its comprehensive report, including more details on its methodology and measurement scale for a price of $495 US dollars. Both versions of the report can be found at https://www.vero-ai.com/resources/gen-ai-report.

About Vero AI
Vero AI's platform is a first-of-its-kind analytical engine and scoreboard built to help enterprises fully harness the potential of AI algorithms and tools while minimizing risk. Through its scientifically derived, AI-assisted platform and objective framework, The VIOLET Impact Model, Vero AI ingests information of all types and creates meaningful, interpretable, reliable scores that allow users to know immediately whether their existing AI tools, algorithms, or any complex system is functioning across a range of curated, holistic criteria. Vero AI sets a new standard for AI optimization and risk mitigation at scale, empowering enterprises to thrive in an era defined by technological innovation and disruption. To learn more visit https://www.vero-ai.com/.

SOURCE Vero AI


These press releases may also interest you

at 12:37
The Hans Foundation USA (THF USA), a charitable organization dedicated to uplifting underprivileged communities globally, announced it awarded nearly $9 million in grants to 45 organizations throughout 2023. This impactful giving is on track to...

at 12:36
Hundreds gathered at Lincoln Center on May 23, 2024, for the American Foundation for Suicide Prevention's (AFSP) 35th annual Lifesaver's Gala. A leading force in suicide prevention, AFSP recognized and reflected on the progress made by many in the...

at 12:30
Today, the Canadian Task Force on Preventive Health (Task Force) issued updated draft recommendations for breast cancer screening that conclude the harms and benefits should be carefully weighed before deciding on screening....

at 12:28
Today, TELUS announced the launch of its newest Mobility for Good program, supporting families across the country that are receiving the maximum Canada Child Benefit. As significant increases in costs of living are noted by 9 in 10 Canadians who have...

at 12:19
SOPHiA GENETICS , a cloud-native healthcare technology company and a global leader in data-driven medicine, today announced SOPHiA UNITY, a new data-driven consortium designed to accelerate cancer research globally. SOPHiA UNITY aims to bring...

at 12:15
"I'm a registered nurse and I suffer from plantar fasciitis. I needed a convenient therapy product to increase circulation while relieving pressure points," said an inventor, from Parlin, N.J., "so I invented the SMART PEDAL MAT. My design provides...



News published on and distributed by: