White Circle 开源 RISE 图像模型红队测试算法

AI 导读

White Circle 开源 RISE，一款自动测试 AI 图像生成器能否被绕过自身规则限制的工具，通过搜索攻击策略来评估图像模型。其开放的攻击模型将每种策略转化为大量提示词，并按提示词突破数量为策略计分，从而在几乎拦截一切的模型上仍能持续学习。代码开源、所用模型公开，防御方现可在自己的图像模型上运行。

正文

Good safety work increasingly means good search.

White Circle’s released RISE, an automated tool for testing whether AI image generators can be tricked into making pictures their own rules forbid.
It searches over attack strategies for image models. An open attacker model turns each strategy into many prompts, and the strategy gets credit for how many of them get through.

That keeps the search learning even against models that block almost everything.

The code is open, the models it uses are public, and defenders can run it on their own image models today.

来源：Rohan Paul · x.com