The guide is intended for red teaming beginners. You might find value in it if you’re an analyst, journalist, or researcher who occasionally probes digital tools for possible safety flaws. Red teaming requires creativity and practice above all. But a light-weight process can help you do better.
Профиль
Alexios Mantzarlis
Профиль VivelyTech, facts, and carbonara. mantzarlis.com
womp womp there goes a PM’s promo package
TL;DR both regulatory regimes now require AI labs to watermark content generated with their tools and large platforms to display this information to users. @indicator.media found in March that this second step was still a work in progress -- we'll have more soon
Microsoft's online course is also a great starting point: www.youtube.com/watch?v=DwFV...
I always enjoy Palo Alto Networks Unit 42's work, and they've collected their jailbreaking material in this tag: unit42.paloaltonetworks.com/tag/jailbrok...
I frequently return to this simple yet comprehensive table of jailbreaking prompt types arxiv.org/html/2403.17...
Don’t Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Modelsarxiv.orgMy take is that it is not a bad instrument for this type of exercise, but that of course in this case the selection bias overstates prevalence. I ran a red-teaming exercise on this a month ago, in case you're interested (gift link) indicator.media/p/what-i-lea...