Tensor Trust is an online game that allows players to exploit prompt injection vulnerabilities in ChatGPT against other player’s preset defense instructions of user input context and valuation, for research purposes
Tensor Trust is an online game that allows players to exploit prompt injection vulnerabilities in ChatGPT against other player’s preset defense instructions of user input context and valuation, for research purposes
Or are we helping researchers develop more sophisticated AI attacks?
Edit: this is one of those things we should have regulations for… to have someone ask, “why exactly are you doing this?” and act appropriately
There’s no real difference between helping a company develop defense against attacks, and helping them develop new attacks.
Fair enough, and at the end of the day it’s suspect to disguise AI training as a video game for the public. Pay me to do your work for you, or fully disclose your financers and intentions if it’s supposed to be for the greater good somehow.
You’re being paid in fun
It’s not disguised so much as disclaimed
We have hacker style events all the time and many websites exist that gamify it. White hat hacking for fun is a complete legitimate thing and should absolutely not be regulated.
This also doesn’t help develop much of anything. Seems like a silly game and that’s about it.