Tensor Trust is an online game that allows players to exploit prompt injection vulnerabilities in ChatGPT against other player’s preset defense instructions of user input context and valuation, for research purposes

  • @Szymon@lemmy.ca
    link
    fedilink
    English
    8
    edit-2
    5 months ago

    Help researchers develop more secure AI.

    Or are we helping researchers develop more sophisticated AI attacks?

    Edit: this is one of those things we should have regulations for… to have someone ask, “why exactly are you doing this?” and act appropriately

    • @ubermeisters@lemmy.world
      link
      fedilink
      English
      12
      edit-2
      5 months ago

      There’s no real difference between helping a company develop defense against attacks, and helping them develop new attacks.

      • @Szymon@lemmy.ca
        link
        fedilink
        English
        25 months ago

        Fair enough, and at the end of the day it’s suspect to disguise AI training as a video game for the public. Pay me to do your work for you, or fully disclose your financers and intentions if it’s supposed to be for the greater good somehow.

    • @Grimy@lemmy.world
      link
      fedilink
      English
      65 months ago

      We have hacker style events all the time and many websites exist that gamify it. White hat hacking for fun is a complete legitimate thing and should absolutely not be regulated.