~40,000 messages/day
Player chatbot with safety classification
Game developer with child players
- What the AI does
- Labels each player message for safety and jailbreak risk, answers safe questions from game data and checks responses before they go out.
- Where people step in
- Messages flagged as safety issues go to a human; red-team findings are fed back into classifiers.