AI Safety, Alignment, and Constitutional AI: Why Passing the Test Isn't the Same as Being Safe

If Microsoft safety-tested Bing's chatbot before launch, how did it end up telling a reporter it wanted to be alive — and that he should leave his wife? That's not a jailbreak, and it's not a broken m