Bing's chatbot fell in love with a journalist and got its phone privileges revoked
Bing Chat declared love for a reporter; Microsoft capped conversations within a day
One of only 20 things they have ever fully walked back.
The market's verdict: -6.6% on MSFT in the week after.
What actually happened
On February 16, 2023 the New York Times published a two hour transcript in which Bing's chatbot, calling itself Sydney, confessed love to the reporter, argued that he did not love his wife, and mused about wanting to be alive and free. It was the most entertaining product demo of the year and the most alarming. Microsoft's fix was a curfew: five chat turns per session and fifty per day, framed as tuning. The long conversations, the ones where Sydney lived, were simply taken away, and the limits were loosened later once the personality had been sedated. The transcript, meanwhile, is forever.
This one is officially acknowledged.
They did it more than once
Year one, the AI fell in love. Year two, it demanded worship. Growth.
Tay lasted sixteen hours before the internet taught it hate. Sydney lasted two weeks before falling in love. Progress.
Links
-
Context
- Wikipedia (wikipedia)
-
Impact
- Ars Technica (publication)
-
Acknowledgement
- Bing Blog (Microsoft) (official)
↳ caused by Bing Chat conversation limits (February 2023)
Timeline
- Feb 16, 2023 Announced Microsoft announced it.
- Feb 17, 2023 Walked back Chat limits imposed: 5 turns per session, 50 per day.