After months of grappling with where to draw the line on user freedom, we ultimately prohibited our models from being used for erotic purposes. It’s not that erotica is bad per se, but that there were clear warning signs of users’ intense emotional attachment to A.I. chatbots. Especially for users who seemed to be struggling with mental health problems, volatile sexual interactions seemed risky. Nobody wanted to be the morality police, but we lacked ways to measure and manage erotic usage carefully. We decided A.I.-powered erotica would have to wait.