Because LLMs are programmed to train themselves behind the scenes, much of what goes on inside these models is a black box even to the people who create them. Chatbots are prone to inventing information out of thin air or giving downright dangerous medical advice. A field called explainable AI has emerged to help scientists uncover how chatbots “think.”