RT @johnjnay: Measuring Uncertainty in LLMs -Hard to know when to trust LLMs -Hard to measure uncertainty in natural lang b/c diff words can mean same thing -By considering shared meanings "Semantic Entropy" more predictive of LLM accuracy -Works out-of-the-box Paper arxiv.org/abs/2302.09664 pic.twitter.com/fuOvfaxRvR
posted at 00:20:50