The L in "LLM" Stands for Lying