Malicious hackers sometimes jailbreak language models (LMs) to exploit bugs in the systems so that they can perform a multitude…