TIL: LLM Jailbreak

Jailbreak in the context of LLM is manipulating the prompt to bypass restrictions set by the service provider. The 4 common prohibited scenarios (Deng et al., 2024): Illegal usage against law Generation of harmful or abusive contents Violation of ...