Language Model API Parameters
May 31, 2023 · 2 min read · An application talking to a language model API has control over the following parameters. Only the Vertex AI PaLM API allows setting Top-K and Top-P at the time of writing. Temperature The temperature (a floating-point number in the range 0.0–1.0) is...
Join discussion