Tag

Prompt Tokens vs Completion Tokens

January 1, 1

Prompt tokens are the tokens consumed by input text, including system messages and user prompts, while completion tokens are those generated as the …