Managing conversation context size with compaction
As conversations grow, they consume more of the model’s context window. Compaction reduces context size while preserving important information, keeping your conversations responsive and cost-effective.