LLMLingua

Prompt Compression: How to Reduce Context Size Without Losing Quality

Long contexts cost money and degrade performance. Prompt compression techniques let you fit more relevant content into fewer tokens — here's what works in practice.