llm-distilleryUse LLMs to run map-reduce summarization tasks on large documents until a target token size is met.text-distillationtext-summarizationtext-compressiontoken-managementllm-distillerylarge-language-modelLLMsemantic-chunkingtext-processingAI-text-reduction1.2.0 • Published 10 months ago