Optimizing Inference of Large Language Models via Multi-Query Instructions in Meeting Summarization

The author investigates the use of multi-query instructions to optimize inference costs for meeting summarization using Large Language Models.