Batch Prompting: Efficient Inference with Large Language Model APIs

Published in Under Review, 2023

Recommended citation: Zhoujun Cheng, Jungo Kasai, and Tao Yu. 2023. "Batch Prompting: Efficient Inference with Large Language Model APIs." Under review. https://arxiv.org/abs/2301.08721