Language Model Prompt Selection via Simulation Optimization
arxiv(2024)
摘要
With the advancement in generative language models, the selection of prompts
has gained significant attention in recent years. A prompt is an instruction or
description provided by the user, serving as a guide for the generative
language model in content generation. Despite existing methods for prompt
selection that are based on human labor, we consider facilitating this
selection through simulation optimization, aiming to maximize a pre-defined
score for the selected prompt. Specifically, we propose a two-stage framework.
In the first stage, we determine a feasible set of prompts in sufficient
numbers, where each prompt is represented by a moderate-dimensional vector. In
the subsequent stage for evaluation and selection, we construct a surrogate
model of the score regarding the moderate-dimensional vectors that represent
the prompts. We propose sequentially selecting the prompt for evaluation based
on this constructed surrogate model. We prove the consistency of the sequential
evaluation procedure in our framework. We also conduct numerical experiments to
demonstrate the efficacy of our proposed framework, providing practical
instructions for implementation.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要