Evaluating Language Model Agency through Negotiations

Language models are being used to create AI agents - by everyone. These “LM-agents” represent a remarkable paradigm shift away from one-shot tasks like question-answering and sentiment analysis. Suddenly, LMs have turned into dynamic decision applications, capable of planning and interacting over extended periods. In contrast, our evaluation methods have... [Read More]