StateBench
StateBench to examine state changes in long documents
The StateBench initiative tests how language models track state changes in long documents. The post was published on Hugging Face.
Ai2's StateBench Shows Frontier Models Struggle to Track State Over Long Inputs
Ai2 has introduced StateBench, a benchmark that measures how well language models keep track of entities as they change across long documents. According to Ai2…