Open Philanthropy recommended a grant of $74,132 to the University of Minnesota to support a project to develop benchmarks for assessing large language models’ capabilities in automating legal tasks, led by Assistant Professor Dongyeop Kang.
This grant was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks and falls within our focus area of potential risks from advanced artificial intelligence.