Industry Collaboration around Benchmarking/Tracking Gen AI Accuracy etc
As the legal tech world gets to grips with generative AI, building trust and mechanisms that promote transparency are going to be critical for success.
The publication of the recent Stanford report: “Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools and the ensuing debate by interview, article and press release has been really interesting. It can’t be true that the same tool is both 90% accurate and 42% accurate!
This is a fantastic opportunity for us to come together across the legal industry and discuss the issues and – more importantly – to agree a way forward.
Litig (www.litig.org) is launching a call for anyone in the legal industry who is interested in collaborating on this to register their interest using this form: https://forms.microsoft.com/e/MsmppgnUi8
We are interested in gathering views from people in the legal industry with knowledge and experience of generative AI: law firms, suppliers, regulators and representative bodies, academics and in-house teams. The aim is to arrange a session in London, possibly in late July, in the CMS offices. Of course, we can’t host hundreds of people, but we will aim to be as inclusive as possible and publish the output of anything we do in collaboration with Richard and Artificial Lawyer and at Litig.org. Other interested parties include Caroline Hill and Legal Technology Insider.