The Litig AI Benchmark initiative is now well underway, with the initial discovery workshops, one in person at CMS’s office in London and the other online having now taken place.  We have had a lot of engagement and insight from over 80 organisations to help challenge and evolve our thinking so far. Thanks to everyone involved!

For a summary of these sessions, please see: LinkedIn Group

To recap, this initiative is aimed at creating an open-source, standardised framework to help evaluate,  improve trust and drive sustainable adoption of AI tools used in legal contexts.

As well as the discovery workshops, the project team have been engaging with industry experts to ensure that any standards and benchmarks created are comprehensive, practical, and reflective of the diverse needs of the legal industry.

The progress being made by ValsAI as part of their 'Vals Legal AI Report' is of particular interest. As they progress their study in the US and we move to the next steps of the initiative, we will consider ways we could work together and support each other to achieve our aligned goals.

To raise further awareness, John spoke at the Legal Innovators conference in November 2024 and will be on a podcast with 3 Geeks and a Law Blog during December 2024.

So what’s next?

With  over 250 individuals registering their interest, we have setup a LinkedIn Group so we can keep everyone updated with progress. We’re really looking forward to having a way to engage with you and look forward to hearing your thoughts as we go along.

A working group will progress the initial thinking that came out of the discovery workshops to create a consultation paper. This paper along with any queries from our engagement with ValsAI will be shared with the mailing list for consideration.

To keep up to date with progress and ensure you receive a copy of the consultation paper make sure you’ve signed up to the mailing list / LinkedIn Group.