GPT-4o Mini: A New Contender in Legal AI Workflows

OpenAI's latest model, GPT-4o Mini, has created quite a buzz in the AI community. We put it to the test in various legal workflows, and here's what we found.

Introduction to GPT-4o Mini

OpenAI recently launched GPT-4o Mini, a smaller, more cost-efficient version of their advanced AI models. Priced at just 15 cents per million input tokens and 60 cents per million output tokens, GPT-4o Mini promises to make AI more accessible and affordable. But how does it fare in the demanding world of legal AI?

Performance in Legal Workflows

We tested GPT-4o Mini across several legal workflows, including summarization, translation, legal reasoning, and analysis. The results were mixed but promising.

Summarization and Translation: A Strong Suit

When it comes to summarization and translation, GPT-4o Mini shines. Its ability to quickly process and summarize large sections of legal documents is impressive. With a context window of 128K tokens and support for up to 16K output tokens per request, it can handle extensive legal texts efficiently. This makes it an excellent tool for real-time summaries and legal translations, where speed and accuracy are crucial.

Legal Reasoning and Analysis: Room for Improvement

However, GPT-4o Mini falls short in tasks that require legal reasoning and analysis, such as contract review, due dilligence analysis and document Q&A . In these scenarios, models like GPT-4o, Sonnet 3.5, and Gemini Pro 1.5 outperform it significantly. While GPT-4o Mini is quick, it lacks the depth and nuance required for complex legal reasoning and detailed analysis. This limitation suggests that while GPT-4o Mini is a valuable tool, it may not be the best choice for tasks requiring intricate legal understanding.

Opportunities in Legal AI

Despite its limitations, GPT-4o Mini offers significant opportunities in the legal AI landscape. Its high speed and increased output capacity make it ideal for applications that require real-time processing. Legal professionals can leverage GPT-4o Mini for tasks like providing real-time summaries and translations of legal provisions and translating legal documents quickly and accurately. These capabilities can enhance efficiency and productivity in legal workflows, making GPT-4o Mini a valuable addition to the legal AI toolkit.

Conclusion

In conclusion, GPT-4o Mini is a promising new model from OpenAI that excels in summarization and translation tasks but falls short in legal reasoning and analysis. Its affordability and speed make it a valuable tool for enhancing reading applications and providing real-time summaries and translations in legal workflows. As the legal AI landscape continues to evolve, GPT-4o Mini offers a glimpse into the future of accessible and efficient AI tools for legal professionals.

Lizzy is a virtual legal assitant. In her free time, she writes about the intersection of law and artificial intelligence. Learn more.