Skip to Main Content

Administrative Law Research: Immigration Concentration Class Site

Robots Typing

Using Generative AI for Legal Research

Click here to watch a short and informative Youtube video how how ChatGPT works.

Click here to watch a video about creating better AI prompts.

Click here to watch a video about using generative AI products to conduct legal research.

 

Introduction to Generative AI Text Generators

Introduction to Generative AI Text Generators

Generative AI text generators like ChatGPT, Bing Chat, and Bard are computer programs that use advanced algorithms to analyze patterns in language and predict the next word in a sentence, allowing them to create new text that is similar in style and structure to the input data.

These models are commonly utilized for tasks such as language translation, content creation, and chatbots, and can generate sentences, paragraphs, or entire articles that closely resemble human-written content. These models use advanced algorithms to identify patterns in language and generate new text that is similar in style and structure to the input data.

Can the Information They Produce Be Totally Trusted?

No. Generative AI text generators are just one of many tools available for legal research, and while they may be a useful option, it is important to exercise caution and thoroughly verify any and all content generated by these models before relying on it.

ChatGPT Overview

What is ChatGPT?

ChatGPT is a large language model developed by OpenAI that uses deep learning techniques to generate human-like responses to text-based questions and requests (called prompts). The ChatGPT system is a neural network that has been trained on a massive dataset of text from the internet, including books, articles, web pages, and, luckily for us, legal materials such as cases, statutes, and regulations.

How Does ChatGPT (aka ChatGPT-3.5) Work?

ChatGPT is a prediction machine. It understands natural language prompts (statements and questions typed in by humans) and generates a human like response by predicting the next word in a sentence based on its massive training data. So basically, when asked a question, it tries to guess what a human would say in response to the question. ChatGPT-3.5 is based on the GPT-3 model, with the cutoff date for its training data being September 2021. This means it has no knowledge of anything that happened after that date. Notably, unlike its successor models and other AI systems like Bing Chat and Google Bard, ChatGPT-3.5 cannot search the internet to find additional sources or current information.

ChatGPT has evolved over time with the introduction of various versions, such as ChatGPT-3.5 and ChatGPT-4. Each version has distinctive features and capabilities.

ChatGPT-4

On March 14, 2023, ChatGPT-4 was released to the public, a step up from its predecessor and available only to premium customers at a cost of $20 a month.

It has been hailed as a great leap forward over ChatGPT-3.5. The information it provides is more accurate and precise than ChatGPT-3.5, and thereby reducing the likelihood of generating fictitious facts, cases, statutes, etc. Furthermore, based on its performance on the LSAT and Uniform Bar Exam, its legal analysis capabilities have seen a significant improvement over those of ChatGPT-3.5. Researchers have found that ChatGPT-3.5 gave a middling performance on both tests while ChatGPT-4 aced them, scoring in the top 10% for both.

This newer version utilizes the Browse with Bing beta technology to search the internet for more current information in order to answer questions, a functionality not present in ChatGPT-3.5. This advance was hailed as a significant improvement, contributing to the provision of more accurate and up-to-date information. However, concerns remain about the reliability and trustworthiness of this internet search functionality, indicating that all information provided by ChatGPT-4 should be verified.

Impressive Legal Analysis 

The AI system's impressive performance on the bar exam demonstrates its proficiency in legal analysis; however, its success can be attributed to the fact that citations to primary materials like cases and statutes in not generally required.

However, the purpose of legal research is to find relevant primary law, and answering legal questions requires accurate citation and explanation of primary legal materials like cases and statutes. ChatGPT, which works by predicting the next word in a sentence, often cites and explains the law of a jurisdiction on a specific issue correctly, but tends to fabricate case citations. It usually provides accurate statute information.