Traditional and A.I.-Powered Brief Drafting Go Head-to-Head

We wanted to put A.I. in law and legal practice to the test, so we set up a head-to-head challenge to find out if attorneys can write better legal briefs with AI. On one side, we had a products liability litigator (Danielle Brim) with over a dozen years of experience, who would show how to write a legal brief the traditional way. On the other side, we had an attorney (Casetext’s CEO, Jake Heller) who has never worked on a products liability case, but would be armed with Casetext’s A.I.-powered drafting technology, Compose. 

They were both given this prompt and asked to see how far they could get in 10 minutes of work:

You represent Greenwood Pharmaceuticals, a manufacturer of a prescription drug, Alvin, which the FDA approved for the treatment of migraine headaches in adults. You’re preparing to move for summary judgment in a case filed by a plaintiff, Jessica Wilson, in the Supreme Court of New York. She alleges she used the drug daily to treat her migraines for several years, and as a result, developed adverse cardiovascular side effects. She alleges that Greenwood failed to adequately warn about the risks and asserts claims for strict liability, failure to warn, negligent failure to warn, and a violation of the general business law sections, which are the consumer protection statutes. 

You now want to move for summary judgment based on three arguments: 

  1. That the warnings were adequate as a matter of law, because the labeling expressly warned about an increased risk of cardiovascular side effects
  2. Ms. Wilson’s prescribing physician testified that he still would have prescribed the drug even if they provided different warning because her migraines were really frequent and debilitating 
  3. Ms. Wilson’s claims under General Business Law fail as a matter of law 

The head-to-head challenge was moderated by Casetext’s General Counsel, Laura Safdie, who checked in on each participant’s progress every couple of minutes. (Watch the full head-to-head challenge below.)

https://www.youtube.com/watch?v=fPXXMyenL-Y

Getting started

  • Compose: With Compose, Jake quickly got started by selecting the Motion for Summary Judgment for Pharmaceutical and Medical Device litigation from the Compose Motion Library, then entering some basic info like his jurisdiction and the names of the parties. After that, he was able to start scanning the list of available arguments. He reviewed the standard for summary judgment in New York and read over the Practice Note provided by the Compose editorial team. He then began building his argument section by selecting pre-packaged arguments along with summary judgment standards. 
  • Traditional drafting: Danielle started by identifying briefs from other cases in the same jurisdiction and with similar claims. In a real-world setting, she said, she would build up this folder of briefs by checking in with colleagues, searching her firm’s DMS, and potentially reaching out to co-counsel, and the process of gathering these briefs would likely take much longer than the two minutes allotted so far. 
https://youtu.be/MmPJLhcUPNo
Jake and Danielle show their progress a couple minutes into the drafting process.

Digging in

  • Compose: A few minutes in, Jake had built out his opening summary judgment statement, found the failure to warn section, and started to build out that argument section of his brief. He also discovered through a Compose Practice Note that strict liability claims and negligence claims are generally treated as equivalent in New York, found the appropriate four-part test, and added some legal standards to his draft. 
  • Traditional drafting: Danielle, meanwhile, had started digging into one of the related briefs. She found where the summary judgment standard was articulated in that brief and copied it into a Word document, leaving herself a note to later go back and check that the rule hasn’t changed since the brief was filed, and another note to make sure a cited case is still good law and potentially find a more recent citation.  

Final progress

  • Compose: In the last couple minutes, Jake started to tackle the question of whether Wilson can establish proximate causation. To support his argument here, Jake added this sentence to his draft, “The Doctor would have prescribed Alvin even if she had different warnings regarding its potential cardiovascular side effects,” which he was able to use as a Parallel Search query. Parallel Search returned a few cases to support Jake’s argument, and he selected one to add to his draft. 
  • Traditional drafting: Danielle was nearly done reviewing the first template brief. She was able to copy over some good articulations from that brief’s failure to warn section into her draft, but had also noted a lot of cases she would need to go back and cite-check as well as research paths to go down. 
https://youtu.be/yvOW3XpljAQ
See how far Jake and Danielle were able to get in 10 minutes through A.I. vs. a traditional drafting process.

Results 

After just ten minutes of research and drafting time, both Jake and Danielle had a document started with an outline of at least one argument. However, thanks to the power of A.I. and NLP in legal tech, Jake was able to build out much more of his draft in less time. Whereas Danielle was left with a number of research projects — including cases to cite-check and citations to update with more recent cases — Jake was able to quickly and confidently add up-to-date law to his draft. 


This head-to-head challenge was part of our recent webinar, “A.I. for Products Liability Motions.” You can watch the recording of the full webinar here. For more on how to write Products Liability briefs efficiently and effectively, tune in to this week’s webinar: https://compose.law/pl-draft-high-quality-briefs/

Featured posts

Draft Correspondence

Rapidly draft common legal letters and emails.

How this skill works

  • Specify the recipient, topic, and tone of the correspondence you want.

  • CoCounsel will produce a draft.

  • Chat back and forth with CoCounsel to edit the draft.

Review Documents

Get answers to your research questions, with explanations and supporting sources.

How this skill works

  • Enter a question or issue, along with relevant facts such as jurisdiction, area of law, etc.

  • CoCounsel will retrieve relevant legal resources and provide an answer with explanation and supporting sources.

  • Behind the scenes, Conduct Research generates multiple queries using keyword search, terms and connectors, boolean, and Parallel Search to identify the on-point case law, statutes, and regulations, reads and analyzes the search results, and outputs a summary of its findings (i.e. an answer to the question), along with the supporting sources and applicable excerpts.

Legal Research Memo

Get answers to your research questions, with explanations and supporting sources.

How this skill works

  • Enter a question or issue, along with relevant facts such as jurisdiction, area of law, etc.

  • CoCounsel will retrieve relevant legal resources and provide an answer with explanation and supporting sources.

  • Behind the scenes, Conduct Research generates multiple queries using keyword search, terms and connectors, boolean, and Parallel Search to identify the on-point case law, statutes, and regulations, reads and analyzes the search results, and outputs a summary of its findings (i.e. an answer to the question), along with the supporting sources and applicable excerpts.

Prepare for a Deposition

Get a thorough deposition outline in no time, just by describing the deponent and what’s at issue.

How this skill works

  • Describe the deponent and what’s at issue in the case, and CoCounsel identifies multiple highly relevant topics to address in the deposition and drafts questions for each topic.

  • Refine topics by including specific areas of interest and get a thorough deposition outline.

Extract Contract Data

Ask questions of contracts that are analyzed in a line-by-line review

How this skill works

  • Allows the user to upload a set of contracts and a set of questions

  • This skill will provide an answer to those questions for each contract, or, if the question is not relevant to the contract, provide that information as well

  • Upload up to 10 contracts at once

  • Ask up to 10 questions of each contract

  • Relevant results will hyperlink to identified passages in the corresponding contract

Contract Policy Compliance

Get a list of all parts of a set of contracts that don’t comply with a set of policies.

How this skill works

  • Upload a set of contracts and then describe a policy or set of policies that the contracts should comply with, e.g. "contracts must contain a right to injunctive relief, not merely the right to seek injunctive relief."

  • CoCounsel will review your contracts and identify any contractual clauses relevant to the policy or policies you specified.

  • If there is any conflict between a contractual clause and a policy you described, CoCounsel will recommend a revised clause that complies with the relevant policy. It will also identify the risks presented by a clause that does not conform to the policy you described.

Summarize

Get an overview of any document in straightforward, everyday language.

How this skill works

  • Upload a document–e.g. a legal memorandum, judicial opinion, or contract.

  • CoCounsel will summarize the document using everyday terminology.

Search a Database

Find all instances of relevant information in a database of documents.

How this skill works

  • Select a database and describe what you're looking for in detail, such as templates and precedents to use as a starting point for drafting documents, or specific clauses and provisions you'd like to include in new documents you're working on.

  • CoCounsel identifies and delivers every instance of what you're searching for, citing sources in the database for each instance.

  • Behind the scenes, CoCounsel generates multiple queries using keyword search, terms and connectors, boolean, and Parallel Search to identifiy the on-point passages from every document in the database, reads and analyzes the search results, and outputs a summary of its findings (i.e. an answer to the question), citing applicable excerpts in specific documents.

Skills

UNIVERSAL
Search a Database

Find all instances of relevant information in a database of documents.

Summarize

Get an overview of any document in straightforward, everyday language.

Draft Correspondence

Rapidly draft common legal letters and emails.

TRANSACTIONAL
Contract Policy Compliance

Get a list of all parts of a set of contracts that don’t comply with a set of policies.

Extract Contract Data

Ask questions of contracts that are analyzed in a line-by-line review

Prepare for a Deposition

Get a thorough deposition outline by describing the deponent and what’s at issue.

LITIGATION
Legal Research Memo

Get answers to your research questions, with explanations and supporting sources.

Review Documents

Get comprehensive answers to your questions about a set of documents.