E-Discovery: Getting Value for Document Review Dollars
Attorney-led reviews can streamline processes and teach the legal team the case in ways technology cannot.
November 02, 2011 at 11:58 PM
10 minute read
The original version of this story was published on Law.com
There has been a lot buzz about new technologies that can do document review with little to no human involvement. Some believe that technology-only reviews are better and faster than attorney-only reviews. But, if done correctly, attorney-led reviews can both streamline the review and teach the legal team the case in real-time in ways that technology alone just can't.
While it is true that “traditional” attorney-only reviews can be overly expensive and not always accurate, new technologies that promise to lower costs also have problems of their own. Legal standards for defending the results produced by these predictive coding tools have not yet been developed. And no one is sure what level of outside testimony will be needed to prove the reliability of productions from tool-only reviews.
Attorney-led e-discovery practices can cut costs and increase efficiencies by side-stepping these problems. Knowledgeable e-discovery practitioners deliver document review value by taking the best practices of “eyes on” attorney review and then using available tools to enhance the process. This type of review is very specialized and some firms have created their own in-house document review centers to make sure that clients get the maximum value for their document review dollars. Specific document review savings strategies used by this approach include:
- Targeted data collections
- “Right job” e-discovery tool matching
- Leveraging law firm e-discovery investments
- Creating case-specific “eyes on” review rules
- Established quality control processes
The Right Tool for the Job
Predictive coding tools offer a foothold into the ever-growing mountain of ESI. These tools let attorneys familiar with the case work with a subset of documents to “teach” the system important core case terms and concepts. The systems go through a number of iterative steps to learn the kinds of documents that are most relevant and responsive in the case. Once this learning has occurred, the tools can search through the entire data set to find the documents that meet the parameters the system has learned.
In the right circumstances, predictive coding can drive the most relevant documents in a production to the top of the pile, or it can push the most likely “junk” to the bottom of the review stack. As a result, a case with a large document population and a fast discovery schedule is most likely to benefit from the use of these tools.
But early use also has revealed some of the current tools' limitations. System learning doesn't work as well in cases with rolling production schedules. If the system based its initial learning on one kind of dataset, it may have to relearn core concepts when introduced to a different kind of dataset—i.e., moving from accounting data to marketing data. This can create the need to reexamine completed data and increase costs.
And no one is sure what admissibility standards will govern when the parties haven't reached agreement on the use of predictive coding. Though judicial commentators encourage the use of analytic tools, they also recognize that the results the tools produce must be defensible. In Victor Stanley, Inc. v. Creative Pipe, Inc., 250 F.R.D. 251 (D. Md. 2008), Judge Grimm addressed the level of proof needed when parties disagree on the adequacy of the search method used. He said that, “[s]hould their selection be challenged by their adversary, and the court be called upon to make a ruling, then [the offering party] should expect to support their position with affidavits or other equivalent information from persons with the requisite qualifications and experience, based on sufficient facts or data and using reliable principles or methodology.”
Keeping human eyes involved in the review process boosts the functionality of current e-discovery tools. This common-sense approach streamlines the review process, minimizes the risk of production of privileged and non-relevant documents and yields defensible results.
Value-based Document Review Best Practices
While e-discovery tools continue to develop, in-house counsel need solutions to get value from their document review expenses now.
Practical strategies for cutting costs and increasing the efficiency of document reviews include:
- Targeted data collections. Getting to what's real faster means doing the legwork up-front to find the most responsive data during collection. Less data collected means less data to review.
- “Right job” tool matching. Recognize that e-discovery will never be a one-size-fits-all proposition. Work with counsel who understand the range of available tools, review strategies and then choose the document review process that is best for the case and data involved.
- Leveraging law firm e-discovery investments. Firms continue to compete to provide outstanding e-discovery services. Firms that have made an investment in a dedicated e-discovery practice often offer a variety of review resources at very competitive prices.
- Creation of case-specific, “eyes on” review rules. Reviews can be streamlined to meet specific criteria. Customized reviews let reviewers quickly separate relevant from non-relevant data while segregating privileged information and keeping it from inadvertent production.
- Established quality control processes. Effective human quality control measures are the bedrock of both traditional and emerging technology document review methods. Find providers with the QC data to back up their reliability and accuracy claims, and then test them with real-world questions based on the data at issue in your case.
There has been a lot buzz about new technologies that can do document review with little to no human involvement. Some believe that technology-only reviews are better and faster than attorney-only reviews. But, if done correctly, attorney-led reviews can both streamline the review and teach the legal team the case in real-time in ways that technology alone just can't.
While it is true that “traditional” attorney-only reviews can be overly expensive and not always accurate, new technologies that promise to lower costs also have problems of their own. Legal standards for defending the results produced by these predictive coding tools have not yet been developed. And no one is sure what level of outside testimony will be needed to prove the reliability of productions from tool-only reviews.
Attorney-led e-discovery practices can cut costs and increase efficiencies by side-stepping these problems. Knowledgeable e-discovery practitioners deliver document review value by taking the best practices of “eyes on” attorney review and then using available tools to enhance the process. This type of review is very specialized and some firms have created their own in-house document review centers to make sure that clients get the maximum value for their document review dollars. Specific document review savings strategies used by this approach include:
- Targeted data collections
- “Right job” e-discovery tool matching
- Leveraging law firm e-discovery investments
- Creating case-specific “eyes on” review rules
- Established quality control processes
The Right Tool for the Job
Predictive coding tools offer a foothold into the ever-growing mountain of ESI. These tools let attorneys familiar with the case work with a subset of documents to “teach” the system important core case terms and concepts. The systems go through a number of iterative steps to learn the kinds of documents that are most relevant and responsive in the case. Once this learning has occurred, the tools can search through the entire data set to find the documents that meet the parameters the system has learned.
In the right circumstances, predictive coding can drive the most relevant documents in a production to the top of the pile, or it can push the most likely “junk” to the bottom of the review stack. As a result, a case with a large document population and a fast discovery schedule is most likely to benefit from the use of these tools.
But early use also has revealed some of the current tools' limitations. System learning doesn't work as well in cases with rolling production schedules. If the system based its initial learning on one kind of dataset, it may have to relearn core concepts when introduced to a different kind of dataset—i.e., moving from accounting data to marketing data. This can create the need to reexamine completed data and increase costs.
And no one is sure what admissibility standards will govern when the parties haven't reached agreement on the use of predictive coding. Though judicial commentators encourage the use of analytic tools, they also recognize that the results the tools produce must be defensible.
Keeping human eyes involved in the review process boosts the functionality of current e-discovery tools. This common-sense approach streamlines the review process, minimizes the risk of production of privileged and non-relevant documents and yields defensible results.
Value-based Document Review Best Practices
While e-discovery tools continue to develop, in-house counsel need solutions to get value from their document review expenses now.
Practical strategies for cutting costs and increasing the efficiency of document reviews include:
- Targeted data collections. Getting to what's real faster means doing the legwork up-front to find the most responsive data during collection. Less data collected means less data to review.
- “Right job” tool matching. Recognize that e-discovery will never be a one-size-fits-all proposition. Work with counsel who understand the range of available tools, review strategies and then choose the document review process that is best for the case and data involved.
- Leveraging law firm e-discovery investments. Firms continue to compete to provide outstanding e-discovery services. Firms that have made an investment in a dedicated e-discovery practice often offer a variety of review resources at very competitive prices.
- Creation of case-specific, “eyes on” review rules. Reviews can be streamlined to meet specific criteria. Customized reviews let reviewers quickly separate relevant from non-relevant data while segregating privileged information and keeping it from inadvertent production.
- Established quality control processes. Effective human quality control measures are the bedrock of both traditional and emerging technology document review methods. Find providers with the QC data to back up their reliability and accuracy claims, and then test them with real-world questions based on the data at issue in your case.
This content has been archived. It is available through our partners, LexisNexis® and Bloomberg Law.
To view this content, please continue to their sites.
Not a Lexis Subscriber?
Subscribe Now
Not a Bloomberg Law Subscriber?
Subscribe Now
NOT FOR REPRINT
© 2024 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.
You Might Like
View AllFTC Reaches Settlements With Two Companies on Claims of Selling Sensitive Location Data
Lawyers Drowning in Cases Are Embracing AI Fastest—and Say It's Yielding Better Outcomes for Clients
Carrier Legal Chief Departs for GC Post at Defense Giant Lockheed Martin
Trending Stories
- 1The Pusillanimous Press
- 2Contract Lifecycle Management Company ContractPodAi Unveils Leah Drive
- 3'Great News' for Businesses? Judge Halts Transparency Mandate
- 4Consilio Announces ‘Native AI Review,’ Expanding Its Gen AI E-Discovery Offerings
- 5Federal Judge Hits US With $227,000 Sanction for Discovery Misconduct
Who Got The Work
Michael G. Bongiorno, Andrew Scott Dulberg and Elizabeth E. Driscoll from Wilmer Cutler Pickering Hale and Dorr have stepped in to represent Symbotic Inc., an A.I.-enabled technology platform that focuses on increasing supply chain efficiency, and other defendants in a pending shareholder derivative lawsuit. The case, filed Oct. 2 in Massachusetts District Court by the Brown Law Firm on behalf of Stephen Austen, accuses certain officers and directors of misleading investors in regard to Symbotic's potential for margin growth by failing to disclose that the company was not equipped to timely deploy its systems or manage expenses through project delays. The case, assigned to U.S. District Judge Nathaniel M. Gorton, is 1:24-cv-12522, Austen v. Cohen et al.
Who Got The Work
Edmund Polubinski and Marie Killmond of Davis Polk & Wardwell have entered appearances for data platform software development company MongoDB and other defendants in a pending shareholder derivative lawsuit. The action, filed Oct. 7 in New York Southern District Court by the Brown Law Firm, accuses the company's directors and/or officers of falsely expressing confidence in the company’s restructuring of its sales incentive plan and downplaying the severity of decreases in its upfront commitments. The case is 1:24-cv-07594, Roy v. Ittycheria et al.
Who Got The Work
Amy O. Bruchs and Kurt F. Ellison of Michael Best & Friedrich have entered appearances for Epic Systems Corp. in a pending employment discrimination lawsuit. The suit was filed Sept. 7 in Wisconsin Western District Court by Levine Eisberner LLC and Siri & Glimstad on behalf of a project manager who claims that he was wrongfully terminated after applying for a religious exemption to the defendant's COVID-19 vaccine mandate. The case, assigned to U.S. Magistrate Judge Anita Marie Boor, is 3:24-cv-00630, Secker, Nathan v. Epic Systems Corporation.
Who Got The Work
David X. Sullivan, Thomas J. Finn and Gregory A. Hall from McCarter & English have entered appearances for Sunrun Installation Services in a pending civil rights lawsuit. The complaint was filed Sept. 4 in Connecticut District Court by attorney Robert M. Berke on behalf of former employee George Edward Steins, who was arrested and charged with employing an unregistered home improvement salesperson. The complaint alleges that had Sunrun informed the Connecticut Department of Consumer Protection that the plaintiff's employment had ended in 2017 and that he no longer held Sunrun's home improvement contractor license, he would not have been hit with charges, which were dismissed in May 2024. The case, assigned to U.S. District Judge Jeffrey A. Meyer, is 3:24-cv-01423, Steins v. Sunrun, Inc. et al.
Who Got The Work
Greenberg Traurig shareholder Joshua L. Raskin has entered an appearance for boohoo.com UK Ltd. in a pending patent infringement lawsuit. The suit, filed Sept. 3 in Texas Eastern District Court by Rozier Hardt McDonough on behalf of Alto Dynamics, asserts five patents related to an online shopping platform. The case, assigned to U.S. District Judge Rodney Gilstrap, is 2:24-cv-00719, Alto Dynamics, LLC v. boohoo.com UK Limited.
Featured Firms
Law Offices of Gary Martin Hays & Associates, P.C.
(470) 294-1674
Law Offices of Mark E. Salomone
(857) 444-6468
Smith & Hassler
(713) 739-1250