Lawyers and legal market professionals need to learn to love statistics more.
More In-House Lawyers Question the Billable Hour by ACC President & CEO Veta T. Richardson in Corporate Counsel magazine (13 March 2013) criticizes a finding concerning alternative fee arrangements in the recently published Fulbright Litigation survey. Her conclusion may well be correct but the evidence she cites does not, statistically speaking, directly rebut the finding she questions. In my reading, the time periods and questions ACC asked are not close enough to compare results directly.
My goal is not to weigh-in on the disputed finding, whether GC are increasing or decreasing their use of alternative fee arrangements. Rather, it is to discuss statistical validity.
Too many legal professionals are uncomfortable with numbers and more still with statistics. I believe that explains persevaration over predictive coding, failure of many legal market surveys to publish the number or demographics of respondents, and incorrect comparisons (see, e.g., my post, 2008 AmLaw Tech Survey.)
Ms. Richardson points out that ACC has a larger sample than the other survey. In general, larger sample sizes are better than smaller sample sizes. But a big sample that fails accurately to represent the population is not necessarily more reliable than a small one. Beyond sample size, the questions asked matter a great deal. Do any AFA studies directly ask about the dollar spend for which the respondent is answering the AFA question?
The point is, statistics is a nuanced science. It’s scary when legal professionals start arguing stats. Fortunately, the next generation of lawyers may do better. Today, Dan Katz, a professor of law at Michigan State University, posted his syllabus for his Quantitative Methods for Lawyers class.
Archives
Blog Categories
- Alternative Legal Provider (44)
- Artificial Intelligence (AI) (57)
- Bar Regulation (13)
- Best Practices (39)
- Big Data and Data Science (14)
- Blockchain (10)
- Bloomberg Biz of Law Summit – Live (6)
- Business Intelligence (21)
- Contract Management (21)
- Cool Legal Conferences (13)
- COVID-19 (11)
- Design (5)
- Do Less Law (40)
- eDiscovery and Litigation Support (165)
- Experience Management (12)
- Extranets (11)
- General (194)
- Innovation and Change Management (188)
- Interesting Technology (105)
- Knowledge Management (229)
- Law Department Management (20)
- Law Departments / Client Service (120)
- Law Factory v. Bet the Farm (30)
- Law Firm Service Delivery (128)
- Law Firm Staffing (27)
- Law Libraries (6)
- Legal market survey featured (6)
- Legal Process Improvement (27)
- Legal Project Management (26)
- Legal Secretaries – Their Future (17)
- Legal Tech Start-Ups (18)
- Litigation Finance (5)
- Low Cost Law Firm Centers (22)
- Management and Technology (179)
- Notices re this Blog (10)
- Online Legal Services (64)
- Outsourcing (141)
- Personal Productivity (40)
- Roundup (58)
- Structure of Legal Business (2)
- Supplier News (13)
- Visual Intelligence (14)