CALL FOR PAPERS
LegalAIIA Workshop Call for Papers:
Participation is invited on all topics relevant to these research themes, including but not limited to:
Comparative Evaluations between AI & IA Systems and Approaches
Practical AI metrics vs. IA metrics and human-centered metrics vs. system-centric metrics (including KPIs such as time, cost, labor, utility, etc.)
Comparative studies examining the effectiveness of AI-enabled systems, tools and approaches versus non-AI-supported versions of the same
Evaluation studies of actual legal systems and practitioner tools which are enabled by AI Functionality, including effectiveness, quality, value rendered for users, and other measures.
Comparative studies examining the relative merits of incorporating human input into AI-driven systems via intentional direction vs. passive feedback
Evaluations of various modes of human-generated relevance feedback – e.g., simple labeling vs more granular feedback
Topics involving bias, discrimination, fairness, or justice
Human-Computer Interaction Studies in the Context of AI or IA Systems
Novel interaction techniques for legal technology systems
User studies relevant to legal professionals and tasks (ethnography studies)
Human-AI Collaboration (machine-directed and human-directed)
An examination of the role of transparency, explainability or interpretability in AI-supported Systems
Utility-related explorations and contributions in AI or IA systems beyond standard metrics
AI & Ethics Topics
An examination of the role of transparency, explainability or interpretability in AI-supported systems
Topics involving bias, discrimination, fairness, or justice in AI systems (either human-induced or machine-induced)
Accountability in AI-supported systems
From organizational, design & development and deploy perspectives
Designing Ethics or Compliance with Law into AI
Human-centered Design for AI Systems
User Proprioception (interactive awareness of the effects of human action on the AI)
AI Contributions to Process Automation (both ethical & bias dimensions)
Accessibility (for those who use it vs. who can use it)
DESI / E-Discovery-related
Human influence on the Technology Assisted Discovery & Review process
Role & resources expended by designers & annotators
Expectations of users, customers and courts for human explanations of TAR processes
Comparative studies on the influence of TAR in a Proactive vs Reactive e-Discovery Process
Examinations of key dimensions of IA through lenses of entities, topics, timelines.
How users interact with such dimensions in dynamic rather than static ways
This workshop is an outgrowth of the popular and successful decade-long DESI (Discovery for Electronically Stored Information) series of workshops (http://users.umiacs.umd.edu/~oard/desi7/#History). While we welcome contributions on AI and IA across the entire spectrum of legal informatics, we also welcome more traditional DESI-related submissions as well.
N.B.: At least one author of each accepted paper is required to register for the workshop (as per rules of the conference) and present at the workshop.