CALL FOR PAPERS






LegalAIIA Workshop Call for Papers:


Participation is invited on all topics relevant to these research themes, including but not limited to:

Comparative Evaluations between AI & IA Systems and Approaches

  • Practical AI metrics vs. IA metrics and human-centered metrics vs. system-centric metrics (including KPIs such as time, cost, labor, utility, etc.)

  • Comparative studies examining the effectiveness of AI-enabled systems, tools and approaches versus non-AI-supported versions of the same

  • Evaluation studies of actual legal systems and practitioner tools which are enabled by AI Functionality, including effectiveness, quality, value rendered for users, and other measures.

  • Comparative studies examining the relative merits of incorporating human input into AI-driven systems via intentional direction vs. passive feedback

  • Evaluations of various modes of human-generated relevance feedback – e.g., simple labeling vs more granular feedback

  • Topics involving bias, discrimination, fairness, or justice

Human-Computer Interaction Studies in the Context of AI or IA Systems

  • Novel interaction techniques for legal technology systems

  • User studies relevant to legal professionals and tasks (ethnography studies)

  • Human-AI Collaboration (machine-directed and human-directed)

  • An examination of the role of transparency, explainability or interpretability in AI-supported Systems

  • Utility-related explorations and contributions in AI or IA systems beyond standard metrics

AI & Ethics Topics

  • An examination of the role of transparency, explainability or interpretability in AI-supported systems

  • Topics involving bias, discrimination, fairness, or justice in AI systems (either human-induced or machine-induced)

  • Accountability in AI-supported systems

    • From organizational, design & development and deploy perspectives

  • Designing Ethics or Compliance with Law into AI

  • Human-centered Design for AI Systems

  • User Proprioception (interactive awareness of the effects of human action on the AI)

  • AI Contributions to Process Automation (both ethical & bias dimensions)

  • Accessibility (for those who use it vs. who can use it)

DESI / E-Discovery-related

  • Human influence on the Technology Assisted Discovery & Review process

    • Role & resources expended by designers & annotators

    • Expectations of users, customers and courts for human explanations of TAR processes

  • Comparative studies on the influence of TAR in a Proactive vs Reactive e-Discovery Process

  • Examinations of key dimensions of IA through lenses of entities, topics, timelines.

    • How users interact with such dimensions in dynamic rather than static ways

This workshop is an outgrowth of the popular and successful decade-long DESI (Discovery for Electronically Stored Information) series of workshops (http://users.umiacs.umd.edu/~oard/desi7/#History). While we welcome contributions on AI and IA across the entire spectrum of legal informatics, we also welcome more traditional DESI-related submissions as well.


N.B.: At least one author of each accepted paper is required to register for the workshop (as per rules of the conference) and present at the workshop.