Participation is invited through the submission of original works on topics relevant to these research themes, including but not limited to:

• Studies of ML systems and their impact on human effectiveness and reliability, including DL and LLM-based systems

• Performance evaluation (AI automation vs. human-in-the-loop approaches)

• User-based experiments (with varying roles and degrees of human involvement)

• AI/IA application risks, including those introduced by the absence of a human-in-the-loop 

Human-Computer Interaction Studies in the Context of AI or IA Systems

• The impact of autonomous ML-trained systems vs. ML-trained systems with human oversight

• Novel interaction techniques for legal technology systems

• User studies relevant to legal professionals and tasks

• Empirical studies/experiments on human-AI collaboration

• Collaborative information seeking and social search, including social utility and network analysis for information interaction

• User-centered evaluation methods and measures, including measures of user experience and performance

• Experimental work on task design, legal data analysis methods, and usability
  
  

Explainability, Fairness, Ethics

• Examination of the role of transparency, explainability or interpretability in AI-supported systems

• Topics involving bias, discrimination, fairness, or justice in AI systems 

• Accountability in AI-supported systems, including organizational, design & development, and deployment perspectives

• Designing ethics or compliance with law into computational systems

• Algorithm appreciation (bias in favor of algorithms over humans) or algorithm aversion (bias in favor of humans over algorithms)

Specific Applications

• Litigation tasks, including analysis and/or, drafting of litigation-related documents

• Technology aided discovery or electronic data discovery (EDD)

• Legal services tasks, including document review, generation, response

• Systems that provide specific guidance to consumers and other end users who are not legal experts, including expert systems, user support systems, and chatbots.

• GPT-3.5/4.0, ChatGPT or Bard-based applications and related deployments

• Contracting tasks, including analysis, review, drafting, and negotiation

• Internal compliance monitoring

• Protection of sensitive data

• Data breach response

• Investigations of criminal behavior

• Forensic Science

• Improved handling and interpretation of data from collaboration platforms

• Generation of synthetic test data for legal and e-discovery applications

• Any additional use of AI and IA tools for legal services and related legal tasks

General Statement on Submissions

Submissions are not limited to the specific examples above. Any research involving the application of AI or ML to the legal domain, as well as complementary technologies such as NLP, IR, DM, NER, is welcome as a workshop submission to submit to the workshop. Material that addresses some of the themes and issues presented above should be integral to the discussion section of such works.

AI & Ethics at LegalAIIA

All submissions to LegalAIIA are strongly encouraged to include a section that addresses the ethical implications of the work being undertaken as well as topics related to the subject matter of the paper. Full papers that are focused on this topic within the specific context of the conference would also be appropriate for submission to the workshop.

Background

This workshop is an outgrowth of the popular and successful decade-long DESI (Discovery for Electronically Stored Information) series of workshops. (See http://users.umiacs.umd.edu/~oard/desi7/#History)