Deep Learning Inside Out (DeeLIO)

Knowledge Extraction and Integration for Deep Learning Architectures

** Important information: Following the EMNLP program chairs' decision to move EMNLP online and change its dates due to the coronavirus crisis, DeeLIO will also be a virtual conference. The DeeLIO submission deadline has been moved to August 24. The conference will take place on November 19. **

Deep Learning Inside Out (DeeLIO) is the first workshop on knowledge extraction and integration for deep learning architectures. It aims to bring together the knowledge interpretation, extraction and integration lines of research in deep learning, and cover the area in between. It will explore the introduction of external knowledge in deep learning models and representations, the types of linguistic and real-world knowledge neural nets encode, the extent to which this can be used for building resources, and whether this knowledge can be beneficial to them by being re-integrated in the models, compared to external hand-crafted knowledge.

DeeLIO also has a strong focus on structurally diverse languages with varying semantic-syntactic properties and low-data regimes. The workshop’s aim is to inspire novel variation-aware transfer learning and multilingual solutions on how to use the knowledge from resource-rich languages to inform deep learning architectures where external repositories are scarce or missing. The focus is on lexico-semantic knowledge that can be recovered from, or integrated into, deep learning methods across a variety of languages.

Topics of interest include but are not limited to:

  • integration of external knowledge in neural networks (under the form of semantic specialization of embeddings, retrofitting, joint modelling, or other);

  • exploration of the types of linguistic and world knowledge neural models, architectures and representations encode;

  • extraction of linguistic and world knowledge from deep learning models;

  • use of the knowledge extracted from deep learning models in practice (for resource enrichment, knowledge transfer to resource-lean languages, or other);

  • analysing and understanding the limitations of the knowledge about language and the world acquired by current neural models;

  • probing and analysing different types of hand-crafted knowledge that can enhance “blind” distributional models;

  • benefits of using external versus internally encoded knowledge, and their combination, for knowledge enhancement in neural networks;

  • development and enrichment of lexico-semantic knowledge resources using deep learning models;

  • (re)integration of (semi-)automatically compiled resources into deep learning models;

  • using external knowledge in resource-lean languages through transfer techniques or joint multilingual modelling.


Submission

We invite the submission of long and short papers on original and unpublished research in any topic related with knowledge interpretation and integration in deep neural networks. Long papers may consist of up to 8 pages of content + references. Short papers may consist of up to 4 pages of content + references. Upon acceptance, both types of papers will be given one additional page of content. Authors are encouraged to use this additional page for addressing reviewers’ comments in the final version.

Papers should follow the official EMNLP 2020 style guidelines and should be submitted via softconf: https://www.softconf.com/emnlp2020/deelio-ws


Multiple Submission Policy

Dual submissions with the main EMNLP conference are allowed. Authors must declare dual submission between the DeeLIO workshop and the main EMNLP conference by entering the paper’s main conference submission ID. The reviews from the main conference will be automatically forwarded to the workshop and taken into consideration when the paper is evaluated. Authors of dual-submission papers accepted to the main conference should retract them from the workshop by September 15.

Papers that will be under consideration for other venues during the DeeLIO reviewing period must also be declared at submission time. If a paper is accepted for publication at DeeLIO, it must be immediately withdrawn from other venues. If a paper under review at DeeLIO is accepted elsewhere and authors intend to proceed there, the DeeLIO committee must be notified immediately.


Important Dates

  • August 24, 2020 – Submission deadline.

  • September 15, 2020 – Retraction of workshop papers accepted for EMNLP.

  • September 29, 2020 – Notification of acceptance.

  • October 10, 2020 – Camera-ready papers due.

  • November 19, 2020 – Workshop

Note: All deadlines are 11:59PM UTC-12:00.