Home Aims & Objectives NaCTeM Services Text Mining Tools Text Mining Infrastructures Text Mining for Biodiversity Resources Terms & Conditions FAQ News & Events News What others are saying about us Press and Journal Mentions NaCTeM Seminars People Projects Publications Community External Collaboration Vacancies Teaching & Tutorials Feedback How to find us

Talk at Open Data Science Conference (ODSC)

2023-05-19

Prof. Sophia Ananiadou, director of NaCTeM, will give a talk entitled Pre-trained Language Models for Summarisation at the Open Data Science Conference (ODSC), to be held at Tobacco Dock, London, from 14th - 15th June 2023.

ODSC aims to bring together the global data science community in an effort to encourage the exchange of innovative ideas and the growth of open source software.

Talk Abstract

Pre-trained language (PLMs) models have been used to boost automatic summarisation methods, both extractive and abstractive. Extractive summarisation methods select key sentences from documents and concatenate them into a summary. Abstractive summarisation methods are more challenging since they generate informative sentences to create a consistent summary. Domain specific pre-training is important for domains such as biomedicine (BioBERT, ClinicalBERT, etc). Some of the PLM-based summarisation methods use features, fine-tuning and domain adaptation. There are several challenges such as the encoding of long documents, how to inject domain-specific knowledge into the models, interpretability, evaluation and controllable factuality of summaries (based on the interests of users) and benchmarking. This session will provide an overview of these challenges and opportunities of PLMs for text summarisation using the biomedical domain as an example.

More information...
https://odsc.com/speakers/pre-trained-language-models-for-summarisation/https://odsc.com/speakers/pre-trained-language-models-for-summarisation/