9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Packing the Meeting Summarization Knapsack

Korbinian Riedhammer (1), Dan Gillick (2), Benoit Favre (3), Dilek Hakkani-Tür (3)

(1) Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
(2) University of California at Berkeley, USA; (3) ICSI, USA

Despite considerable work in automatic meeting summarization over the last few years, comparing results remains difficult due to varied task conditions and evaluations. To address this issue, we present a method for determining the best possible extractive summary given an evaluation metric like ROUGE. Our oracle system is based on a knapsack-packing framework, and though NP-Hard, can be solved nearly optimally by a genetic algorithm. To frame new research results in a meaningful context, we suggest presenting our oracle results alongside two simple baselines. We show oracle and baseline results for a variety of evaluation scenarios that have recently appeared in this field.

Full Paper

Bibliographic reference.  Riedhammer, Korbinian / Gillick, Dan / Favre, Benoit / Hakkani-Tür, Dilek (2008): "Packing the meeting summarization knapsack", In INTERSPEECH-2008, 2434-2437.