A* shortest string decoding for non-idempotent semirings

Kyle Gorman, Cyril Allauzen

Main: Machine Learning for NLP Oral Paper

Session 2: Machine Learning for NLP (Oral)
Conference Room: Carlson
Conference Time: March 18, 11:00-12:30 (CET) (Europe/Malta)
TLDR:
You can open the #paper-107-Oral channel in a separate window.
Abstract: Abstract: The single shortest path algorithm is undefined for weighted finite-state automata over non-idempotent semirings because such semirings do not guarantee the existence of a shortest path. However, in non-idempotent semirings admitting an order satisfying a monotonicity condition (such as the plus-times or log semirings), the shortest string is well-defined. We describe an algorithm which finds the shortest string for a weighted non-deterministic automaton over such semirings using the backwards shortest distance of an equivalent deterministic automaton (DFA) as a heuristic for A* search performed over a companion idempotent semiring, which is proven to return the shortest string. There may be exponentially more states in the DFA, but the proposed algorithm needs to visit only a small fraction of them if determinization is performed "on the fly".