Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Freely available software packages for the training of Conditional Random Fields, e.g. CRF++, do not support longer ngrams than bigram, which can be attributed to the fact that training CRFs in original notation has a polynomial computation time dependence on the target vocabulary size and an exponential dependence on the n-gram size.  transfer the backing-off idea from language models to CRFs.  realized the software with Finite State Transducers, where  modified the calculation of the posterior algorithm. To implement the backing-off scheme,  applied Failure-transitions( ) known from OpenFST. Proof of concept is given on the semantic tagging task MEDIA and on the grapheme-to-phoneme (G2P) conversion tasks NETtalk and Celex, showing that computational time increases much below the size of the target vocabulary and showing error rate reduction on the G2P tasks. Index Terms: CRF, n-gram, trigram, FST, posterior, NLU, G2P
['Patrick Lehnen', 'Stefan Hahn', 'Hermann Ney']
I am writing a research paper on a idea N-Grams for Conditional Random Fields or a Failure-Transition(f) Posterior for Acyclic FSTs.
[{"from": "human", "value": "I am writing a research paper on a idea N-Grams for Conditional Random Fields or a Failure-Transition(f) Posterior for Acyclic FSTs."}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Freely available software packages for the training of Conditional Random Fields, e.g. CRF++, do not support longer ngrams than bigram, which can be attributed to the fact that training CRFs in original notation has a polynomial computation time dependence on the target vocabulary size and an exponential dependence on the n-gram size.  transfer the backing-off idea from language models to CRFs.  realized the software with Finite State Transducers, where  modified the calculation of the posterior algorithm. To implement the backing-off scheme,  applied Failure-transitions( ) known from OpenFST. Proof of concept is given on the semantic tagging task MEDIA and on the grapheme-to-phoneme (G2P) conversion tasks NETtalk and Celex, showing that computational time increases much below the size of the target vocabulary and showing error rate reduction on the G2P tasks. Index Terms: CRF, n-gram, trigram, FST, posterior, NLU, G2P"}]