Just drop all that NN/DL approach to language understanding. It is a futile effort. You cannot handle any serious phenomenon in language using these simple models, beyond tasks that are “classification” tasks in nature (spam filtering, document classification, etc.)
There are at least 5 technical reasons why data-driven approaches to NLU are fallacious….