Bert Limitations
Contents
Kyle Polich discusses the limitations of Bert Model.
- BERT does not work properly with “negative” sentences
- Mary likes —
- Mary does not like —
- The blanks should be kind of opposite. But BERT does not do well
- He did not like red mark on his cheek and hence asked his girl friend not to use (lipstick). The word lipstick is obvious to humans but very difficult to decipher for BERT
- BERT still is a long way to go in terms of even coming close to human level reasoning