For example, consider the following two sentences:
Sentence 1: What is your date of birth?
Sentence 2: I went out for a date with John.
The meaning of the word date is different in these two sentences.
Contextual models generate a representation of each word based on the other words in the sentence, i.e., they would represent ‘date’ based on ‘What is your‘, but not ‘of birth.‘ However, BERT represents ‘date’ using both its previous and next context — ‘ What is your …of birth?‘
Google has displayed several examples regarding this search update. One such example is the query: “do estheticians stand a lot at work.“
Join To Our Newsletter
You are welcome