This is the generalization of the family of function where Softmax Function belongs. Many many functions are part of this family, most of the distributions that are used in science are part of the exponential family, e.g. beta, Gaussian, Bernoulli, Categorical distribution,…
This set of note is still in TODO Dependency Grammar has been much bigger in Europe compared to USA, where Chomsky's grammars ruled. One of the main developers of this theory is Lucien Tesnière (1959): “The sentence is an organized whole, the constituent elements of which are…
The landscape of NLP was very different in the beginning of the field. "But it must be recognized that the notion 'probability of a sentence' is an entirely useless one, under any known interpretation of this term 1968 p 53. Noam Chomsky . Probability was not seen very well…
Bag of words only takes into account the count of the words inside a document, ignoring all the syntax and boundaries. This method is very common for email classifications techniques. We can say bag of words can be some sort of pooling , it's similar to the computer vision…