Locality principles # Remember the two locality principles in Memoria . temporal locality and spatial locality . Temporal Locality # Some elements just are accessed many times in time. This is an example of a temporal locality . Spatial locality # Some elements are accessed…
On Compiler # Adding compilation flags to gcc not always makes it faster, it just enables a specific set of optimization methods. It's also good to turn on platform specific flags to turn on some specific optimization methods to that architecture. Remember that compilers are…
A seconda dell'utilizzatore l’OS può essere molte cose, come solamente l’interfaccia se sei un programmatore, servizi (se sei un utente, ma gran parte dei servizi sono astratti e l'utente ne può anche essere a non-conoscenza). Ma se sei un programmatore OS ti interessa capire le…
PAC Learning is one of the most famous theories in learning theory. Learning theory concerns in answering questions like: What is learnable? Somewhat akin to La macchina di Turing for computability theory. How well can you learn something? PAC is a framework that allows to…
Gaussian Mixture Models # This set takes inspiration from chapter 9.2 of (Bishop 2006) . We assume that the reader already knows quite well what is a Gaussian Mixture Model and we will just restate the models here. We will discuss the problem of estimating the best possible…
The DP (Dirichlet Processes) is part of family of models called non-parametric models. Non parametric models concern learning models with potentially infinite number of parameters. One of the classical application is unsupervised techniques like clustering. Intuitively,…
This is a quite good resource about this part of Support Vector Machines (step by step derivation). (Bishop 2006) chapter 7 is a good resource. The main idea about this supervised method is separating with a large gap . The thing is that we have a hyperplane, when this plane is…
Active Learning concerns methods to decide how to sample the most useful information in a specific domain; how can you select the best sample for an unknown model? Gathering data is very costly, we would like to create some principled manner to choose the best data point to…
This note is one of the few notes that was generated with the help of chatgpt. Bayesian Information Criterion (BIC) # The Bayesian Information Criterion (BIC) is a model selection criterion that helps compare different statistical models while penalizing model complexity. It is…
The beta distribution # The beta distribution is a powerful tool for modeling probabilities and proportions between 0 and 1. Here's a structured intuition to grasp its essence: Core Concept # The beta distribution, defined on [ 0 , 1 ] , is parameterized by two shape parameters:…