On intuitive notions of probability

This note will mainly attempt to summarize the introduction of some intuitive notions of probability used in common sense human reasoning. Most of what is said here is available here (Jaynes 2003) . Three intuitive notions of probability # Jaynes presents some forms of inference…

Spazi di probabilita

In order to define the concept of probability formally, we need first to introduce some mathematical concepts. La probabilità # Termini # Esito ed esperimenti aleatorio # L’evento è quello che accade, mentre un esperimento aleatorio qualcosa di cui vogliamo andare a misurare la…

September 20, 2024 · Reading Time: 6 minutes · By Xuanqiang Angelo Huang

Entropy

Questo è stato creato da 1948 Shannon in (Shannon 1948) . Questa nozione è basata sulla nozione di probabilità, perché le cose rare sono più informative rispetto a qualcosa che accade spesso. Introduction to Entropy # The Shannon Information Content # This is dependent on the…

Introduction to Information Theory

The course will be more about the the quantization, talking about lossless and lossy compression (how many bits will be needed to describe something? This is not a CS course so it will not be so much algorithmically focused course), then we will talk about channel and capacity…

Topological Spaces

Introduction to topological spaces # We want now to extend the idea of continuity presented in limits , which is a function f : E n → E n is continuous if given x then ∀ ε > 0 ∃ δ such that ∀ y : ∥ y − x ∥ < δ ⟹ ∥ f ( y ) − f ( x )∥ < ε . But we want to get rid of the…

September 2, 2024 · Reading Time: 10 minutes · By Xuanqiang Angelo Huang

Metric Spaces

There is a close relationship between topologies and metric spaces. We will see that every metric space directly induces a topology based on its metric. (from a CS point of view, this means topologies are more general than metric spaces). Definition of Metric Space # We say that…

September 1, 2024 · Reading Time: 2 minutes · By Xuanqiang Angelo Huang

Introduction to statistical learning

Introduzione # This is a short introduction to statistical learning, made with the help of the book (James et al. 2023) . statistical learning refers to a set of approaches for estimating f . Utilizzi del statistical learning # Solitamente sono due gli utilizzi Predizione e…

August 29, 2024 · Reading Time: 3 minutes · By Xuanqiang Angelo Huang

Vapnik-Chervonenkis Dimension

This note will introduce the ideas presented by Vapnik, presented in (Shalev-Shwartz & Ben-David 2014) chapter 6. Briefly this says that infinite-size classes are indeed learnable. This set of note is still a work in progress. But it's very important for statistical…

August 29, 2024 · Reading Time: 1 minutes · By Xuanqiang Angelo Huang

Algoritmi di ordinamento

Introduzione # L’importanza del topic # Gli algoritmi di ordinamento sono molto di base per la comprensione dell'ampio raggio degli algoritmi. Utilizzano l'analisi, introducono tecniche di risoluzione dei problemi computazionali come greedy, divide et impera e simile. Permettono…

Cammini

1.1 Il cammino minimo # 1.1.1 Definizione e caratteristiche # 1.1.2 Costi negativi # Sono cose molto brutte 1.1.3 Cammino minimo semplice # Costruzione di cammini minimi # 1.2 Vertici # 1.2.1 definizione distanza fra due vertici # Costo del cammino minimo che li connette…