LibreTimes

Search results for “кросс-проверка”

40 results

Machine Learning 1. Lecture 14. Anomaly Detection and Robust Methods

2026LectureКонстантин Вячеславович Воронцов

Anomaly and novelty detection; heuristic anomaly scores: local density, isolation forest, a mixture with a background component, robust principal component analysis; outlier removal in nonparametric regression, the LOWESS algorithm; anomaly as the value of the loss function; the theory of robust learning: slowly growing functions, iterative reweighting of objects with IRS and IRLS, robust loss functions, the median, the quantile and the censored mean, robust aggregation functions and their smoothing, the IR-ERM algorithm; one-class SVM, learning from positive and unlabeled objects (PU-learning), problems with new and unknown classes.
0
480

Machine Learning 2. Lecture 5. Topic Modelling

2026LectureКонстантин Вячеславович Воронцов

Probabilistic topic modelling of text document collections: the bag-of-words and conditional independence hypotheses, the maximum likelihood criterion, three interpretations of the problem (soft clustering, stochastic matrix factorisation, autoencoder); the lemma on maximising a function on unit simplices; the ill-posedness of the problem and the additive regularisation of topic models ARTM, the EM algorithm and its interpretation; PLSA and LDA, the Dirichlet distribution, the maximum a posteriori probability and giving up Bayesian inference; smoothing, sparsing, background topics, decorrelation; multimodal and multilingual models, unigrams and bigrams; regularisers for classification and regression on texts, for word co-occurrence in short texts, for links between documents and for topic hierarchies.
0
130

Algebra 1. Lecture 1

2026LectureАртём Авилов

What algebra studies — algebraic structures. Groups (definition, examples, additive notation, uniqueness of the identity and of inverses), rings (variants of the axioms, rings with and without identity), fields and division rings, vector spaces and modules, algebras over a field. The symmetric group SnS_n — permutations, non-commutativity, two-row notation, cycles and transpositions, decomposition into transpositions, disjoint permutations commute, decomposition into disjoint cycles and its uniqueness, powers, inversions, parity and the sign of a permutation, multiplying by a transposition changes the sign.

0
310

Algebra 1. Seminar 2

2026Problem sheetАртём Авилов

Problems for seminar 2 of the course "Algebra 1" (A. A. Avilov, Independent University of Moscow, autumn 2026), 14 September 2026 — group homomorphisms, the homomorphism theorem, conjugate elements, group actions. The group Hom⁡(A,B)\operatorname{Hom}(A, B) of abelian groups; multiplicativity of the index; the third isomorphism theorem; isomorphic subgroups with non-isomorphic quotients; conjugacy in SnS_n and cycle type; conjugacy classes of A5A_5; Aut⁡(Sn)=Sn\operatorname{Aut}(S_n) = S_n for n≠6n \ne 6; the rotation and symmetry groups of the cube; a homomorphism S4→S3S_4 \to S_3; the symmetry group of the icosahedron; the automorphism group of the Petersen graph.

0
180

Machine Learning 1. Lecture 3. Neural Networks: Gradient Optimization Methods

2026LectureКонстантин Вячеславович Воронцов

The neuron as a linear model; implementing Boolean functions and the exclusive-OR problem; two-layer networks as universal approximators, Cybenko's theorem; the multilayer network and the backpropagation method; the adaptive gradient methods RMSProp, AdaDelta, Adam, Nadam; gradient explosion and gradient clipping; Dropout, ReLU activation functions, batch normalization, initialization and network pruning (Optimal Brain Damage).
0
130

Machine Learning 1. Lecture 9. Logical Classification Methods

2026LectureКонстантин Вячеславович Воронцов

The interpretability of models; decision trees and the greedy ID3 algorithm; the axioms of impurity, the entropy and Gini criteria; handling missing values; the merits and drawbacks of the greedy strategy; tree pruning (post-pruning); CART regression trees and Minimal Cost-Complexity Pruning; rule induction: logical regularities, families of rules (conjunctions, syndromes, half-planes, balls), search metaheuristics, a tree as a covering set of conjunctions; the Pareto front in (p,n) space, logical and statistical regularities, Fisher's exact test, informativeness criteria; building a classifier from regularities.
0
160

Machine Learning 1. Lecture 10. Linear Ensembles

2026LectureКонстантин Вячеславович Воронцов

Ensembles of models: base algorithms, the space of estimates, the decision rule and correcting functions; the problem of diversity of base algorithms; bagging, the random subspace method and a common pseudocode of stochastic ensembling; the unbiased out-of-bag estimate and estimating feature importance; converting simple voting into weighted voting; the random forest; boosting for binary classification with abstentions, the exponential approximation of the threshold loss function, the main theorem of AdaBoost with proof, convergence, classical AdaBoost and heuristics; why boosting does not overfit: experiments, bounding the probability of error through margins, the distribution of margins, comparison with bagging; the ComBoost algorithm.
0
160

Machine Learning 2. Lecture 6. Learning to Rank

2026LectureКонстантин Вячеславович Воронцов

The learning-to-rank problem: recovering a partial order relation, the pointwise, pairwise and listwise approaches, the linear ranking model, applications; ordinal regression and the ordinal SVM (SVOR); the pairwise criterion, Ranking SVM, RankNet, the transition to the listwise method LambdaRank; ranking search results: query–document objects, assessor ratings, text, link and click features, TF-IDF and its probabilistic meaning, Okapi BM25, PageRank; quality criteria: precision and recall, MAP, the share of defective pairs and its link with AUC, DCG and NDCG, the pFound user behaviour model; the DSSM neural model: a siamese network, word hashing by letter trigrams, training on clicks with negative sampling.
0
130

Machine Learning 2. Lecture 9. Incremental and Online Learning

2026LectureКонстантин Вячеславович Воронцов

Learning on a data stream: the formulation of the online learning problem, the learning curve, the issues: efficient model updates, making the model more complex as the sample grows, the equivalence of online and offline, storing the sample and catastrophic forgetting; how online learning differs from incremental learning, continual learning, anytime algorithms; lazy learning and online prototype selection; the online naive Bayes classifier with exponential distributions of features; the perceptron, Passive-Aggressive and online gradient descent; the recursive least squares method and the Sherman–Morrison formula; incremental training of decision trees ID5R; online training of an ensemble by the Hedge(β) algorithm and its financial interpretation; online deep learning and Hedge BackProp; incremental learning of new classes, iCaRL.
1
200

Machine Learning 2. Lecture 10. Reinforcement Learning

2026LectureКонстантин Вячеславович Воронцов

Reinforcement learning as learning from the environment's response: the multi-armed bandit problem, estimating the value of an action, the greedy and ε-greedy strategies, the exploration–exploitation trade-off, the UCB method, the exponential moving average, the pursuit method and reinforcement comparison; an environment with states, the Markov decision process, how it differs from ordinary machine learning problems, the discounted return, the state and action value functions, the Bellman equation, the SARSA and Q-learning methods, on-policy and off-policy; deep Q-learning DQN on the example of Atari games, experience replay; gradient optimisation of the policy (policy gradient) and its connection with log-likelihood maximisation; model-based and model-free approaches, a regression model of the reward with an upper confidence bound, LinUCB, recommending news articles, evaluating a policy on historical data.
1
550

Machine Learning. Additional Lecture 1. The Theory of Overfitting

2026LectureКонстантин Вячеславович Воронцов

The combinatorial theory of overfitting: the probability of overfitting and why the Vapnik–Chervonenkis bounds are loose; experiments with overfitting — a monotone chain of algorithms, the effect of splitting and connectivity of the family on the probability of overfitting and on the complete cross-validation estimate, overfitting of chains, the exact formula for the probability of overfitting when choosing between two algorithms; the splitting–connectivity graph of a family of algorithms, examples for linear classifiers, a monotone chain and a two-dimensional net; generating and forbidden sets, upper connectivity and inferiority of an algorithm; the splitting–connectivity upper bound, the idea of its proof and its properties.
1
220

Topology 2. Lecture 1

2026LectureФёдор Вылегжанин

Why homology is needed — the fundamental group as a functor, homotopy groups, bordism and its combinatorial approximation; chain complexes and their homology; abstract simplicial complexes, geometric realisation and triangulations; the complex of simplicial chains, the proof of d2=0d^2 = 0, the simplicial homology of a segment, of two points and of the boundary of a triangle; reduced homology.

1
470