LibreTimes

Search results for “уравнение Беллмана”

29 results

Machine Learning 2. Lecture 10. Reinforcement Learning

2026LectureКонстантин Вячеславович Воронцов

Reinforcement learning as learning from the environment's response: the multi-armed bandit problem, estimating the value of an action, the greedy and ε-greedy strategies, the exploration–exploitation trade-off, the UCB method, the exponential moving average, the pursuit method and reinforcement comparison; an environment with states, the Markov decision process, how it differs from ordinary machine learning problems, the discounted return, the state and action value functions, the Bellman equation, the SARSA and Q-learning methods, on-policy and off-policy; deep Q-learning DQN on the example of Atari games, experience replay; gradient optimisation of the policy (policy gradient) and its connection with log-likelihood maximisation; model-based and model-free approaches, a regression model of the reward with an upper confidence bound, LinUCB, recommending news articles, evaluating a policy on historical data.
1
550

Algebra 1. Lecture 1

2026LectureАртём Авилов

What algebra studies — algebraic structures. Groups (definition, examples, additive notation, uniqueness of the identity and of inverses), rings (variants of the axioms, rings with and without identity), fields and division rings, vector spaces and modules, algebras over a field. The symmetric group SnS_n — permutations, non-commutativity, two-row notation, cycles and transpositions, decomposition into transpositions, disjoint permutations commute, decomposition into disjoint cycles and its uniqueness, powers, inversions, parity and the sign of a permutation, multiplying by a transposition changes the sign.

0
310

Алгебра 1. Лекция 4. Формальные степенные ряды и производящие функции

2026LectureAlexey Ilyin

В этой лекции рассматриваются формальные степенные ряды как алгебраический объект. Вводятся операции сложения, умножения, а также аналоги производной и интеграла. Ключевая идея лекции — применение этого аппарата для решения линейно-рекуррентных соотношений с помощью производящих функций, что демонстрируется на классическом примере чисел Фибоначчи.
2
240

Machine Learning 1. Lecture 2. Stochastic Gradient and the Linear Classifier

2026LectureКонстантин Вячеславович Воронцов

The general scheme of supervised learning for regression, binary and multiclass classification; the margin and continuous approximations of the threshold loss; the linear classifier as a model of a neuron; the stochastic gradient method, momentum, Nesterov's accelerated gradient and heuristics; multicollinearity and L2 regularization; the maximum likelihood principle, its link to empirical risk minimization and the probabilistic meaning of regularization.
0
130

Аффинные пространства

2026LectureTaras Panov

Аффинные пространства и подпространства, аффинные системы координат и формулы их замены, прямые и плоскости в аффинных пространствах.
1
460
Станислав Шапошников
@shaposhnikov

Станислав Валерьевич Шапошников — профессор кафедры математического анализа механико-математического факультета МГУ имени М. В. Ломоносова (с 2014 года) и профессор факультета математики НИУ ВШЭ (с 2013 года). Доктор физико-математических наук. Окончил мехмат МГУ в 2006 году. Кандидатская диссертация «Эллиптические уравнения для мер» (2009); докторская — «Качественные свойства стационарных распределений и переходных вероятностей диффузионных процессов» (2011), защищена в 27 лет. Специалист по уравнениям Фоккера–Планка–Колмогорова. Разработал метод перенормировки решений и в соавторстве решил задачу А. Н. Колмогорова о единственности вероятностных решений уравнений Фоккера–Планка–Колмогорова; предложил новый подход к регулярности решений эллиптических уравнений в дважды дивергентной форме. Лауреат премии имени А. Н. Колмогорова РАН (2018) за цикл работ «Стационарные уравнения Колмогорова», премии Правительства Москвы молодым учёным (2017) и премии имени И. И. Шувалова (2012) за докторскую диссертацию. Читает курсы анализа и теории вероятностей в МГУ и НИУ ВШЭ; в Независимом московском университете осенью 2026 года читает «Математический анализ-1» и «Теорию вероятностей».

Machine Learning 1. Lecture 10. Linear Ensembles

2026LectureКонстантин Вячеславович Воронцов

Ensembles of models: base algorithms, the space of estimates, the decision rule and correcting functions; the problem of diversity of base algorithms; bagging, the random subspace method and a common pseudocode of stochastic ensembling; the unbiased out-of-bag estimate and estimating feature importance; converting simple voting into weighted voting; the random forest; boosting for binary classification with abstentions, the exponential approximation of the threshold loss function, the main theorem of AdaBoost with proof, convergence, classical AdaBoost and heuristics; why boosting does not overfit: experiments, bounding the probability of error through margins, the distribution of margins, comparison with bagging; the ComBoost algorithm.
0
160

Machine Learning 2. Lecture 8. Association Rule Mining

2026LectureКонстантин Вячеславович Воронцов

Association rule mining as unsupervised learning: binary features, support and frequent itemsets, the association rule, minimum support MinSupp and minimum confidence MinConf; market basket analysis; the link between association rules and logical regularities; the anti-monotonicity of support; the APriori algorithm: breadth-first search for frequent itemsets and recursive extraction of rules; modifications: search on a random subsample, item hierarchies, incremental and decremental algorithms; the FP-growth algorithm: the prefix FP-tree, building it in one pass over the transaction database, computing the support of any itemset from the tree, the conditional FP-tree and recursive search for frequent itemsets; the speed of FP-growth compared with APriori.
0
160

Machine Learning 1. Lecture 7. Generalizations of Linear Models

2026LectureКонстантин Вячеславович Воронцов

Nonlinear regression: the Newton–Raphson and Gauss–Newton methods as a series of linear regressions; logistic regression and iteratively reweighted least squares (IRLS); the generalized additive model and backfitting; the probabilistic meaning of least squares; the generalized linear model (GLM), the exponential family of distributions and the link function; logistic regression as a special case of GLM; the median, quantile regression and robust loss functions.
0
130

Machine Learning. Additional Lecture 2. A Survey of Optimisation Problems in Machine Learning

2026LectureКонстантин Вячеславович Воронцов

A survey lecture: machine learning as formulations of optimisation problems, a model, a loss function, a regulariser. Regression and classification, continuous approximations of the threshold loss function, SVM and logistic regression, quantile, robust and SVM regression; the L0, L1, L2, Elastic Net, SFM, RFM regularisers and feature selection; learning to rank: ordinal regression, the pairwise approach and AUC, LambdaRank; estimating a density and a mixture of distributions, clustering as a special case of a mixture, the one-class SVM; semi-supervised learning, the transductive SVM, PU-learning; matrix factorisations, autoencoders, multidimensional scaling, graph factorisations, GraphEDM; transfer learning, multi-task and self-supervised learning, distillation, learning using privileged information, generative adversarial networks; a typology of machine learning problems.
1
210