Search results for “обратное распространение ошибок”

The continuity and compactness hypotheses; the Minkowski metric and feature-free distances; the generalized metric classifier, the k nearest neighbours method, the Parzen window and the method of potential functions as a linear classifier; complete cross-validation, the compactness profile and the exact CCV formula for the nearest neighbour method; prototype selection; Nadaraya–Watson kernel smoothing, the choice of kernel and bandwidth.

Multiple linear regression and least squares, the pseudoinverse and the geometric meaning of least squares; the solution through the singular value decomposition; multicollinearity and the condition number; ridge regression, choosing the regularization parameter and the effective dimension; LASSO and non-smooth regularizers for feature selection; principal component analysis as a low-rank matrix decomposition; the spectral method of least squares.

Nonlinear regression: the Newton–Raphson and Gauss–Newton methods as a series of linear regressions; logistic regression and iteratively reweighted least squares (IRLS); the generalized additive model and backfitting; the probabilistic meaning of least squares; the generalized linear model (GLM), the exponential family of distributions and the link function; logistic regression as a special case of GLM; the median, quantile regression and robust loss functions.

Estimating a probability density from a sample: the maximum likelihood principle, the multivariate Gaussian density and its geometric meaning, multicollinearity and regularisation of the covariance matrix; separating a mixture of distributions, the EM algorithm as a method of simple iterations, the Gaussian mixture (GMM); the nonparametric Parzen–Rosenblatt estimate, the choice of kernel and window width; Bayesian classification theory: the generative and discriminative approaches, the optimal Bayes classifier, the Parzen window method, the quadratic discriminant, Fisher's linear discriminant, the radial basis function network and its training by the EM algorithm.

Vector representations (embeddings) of texts and graphs: the distributional semantics hypothesis, syntagmatic and paradigmatic similarity of words, the CBOW and Skip-gram models of the word2vec program, hierarchical SoftMax on a Huffman tree, negative sampling (SGNS) and the connection of word2vec with the matrix factorisation of the PMI matrix, semantic analogies of words, the FastText model on character n-grams; texts as graphs; multidimensional scaling and the stress criterion, stochastic neighbour embedding SNE, perplexity, t-SNE; matrix factorisations of graphs, the random-walk models DeepWalk and node2vec; graph embedding methods as autoencoders, the generalised GraphEDM model, graph neural networks and message passing.

A contour integral as a double integral: the hypotheses of Green's theorem, orientation of the contour, area as a contour integral, closing an open arc, an annulus, a singular point inside the contour.