Search results for “иерархическая кластеризация”

The clustering problem and its ill-posedness, the aims of clustering, types of cluster structure, sensitivity to the choice of metric; the problem of semi-supervised learning and transductive learning, why it reduces neither to classification nor to clustering; criteria of clustering quality, the silhouette coefficient, the BCubed measures of precision and recall; the k-means method (Lloyd's algorithm) as a simplification of the EM algorithm for a mixture of Gaussians; the DBSCAN algorithm; agglomerative hierarchical clustering, the Lance–Williams formula and its special cases, the dendrogram, monotonicity, contracting and dilating distances, Ward's distance; semi-supervised learning based on classification: self-training, co-training, co-learning, the transductive SVM, expectation regularisation (XR).

Sequence-to-sequence problems: the recurrent network, the encoder–decoder architecture and its limitations; the recurrent network with an attention model, interpreting the attention matrix in machine translation and image captioning; similarity functions, the query–key–value attention model, the attention formula, self-attention; multi-head attention and its regularisation, hierarchical attention for document classification, the graph attention model GAT; the transformer for machine translation: the encoder, positional encoding, layer normalisation and skip connections, the decoder with masking, the training criterion, BLEU and WER; the transformer encoder BERT, the MLM and NSP criteria, fine-tuning, BPE and WordPiece tokenisation, model sizes.