Search results for “BERT”

Sharing scientific knowledge in the community is an important endeavor. However, most papers are written in English, which makes dissemination of knowledge in countries where English is not spoken by the majority of people harder. Nowadays, machine translation and language models may help to solve this problem, but it is still complicated to train and evaluate models in languages other than English with no or little data in the required language. To address this, we propose the first benchmark for evaluating models on scientific texts in Russian. It consists of papers from Russian electronic library of scientific publications. We also present a set of tasks which can be used to fine-tune various models on our data and provide a detailed comparison between state-of-the-art models on our benchmark.

Text trees as a data structure occur in numerous machine learning tasks like hierarchical summarization and automatic mind map generation. One of the main methods of quality evaluation in these tasks is comparison with reference hierarchies created by experts. The method used so far to compare text hierarchies, as shown in this work, poorly accounts for their structure and text semantics relative to phrasing. To address this issue, we propose a new metric on the set of text trees — text tree edit distance (TTED), based on tree edit distance with semantic distance between texts measured using a large language model. To evaluate how the metric reflects different aspects of text tree difference, we introduce special quality coefficients that reflect the sensitivity of a metric to paraphrasing relative to structural and semantic differences of text trees. Using these coefficients, we conduct extensive testing of the proposed metric and its modifications compared to a baseline used in previous works to compare text hierarchies, which shows that TTED indeed captures significant differences between text trees more accurately than the previously used method. We also provide a practical implementation of TTED for further usage.

This paper introduces an approach to measuring the cognitive complexity of texts on various language levels. While standard readability indices are based on the linear combination of primary statistics, our general approach allows us to estimate complexity on morphological, lexical, syntactic, and discursive levels. Each model is defined by the tokens for the specific language level and the complexity function of a single token. We then use the reference collection of moderately complex texts and the quantile-based approach to spot the abnormally rare tokens. The proposed supervised ensemble, based on the ElasticNet model, incorporates models from all language levels. Having collected a labeled dataset through crowdsourcing, consisting of pairs of articles from the Russian Wikipedia, we consider several models and ensembles and compare them to common baselines. Suggested models are flexible due to the freedom in choosing the reference collection. The described experiments confirm the competitiveness of the proposed approach, as the ensembles demonstrate the best target metric value.

Linear systems in matrix form, the Kronecker–Capelli theorem, homogeneous systems, and the fundamental system of solutions.

Quadratic forms and their matrix, definiteness, Sylvester's criterion, and canonical form.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.

57th International Mathematical Olympiad. Hong Kong, 2016.

60th International Mathematical Olympiad, 2019.

The basic properties of addition, scalar multiplication, transposition, and multiplication of matrices, with justifications.

Two methods for solving a SLAE — Cramer's rule via determinants and the universal Gaussian elimination method, with examples.

Linear dependence of vectors, basis and coordinates, dimension, subspaces, and linear span.

International mathematics competition for pre-university students, held annually since 1959. Six problems over two days.