LibreTimes

Search results for “ARTM”

Categories

39 results

Topic Modelling for Extracting Behavioral Patterns from Transactions Data

2019Conference paperEvgeny Egorov, Filipp Nikitin, Vasiliy Alekseev, Alexey Goncharov +1

With the increasing popularity of cashless payment methods for everyday, seasonal and special expenses popular banks accumulate huge amount of data about customer operations. In the article, we report a successful application of topic modelling to extract behaviour patterns from the data. The resulting models are built with BigARTM framework: flexible and efficient tool for topic modelling. The framework allows us to experiment with various models including PLSA, LDA and beyond. Results demonstrate ability of the approach to aggregate information about behaviour patterns of different customer groups. The results analysis allows to see the topics of such people clusters varying from travellers to mortgage holders. Moreover, low-dementional embeddings of the customers, which was given with topic model, were studied. We display that the client vector representations store demographic information as well as source data. We also test for a best way of preparing data for the model with metric above in mind.
0
5

Lexical Quantile-Based Text Complexity Measure

2019Conference paperAITHEA, Russia, Maksim Eremeev, Konstantin Vorontsov

This paper introduces a new approach to estimating the text document complexity.Common readability indices are based on average length of sentences and words.In contrast to these methods, we propose to count the number of rare words occurring abnormally often in the document.We use the reference corpus of texts and the quantile approach in order to determine what words are rare, and what frequencies are abnormal.We construct a general text complexity model, which can be adjusted for the specific task, and introduce two special models.The experimental design is based on a set of thematically similar pairs of Wikipedia articles, labeled using crowdsourcing.The experiments demonstrate the competitiveness of the proposed approach.
0
7

QUANTILE-BASED APPROACH TO ESTIMATING COGNITIVE TEXT COMPLEXITY

2020Conference paperM. A. Eremeev, K. V. Vorontsov

Computational Linguistics and Intellectual Technologies

This paper introduces an approach to measuring the cognitive complexity of texts on various language levels. While standard readability indices are based on the linear combination of primary statistics, our general approach allows us to estimate complexity on morphological, lexical, syntactic, and discursive levels. Each model is defined by the tokens for the specific language level and the complexity function of a single token. We then use the reference collection of moderately complex texts and the quantile-based approach to spot the abnormally rare tokens. The proposed supervised ensemble, based on the ElasticNet model, incorporates models from all language levels. Having collected a labeled dataset through crowdsourcing, consisting of pairs of articles from the Russian Wikipedia, we consider several models and ensembles and compare them to common baselines. Suggested models are flexible due to the freedom in choosing the reference collection. The described experiments confirm the competitiveness of the proposed approach, as the ensembles demonstrate the best target metric value.
0
6

RuSciBench: Open Benchmark for Russian and English Scientific Document Representations

2024Journal articleA. Vatolin, N. Gerasimenko, A. Ianina, K. Vorontsov

Doklady Mathematics

Sharing scientific knowledge in the community is an important endeavor. However, most papers are written in English, which makes dissemination of knowledge in countries where English is not spoken by the majority of people harder. Nowadays, machine translation and language models may help to solve this problem, but it is still complicated to train and evaluate models in languages other than English with no or little data in the required language. To address this, we propose the first benchmark for evaluating models on scientific texts in Russian. It consists of papers from Russian electronic library of scientific publications. We also present a set of tasks which can be used to fine-tune various models on our data and provide a detailed comparison between state-of-the-art models on our benchmark.
0
4

Basis, Dimension, and Span

2026TheorySergey

Linear dependence of vectors, basis and coordinates, dimension, subspaces, and linear span.
0
220

Determinant via Permutations

2026TheorySergey

The direct definition of a determinant via permutations: inversions, parity, and a sum of n! terms.

0
170

Properties of Determinants

2026TheorySergey

The basic properties of determinants with brief proofs, and their use in simplifying computations.
0
260

Determinant

2026TheorySergey

The determinant of a square matrix — its meaning, minors and cofactors, Laplace expansion, and computation methods.
0
190

A curiosity: “supersmooth” varieties

2026TheorySean Cotner

A rigidity condition on schemes, strictly stronger than smoothness, introduced with examples and a look at where it fails to be geometric — no known application, just a curiosity.
1
120

Basic Operations on Matrices

2026TheorySergey

Addition, scalar multiplication, transposition and multiplication of matrices, along with subtraction, powers, and trace.
0
150

Properties of Matrix Operations

2026TheorySergey

The basic properties of addition, scalar multiplication, transposition, and multiplication of matrices, with justifications.
0
180

Machine Learning 2. Lecture 10. Reinforcement Learning

2026LectureКонстантин Вячеславович Воронцов

Reinforcement learning as learning from the environment's response: the multi-armed bandit problem, estimating the value of an action, the greedy and ε-greedy strategies, the exploration–exploitation trade-off, the UCB method, the exponential moving average, the pursuit method and reinforcement comparison; an environment with states, the Markov decision process, how it differs from ordinary machine learning problems, the discounted return, the state and action value functions, the Bellman equation, the SARSA and Q-learning methods, on-policy and off-policy; deep Q-learning DQN on the example of Atari games, experience replay; gradient optimisation of the policy (policy gradient) and its connection with log-likelihood maximisation; model-based and model-free approaches, a regression model of the reward with an upper confidence bound, LinUCB, recommending news articles, evaluating a policy on historical data.
1
550

Machine Learning 2. Lecture 12. Interpretability and Explainability

2026LectureКонстантин Вячеславович Воронцов

Interpretability and explainability of machine learning models: goals, tasks and basic notions, who needs explanations and why; interpretable models; feature importance in linear regression: the t-statistic, net effects, contributions and situational importance; partial dependence plots (PDP) and individual conditional expectation plots (ICE); permutation feature importance; the Shapley value from cooperative game theory, its axioms and Monte Carlo estimation, its use in linear regression; surrogate modelling in the neighbourhood of an object, the LIME, Anchors, SHAP, Shapley Kernel and SAGE methods; the Shapley value for training objects, Data Shapley and Gradient Shapley; counterfactual explanations.
0
230

Linear (Vector) Space

2026TheorySergey

The axioms of a linear (vector) space, examples and counterexamples.
0
160

Linear Operator

2026TheorySergey

A linear operator and its matrix, the action x' = Ax, similar matrices, and the formula B = C⁻¹AC.
0
150

The torsion component of the Picard scheme

2026OtherBogdan Zavyalov

Every finite flat commutative group scheme over a noetherian local ring is the torsion component of the Picard scheme of a smooth projective scheme with 3-dimensional fibers, built as a quotient of a complete intersection. An application: Hodge numbers that jump in a smooth projective family.
1
500

An example of a non-reduced Picard scheme

2026TheorySean Cotner

An example, due to Serre, of a smooth projective surface in positive characteristic whose Picard scheme fails to be reduced, worked out via the two governing dimension inequalities.
1
170