Search results for “query by committee”

Active learning: the model itself chooses which objects to give the teacher for labelling. The problem setting, why active learning is faster than passive learning, learning curves; pool-based sampling, query synthesis and stream-based selective sampling, cost-sensitive methods; uncertainty sampling (least confidence, minimum margin, maximum entropy), query by committee, version space reduction, expected model change, expected error reduction; query synthesis by the Nelder–Mead method and by the variance reduction criterion; density weighting; exploratory actions, the ε-active and EG-active algorithms with the exponentiated gradient; active learning in crowdsourcing: reconciling annotators' labels, models of their reliability and of object difficulty, assigning tasks to annotators.

In the exploratory search paradigm of information retrieval, the user has a complicated search demand that can not be formulated in a short query. The user collects thematically relevant information iteratively in a “query-browse-refine” process being motivated by learning, understanding, and knowledge acquisition purposes. We consider an elementary step of this scenario in which the search intent can be expressed by a long text query. For this case, we develop an exploratory search engine based on probabilistic topic modeling. Topic model gives a low-dimensional sparse interpretable vector representation (topical embedding) of a text. The search engine uses these embeddings for ranking documents by their similarity to the query. We show that performing only one query, the topic-based search engine achieves better precision and recall that human assessors do spending up to one hour in a conventional browse-refine loop. We use additive regularization for topic modeling (ARTM) to make the model simultaneously sparse, decorrelated, n-gram, multimodal and hierarchical. We show experimentally that each of these features of the model is important to achieve precision and recall higher than 90

Real-time monitoring of scientific papers and technological news requires fast processing of complicated search demands motivated by thematically relevant information acquisition. For this case, the authors develop an exploratory search engine based on probabilistic hierarchical topic modeling. Topic model gives a low dimensional sparse interpretable vector representation (topical embedding) of a text, which is used for ranking documents by their similarity to the query. They explore several ways of comparing topical vectors including searching with thematically homogeneous text segments. Topical hierarchies are built using the regularized EM-algorithm from BigARTM project. The topic-based search achieves better precision and recall than other approaches (TF-IDF, fastText, LSTM, BERT) and even human assessors who spend up to an hour to complete the same search task. They also discover that blending hierarchical topic vectors with neural pretrained embeddings is a promising way of enriching both models that helps to get precision and recall higher than 90

The learning-to-rank problem: recovering a partial order relation, the pointwise, pairwise and listwise approaches, the linear ranking model, applications; ordinal regression and the ordinal SVM (SVOR); the pairwise criterion, Ranking SVM, RankNet, the transition to the listwise method LambdaRank; ranking search results: query–document objects, assessor ratings, text, link and click features, TF-IDF and its probabilistic meaning, Okapi BM25, PageRank; quality criteria: precision and recall, MAP, the share of defective pairs and its link with AUC, DCG and NDCG, the pFound user behaviour model; the DSSM neural model: a siamese network, word hashing by letter trigrams, training on clicks with negative sampling.