lerot.comparison

class lerot.comparison.BalancedInterleave(arg_str=None)

Bases: lerot.comparison.AbstractInterleavedComparison.AbstractInterleavedComparison

Interleave and compare rankers using the original balanced interleave method.

infer_outcome(l, a, c, query)

interleave(r1, r2, query, length)

class lerot.comparison.DocumentConstraints(arg_str='random')

Bases: lerot.comparison.AbstractInterleavedComparison.AbstractInterleavedComparison

Interleave using balanced interleave, compare using document constraints.

check_constraints(l, a, click_ids)

infer_outcome(l, a, c, query)

interleave(r1, r2, query, length)

class lerot.comparison.HistBalancedInterleave(arg_str=None)

Bases: lerot.comparison.AbstractHistInterleavedComparison.AbstractHistInterleavedComparison

Balanced interleave method, applied to historical data.

infer_outcome(l, a, c, target_r1, target_r2, query)

count clicks within the top-k interleaved list

class lerot.comparison.HistDocumentConstraints(arg_str=None)

Bases: lerot.comparison.AbstractHistInterleavedComparison.AbstractHistInterleavedComparison

Document constraints method, applied to historical data.

infer_outcome(l, a, c, target_r1, target_r2, query)

count clicks within the top-k interleaved list

class lerot.comparison.HistProbabilisticInterleave(arg_str=None)

Bases: lerot.comparison.AbstractHistInterleavedComparison.AbstractHistInterleavedComparison

Probabilistic interleaving using historical data

infer_outcome(l, source_context, c, target_r1, target_r2, query)

class lerot.comparison.HistTeamDraft(arg_str=None)

Bases: lerot.comparison.AbstractHistInterleavedComparison.AbstractHistInterleavedComparison

Team draft method, applied to historical data.

infer_outcome(l, a, c, target_r1, target_r2, query)

assign clicks for contributed documents

class lerot.comparison.OptimizedInterleave(arg_str='')

Bases: lerot.comparison.AbstractInterleavedComparison.AbstractInterleavedComparison

An implementation of Optimized Interleave as described in:

@see: Radlinski, F., & Craswell, N. (2013, February). Optimized interleaving for online retrieval evaluation. In Proceedings of the sixth ACM international conference on Web search and data mining (pp. 245-254).

@author: Anne Schuth @contact: anne.schuth@uva.nl @since: February 2013 @requires: Gurobi from http://www.gurobi.com/

binary_credit(li, rankA, rankB)

f(i)

infer_outcome(l, credit, clicks, query)

interleave(r1, r2, query, length, bias=0)

interleave_n(r1, r2, query, length, num_repeat, bias=0)

inverse_credit(li, rankA, rankB)

linear_credit(li, rankA, rankB)

perm_given_index(alist, apermindex)

See http://stackoverflow.com/questions/5602488/random-picks-from-permutation-generator

precompute_rank(R)

prefix_constraint(rankings, length)

prefix_constraint_bound(rankings, length, prefix_bound)

rank(li, R)

reject(l, rankings)

sample(docs, length)

sample_prefix_constraint(rankings, length)

sample_prefix_constraint_constructive(rankings, length)

class lerot.comparison.OptimizedInterleaveVa(arg_str=None)

Bases: lerot.comparison.OptimizedInterleave.OptimizedInterleave

precompute_rank_va(R)

prefix_constraint_va(rankings, length)

class lerot.comparison.ProbabilisticInterleave(arg_str=None)

Bases: lerot.comparison.AbstractInterleavedComparison.AbstractInterleavedComparison

Probabilistic interleaving, marginalizes over assignments

get_probability_of_list(result_list, context, query)

infer_outcome(l, a, c, query)

interleave(r1, r2, query, length)

class lerot.comparison.ProbabilisticInterleaveWithHistory(arg_str)

Bases: lerot.comparison.ProbabilisticInterleave.ProbabilisticInterleave

Probabilistic interleaving that reuses historic data (with importance sampling).

infer_outcome(l, context, c, query)

class lerot.comparison.StochasticBalancedInterleave(arg_str)

Bases: lerot.comparison.AbstractInterleavedComparison.AbstractInterleavedComparison

Interleave and compare rankers using the stochastic interleave method introduced in Hofmann et al. ECIR‘11.

infer_outcome(l, a, c, query)

interleave(r1, r2, query, length)

class lerot.comparison.TeamDraft(arg_str=None)

Bases: lerot.comparison.AbstractInterleavedComparison.AbstractInterleavedComparison

Baseline team draft method.

infer_outcome(l, a, c, query)

assign clicks for contributed documents

interleave(r1, r2, query, length1=None)

updated to match the original method

class lerot.comparison.VaTdi(arg_str=None)

Bases: lerot.comparison.TeamDraft.TeamDraft

Algorithm described in https://bitbucket.org/varepsilon/tois2013-interleaving

interleave(r1, r2, query, length=None)

static sampleSmoothly(a, b, maxVal)