
# top_bigrams

See https://confirmlabs.org/posts/catalog.html for details.

- `id0`: the first token in the bigram
- `id1`: the most common token following `id0` in The Pile
- `sum_count`: the number of times that `id0` appears in The Pile.
- `max_count`: the number of times that `id1` appears after `id0` in The Pile.
- `frac_max`: `max_count / sum_count`
- `token0`: the string representation of `id0`
- `token1`: the string representation of `id1`
- `seq`: the string representation of the bigram, `token0 token1`
- `p_{model_size}`: the probability of the bigram under Pythia-{model_size} when prompted with `id0`.

region:us
{}
TAGS
#region-us 


# top_bigrams

See URL for details.

- 'id0': the first token in the bigram
- 'id1': the most common token following 'id0' in The Pile
- 'sum_count': the number of times that 'id0' appears in The Pile.
- 'max_count': the number of times that 'id1' appears after 'id0' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'seq': the string representation of the bigram, 'token0 token1'
- 'p_{model_size}': the probability of the bigram under Pythia-{model_size} when prompted with 'id0'.

# top_bigrams

See URL for details.

- 'id0': the first token in the bigram
- 'id1': the most common token following 'id0' in The Pile
- 'sum_count': the number of times that 'id0' appears in The Pile.
- 'max_count': the number of times that 'id1' appears after 'id0' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'seq': the string representation of the bigram, 'token0 token1'
- 'p_{model_size}': the probability of the bigram under Pythia-{model_size} when prompted with 'id0'.
TAGS
#region-us 
 # top_bigrams

See URL for details.

- 'id0': the first token in the bigram
- 'id1': the most common token following 'id0' in The Pile
- 'sum_count': the number of times that 'id0' appears in The Pile.
- 'max_count': the number of times that 'id1' appears after 'id0' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'seq': the string representation of the bigram, 'token0 token1'
- 'p_{model_size}': the probability of the bigram under Pythia-{model_size} when prompted with 'id0'.
passage: TAGS
#region-us 
# top_bigrams

See URL for details.

- 'id0': the first token in the bigram
- 'id1': the most common token following 'id0' in The Pile
- 'sum_count': the number of times that 'id0' appears in The Pile.
- 'max_count': the number of times that 'id1' appears after 'id0' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'seq': the string representation of the bigram, 'token0 token1'
- 'p_{model_size}': the probability of the bigram under Pythia-{model_size} when prompted with 'id0'.