
# top_trigrams

See https://confirmlabs.org/posts/catalog.html for details.

- `id0`: the first token in the trigram
- `id1`: the second token in the trigram
- `id2`: the most common token following `(id0, id1)` in The Pile
- `sum_count`: the number of times that `(id0, id1)` appears in The Pile.
- `max_count`: the number of times that `id2` appears after `(id0, id1)` in The Pile.
- `frac_max`: `max_count / sum_count`
- `token0`: the string representation of `id0`
- `token1`: the string representation of `id1`
- `token2`: the string representation of `id2`
- `seq`: the string representation of the trigram, `token0 token1 token2`
- `p_{model_size}`: the probability of the trigram under Pythia-{model_size} when prompted with `(id0, id1)`.

region:us
{}
TAGS
#region-us 


# top_trigrams

See URL for details.

- 'id0': the first token in the trigram
- 'id1': the second token in the trigram
- 'id2': the most common token following '(id0, id1)' in The Pile
- 'sum_count': the number of times that '(id0, id1)' appears in The Pile.
- 'max_count': the number of times that 'id2' appears after '(id0, id1)' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'token2': the string representation of 'id2'
- 'seq': the string representation of the trigram, 'token0 token1 token2'
- 'p_{model_size}': the probability of the trigram under Pythia-{model_size} when prompted with '(id0, id1)'.

# top_trigrams

See URL for details.

- 'id0': the first token in the trigram
- 'id1': the second token in the trigram
- 'id2': the most common token following '(id0, id1)' in The Pile
- 'sum_count': the number of times that '(id0, id1)' appears in The Pile.
- 'max_count': the number of times that 'id2' appears after '(id0, id1)' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'token2': the string representation of 'id2'
- 'seq': the string representation of the trigram, 'token0 token1 token2'
- 'p_{model_size}': the probability of the trigram under Pythia-{model_size} when prompted with '(id0, id1)'.
TAGS
#region-us 
 # top_trigrams

See URL for details.

- 'id0': the first token in the trigram
- 'id1': the second token in the trigram
- 'id2': the most common token following '(id0, id1)' in The Pile
- 'sum_count': the number of times that '(id0, id1)' appears in The Pile.
- 'max_count': the number of times that 'id2' appears after '(id0, id1)' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'token2': the string representation of 'id2'
- 'seq': the string representation of the trigram, 'token0 token1 token2'
- 'p_{model_size}': the probability of the trigram under Pythia-{model_size} when prompted with '(id0, id1)'.
passage: TAGS
#region-us 
# top_trigrams

See URL for details.

- 'id0': the first token in the trigram
- 'id1': the second token in the trigram
- 'id2': the most common token following '(id0, id1)' in The Pile
- 'sum_count': the number of times that '(id0, id1)' appears in The Pile.
- 'max_count': the number of times that 'id2' appears after '(id0, id1)' in The Pile.
- 'frac_max': 'max_count / sum_count'
- 'token0': the string representation of 'id0'
- 'token1': the string representation of 'id1'
- 'token2': the string representation of 'id2'
- 'seq': the string representation of the trigram, 'token0 token1 token2'
- 'p_{model_size}': the probability of the trigram under Pythia-{model_size} when prompted with '(id0, id1)'.