WARNING: this adds the Redwood 2L Attn Only tokenizer for compatibility with transformer lens. I think this implementation is correct, though check against the reference tokenizer here: https://github.com/redwoodresearch/rust_circuit_public/blob/42c3fcbffbc367897d3a810b20c12d7c1c99a00d/python/rust_circuit/module_library.py#L1012
{}
region:us
TAGS
#region-us 

WARNING: this adds the Redwood 2L Attn Only tokenizer for compatibility with transformer lens. I think this implementation is correct, though check against the reference tokenizer here: URL
TAGS
#region-us 

TAGS
#region-us 
