llama llama-2 golang license:other region:us
---
license: other
license_link: https://ai.meta.com/llama/license/
inference: false
tags:
  - llama
  - llama-2
  - golang
---

# llama2.go

this is a model for [llama2.go](https://github.com/lwch/llama2.go) project, this project can run meta LLaMA model in less memory like Raspberry Pi.

## memory usage

| Model | Precision | Memory | Memory(Cached Params) |
| ----- | --------- | ------ | --------------------- |
| 7B  | bf16 | 600M+ | 25G+ |
| 13B | bf16 | 1G+ | 43G+ |
| 70B | bf16 | 3G+ | untest |