GraphAgent

/

GraphAgent-8B

like 3

New architecture that's not supported in llama.cpp yet :')

@bartowski thanks for the info. I thought this model is based on Llama3 8B, but you're right, there's another "HeteroGraphLLMForCausalLM" architecture in config.json.

So maybe @GraphAgent can shed some light on this.

Thanks for the discussion. We will consider implement it with llama.cpp with reference to that of Llava, if any.
It is worth mention that we have basically very similar architecture with Llava, code reference: https://github.com/HKUDS/GraphAgent/blob/main/GraphAgent-inference/graph_action_agent/graphllm/graphllm.py

We would appreciate any forms of contribution! :)