Not sure if this RNN counts as a LLM, but if so would be nice to have it, let me know what needs to be done with packaging.
https://www.rwkv.com/
Not sure if this RNN counts as a LLM, but if so would be nice to have it, let me know what needs to be done with packaging.
https://www.rwkv.com/
4条答案
按热度按时间ldfqzlk81#
查看配置文件(config.json · RWKV/rwkv-5-world-1b5 at main),它看起来像是llama.cpp不支持的架构，因此我们暂时还无法支持它。
我们可以保留这个问题以追踪支持Rwkv5ForCausalLM的情况。
bvn4nwqk2#
This seems to be where discussion of RWKV support in Lllama.cpp is happening。到目前为止，这真的只是讨论。
oiopk7p53#
尤其是现在1.0版本(v5)和Eagle 7B已经发布。
6ioyuze24#
Seems like some work has already been done on this https://github.com/RWKV/rwkv.cpp