免费且开源的国产大模型-RWKV / ai #23

lemooljiang(76)

Published in

HIVE CN 中文社区

Words

257

Reading

2 min

Listen

Play

https://www.rwkv.com/

RWKV是一种无需注意力机制的循环神经网络，因此速度更快且更省显存。它还支持 GPT 模式并行训练。还好，名字不再是啥驼啊马的，改成鸟了。看来这帮搞大模型的也就这点恶趣味。

目前它已经在Hugging Face上开源，还制作了免费的API接口。我试着调用了下，效果还是不错的。

下载与资源

API节点

https://better-chat-rwkv.ai-creator.net/
https://rwkv.ai-creator.net/jpntuned/v1/chat/completions
https://rwkv.ai-creator.net/chntuned/v1/chat/completions

python使用

import requests

def send_get_request(prompt):
    try:
        url= "https://rwkv.ai-creator.net/chntuned/v1/chat/completions"
        message=[{"role": "user", "content": prompt}]
        data = {
            "messages":message,
            "temperature":0.3,
            "max_tokens":1500
        }
        headers = {'content-type': 'application/json', 'Authorization': 'Bearer '}
        response = requests.post(url=url, json=data, headers=headers)
        result = eval(response.text)
        response_text = result["choices"][0]["message"]["content"]
        print("res:",response_text)
        return ""

    except requests.exceptions.HTTPError as e:
        print('HTTPError:', e.response.status_code, e.response.reason)
    except requests.exceptions.RequestException as e:
        print('RequestException:', e)

response_data = send_get_request("introduce youself")
print(response_data)

nodejs使用

import fetch from "node-fetch"

const url= "https://rwkv.ai-creator.net/chntuned/v1/chat/completions"
async function test(){
    const response = await fetch(url, {
      method: 'POST',
      headers: {
        'content-type': 'application/json'
      },
      body: JSON.stringify({
        messages: [
          {"role": "system", "content": "You are a helpful assistant."},
          {"role": "user", "content": "介绍一下你自己"}
        ],
        "temperature":0.3,
      })
    })
        const result = await response.text()
    const res = JSON.parse(result)
    console.log(566, res.choices[0].message.content)

}
test()