mii/llama.cpp
1
0
Fork 0
mirror of https://github.com/mii443/llama.cpp.git synced 2025-08-22 15:05:34 +00:00
Code Issues Packages Projects Releases Wiki Activity

add API description

Browse Source
This commit is contained in:
mii
2023-03-16 12:55:51 +00:00
parent 8c91c48552
commit 11eabb4350
1 changed files with 25 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

25
README.md
View File

@ -1,3 +1,28 @@
Send the following json towards port 18080 and you will get a response.
```json
{
"messages": [
{
"role": "user",
"content": "Hello!"
},
{
"role": "ai",
"content": " Good to meet you! I am Bob! Welcome to my world!"
},
{
"role": "user",
"content": "Where is the capital of Japan?"
}
]
}
```
Also, the startup command is as follows
```
./main -m ./models/7B/ggml-model-q4_0.bin -t 24 -n 128 --repeat_penalty 1.0 -i -r "User:"
```
# llama.cpp # llama.cpp
[![Actions Status](https://github.com/ggerganov/llama.cpp/workflows/CI/badge.svg)](https://github.com/ggerganov/llama.cpp/actions) [![Actions Status](https://github.com/ggerganov/llama.cpp/workflows/CI/badge.svg)](https://github.com/ggerganov/llama.cpp/actions)