23ebe8fe11
fix some typos ( #2973 )
...
Signed-off-by: hishope <csqiye@126.com>
2024-03-06 22:50:11 -08:00
ce9f7c4674
Update api.md
2024-03-05 13:13:23 -08:00
3b4bab3dc5
Fix embeddings load model behavior ( #2848 )
2024-02-29 17:40:56 -08:00
1f087c4d26
Update langchain python tutorial ( #2737 )
...
Remove unused GPT4all
Use nomic-embed-text as embedded model
Fix a deprecation warning (__call__)
2024-02-25 00:31:36 -05:00
bdc0ea1ba5
Update import.md
2024-02-22 02:08:03 -05:00
7fab7918cc
Update import.md
2024-02-22 02:06:24 -05:00
f0425d3de9
Update faq.md
2024-02-20 20:44:45 -05:00
8125ce4cb6
Update import.md
...
Add instructions to get public key on windows
2024-02-19 22:48:24 -05:00
df56f1ee5e
Update faq.md
2024-02-19 22:16:42 -05:00
41aca5c2d0
Update faq.md
2024-02-19 21:11:01 -05:00
753724d867
Update api.md to include examples for reproducible outputs
2024-02-19 20:36:16 -05:00
9a7a4b9533
add faqs for memory pre-loading and the keep_alive setting ( #2601 )
2024-02-19 14:45:25 -08:00
b338c0635f
Document setting server vars for windows
2024-02-19 13:30:46 -08:00
9774663013
Update faq.md with the location of models on Windows ( #2545 )
2024-02-16 11:04:19 -08:00
1ba734de67
typo
2024-02-15 14:56:55 -08:00
29e90cc13b
Implement new Go based Desktop app
...
This focuses on Windows first, but coudl be used for Mac
and possibly linux in the future.
2024-02-15 05:56:45 +00:00
48a273f80b
Fix issues with templating prompt in chat mode ( #2460 )
2024-02-12 15:06:57 -08:00
1c8435ffa9
Update domain name references in docs and install script ( #2435 )
2024-02-09 15:19:30 -08:00
42b797ed9c
Update openai.md
2024-02-08 15:03:23 -05:00
336aa43f3c
Update openai.md
2024-02-08 12:48:28 -05:00
ab0d37fde4
Update openai.md
2024-02-07 17:25:33 -05:00
14e71350c8
Update openai.md
2024-02-07 17:25:24 -05:00
453f572f83
Initial OpenAI `/v1/chat/completions` API compatibility ( #2376 )
2024-02-07 17:24:29 -05:00
128fce5495
docs: keep_alive ( #2258 )
2024-02-06 11:00:05 -05:00
b9f91a0b36
Update import instructions to use convert and quantize tooling from llama.cpp submodule ( #2247 )
2024-02-05 00:50:44 -05:00
f0e9496c85
Update api.md
2024-02-02 12:17:24 -08:00
e7dbb00331
Add container hints for troubleshooting
...
Some users are new to containers and unsure where the server logs go
2024-01-29 08:53:41 -08:00
e02ecfb6c8
Merge pull request #2116 from dhiltgen/cc_50_80
...
Add support for CUDA 5.0 cards
2024-01-27 10:28:38 -08:00
5be9bdd444
Update modelfile.md
2024-01-25 16:29:48 -08:00
b706794905
Update modelfile.md to include `MESSAGE`
2024-01-25 16:29:32 -08:00
93a756266c
faq: update to use launchctl setenv
2024-01-22 13:10:13 -08:00
df54c723ae
Make CPU builds parallel and customizable AMD GPUs
...
The linux build now support parallel CPU builds to speed things up.
This also exposes AMD GPU targets as an optional setting for advaced
users who want to alter our default set.
2024-01-21 15:12:21 -08:00
a447a083f2
Add compute capability 5.0, 7.5, and 8.0
2024-01-20 14:24:05 -08:00
abec7f06e5
Merge pull request #2056 from dhiltgen/slog
...
Mechanical switch from log to slog
2024-01-18 14:27:24 -08:00
ecbfc0182f
Go bump to v1.21 to pick up slog
2024-01-18 14:12:57 -08:00
fedd705aea
Mechanical switch from log to slog
...
A few obvious levels were adjusted, but generally everything mapped to "info" level.
2024-01-18 14:12:57 -08:00
9cd20b0ec8
Refine the linux cuda/rocm developer docs
2024-01-18 09:44:44 -08:00
40a0a90a88
Add group delete to uninstall instructions ( #1924 )
...
After executing the `userdel ollama` command, I saw this message:
```sh
$ sudo userdel ollama
userdel: group ollama not removed because it has other members.
```
Which reminded me that I had to remove the dangling group too. For completeness, the uninstall instructions should do this too.
Thanks!
2024-01-12 00:07:00 -05:00
d88c527be3
Build multiple CPU variants and pick the best
...
This reduces the built-in linux version to not use any vector extensions
which enables the resulting builds to run under Rosetta on MacOS in
Docker. Then at runtime it checks for the actual CPU vector
extensions and loads the best CPU library available
2024-01-11 08:42:47 -08:00
e868c8a5c7
Update api.md ( #1878 )
...
Fixed assistant in the example response.
2024-01-09 16:21:17 -05:00
3f3eb19a3b
document response in modelfile template variables ( #1428 )
2024-01-08 14:38:51 -05:00
2d9dd14f27
Merge pull request #1697 from dhiltgen/win_docs
...
Add windows native build instructions
2024-01-05 19:34:20 -08:00
df086d3c8c
fix docker doc to point to hub
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2024-01-04 18:42:23 -08:00
b846eb64d0
Fix `template` api doc description ( #1661 )
2024-01-03 11:00:59 -05:00
3c5dd9ed1d
Update README.md ( #1766 )
2024-01-03 10:44:22 -05:00
b17ccd0542
Update import.md
2024-01-02 22:28:18 -05:00
2a2fa3c329
`api.md` cleanup & formatting
2023-12-27 14:32:35 -05:00
e201efa14b
Add windows native build instructions
2023-12-25 08:31:34 -08:00
10da41d677
Add Cache flag to api ( #1642 )
2023-12-22 17:16:20 -05:00
511069a2a5
update where are models stored q
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-12-22 09:48:44 -08:00
291700c92d
Clean up documentation ( #1506 )
...
* Clean up documentation
Will probably need to update with PRs for new release.
Signed-off-by: Matt Williams <m@technovangelist.com>
* Correcting to fit in 0.1.15 changes
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* addressing comments
Signed-off-by: Matt Williams <m@technovangelist.com>
* more api cleanup
Signed-off-by: Matt Williams <m@technovangelist.com>
* its llava not llama
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update docs/troubleshooting.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Updated hosting to server and documented all env vars
Signed-off-by: Matt Williams <m@technovangelist.com>
* remove last of the cli descriptions
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* update further per conversation with jeff earlier today
Signed-off-by: Matt Williams <m@technovangelist.com>
* cleanup the doc readme
Signed-off-by: Matt Williams <m@technovangelist.com>
* move upgrade to faq
Signed-off-by: Matt Williams <m@technovangelist.com>
* first change
Signed-off-by: Matt Williams <m@technovangelist.com>
* updated
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update docs/faq.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* examples in parent
Signed-off-by: Matt Williams <m@technovangelist.com>
* add exapmle for create model.
Signed-off-by: Matt Williams <m@technovangelist.com>
* update faq
Signed-off-by: Matt Williams <m@technovangelist.com>
* update create model api
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update docs/api.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/faq.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/troubleshooting.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* update the readme in docs
Signed-off-by: Matt Williams <m@technovangelist.com>
* update a few more things
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update docs/troubleshooting.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/faq.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/modelfile.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
* Update docs/troubleshooting.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
---------
Signed-off-by: Matt Williams <m@technovangelist.com>
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
2023-12-22 09:10:01 -08:00
e5202eb687
Quiet down llama.cpp logging by default
...
By default builds will now produce non-debug and non-verbose binaries.
To enable verbose logs in llama.cpp and debug symbols in the
native code, set `CGO_CFLAGS=-g`
2023-12-22 08:47:18 -08:00
96fb441abd
Merge pull request #1146 from dhiltgen/ext_server_cgo
...
Add cgo implementation for llama.cpp
2023-12-22 08:16:31 -08:00
495c06e4a6
Fix doc glitch
2023-12-21 18:21:31 -08:00
a607d922f0
add FAQ for slow networking in WSL2 ( #1646 )
2023-12-20 16:27:24 -08:00
df06812494
Update api.md
2023-12-20 08:47:53 -05:00
1b991d0ba9
Refine build to support CPU only
...
If someone checks out the ollama repo and doesn't install the CUDA
library, this will ensure they can build a CPU only version
2023-12-19 09:05:46 -08:00
811b1f03c8
deprecate ggml
...
- remove ggml runner
- automatically pull gguf models when ggml detected
- tell users to update to gguf in the case automatic pull fails
Co-Authored-By: Jeffrey Morgan <jmorganca@gmail.com>
2023-12-19 09:05:46 -08:00
6e16098a60
remove sample_count from docs ( #1527 )
...
this info has not been returned from these endpoints in some time
2023-12-14 17:49:00 -05:00
fedba24a63
Docs for multimodal support ( #1485 )
...
* add multimodal docs
* add chat api docs
* consistency between `/api/generate` and `/api/chat`
* simplify docs
2023-12-13 13:59:33 -05:00
e3b090dbc5
Added message format for chat api ( #1488 )
2023-12-13 11:21:23 -05:00
0a9d348023
Fix issues with `/set template` and `/set system` ( #1486 )
2023-12-12 14:43:19 -05:00
910e9401d0
Multimodal support ( #1216 )
...
---------
Co-authored-by: Matt Apperson <mattapperson@Matts-MacBook-Pro.local>
2023-12-11 13:56:22 -08:00
5d4d2e2c60
update docs with chat completion api
2023-12-10 13:53:36 -05:00
32064a0646
fix empty response when receiving runner error
2023-12-10 10:53:38 -05:00
b74580c913
Update api.md
2023-12-08 16:02:07 -08:00
2a2289fb6b
Update api.md
2023-12-08 09:36:45 -08:00
ba264e9da8
add future version note to chat api docs
2023-12-07 09:42:15 -08:00
f9b7d65e2b
docs/tutorials: add bit on how to use Fly GPUs on-demand with Ollama ( #1406 )
...
Signed-off-by: Xe Iaso <xe@camellia.finch-kitefin.ts.net>
2023-12-06 14:14:02 -08:00
13524b5e72
List "Send chat messages" in table of contents ( #1399 )
...
Thank you @calderonsamuel
2023-12-06 12:34:27 -08:00
97c5696945
fix base urls in chat examples
2023-12-06 12:10:20 -08:00
195e3d9dbd
chat api endpoint ( #1392 )
2023-12-05 14:57:33 -05:00
00d06619a1
Revert "chat api ( #991 )" while context variable is fixed
...
This reverts commit 7a0899d62d
2023-12-04 21:16:27 -08:00
f1ef3f9947
remove mention of gpt-neox in import ( #1381 )
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-12-04 20:58:10 -08:00
7a0899d62d
chat api ( #991 )
...
- update chat docs
- add messages chat endpoint
- remove deprecated context and template generate parameters from docs
- context and template are still supported for the time being and will continue to work as expected
- add partial response to chat history
2023-12-04 18:01:06 -05:00
7eda3d0c55
Corrected transposed 129 to 192 for OLLAMA_ORIGINS example ( #1325 )
2023-11-29 22:44:17 -05:00
91897a606f
Add OllamaEmbeddings to python LangChain example ( #994 )
...
* Add OllamaEmbeddings to python LangChain example
* typo
---------
Co-authored-by: Alec Hammond <alechammond@fb.com>
2023-11-29 16:25:39 -05:00
63097607b2
Correct MacOS Host port example ( #1301 )
2023-11-29 11:44:03 -05:00
e1a69d44c9
Update faq.md ( #1299 )
...
Fix a typo in the CA update command
2023-11-28 09:54:42 -05:00
2eaa95b417
Update api.md
2023-11-21 15:32:05 -05:00
f24741ff39
Documenting how to view `Modelfile`s ( #723 )
...
* Documented viewing Modelfiles in ollama.ai/library
* Moved Modelfile in ollama.ai down per request
2023-11-20 15:24:29 -05:00
1657c6abc7
add note to specify JSON in the prompt when using JSON mode
2023-11-18 22:59:26 -05:00
c82ead4d01
faq: fix heading and add more details
2023-11-17 09:02:17 -08:00
90860b6a7e
update faq ( #1176 )
2023-11-17 11:42:58 -05:00
81092147c4
remove unnecessary `-X POST` from example `curl` commands
2023-11-17 09:50:38 -05:00
92656a74b7
Use `llama2` as the model in `api.md`
2023-11-17 07:17:51 -05:00
d8842b4d4b
update faq
2023-11-16 17:07:36 -08:00
c13bde962d
Update docs/faq.md
...
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
2023-11-16 16:48:38 -08:00
ee307937fd
update faq
2023-11-16 16:46:43 -08:00
b5f158f046
add faq for proxies ( #1147 )
2023-11-16 11:43:37 -05:00
77954bea0e
Merge pull request #898 from jmorganca/mxyng/build-context
...
create remote models
2023-11-15 16:41:12 -08:00
54f92f01cb
update docs
2023-11-15 15:28:15 -08:00
ecd71347ab
Update faq.md
2023-11-15 18:17:13 -05:00
8ee4cbea0f
Remove table of contents in `faq.md`
2023-11-15 18:16:27 -05:00
71d71d0988
update docs
2023-11-15 15:16:23 -08:00
cac11c9137
update api docs
2023-11-15 15:16:23 -08:00
f61f340279
FAQ: answer a few faq questions ( #1128 )
...
* faq: does ollama share my prompts
Signed-off-by: Matt Williams <m@technovangelist.com>
* faq: ollama and openai
Signed-off-by: Matt Williams <m@technovangelist.com>
* faq: vscode plugins
Signed-off-by: Matt Williams <m@technovangelist.com>
* faq: send a doc to Ollama
Signed-off-by: Matt Williams <m@technovangelist.com>
* extra spacing
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update faq.md
* Update faq.md
---------
Signed-off-by: Matt Williams <m@technovangelist.com>
Co-authored-by: Michael <mchiang0610@users.noreply.github.com>
2023-11-15 18:05:13 -05:00
85951d25ef
Created tutorial for running Ollama on NVIDIA Jetson devices ( #1098 )
2023-11-15 12:32:37 -05:00
df18486c35
Move /generate format to optional parameters ( #1127 )
...
This field is optional and should be under the `Advanced parameters` header
2023-11-14 16:12:30 -05:00
5cba29b9d6
JSON mode: add `"format" as an api parameter ( #1051 )
...
* add `"format": "json"` as an API parameter
---------
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
2023-11-09 16:44:02 -08:00
5b39503bcd
document specifying multiple stop params ( #1061 )
2023-11-09 13:16:26 -08:00
dd3dc47ddb
Merge pull request #992 from aashish2057/aashish2057/langchainjs_doc_update
2023-11-09 05:08:31 -08:00
a49d6acc1e
add a complete /generate options example ( #1035 )
2023-11-08 16:44:36 -08:00
ec2a31e9b3
support raw generation requests ( #952 )
...
- add the optional `raw` generate request parameter to bypass prompt formatting and response context
-add raw request to docs
2023-11-08 14:05:02 -08:00
1d155caba3
docs: clarify where the models are stored in the faq
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-11-06 14:38:49 -08:00
b13586cc72
update langchainjs doc
2023-11-03 18:45:19 -05:00
6109bebba6
reformat api docs for more examples ( #972 )
2023-11-03 10:57:00 -04:00
f21bd6210d
docs: clarify and clean up API docs
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-10-31 13:11:33 -07:00
874bb31986
Fix conversion command for gptneox ( #948 )
2023-10-30 14:34:29 -04:00
c0dcea1398
Update faq.md
2023-10-27 18:29:00 -07:00
5c3491f425
allow for a configurable ollama model storage directory ( #897 )
...
* allow for a configurable ollama models directory
- set OLLAMA_MODELS in the environment that ollama is running in to change where model files are stored
- update docs
Co-Authored-By: Jeffrey Morgan <jmorganca@gmail.com>
Co-Authored-By: Jay Nakrani <dhananjaynakrani@gmail.com>
Co-Authored-By: Akhil Acharya <akhilcacharya@gmail.com>
Co-Authored-By: Sasha Devol <sasha.devol@protonmail.com>
2023-10-27 10:19:59 -04:00
92119de9d8
update linux.md
2023-10-25 14:57:50 -07:00
53b0ba8d43
Merge pull request #893 from jmorganca/mxyng/update-faq
...
update faq
2023-10-24 16:02:35 -07:00
db342691f9
Update docs/faq.md
...
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
2023-10-24 13:59:33 -07:00
cecf83141e
Linux uninstall instructions ( #894 )
2023-10-24 14:07:05 -04:00
a5a2adf1ec
update faq
2023-10-24 10:54:16 -07:00
914428351a
Update import.md
2023-10-23 17:44:53 -07:00
9afea9e3b9
Update import.md
...
Separate GGUF and PyTorch guides
2023-10-23 17:42:17 -07:00
6b213216d5
Update import.md
2023-10-19 12:17:36 -04:00
b7e137323a
Fix a typo ( #818 )
2023-10-17 09:00:15 -04:00
a0c3e989de
deprecate modelfile embed command ( #759 )
2023-10-16 11:07:37 -04:00
f9b2f999ac
update readme with `docker` setup and link to `import.md`
2023-10-15 02:23:03 -04:00
c416087339
`import.md`: formatting and spelling
2023-10-15 01:39:46 -04:00
6002cebd2c
`import.md`: convert and quantize docs
2023-10-15 00:11:51 -04:00
212bdc541c
`import.md`: model architectures spelling
2023-10-15 00:07:58 -04:00
dca6686273
add steps for creating a Modelfile and more example commands to `import.md`
2023-10-15 00:05:50 -04:00
b2974a7095
applied mikes comments
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-10-14 08:29:24 -07:00
3c975f898f
update doc to refer to docker image
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-10-12 15:57:50 -07:00
9245c8a1df
add how to quantize doc
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-10-12 15:34:57 -07:00
274d5a5fdf
optional parameter to not stream response ( #639 )
...
* update streaming request accept header
* add optional stream param to request bodies
2023-10-11 12:54:27 -04:00
f7f5169c94
Update api.md ( #741 )
...
Avoid triple ticks in visual editor and also copied in clipboard.
2023-10-09 16:01:46 -04:00
6f2ce74231
Got rif of all caps to show it can be lower case
2023-10-02 13:54:27 -07:00
6edcc5c79f
Using code highlighting syntax around Modelfile
2023-10-02 13:46:05 -07:00
4fc10acce9
add some missing code directives in docs ( #664 )
2023-10-01 11:51:01 -07:00
1d0ebe67e8
Document response stream chunk delimiter. ( #632 )
...
Document response stream chunk delimiter.
2023-09-29 21:45:52 -07:00
6ae33d8141
Update modelfile.md to reflect the usage of num_gpu. ( #629 )
2023-09-28 10:21:21 -04:00
c5664c1fef
Update faq.md
2023-09-27 13:49:43 -07:00
ed20837f9a
Update modelfile.md
2023-09-27 10:38:10 -04:00
1db2a61dd0
Added num_predict to the options table ( #614 )
2023-09-27 10:26:08 -04:00
5306b0269d
Update linux.md
2023-09-25 16:10:32 -07:00
0fb5268496
Update linux.md
2023-09-25 10:06:23 -07:00
ee3032ad89
improvements to `docs/linux.md`
2023-09-24 21:50:07 -07:00
5b7a27281d
improvements to `docs/linux.md`
2023-09-24 21:38:23 -07:00
d2a784e33e
add `docs/linux.md`
2023-09-24 21:34:44 -07:00
6c6a31a1e8
embed libraries using cmake
2023-09-20 14:41:57 -07:00
fc6ec356fc
remove libcuda.so
2023-09-20 20:36:14 +01:00
1255bc9b45
only package 11.8 runner
2023-09-20 20:00:41 +01:00
4e8be787c7
pack in cuda libs
2023-09-20 17:40:42 +01:00
2540c9181c
support for packaging in multiple cuda runners ( #509 )
...
* enable packaging multiple cuda versions
* use nvcc cuda version if available
---------
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-09-14 15:08:13 -04:00
fc8707686f
Update API docs ( #527 )
...
* Update API docs
Signed-off-by: Matt Williams <m@technovangelist.com>
* strange TOC was getting auto generated
Signed-off-by: Matt Williams <m@technovangelist.com>
* Update docs/api.md
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
* Update docs/api.md
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
* Update docs/api.md
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
* Update api.md
---------
Signed-off-by: Matt Williams <m@technovangelist.com>
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
Co-authored-by: Michael Chiang <mchiang0610@users.noreply.github.com>
2023-09-14 08:51:26 -07:00
f221637053
first pass at linux gpu support ( #454 )
...
* linux gpu support
* handle multiple gpus
* add cuda docker image (#488 )
---------
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-09-12 11:04:35 -04:00
154f24af91
Added missing options params to the embeddings docs ( #472 )
2023-09-05 20:18:49 -04:00
42998d797d
subprocess llama.cpp server ( #401 )
...
* remove c code
* pack llama.cpp
* use request context for llama_cpp
* let llama_cpp decide the number of threads to use
* stop llama runner when app stops
* remove sample count and duration metrics
* use go generate to get libraries
* tmp dir for running llm
2023-08-30 16:35:03 -04:00
f4432e1dba
treat stop as stop sequences, not exact tokens ( #442 )
...
The `stop` option to the generate API is a list of sequences that should cause generation to stop. Although these are commonly called "stop tokens", they do not necessarily correspond to LLM tokens (per the LLM's tokenizer). For example, if the caller sends a generate request with `"stop":["\n"]`, then generation should stop on any token containing `\n` (and trim `\n` from the output), not just if the token exactly matches `\n`. If `stop` were interpreted strictly as LLM tokens, then it would require callers of the generate API to know the LLM's tokenizer and enumerate many tokens in the `stop` list.
Fixes https://github.com/jmorganca/ollama/issues/295 .
2023-08-30 11:53:42 -04:00
d3b838ce60
update `orca` to `orca-mini`
2023-08-27 13:26:30 -04:00
041f9ad1a1
update README.md
2023-08-25 11:44:25 -07:00
519f4d98ef
add embed docs for modelfile
2023-08-17 13:37:42 -04:00
23e1da778d
Add context to api docs
2023-08-15 11:43:22 -03:00
53bc36d207
Update modelfile.md
2023-08-15 09:23:36 -03:00
af98a1773f
update python example
2023-08-14 16:38:44 -03:00
9ae9a89883
Update modelfile.md
2023-08-14 16:26:53 -03:00
648f0974c6
python example
2023-08-14 15:27:13 -03:00
fc5230dffa
Add context to api docs
2023-08-14 15:23:24 -03:00
4c33a9ac67
Update langchainpy.md
...
base_url value for Ollama object creation is corrected.
2023-08-14 12:12:56 +03:00
202c29c21a
resolving bmacd comment
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-11 13:51:44 -07:00
c1c871620a
Update docs/tutorials/langchainjs.md
...
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
2023-08-11 13:48:46 -07:00
a21a8bef56
Update docs/tutorials/langchainjs.md
...
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
2023-08-11 13:48:35 -07:00
522726228a
Update docs/tutorials.md
...
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
2023-08-11 13:48:16 -07:00
d3ee1329e9
Add tutorials for using Langchain with ollama
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-10 21:27:37 -07:00
3a05d3def7
Merge pull request #326 from asarturas/document-num-gqa-parameter
...
Document num_gqa parameter
2023-08-10 18:18:38 -07:00
d9c2687fd0
document default num_gqa to 1, as it's applicable to most models
...
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-08-11 01:29:40 +01:00
6517bcc53c
Merge pull request #290 from jmorganca/add-adapter-layers
...
implement loading ggml lora adapters through the modelfile
2023-08-10 17:23:01 -07:00
c0e7a3b90e
Document num_gqa parameter
...
It is required to be adjusted for some models, see https://github.com/jmorganca/ollama/issues/320 for more context
2023-08-11 00:58:09 +01:00
be889b2f81
add docs for `/api/embeddings`
2023-08-10 15:56:59 -07:00
7e26a8df31
cmd: use environment variables for server options
2023-08-10 14:17:53 -07:00
37c9a8eea9
add lora docs
2023-08-10 09:23:40 -07:00
43c40c500e
add embed docs for modelfile
2023-08-09 16:14:58 -04:00
c4861360ec
remove embed docs
2023-08-09 16:14:19 -04:00
7a5f3616fd
embed text document in modelfile
2023-08-09 10:26:19 -04:00
371d4e5df3
docs: fix invalid json in `api.md`
2023-08-08 15:46:05 -07:00
1f78e409b4
docs: format with `prettier`
2023-08-08 15:41:48 -07:00
34a88cd776
docs: update `api.md` formatting
2023-08-08 15:41:19 -07:00
1bee2347be
pr feedback
...
- defer closing llm on embedding
- do not override licenses
- remove debugging print line
- reformat model file docs
2023-08-08 17:01:37 -04:00
3ceac05108
Add embedding docs
2023-08-08 14:04:11 -04:00
1267895e44
missed a backtick
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-07 13:53:49 -07:00
0c52b4509b
get rid of namespace and site
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-07 13:27:58 -07:00
13aace3d34
clarify some more
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-07 13:21:54 -07:00
2b3bb41598
model name format added
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-07 13:17:16 -07:00
4904cd8bcd
update simpler code samples
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-07 07:40:38 -07:00
8a45359ec6
Update docs/api.md
...
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
2023-08-07 07:33:05 -07:00
2544b8afa1
update as per Mike's comments
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 17:42:24 -07:00
ac1b04f271
Update docs/api.md
...
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-08-04 17:40:52 -07:00
123fdeb919
Update docs/api.md
...
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-08-04 17:38:52 -07:00
5c82bf95d1
Update docs/api.md
...
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-08-04 17:12:24 -07:00
38a9b1618c
missed some quotes
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 16:09:07 -07:00
c18be72a3b
complete 1st draft of api docs
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 16:08:11 -07:00
a101fe51a7
clean up
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 12:56:41 -07:00
d93e2f9210
fleshing out response
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 12:38:58 -07:00
31edc829fc
continuing
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 12:30:23 -07:00
b31104768c
filling out generate
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 12:27:47 -07:00
b662d9fd8c
starting to build out some docs
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-08-04 11:55:00 -07:00
da2459d519
Update README.md ( #265 )
2023-08-02 22:38:32 -04:00
47bda0b860
add stop to docs
2023-07-28 12:30:27 -04:00
fee7687cf3
Update modelfile.md
2023-07-27 15:15:10 -04:00
1ac38ec89c
improve modelfile docs
2023-07-27 15:13:04 -04:00
24e43e3212
update development.md
2023-07-24 09:43:57 -07:00
65d93a86b2
Update modelfile.md ( #177 )
...
fix markdown.
2023-07-22 08:19:30 -07:00
52f04e39f2
Note that CGO must be enabled in dev docs
2023-07-21 22:36:36 +02:00
31f0cb7742
new `Modelfile` syntax
2023-07-20 07:52:24 -07:00
8945b25484
new modelfile syntax on branch
2023-07-20 02:24:21 -07:00
7c6ea2a966
fix dangling """
2023-07-19 23:24:32 -07:00
c161aef5f9
update example
2023-07-19 23:24:32 -07:00
c47786c1b0
Update docs/modelfile.md
...
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-07-19 23:24:32 -07:00
df100ce540
Update docs/modelfile.md
...
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-07-19 23:24:32 -07:00
5c5948b4e7
clean up my previous empty sentences
2023-07-19 23:24:32 -07:00
1c72e46e09
update modelfile.md
2023-07-19 23:24:32 -07:00
25f874c030
Update modelfile.md
2023-07-19 12:48:57 -07:00
7fbdc8e2c1
Update modelfile.md
2023-07-19 11:38:06 -07:00
67c8d49757
Updated modelfile doc to include license
...
and attributed midjourneyprompt
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-07-19 07:16:38 -07:00
9310ee3967
First stab at a modelfile doc
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-07-18 08:22:17 -07:00
3d9498dc95
Some simple modelfile examples
...
Signed-off-by: Matt Williams <m@technovangelist.com>
2023-07-17 17:16:59 -07:00
6fdea03049
docs: remove `python.md`
2023-07-14 21:41:46 -07:00
1358e27b77
add publish script
2023-07-07 12:59:45 -04:00
55898a3382
Move python docs to separate file
2023-07-01 17:54:29 -04:00
9811956938
update development.md
2023-06-28 12:41:30 -07:00
9ba58c8a9e
move desktop docs to `desktop/`
2023-06-28 11:29:29 -04:00
9f868d8258
move desktop docs to `desktop/`
2023-06-28 11:27:18 -04:00
4018b3c533
poetry development
2023-06-28 11:17:08 -04:00
ecfb4abafb
simplify loading
2023-06-27 14:50:30 -04:00
2906cbab11
Update development.md
2023-06-27 14:07:31 -04:00
9d14e75185
Update development.md
2023-06-27 14:06:59 -04:00
a2745f8174
Update development.md
2023-06-27 14:06:49 -04:00
20cdd9fee6
update `README.md`
2023-06-27 13:51:20 -04:00
11614b6d84
add development doc
2023-06-27 13:46:46 -04:00
John
Jeffrey Morgan
elthommy
Patrick Devine
Daniel Hiltgen
Tristan Rhodes
Bruce MacDonald
Daniel Hiltgen
Michael Yang
Tristram Oaten
Robin Glauser
Matt Williams
Cole Gillespie
Daniel Hiltgen
K0IN
pepperoni21
Xe Iaso
Samuel Calderon
James Radtke
Alec Hammond
ToasterUwU
ftorto
James Braza
bnodnarb
aashish2057
Dirk Loss
Alexander F. Rødseth
Costa Alexoglou
Jiayu Liu
Jay Nakrani
Aaron Coffey
Ackermann Yuriy
Quinn Slack
Güvenç Usanmaz
Arturas Smorgun
Ikko Eltociear Ashimine
Michael Chiang
Michael Yang