Skip to content

Commit f45aa6b

Browse files
authored
Update readme.md
1 parent 1547d22 commit f45aa6b

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

LLM/readme.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,14 @@
11
# Large Language Models in OCI Data Science
2+
3+
OCI Data Science can be used to fine-tune, deploy, and manage Large Langugage Models (LLMs) effectively, efficiently, and easily.
4+
This page curates the links to some common use cases for LLMs.
5+
6+
[Fine tune Llama 2 with distributed multi-node, multi-GPU job](https://github.com/oracle-samples/oci-data-science-ai-samples/tree/main/distributed_training/llama2)
7+
8+
[Quantize Llama 2 70B to 4 bits and deploy on 2xA10s](tbd)
9+
10+
[Deploy Llama 2 on fully service managed deployment using TGI or vLLM](https://github.com/oracle-samples/oci-data-science-ai-samples/tree/master/model-deployment/containers/llama2)
11+
12+
[Deploy Mistral 7B](https://github.com/oracle-samples/oci-data-science-ai-samples/tree/main/model-deployment/containers/llm/mistral)
13+
14+
[Deploy GPT-2 using NVidia Triton Inference Server](https://github.com/oracle-samples/oci-data-science-ai-samples/blob/main/model-deployment/containers/Triton/gpt2_ensemble/Deploy_GPT2_Ensemble.md)

0 commit comments

Comments
 (0)