> ## Documentation Index
> Fetch the complete documentation index at: https://docs.distoai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Deploy LLM on AWS Sagemaker

Disto uses the state-of-the-art Llama model from Meta as its underlying LLM. Follow the instructions below to deploy this LLM on AWS Sagemaker.

1. Go to "Amazon Sagemaker" in the AWS console. Click on "Studio" in the left sidebar.

<img height="70" src="https://mintcdn.com/disto/Fn7IlL7Fo_zKPZAm/images/sagemaker-studio.png?fit=max&auto=format&n=Fn7IlL7Fo_zKPZAm&q=85&s=c588ddee61d5086c0b075f06082afaf9" data-path="images/sagemaker-studio.png" />

2. Choose your user profile and click "Open Studio".

<img height="70" src="https://mintcdn.com/disto/ScZdLUgUm_F7bLvL/images/open-sagemaker-studio.png?fit=max&auto=format&n=ScZdLUgUm_F7bLvL&q=85&s=fa950edf0cb8a8c08ac175b888049381" data-path="images/open-sagemaker-studio.png" />

3. Click on "Jumpstart".

<img height="70" src="https://mintcdn.com/disto/ScZdLUgUm_F7bLvL/images/jumpstart.png?fit=max&auto=format&n=ScZdLUgUm_F7bLvL&q=85&s=4925ff533ca6bb424418d405cff735f6" data-path="images/jumpstart.png" />

4. Search for your preferred Llama model in the search bar and click on it. We recommend "Llama-2-70b-chat", as it is most accurate, but you can choose a smaller model if you wish.

<img height="70" src="https://mintcdn.com/disto/ScZdLUgUm_F7bLvL/images/llama-model.png?fit=max&auto=format&n=ScZdLUgUm_F7bLvL&q=85&s=332a51561caf426f493c6b2aee51a58c" data-path="images/llama-model.png" />

5. Click on "deploy". Wait for the model to deploy.

<img height="70" src="https://mintcdn.com/disto/ScZdLUgUm_F7bLvL/images/sagemaker-deploy.png?fit=max&auto=format&n=ScZdLUgUm_F7bLvL&q=85&s=fa5f2fd15f130b11e65457a7ea0e7f29" data-path="images/sagemaker-deploy.png" />

6. Copy your Endpoint name. This will be the value for **sagemaker-endpoint-name** in the deploy script.

<img height="70" src="https://mintcdn.com/disto/Fn7IlL7Fo_zKPZAm/images/sagemaker-endpoint-name.png?fit=max&auto=format&n=Fn7IlL7Fo_zKPZAm&q=85&s=ebe2ae29b213b17b6b4a0b7d66131296" data-path="images/sagemaker-endpoint-name.png" />

7. If you wish to delete the endpoint, click on "delete".

<img height="70" src="https://mintcdn.com/disto/ScZdLUgUm_F7bLvL/images/sagemaker-delete-endpoint.png?fit=max&auto=format&n=ScZdLUgUm_F7bLvL&q=85&s=3043e9d86c8485467d5f2a16d7cc60fe" data-path="images/sagemaker-delete-endpoint.png" />
