Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.distoai.com/llms.txt

Use this file to discover all available pages before exploring further.

​
Introduction

Disto runs in its own Kubernetes cluster in your AWS environment. You can run Disto’s deploy script to create a Kubernetes cluster and deploy Disto on it.

​
Prerequisites

You will need to provide the values for the following arguments:
  • aws-region: the region you want to deploy Disto to.
  • aws-access-key-id: your AWS access key
  • aws-secret-access-key: your AWS secret access key
You can follow the instructions here to obtain your access key and secret access key, or create new ones.
  • s3-bucket-name: name of S3 bucket that will store configuration files.
Follow the instructions here to create an S3 bucket.
  • cognito-user-pool-id: name of your AWS Cognito user pool for managing Disto user accounts.
  • cognito-client-id: your AWS Cognito client ID
Follow the instructions here to create a user pool and client ID.
  • sagemaker-endpoint-name: The name of the endpoint from the deployed Sagemaker LLM.
  • sagemaker-region-name: your Sagemaker region name.
Follow the instructions here to deploy Disto’s LLM on Sagemaker.

​
Deployment

After you have obtained these values, follow the steps below.
  1. Ensure you have the following requirements:
    • Shell environment with eksctl, git, and kubectl.
  2. Clone the disto-deploy repository. 
    git clone https://github.com/mgorkove/disto-deploy
cd disto-deploy/
  3. Run the aws-deploy script 
    chmod +x ./aws-deploy.sh
./aws-deploy.sh \
 --s3-bucket-name "your_s3_bucket_name" \
 --aws-region "your_aws_region" \
 --cognito-user-pool-id "your_cognito_user_pool_id" \
 --cognito-client-id "your_cognito_client_id" \
 --sagemaker-endpoint-name "your_sagemaker_endpoint_name" \
 --sagemaker-region-name "your_sagemaker_region_name" \
 --aws-access-key-id "your_aws_access_key_id" \
 --aws-secret-access-key "your_aws_secret_access_key"
After the script is done, it will output the following: 
Access services via: <URL>
You can copy the URL into your browser and start using Disto.

​
Troubleshooting

The ingress controller may not have been created at the time the rest of the resources were deployed. Run the following command again:
kubectl apply -f deploy.yaml