Disto runs in its own Kubernetes cluster in your AWS environment. You can run Disto’s deploy script to create a Kubernetes cluster and deploy Disto on it.
You will need to provide the values for the following arguments:
aws-region
: the region you want to deploy Disto to.aws-access-key-id
: your AWS access keyaws-secret-access-key
: your AWS secret access keyYou can follow the instructions here to obtain your access key and secret access key, or create new ones.
s3-bucket-name
: name of S3 bucket that will store configuration files.Follow the instructions here to create an S3 bucket.
cognito-user-pool-id
: name of your AWS Cognito user pool for managing Disto user accounts.cognito-client-id
: your AWS Cognito client IDFollow the instructions here to create a user pool and client ID.
sagemaker-endpoint-name
: The name of the endpoint from the deployed Sagemaker LLM.sagemaker-region-name
: your Sagemaker region name.Follow the instructions here to deploy Disto’s LLM on Sagemaker.
After you have obtained these values, follow the steps below.
Ensure you have the following requirements:
eksctl
, git
, and kubectl
.Clone the disto-deploy repository.
Run the aws-deploy script
After the script is done, it will output the following:
You can copy the URL into your browser and start using Disto.
Internal error occurred: failed calling webhook 'validate.nginx.ingress.kubernetes.io'
The ingress controller may not have been created at the time the rest of the resources were deployed. Run the following command again:
Disto runs in its own Kubernetes cluster in your AWS environment. You can run Disto’s deploy script to create a Kubernetes cluster and deploy Disto on it.
You will need to provide the values for the following arguments:
aws-region
: the region you want to deploy Disto to.aws-access-key-id
: your AWS access keyaws-secret-access-key
: your AWS secret access keyYou can follow the instructions here to obtain your access key and secret access key, or create new ones.
s3-bucket-name
: name of S3 bucket that will store configuration files.Follow the instructions here to create an S3 bucket.
cognito-user-pool-id
: name of your AWS Cognito user pool for managing Disto user accounts.cognito-client-id
: your AWS Cognito client IDFollow the instructions here to create a user pool and client ID.
sagemaker-endpoint-name
: The name of the endpoint from the deployed Sagemaker LLM.sagemaker-region-name
: your Sagemaker region name.Follow the instructions here to deploy Disto’s LLM on Sagemaker.
After you have obtained these values, follow the steps below.
Ensure you have the following requirements:
eksctl
, git
, and kubectl
.Clone the disto-deploy repository.
Run the aws-deploy script
After the script is done, it will output the following:
You can copy the URL into your browser and start using Disto.
Internal error occurred: failed calling webhook 'validate.nginx.ingress.kubernetes.io'
The ingress controller may not have been created at the time the rest of the resources were deployed. Run the following command again: