Adapt the following but for vllm on EKS: [Accelerating LLM inference with post-training weight and activation using AWQ and GPTQ on Amazon SageMaker AI](https://aws.amazon.com/blogs/machine-learning/accelerating-llm-inference-with-post-training-weight-and-activation-using-awq-and-gptq-on-amazon-sagemaker-ai/).
Adapt the following but for vllm on EKS: Accelerating LLM inference with post-training weight and activation using AWQ and GPTQ on Amazon SageMaker AI.