Browse Source

docs: Add system requirements for DeepSeek-Infer demo

enoch kan 1 year ago
parent
commit
53b055bc1e
1 changed files with 11 additions and 1 deletions
  1. 11 1
      README.md

+ 11 - 1
README.md

@@ -253,6 +253,16 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/fp8_weights --output-bf16-h
 
 ### 6.1 Inference with DeepSeek-Infer Demo (example only)
 
+#### System Requirements
+
+OS: Linux (Mac, Windows are currently not supported)
+
+- Python 3.10
+- PyTorch 2.4.1
+- Transformers 4.46.3
+- Safetensors 0.4.5
+- Triton 3.0.0
+
 #### Model Weights & Demo Code Preparation
 
 First, clone our DeepSeek-V3 GitHub repository:
@@ -261,7 +271,7 @@ First, clone our DeepSeek-V3 GitHub repository:
 git clone https://github.com/deepseek-ai/DeepSeek-V3.git
 ```
 
-Navigate to the `inference` folder and install dependencies listed in `requirements.txt`.
+Navigate to the `inference` folder and install dependencies listed in `requirements.txt`. Easiest way is to use a package manager like `conda` or `uv` to create a new virtual environment and install the dependencies.
 
 ```shell
 cd DeepSeek-V3/inference