Changes between Version 3 and Version 4 of en/UsingDeptGPU
- Timestamp:
- Feb 2, 2025, 9:39:55 PM (6 months ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
en/UsingDeptGPU
v3 v4 10 10 If you are not currently inside the faculty network, you must [#ConnectingtoFIMUNIVPN connect to the FI MUNI VPN] first. 11 11 1. `cd /nlp/projekty/...` or `cd /cyb-trials/...` to your project directory 12 1. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceData setsbelow]12 1. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceData below] 13 13 1. find available GPUs: run `gpustat` or `nvidia-smi` 14 14 2. `export CUDA_DEVICE_ORDER=PCI_BUS_ID` … … 32 32 * Type in the secondary password again 33 33 34 == Change the cache location of !HuggingFace Data sets==34 == Change the cache location of !HuggingFace Data == 35 35 36 36 Keep your home directory small, there are quotas active. … … 42 42 export PROJECT_DIR=/cyb-trials/... 43 43 }}} 44 * You need to change the download location of datasets. The default location is in your home and it can easily get full44 * You need to change the download location of !HuggingFace models, datasets, .... The default location is in your home and it can easily get full 45 45 * prepare a cache directory in your project 46 46 {{{ 47 47 mkdir $PROJECT_DIR/hf_cache 48 48 }}} 49 * To change the HF Datasetslocation run:49 * To change the HF cache location run: 50 50 {{{ 51 export HF_ DATASETS_CACHE="$PROJECT_DIR/hf_cache"51 export HF_HOME="$PROJECT_DIR/hf_cache" 52 52 }}} 53 53 * To make this change permanent so you don't need to type it every time you enter the server, add it to your `.bashrc` file in your home directory (including the setting for `PROJECT_DIR`).