Changes between Version 3 and Version 4 of en/UsingDeptGPU


Ignore:
Timestamp:
Feb 2, 2025, 9:39:55 PM (6 months ago)
Author:
Ales Horak
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • en/UsingDeptGPU

    v3 v4  
    1010   If you are not currently inside the faculty network, you must [#ConnectingtoFIMUNIVPN connect to the FI MUNI VPN] first.
    11111. `cd /nlp/projekty/...` or `cd /cyb-trials/...` to your project directory
    12 1. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceDatasets below]
     121. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceData below]
    13131. find available GPUs: run `gpustat` or `nvidia-smi`
    14142. `export CUDA_DEVICE_ORDER=PCI_BUS_ID`
     
    3232* Type in the secondary password again
    3333
    34 == Change the cache location of !HuggingFace Datasets ==
     34== Change the cache location of !HuggingFace Data ==
    3535
    3636Keep your home directory small, there are quotas active.
     
    4242export PROJECT_DIR=/cyb-trials/...
    4343}}}
    44 * You need to change the download location of datasets. The default location is in your home and it can easily get full
     44* You need to change the download location of !HuggingFace models, datasets, .... The default location is in your home and it can easily get full
    4545* prepare a cache directory in your project
    4646{{{
    4747mkdir $PROJECT_DIR/hf_cache
    4848}}}
    49 * To change the HF Datasets location run:
     49* To change the HF cache location run:
    5050{{{
    51 export HF_DATASETS_CACHE="$PROJECT_DIR/hf_cache"
     51export HF_HOME="$PROJECT_DIR/hf_cache"
    5252}}}
    5353* To make this change permanent so you don't need to type it every time you enter the server, add it to your `.bashrc` file in your home directory (including the setting for `PROJECT_DIR`).