Changes between Version 12 and Version 13 of en/UsingGPU


Ignore:
Timestamp:
Feb 2, 2025, 9:37:18 PM (6 months ago)
Author:
Ales Horak
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • en/UsingGPU

    v12 v13  
    14141. `ssh ...` to one of the servers (e.g. `ssh apollo`). If you are not currently inside the faculty network, you must [#ConnectingtoFIMUNIVPN connect to the FI MUNI VPN] first.
    15151. `cd /nlp/projekty/...` to your project directory
    16 1. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceDatasets below]
     161. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceData below]
    17171. find available GPUs: run `gpustat` or `nvidia-smi`
    18182. `export CUDA_DEVICE_ORDER=PCI_BUS_ID`
    … …  
    3535* Type in the secondary password again
    3636
    37 == Change the cache location of !HuggingFace Datasets ==
     37== Change the cache location of !HuggingFace Data ==
    3838
    3939Keep your home directory small, there are quotas active.
    4040
    4141
    42 * You need to change the download location of datasets. The default location is in your home and it can easily get full
     42* You need to change the download location of !HuggingFace models, datasets, .... The default location is in your home and it can easily get full
    4343* prepare a cache directory in your project
    4444{{{
    4545mkdir /nlp/projekty/.../hf_cache
    4646}}}
    47 * To change the HF Datasets location run:
     47* To change the HF cache location run:
    4848{{{
    49 export HF_DATASETS_CACHE="/nlp/projekty/.../hf_cache"
     49export HF_HOME="/nlp/projekty/.../hf_cache"
    5050}}}
    5151* To make this change permanent so you don't need to type it every time you enter the server, add it to your `.bashrc` file in your home directory