Changes between Version 5 and Version 6 of en/UsingGPU
- Timestamp:
- Oct 16, 2024, 1:46:27 PM (9 months ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
en/UsingGPU
v5 v6 12 12 Follow these actions: 13 13 14 1. `ssh ...` to one of the servers (e.g. `ssh apollo`). If you are not currently inside the faculty network, you must [# vpnconnect to the FI MUNI VPN] first.14 1. `ssh ...` to one of the servers (e.g. `ssh apollo`). If you are not currently inside the faculty network, you must [#ConnectingtoFIMUNIVPN connect to the FI MUNI VPN] first. 15 15 1. `cd /nlp/projekty/...` to your project directory 16 1. setup !HuggingFace cache as detailed [# cachebelow]16 1. setup !HuggingFace cache as detailed [#ChangethecachelocationofHuggingFaceDatasets below] 17 17 1. find available GPUs: run `gpustat` or `nvidia-smi` 18 18 2. `export CUDA_DEVICE_ORDER=PCI_BUS_ID` … … 22 22 23 23 == Connecting to a GPU server == 24 ==== [#vpn Connecting to FI MUNI VPN ]====24 ==== Connecting to FI MUNI VPN ==== 25 25 - Download the VPN configuration for FI MUNI from here: https://www.fi.muni.cz/tech/unix/vpn.html 26 26 - Use your faculty login `x.....` with your secondary password as the credentials … … 33 33 * Type in the secondary password again 34 34 35 == [#cache Change the cache location of HuggingFace Datasets]==35 == Change the cache location of HuggingFace Datasets == 36 36 * You need to change the download location of datasets. The default location is in your home and it can easily get full 37 37 * prepare a cache directory in your project … … 89 89 You will use it later, after setting up an SSH tunnel. 90 90 91 ==== [#ssh Create SSH Tunnelling]====91 ==== Create SSH Tunnelling ==== 92 92 * Open new second terminal and insert the following command 93 93 {{{ … … 100 100 http://localhost:2222?token=... [[br]] 101 101 If you have used the same port numbers, as we do, you do not need to change anything in the URL. 102 Otherwise, the port must match the first port in the [# sshssh tunelling] step.102 Otherwise, the port must match the first port in the [#CreateSSHTunnelling ssh tunelling] step. 103 103 * If you have correctly copied the `token`, then you are logged in. 104 104 Otherwise, to get the token again run:
