DreamTeam/Valis

From Noisebridge
Revision as of 20:43, 10 March 2018 by Bfb (talk | contribs) (Bfb moved page Valis to DreamTeam/Valis)
Jump to navigation Jump to search

About

Valis is a shared compute resource for training machine learning models. Specifically, Valis excels at tasks that require GPU compute. Valis is intended for research and educational purposes only (not for profit).

Specs

  • Intel 4114 10-core CPU
  • 4x Nvidia Titan V GPUs
  • 196GB ECC RAM
  • 2x 2TB SSDs

Access

Valis is accessed through a VPN. Follow the instructions below to receive and utilize a VPN user account.

  1. Let the community know about your project by sending a message to the ml list or join the Dream Team Neurohackers in person on Wednesday nights at 8pm.
  2. Make a note on Talk:Valis with your GPG public key fingerprint. You will be emailed an encrypted archive containing your cert, key, OpenVPN configuration file, and OpenVPN username/password for connecting to the VPN plus a Jupyterhub username/password.
    1. Jupyterhub and OpenVPN currently use two different user access systems.
  3. Configure your computer to connect to our OpenVPN server
    1. On Debian this can be configured using network-manager-openvpn.
    2. On OS X Tunnelblick works well.
  4. Connect to the VPN and run #verifications.
  5. If the verifications pass, then continue. If not, see #Debugging/FAQ.
  6. Change your VPN password here.
    1. Please note that all TLS certs on the internal network are signed by an internal CA. Your browser will not trust this CA, nor the certs that it has signed by default.
  7. Login to our Jupyterhub instance.
  8. Open a terminal session and #change your linux user password.
  9. Open a Python 3 notebook and begin hacking.

verifications

$ ping 172.16.1.1 # DNS server
$ ping 172.16.1.2 # Valis
$ ping valis.ml   # Also Valis, demonstrates your using the internal DNS

change your linux user password

$ passwd

Scheduling

Notes on how/what to check before running a process


Debugging/FAQ

Services

URL Comments
https://pfsense.localdomain Firewall, DNS, OpenVPN server, etc.
https://jupyterhub.valis.ml Notebook server
https://chronograf.valis.ml Metrics dashboards