Setting up pyspark
Spark is a general-purpose cluster computing system.
Here are some of my notes in setting up:
SSH Tunneling
Sometimes, you want to access a service running on a remote server, but there might be a firewall that does not forward the traffic to the port.
One way to deal with this is to create a socks proxy.