Mounting S3 bucket

amazon amazon s3

Here is my notes on how to mount an s3 bucket as a file system.

Mounting S3 bucket

Setting up pyspark

spark python spark

Spark is a general-purpose cluster computing system.

Here are some of my notes in setting up:

Setting up pyspark

SSH Tunneling

hacks ssh proxy ec2

Sometimes, you want to access a service running on a remote server, but there might be a firewall that does not forward the traffic to the port.

One way to deal with this is to create a socks proxy.

SSH Tunneling