My Blog

Spark Summit 2021

May 28, 2021

Tags: spark

Categories: spark

Project Zen: Making Data Science Easier in PySpark Project Zen Goals: make spark more pythonic better ops with python libraries Changes: Python Hints better documentation support conda, pip, pipex to deploy package Shipping pacakge in conda pandas Api on Spark visualization Links: Project Zen Databricks Blog

Scheduling Jobs

Jan 7, 2021

Tags: scheduling

Categories: etl

Here is an alternative to using cron.

Intro to Streamlit

Dec 21, 2020

Tags: streamlit

Categories: cheatsheet

Streamlit is a useful framework for building interaction python apps.