Scraping SA Dam(n) Data using a Scheduled Lambda and uploading it to Mongo
Lately, it has been raining quite a lot, which got me wondering about the current dam levels at the Vaal Dam. Aside from hearing updates through word of mouth or some Facebook group, how could I find out the current dam levels? A quick Google search for “SA Dam Levels” directs you to the “Weekly State of Dams” webpage on the Department of Water and Sanitation’s website.
Read More
Deploy Your Streamlit App with Python, Docker, Nginx, and Cloudflare
Have you ever heard of an open-source project called Streamlit? Let me tell you – Streamlit is truly lit 🔥. It allows you to turn simple Python scripts into shareable web apps in just minutes. Yes, really – minutes! Here’s all the code you need to create a basic app:
Read More
Python Threaded Queues: Building a Data Crawler for 70,000+ API Calls
My plan of action Ever since I read the documentation for Python’s threaded queue, I’ve been wondering: “Can I use this to build a really efficient web crawler?” The answer is yes!
Read More