Posts

Showing posts from July 8, 2024

[Day 188] Setting up automatically updated monitoring UI using streamlit

Image
 Hello :) Today is Day 188! A quick summary of today: setting up postgres properly creating and hosting a monitoring interface using streamlit creating a Grafana dashboard setting up a batch model prediction flow in prefect All code from previous days and today is on my repo . First, setting up a better way to upload data to postgres Before, everytime I ran docker the script checked if I had inserted data into postgres. Now I set up a proper sql script that inserts data once and I am set up (as long as I do not delete the built container of course) I put all the sql and commands I used to upload the data in the postgres folder in my repo. I first create the tables (pic is truncated) And I also added a default column for FraudFound_P_prob just in case the user wants to get probabilities when they run a pred model.  I uploaded 2 datasets to postgres - the above one, and one ready for the balanced random forest classifier model - it is the same as the above one but all vars are in dummies