Posts

Showing posts from July 27, 2024

[Day 208] Setting up docker-services for the KB project, streaming transactions, and the Scottish dataset

Image
 Hello :) Today is Day 208! A quick summary of today: making progress with the Kukmin Bank (KB) project Scottish dataset 2hr audio mark is close First, about the KB project for the KB AI competition All code from today is on the project's repo on branch ivan . Today I managed to set up the (what I think are the) needed services going forward. I hit the Docker storage space limit a few times, so I had to compromise on complexixty. For example instead of using postgres as a db for mlflow, even using a simple sqlite3 db for this project is fine. Later, plugging in a better storage for mlflow, and its artifacts is trivial. One new thing, that was not there before is grafana. I saw online that there is a neo4j grafana plugin - so I tried to install it. At first, by default, I could not, so I looked in grafana cloud (free for 14 days) and on there, the plugin could easily be loaded, and I could easily connect to my neo4j db. However, I wanted to do it locally, so I found a way to install