[Day 197] Learning about kafka
Hello :) Today is Day 197! A quick summary of today: finally decided to learn about kafka and streamed data I started the day by watching and replicating this video on Building a Real-Time Data Streaming Pipeline using Kafka,Postgres and Streamlit Kafka, and in general streaming (data/models) have been in my zone of interest for a while, and this video finally gave me a good starting point. The video helped me set up a Kafka service, a Zookeeper (which manages metadata), a producer (which reads data from a streaming source like a live weather feed and sends it to Kafka), and a consumer (which reads data from Kafka). The whole thing was around sentiment of generated sentences. First we generate sentences, send them to kafka using the producer, read them from kafka using the consumer and use a sentence sentiment analyser to get a score -> then upload the sentence + score to postgres -> then as each new data comes in, show it in a UI (streamlit). I took some pics but I do not ha