Apache Kafka in @newrelic is a big thing. I learn a lot from my colleagues every day and a grateful for that. A list of Kafka resources shared by New Relic engineers ordered chronologically 🧵
I will keep it updated!
"Imagine halving the resource costs of AI and what that could mean for the planet and the industry -- based on extreme estimates such savings could reduce the total US power usage by over 10% by 2030"
AI Flame Graphs: Showing what's actually running on the HW and how we got there. Uses Intel EU stall profiling and eBPF. brendangregg.com/blog/2024-10-2…
Last Friday, I gave a talk to my friends at @FactorialEs about cell architecture. It was also a great reminder for me of how companies are using Kafka in production. While they aren't using Flink or even Java-based clients, they're quite happy with the results so far.
Ramesh and I are ready for our talk in @FlinkForward about streaming over S3 with Paimon, Iceberg or the Flink FileSource/Sink and how we use them to optimize our pipelines in @newrelic
