This feels very promising for the future as we enter a world that is more and more dependent on AI that inference is so cheap. I did not understand the scale to how much cheaper inference is compared to training. As we get better with training I imagine this gets significantly better as well. I know they all claim to be profitable on inference, but scrolling through Simonβs feed here you see several articles on the stark difference.
Note
This post is a thought. Itβs a short note that I make about someone elseβs content online #thoughts