Sports, School, Science, (S)Music. Everything needs RAM.

No not that Ram. This RAM:

You probably have no idea what RAM (Random Access Memory) is and since this is the center of what we’re talking about here’s a nice friendly diagram:

Tech Overview (don’t cry it’s brief)

Now when Claude generated this information it took my message I sent it and packaged that message into things called “tokens.” Same way an arcade exchanges your tokens for prizes, Claude took the words you prompted for a number ID and does math with the numbers its given. Using statistical weights that it gives to certain numbers because it was trained to do so, you get the given output you have above. But in order to have it “run” you the stored data it generated in the form of a picture, you have to use memory that lives on the computer chips themselves now often called GPUs. Now this super fast RAM running on Claude is processing how ever many people are using it all at the same time, as you can imagine it requires a ton of computing power.

In using the RAM to process all these tokens, one at a time, and then stores it in something called the KV cache. It doesn’t reread your story because it’s storing all that info in the cache, including the drawing you saw above. After re-interpretting the code it wrote into a workable PNG we get what we get from very, very fast RAM processing.

Tech Overview Over

What the heck does this have to do with what I talked about above?

Everyone is using and buying these AI Processors for their specific work. NFL Next Gen Stats is not just very smart people sitting in a room and drawing amazing graphics anymore. The entire Microsoft 365 suite has been revamped to include their generative AI ecosystem. Spotify with the AI DJ and AI Generated music is saturated. Every single sector is using Moores Law to justify why this super speed RAM is necessary to improve the field and the supply chain is insanely bottlenecked to provide this.

So while I do care about data centers not being just plopped next to a neighborhood, if RAM continues to be bottlenecked at the source, investors can keep making plans to build those data centers, pre-planning the RAM because they’re the only ones that can afford the price.

Think about it, and let me know if you disagree with this Op-Ed in the comments below.

Go enjoy the outdoors this weekend!

Until next time.