In the next year you're going to see Very large context Windows agents and text action when they Are delivered at scale it's going to Have an impact on the world at a scale That no one understands yet much bigger Than the horrific impact we've had on by Social media right in my view so here's Why in a context window you can Basically use that as short-term memory And I was shocked that cont Windows get This long the technical reasons have to Do with the fact that it's hard to serve Hard to calculate and so forth the Interesting thing about short-term Memory is when you feed the the you ask It a question read 20 books you give it The text of the books is the query and You say tell me what they say it forgets The middle which is exactly how human Brains work too right that's where we Are with respect to agents there are People who are now building essentially Llm agents