Interestingly, infinite context memory is functionally identical to learning.
Except for still being incapable of responding to anything not within that context memory, todays models have zero problem solving skills; or to put it another way they’re incapable of producing novel solutions to new problems.
Hence the reason it’s not a real intelligence (yet) even a goldfish can do problem solving without first having to be equipped with god like levels of prior knowledge about the entire universe.