The rumors I hear put the internal flash memory at 8 gigs (The same as the hard drive on the Xbox, and nearly at the 50% mark of what the initial premium model of the 360 had and what the initial budget model of the PS3 had).
That seems like it would offer ample capacity for game caching with significant space left over for some DLC and other necessary uses like the OS.