SRAM, the variety memory that makes up volatile CPU level cache, is oftentimes slim because 1, it's expensive, and 2, due to to it's internal makeup is inherently less dense than other storage mediums. SRAM requires several extra transistors to make up one data block, whereas the widely used, high capacity SDRAM requires only a solitary unit.
Extra cache will help with all redundant tasks and processes, by a decent degree, but the benefit of very large amounts of cache is hard to observe, in the sense that it's not accomplished much.
For the record, GB's of cache FTW.