Energy-Efficient Shared Cache Using Way Prediction Based on Way Access Dominance Detection

To meet the performance demands of chip multiprocessors, chip designers have increased the capacity and hierarchy of cache memories. Accordingly, a shared lower-level cache reduces conflict misses by adopting a multi-way set-associative structure with high associativity. This structure allows fast a...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Yun-Seok Oh, Eui-Young Chung
Formato: article
Lenguaje:EN
Publicado: IEEE 2021
Materias:
Acceso en línea:https://doaj.org/article/651c5058aa7b4724be14ea67f2319fd5
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
Descripción
Sumario:To meet the performance demands of chip multiprocessors, chip designers have increased the capacity and hierarchy of cache memories. Accordingly, a shared lower-level cache reduces conflict misses by adopting a multi-way set-associative structure with high associativity. This structure allows fast access because it allows access to all the ways in the cache set in parallel. However, it consumes a large amount of dynamic energy. Therefore, various schemes have been proposed to increase the energy efficiency of the cache memory. These schemes use <italic>way prediction</italic> or <italic>partial comparison</italic> to reduce unnecessary way access. This paper proposes a <italic>way prediction</italic> algorithm suitable for a shared second-level cache with high associativity. This algorithm is based on real-time <italic>way access dominance detection</italic> (<italic>WADD</italic>). Through this detection, the proposed algorithm can determine the number and location of <italic>way candidates</italic> suitable for each <italic>partial access pattern</italic> among the fragmented access patterns owing to the first-level cache replacement policy and intermingled accesses by multiple cores. Through this process, the proposed algorithm can implement an efficient <italic>way prediction</italic>. Simulation results show that the <italic>WADD</italic> exhibits the highest energy efficiency among the comparison groups, thus reducing the energy-delay product by 13.5&#x0025; compared with the conventional cache without <italic>way prediction</italic>. This result is achieved by reducing the <italic>way prediction</italic> penalty through fast detection and high prediction accuracy.