SemCache: Semantics-Aware Caching for Efficient GPU Offloading

von Nabeel Al-Saber

120 Seiten, Taschenbuch

Kurzbeschreibung des Verlags

In this book, we introduce SemCache, a semantics-aware GPU cache that automatically manages CPU-GPU communication in addition to optimizing communication by eliminating redundant transfers using caching. It uses library semantics to determine the appropriate caching granularity for a given offloaded library. Our caching technique is efficient; it only tracks matrices instead of tracking every memory access at fine granularity. We applied SemCache to Basic Linear Algebra Subprograms (BLAS) library to provide a GPU drop-in replacement library. SemCache++ extends SemCache to support offloading to multiple GPUs. SemCache++ is used to build the first multi-GPU drop-in replacement library that (a) uses the virtual memory to automatically manage and optimize multi-GPU communication and (b) requires no program rewriting or annotations. SemCache++ also enables new features like asynchronous transfers, parallel execution and overlapping communication with computation. Experimental results show that our system can dramatically reduce redundant communication for real-world computational science application and deliver significant improvements, beating exciting GPU-based implementations.

• Themen: Informatik und Informationstechnologie Computerprogrammierung und Softwareentwicklung Programmier- und Skriptsprachen, allgemein
• ISBN: 9783659878145
• Sprache: Englisch
• Erscheinungsdatum: 01.06.2016
• Größe: 220 x 150 mm
• Verlag: LAP LAMBERT Academic Publishing