Publication:
Compiler-Assisted Instruction Fusion

relationships.isAuthorOfPublication
relationships.isSecondaryAuthorOf
relationships.isDirectorOf
Authors
Reddy, Ravikiran Ravindranath ; Singh, Sawan ; Perais, Arthur ; Ros Bardisa, Alberto ; Jimborean, Alexandra
item.page.secondaryauthor
item.page.director
Publisher
IEEE
publication.page.editor
DOI
10.1109/CGO68049.2026.11394845
item.page.type
info:eu-repo/semantics/article
Description
Abstract
Hardware instruction fusion combines multiple architectural instructions into a single operation, improving performance by freeing up resources. While fusion typically involves consecutive instructions, there are proposals to fuse nonconsecutive instructions to maximize potential. However, such approaches require complex and costly hardware to predict and either validate fusion or unfuse, which significantly increases the cost of fusion. In this work, we propose a compiler technique, CAIF - Compiler Assisted Instruction Fusion, for fusionaware instruction scheduling. CAIF identifies fusible but nonconsecutive memory operations and reorders eligible pairs of instructions such that they appear consecutively in the instruction stream. Our experiments demonstrate that for neural network workloads, a hardware that only fuses consecutive instructions obtains 1.2% average performance improvements over a no-fusion baseline when applications are compiled with a standard compiler and 19.6% when compiled with CAIF. In addition, when nonconsecutive hardware fusion (Helios) is enabled, CAIF boosts performance from 6.6% to 20.3%. Moreover, CAIF can effectively handle the statically challenging general-purpose application and boost performance on SPEC CPU 2017 from 2.4% to 6.4%, and from 14.4% to 17.7%, respectively, on the hardware configurations mentioned above.
Citation
2026 IEEE/ACM International Symposium on Code Generation and Optimization (CGO) Pages: 726-739
item.page.embargo
Collections