Michael Garland

See Also

Nitro: A Framework for Adaptive Code Variant Tuning


S. Muralidharan, M. Shantharam, M. Hall, M. Garland, and B. Catanzaro. Nitro: A Framework for Adaptive Code Variant Tuning. Proc. IPDPS 2014, May 2014.


Autotuning systems intelligently navigate a search space of possible implementations of a computation to find the implementation(s) that best meets a specific optimization criteria, usually performance. This paper describes Nitro, a programmer-directed autotuning framework that facilitates tuning of code variants, or alternative implementations of the same computation. Nitro provides a library interface that permits programmers to express code variants along with meta- information that aids the system in selecting among the set of variants at run time. Machine learning is employed to build a model through training on this meta-information, so that when a new input is presented, Nitro can consult the model to select the appropriate variant. In experiments with five real-world irregular GPU benchmarks from sparse numerical methods, graph computations and sorting, Nitro-tuned variants achieve over 93% of the performance of variants selected through exhaustive search. Further, we describe optimizations and heuristics in Nitro that substantially reduce training time and other overheads.


    author = {Saurav Muralidharan AND Manu Shantharam AND
              Mary Hall AND Michael Garland AND Bryan Catanzaro},
    title = {Nitro: A Framework for Adaptive Code Variant Tuning},
    booktitle={Proc. 28th IEEE Int'l Parallel and Distributed Processing Symposium},
    series = {IPDPS 2014},
    year = 2014,
    month = may,