willyborn · GitHub

@willyborn changed the title Speedup of kernel caching mechanism Speedup of OpenCL kernel caching mechanism

Nov 10, 2020

@willyborn

@willyborn

willyborn

@9prady9

@willyborn

@willyborn

@willyborn

9prady9

9prady9 previously approved these changes Dec 7, 2020

@9prady9

The program source files memory footprint is reduced (-30%) by eliminating
comments in the generated kernel headers.  Hash calculation of each source
file  is performed at compile time and incrementally extended at runtime
with the options & tInstance vectors.  Overall performance increased up to
21%, up to the point that the GPU becomes the bottleneck, and the overhead
to launch the same (small) kernel was improved by 63%.

@9prady9

@9prady9

@9prady9

@umar456

9prady9 added a commit to 9prady9/arrayfire that referenced this pull request

Aug 2, 2021
arrayfire#3043)
* Reduced overhead of kernel caching for OpenCL & CUDA.
The program source files memory footprint is reduced (-30%) by eliminating
comments in the generated kernel headers.  Hash calculation of each source
file  is performed at compile time and incrementally extended at runtime
with the options & tInstance vectors.  Overall performance increased up to
21%, up to the point that the GPU becomes the bottleneck, and the overhead
to launch the same (small) kernel was improved by 63%.
* Fix couple of minor cmake changes
* Move spdlog fetch to use it in bin2cpp link command
Co-authored-by: pradeep <pradeep@arrayfire.com>
(cherry picked from commit  3cde757 )

syurkevi pushed a commit that referenced this pull request

Dec 28, 2021
#3043)
* Reduced overhead of kernel caching for OpenCL & CUDA.
The program source files memory footprint is reduced (-30%) by eliminating
comments in the generated kernel headers.  Hash calculation of each source
file  is performed at compile time and incrementally extended at runtime
with the options & tInstance vectors.  Overall performance increased up to
21%, up to the point that the GPU becomes the bottleneck, and the overhead
to launch the same (small) kernel was improved by 63%.
* Fix couple of minor cmake changes
* Move spdlog fetch to use it in bin2cpp link command
Co-authored-by: pradeep <pradeep@arrayfire.com>
(cherry picked from commit  3cde757 )

@willyborn

Read the original on github.com ↗