Personal website of Markus Konrad from Berlin: Computer Science related topics, own open-source software projects.
Many consumer laptops have integrated Intel GPUs like the Intel Arc graphics processor. In contrast to Nvidia GPUs, it’s still quite hard to use Intel GPUs for LLM training and inference or deep learning in general, at least from my experience on Linux. I’ve written down the necessary steps here for setting up GPU acceleration with an Intel GPU on Ubuntu 24.04 using a quantized Llama…
For a project I needed to decrypt thousands of OpenPGP-encrypted files using Python. This is a task that can be easily sped up by the means of parallel processing to use all the CPU cores in your machine. This can be implemented using for example Python’s multiprocessing Pool. However, the implementation was not as straight forward as I thought. Let’s start with an UTF-8 encoded plain…
I recently worked on a software project that required that R code submitted by users should be executed on a server. This, of course, is a security nightmare, as users can basically run any code on the server with the permissions of the R process that’s interpreting the submitted code. For example, a user may submit code using the system() function to manipulate and delete files on the…
I recently updated my @ZwoSchlagzeilen Twitter bot. I replaced the complicated, mostly rule-based language generation algorithm with a statistical approach using a trigram language model. Details can be found in the GitHub repository. Using this approach, the bot strictly speaking doesn’t mix two headlines anymore but rather uses a part from a randomly sampled headline as “seed”…