RSSAmplifier

Blog

~dsalaj/com/

Personal website of Darjan Salaj, a student of Graz University of Technology (TU Graz) and an employee of Institut für Informationssysteme und Computer Medien (IICM).

dsalaj.comRSS feed ↗9 posts

Latest posts

Instead of more photos, make an audio album of your loved ones!

tl;dr: If you really want to capture a moment with someone you love, stop taking pictures and hit record on the voice memos app instead. We are currently drowning in JPEGs. Every interesting moment results in a bunch of photos getting taken with our phones, synced to the cloud, and largely forgotten. Don’t get me wrong, photos are great for remembering what someone or something looked like at a…

Similarity search and Deduplication at scale

With the increase in the application of large-scale data collection, analytics, and accompanying big data platforms over the past decade, the necessity for reliable entity matching solutions is proportionately growing. The newly available data volumes need to be integrated, processed and made usable before further value can be generated. The fundamental problem of entity matching (also known as…

Pruning and Sparsification of Neural Networks

The pruning practice entails targeted removal of diseased, damaged, dead, non-productive, structurally unsound, or otherwise unwanted tissue from crop and landscape plants. [ Wikipedia ] Just as the practice of pruning helps shape and direct the growth of trees and bushes, so does pruning of synaptic connections in the brain play a critical role in learning. The use of pruning in neural network…

All about Positional Encoding

What is positional encoding? Positional encoding was originally mentioned as a part of the Transformer architecture in the landmark paper “Attention is all you need” [ Vaswani et al., 2017 ]. This concept is first introduced under the name of position embedding in [ Gehring et al., 2017 ] where it was used in the context of sequence modelling with convolutional architectures. In the Transformer…

How to migrate binary bloat out of git repository

The situation: A project has several binaries that need to be tracked and versioned along with the code. The binaries are small enough and rarely change, so versioning them directly in git is appropriate. That was some months ago, and in the meantime, the project evolved, binaries grew and changed. Now you're left with a bloated repository of multiple gigabytes that takes a long time to clone.…

Corrupt, sparse, irregular and ugly: Deep learning on time series

Update 24.06.2020: Thanks to BadInformatics for pointing me to ODE based models and other remarks. The content was extended accordingly. Update 22.08.2020: Extended the details on missing values; Replaced the first figure with example and code; Added tip for Traces library. Update 01.11.2021: Added Multi-Time Attention Nets and Neural Rough Differential Equations method How to train neural…

Nips 2018 Plan And Notes

NIPS 2018 (=NeurIPS 2018) List of all posters here . Registration Desk 7:00 am - 8 pm Sunday QR code required for check in 7:00 am - 7 pm Monday - Friday QR code required for check in 7:00 am - noon Saturday QR code required for check in Food: Breakfast and lunch are not provided. 6:30 pm Monday reception in Room 220 AB and 210 ABCDEFGH 6:30 pm Reception on Saturday evening reception in 220 ABCD…

How to pip install from private github repository in Dockerfile

This is a short note on how to effectively pip install requirements that contain private repositories in a Dockerfile. For the security reasons it is a good idea to generate an ssh key specificly for the repository you want to pull with only read permissions. If you refuse to generate a new ssh key, you can transfer existing key through local webserver and remove it after installing the…

Quick Guide To Restoring Your Bootloader

So you installed a new operating system and suddenly your boot loader is gone. In most cases the new OS is aggressive enough to make your computer boot directly to it without even making an effort to give you options for you to boot to your old OS. Worry no more, we are going to fix that now. I will assume that have installed some sort of Linux and Windows version together, probably some newer…