eventually I'll change this
I have been working with AWS (Amazon Web Services) over the past decade. At my current job at Semrush, I am lucky enough that I got to work with GCP (Google Cloud Platform) for a change. After a year of experience with it, here are my very personal comments on
As most people in the Data world, I have been more and more exposed to LLM based AI tools. Things like Copilot or Perplexity have been adopted as new, better tools and have indeed made my regular workflow faster (to an extent). Side note : I don't understand why
Last weekend, I had some time to kill, and I thought I would tackle a minor pet peeve of mine.   My wife and I are trying to go on a hike at least once a month, we like to try different trails around our area. In Spain, the dominant
At my current company (Carpe Data, we are hiring! ) , one of my tasks is to maintain an internal Airflow plugin ( common-airflow-utils ) with Airflow related utilities. The library is used by 5 different teams, powering a big part of our production worfklows. and it provides higher abstractions on top of the
Its been 9 years since I spin up my Digital Ocean instance. It has been hosting my personal site, blog, random personal projects, and even faced one or two Hacker news front page traffic spikes. Why named dokku you wonder, oh young reader? Well, back before kubernetes was a thing,
Recently I did a fresh install of Ubuntu 20.04 via WSL2 (which i don't love yet but its growing on me), and I had to do the following steps to set git up: 1.Install git (duh!) Im just putting it here for completion sake sudo apt-get
TL;DR I made a map displaying weather and traffic road conditions for Spain that is easier to use, nicer and faster than the official Spanish Government map. As usual ( 1 , 2 ), I keep being disappointed with the Spanish Government Open Data policies. You can check out the map here
Airflow is one of the most widely used Schedulers currently in the tech industry. Initially developed at Airbnb, a few years ago it became an Apache foundation project, quickly becoming one of the foundation top projects. It is a direct competitor of other schedulers such as Spotify's Luigi
Airflow is one of the most widely used Schedulers currently in the tech industry. Initially developed at Airbnb, a few years ago it became an Apache foundation project, quickly becoming one of the foundation top projects. It is a direct competitor of other schedulers such as Spotify's Luigi
These are the steps I took to install Microsoft's cool Gradient Boosted Models library, LightGBM Step 1. Install CUDA I am not going to explain this step because it is easy to find. Step 2. Install Boost sudo apt-get install libboost-all-dev Step 3. Clone LightGBM and build with
If you run pyspark and see this error (it happens in scala-shell as well): Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionState’ The solution is easy, yet ridiculous. 1. Create the folder /tmp/hive 2. Give it chmod permissions sudo chmod -R 777 /tmp/hive Found here
Yesterday I spent a few hours dealing with what I like to call "the edges of StackOverflow" . By that I mean those situations in which you are trying to solve a programming problem (mostly a bug) and you have no idea why its happening, and even worse, no
Let's assume we have a service set up as follows: [Unit] Description=systemd_microservice [Service] User=USER Group=GROUP WorkingDirectory=systemd_working_directory ExecStart=/usr/bin/python python_scripts.py SuccessExitStatus=143 TimeoutStopSec=10 Restart=on-failure RestartSec=10 [Install] WantedBy=multi-user.target And inside python_script.py you
Sources: here and here This post shows how to disable the caps lock key and enables it only by pressing both shift keys together. 1. Install DCONF $ sudo apt-get install dconf-tools 2. Disable caps lock and reenable it as pressing both shift keys at once: $ setxkbmap -option "caps:none&
Nowadays, everyone seems to be fascinated about startups. Media bombard us with success story after success story, displaying incredible offices featuring slides instead of stairs and in house chefs preparing home made dinners. I started working in November 2013 in a NYC based Startup named Namely . I was the 18th