Linux All Day Everyday
I needed a way to refresh a postgres logical replication subscription on many hosts. I decided to write a python script to achieve this, it reads in a list of hostnames and executes the refresh against each host. The subscription names are part of the host name name and I have a master server that [ ]
Thought I would document one of my hobbies, I like to race and build remote control cars. In this post I will post the steps along the way of what it takes to build this car. I will continue to add to this post as I make progress. Here is the manual I am following [ ]
Another day another odd error, my colleague and I were alerted to an issue on one of our MWAA Airflow 2.5.1 environments. [crayon-6a81cf9e4e49f252747696/] The above error was happening when a new DAG tried to instantiate S3 via botocore/boto3. We traced it down to the S3transfer package. Apparently in this commit: https://github.com/boto/s3transfer/commit/3b50c31bb608188cdfb0fc7fd8e8cd03b6b7b187…
I recently ran into an issue on my M1 MacBook Pro after updating to 14.6.1 Sonoma. When the screen locked due to a screensaver, or a reboot, and I attempt to unlock it via the fingerprint reader, it can take upwards of 10 to 20 seconds to go through. After researching this issue, it appears [ ]
Here is an interesting error that we recently encountered with one of our Redshift Serverless and Redshift Provisioned clusters. We have a data sharing setup where the serverless DB is the producer cluster of certain key tables. We share these tables to a provisioned Redshift cluster via data sharing. When querying this particular table on [ ]
You can use the below SQL on redshift serverless to find the top largest tables. You can return the results in 1MB data blocks or convert to TB. You can obviously change the limit N to whatever you want to change the number of results returned. 1MB data blocks: [crayon-6a81cf9e4e8e6431635938/] Size In TB: [crayon-6a81cf9e4e8eb847059322/] Specific [ ]
Recently while working on one of our EMR projects that uses lambdas and airflow, I ran into the following timeout issue: [crayon-6a81cf9e4ea5c914147123/] We have a lambda that was invoked from boto3 in a Airflow step that would update dynamo db with values needed for our pipeline. This function worked in previous tests with no issues. [ ]
I ran into this issue on a CENTOS8 server that has yet to be updated to RHEL8, after upgrading some packages via Pip: [crayon-6a81cf9e4ecb3482977951/] Turns out: Module python3-requests is not compatible with locally installed third party module urllib3 of version 1.26.8 and get conflicting with Red Hat provided python3-urllib3 version 1.24.2-5.el8. I was able to [ ]
I recently had an issue where one of our EMR clusters failed to bootstrap the python modules via PIP. I checked the logs and saw that we ran into the following error: [crayon-6a81cf9e4ee39681569056/] I wanted to have PIP not die if it timed out, I also wanted it to retry on failure. By adding the [ ]
I thought I would share my version of how I updated the server that runs this blog from Rocky 8 to Rocky 9 without a clean install. I want to mention this is a do at your own risk post, this is not officially supported. !!!Do not attempt this if you do not have backups [ ]