Robert's Rambling Ruminations Regarding Reality...
TL;DR version: install either Java 17 or Java 21. Install PySpark (e.g. via pip). Run it. Longer Version Story Time As part of work for a client, we’ve been looking at using Microsoft Fabric and PowerBI to pull together data, do analysis using the IES platform (my team’s core product), and present the results in … Continue reading "How to run PySpark on Windows"
For reasons that should be obvious, I’m just making sure that my blog is still alive. Moribund, but alive…
The privatisation of the employment system is one of the classic examples of failure. Private employment agencies work well as an opt-in system – you want a job, you go to an agency to help find you one, and if you’re one of the lucky ones, they get you one. It works well for people … Continue reading "JobSeeker and JobActive are meant to move people off welfare and into work, but COVID-19 has…
An example of configuring a global AJAX exception handler
(to the tune of the Ewoks Victory Song. Now it can be stuck in your head, and not just mine) Picking up from last time, I needed to start creating things inside my Virtual Private Cloud, or VPC. The first things to create are subnets – public subnets, in particular. Without a public subnet, nothing … Continue reading "AiL – Subnets! Public Subnets! Wow, they are free, and we can au-to-mate!"
As previously discussed, I’m doing a small series of posts around bringing the AWS infrastructure that I use into the current era, and putting it all into CloudFormation. In this post, I’m going to cover setting up the first stack. This is going to set up a Virtual Private Cloud (or VPC), which is where … Continue reading "AiL – Baby’s First CloudFormation Stack"
I’ve been an active user of AWS for over six years now. The application I work on – a vertical niche app for the mining industry – is hosted there. But as the lead developer – and sole DevOps type – of a small team with an aggressive development schedule, I haven’t ever managed to … Continue reading "AiL – Exploring AWS CloudFormation"
So here’s my favourite bit of news out of Amazon for today – they’ve finally got Ruby support in AWS Lambda, AND they’ve got support for shared libraries. I’ve got a metric tonne of scripts for dealing with AWS environments in Ruby that I’ve written over the last six years of working on IES, mostly … Continue reading "AWS Lambda finally supports Ruby, shared libraries"
ABC facts checks claims about negative gearing Negative gearing is a system where the rent earned on a property – after removing other expenses – doesn’t cover the interest on the mortgage. You can then take that loss, and use it to offset other taxable income. It’s a system where you deliberately run what is … Continue reading "Of course negative gearing benefits go mostly to the already wealthy……
Want reliable power? Don't bank on coal says the AEMO