Mastering AWK – scripting, data processing, Unix philosophy
1. The Unix pipeline Every Unix user knows the pipe operator. Typing ls | wc -l, and two independent programs exchange data as if they were designed together. That simplicity reflects a deliberate des
The AWK scripting language emerged from Bell Labs in 1977, named for its creators Alfred Aho, Peter Weinberger, and Brian Kernighan. AWK is still widely used today, as a core tool it is available on a
FreeBSD is a Unix operating system with a long history of stability, clean design, and excellent documentation. Older hardware tends to run it particularly well: mature driver support and a lean base
In his book Unix: A History and a Memoir, Brian Kernighan recounts his favorite grep story from the early days of Unix. Someone at Bell Labs asked whether it was possible to find English words composed only of the letters formed by an upside-down cal...
Modern data pipelines most often fail at their beginning, not their end. A malformed record, an unexpected delimiter, or an encoding anomaly can cause otherwise robust processing engines to abort after consuming significant computational resources. T...
Syntax is based on The AWK Programming Language, 2nd Edition by Alfred V. Aho, Brian W. Kernighan, and Peter J. Weinberger. Pattern A pattern determines when an action is executed. When a pattern matches an input line, its associated action is execut...
Because small is beautiful. Because AWK gives unmatched bang for the buck. Because AWK is the antidote to AI slop. Because AWK is always there when you need it. Because AWK assumes your data fits in a pipe, not a cluster. Because AWK makes you t...
"I think in terms of programming languages you get the most bang for your buck by learning AWK", said Brian Kernighan, the K in AWK (Lex Fridman podcast #109). AWK was created in Bell Labs in 1977, and its name is derived from the surnames of its au...