Building a Lexer Framework Part 1 - Introduction

On the journey to reinvent the wheel yet again while learning formal languages, it is time to build a lexer to generate old-school non-AI tokens