Thinking Outside the Black Box

If AI can one day quickly and reliably write new code and edit existing code to produce the intended new behavior of the software system, such that the system itself effectively becomes a black box… there's a whole slew of things that don't matter anymore.