Turns .aether source text into a flat list of Aether.Tokens.

Whitespace and ;-to-end-of-line comments are trivia here -- they separate tokens but never appear in the output. This is Ichor's own front-end lexer, entirely separate from the @skip/@noskip machinery a compiled Aether grammar applies to its own rules -- that splicing happens later, in Aether.Parser.