Patch: Refining the Foundation: Decomposing the Lexer for Better Maintainability

Following our recent efforts to modularize the parser, we have now turned our attention to the very first stage of our compilation pipeline: the Lexer. Over time, this component had grown into a single file of nearly 900 lines, making it increasingly...