syntax-lab/QESTIONS.md

tokens in Partial Concrete Syntax

What sort of tokens should I track in the syntax?

• delimiters like e.g. in [a, b, c]?
• more significant separators like the : in { "foo" : a }?
• What about groupin symbols like { ... }?
• What about keywords? e.g. fn or for or while?

Can these questions be answered universally, or is this application dependent?

• For example, maybe when building a compiler, we don't need to track so much stuff.
• But for formatter, we probably need to track a bit more.
• But what about something like a library in a IDE that handles various transformations of the code?

delimiter confusion

I just realized that I've been misunderstanding the word delimiter. I thought that a delimiter was like the , in [ a, b, c]. But that's called properly called a separator! Or item-separator. I thought separator and delimiter where synonyms. But it seems like a delimiter is actually the grouping symbols like [ or ].