Token package:regex
our RE scanner returns a list of these tokens
format [Token] into an RE string
the general Token formatter, generating REs according to the options
a configuration that will preserve the parsed regular expression in
the output
check that a token is well formed