Sign in to follow this  

Using non English Characters in a Flex scanner

This topic is 2657 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

For some obscure micro-optimization reason, Unicode support tends to be flaky in most parser generators.

It would appear that there exists ALex and AYacc which does support more than ASCII. It's likely there are others.

It's been a very long time since I dabbled with parsing, but I remember hacking something myself to work around it and I think I finally abandoned the tools and just went with manually constructed parser.

Share this post


Link to post
Share on other sites
Thanks guys for the info and inspiration.
I started a couple of days ago building my own scanner.
Trying to figure out how to improve speed with
"(Inline assembly)?(SIMD)?(OpenMP)?$"
I think i will drop Bison in favor of a hand written parser as well...

(And a credit goes to Phresnel too ) :)

This is the best site ever! ~(\'0'\)~ ... ~>

Share this post


Link to post
Share on other sites

This topic is 2657 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this