Sign in to follow this  

Bug in tokenizer on 64-bit?

This topic is 3574 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

I think I just ran into a bug in as_tokenizer.cpp. In line 118 (in 2.11.2), a loop is run on every character of the whitespace-string. The length of this string is determined by doing:
for( int w = 0; w < (int)sizeof(whiteSpace); w++ )


However, sizeof(whiteSpace) seems to give the size of the pointer to the string, which on 32-bit is 4 and incidentally correct. On 64-bit however, this becomes 8, which leads to all kinds of weird errors. Changing the line to
for( int w = 0; w < 4; w++ )


fixed these problems for me. [Edited by - DaBono on March 6, 2008 3:37:16 PM]

Share this post


Link to post
Share on other sites

This topic is 3574 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this