• Advertisement

Archived

This topic is now archived and is closed to further replies.

Token

This topic is 5954 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Advertisement
A token is a single discrete element. Its specific usage depends on context. With respect to compilers and parsers, a token is a single language element such as an identifier (variable or function name), an operator or another form of lexical symbol. With regard to string manipulation, tokens are what are obtained after the string has been separated by delimiters - special symbols such as whitespace (decided by the programmer).

For example, if I decide to use whitespace (space, newline, tab, ...) as separators, then tokenizing the string "Every good boy deserves favor" results in the following tokens:
  1. Every

  2. good

  3. boy

  4. deserves

  5. favor




I wanna work for Microsoft!

Share this post


Link to post
Share on other sites
Wow, and there me thinking token was when you had finnished your bong

Share this post


Link to post
Share on other sites
quote:
Original post by Ignacio Liverotti
And by the way, Who doesn´t want to work in Microsoft??

You''d be surprised at how vehemently opposed a lot of people are to that lovable, cuddly-wuddly firmie-wirmie called Microsoftie-woftie...

*ahem*



I wanna work for Microsoft!

Share this post


Link to post
Share on other sites
quote:
Original post by Oluseyi
[quote]Original post by Ignacio Liverotti
And by the way, Who doesn´t want to work in Microsoft??

You''d be surprised at how vehemently opposed a lot of people are to that lovable, cuddly-wuddly firmie-wirmie called Microsoftie-woftie...

*ahem*



I wanna work for Microsoft!

During a co-op placement round, I missed a message that said I had a job interview with MS. But because the interviewer was so impressed by my resume, she was going to give me a phone interview. Problem was that she went on vacation the day of.

Plus they don''t pay that much.

Share this post


Link to post
Share on other sites
quote:
Original post by Ignacio Liverotti
Yeah! But I heard you get your own office there!



Heh, not likely, they have over 30,000 employees. I mean, the Redmond campus is big, but it''s not that big


codeka.com - Just click it.

Share this post


Link to post
Share on other sites

  • Advertisement