Archived

This topic is now archived and is closed to further replies.

Nacho

Token

Recommended Posts

A token is a single discrete element. Its specific usage depends on context. With respect to compilers and parsers, a token is a single language element such as an identifier (variable or function name), an operator or another form of lexical symbol. With regard to string manipulation, tokens are what are obtained after the string has been separated by delimiters - special symbols such as whitespace (decided by the programmer).

For example, if I decide to use whitespace (space, newline, tab, ...) as separators, then tokenizing the string "Every good boy deserves favor" results in the following tokens:
  1. Every

  2. good

  3. boy

  4. deserves

  5. favor




I wanna work for Microsoft!

Share this post


Link to post
Share on other sites
quote:
Original post by Ignacio Liverotti
And by the way, Who doesn´t want to work in Microsoft??

You''d be surprised at how vehemently opposed a lot of people are to that lovable, cuddly-wuddly firmie-wirmie called Microsoftie-woftie...

*ahem*



I wanna work for Microsoft!

Share this post


Link to post
Share on other sites
quote:
Original post by Oluseyi
[quote]Original post by Ignacio Liverotti
And by the way, Who doesn´t want to work in Microsoft??

You''d be surprised at how vehemently opposed a lot of people are to that lovable, cuddly-wuddly firmie-wirmie called Microsoftie-woftie...

*ahem*



I wanna work for Microsoft!

During a co-op placement round, I missed a message that said I had a job interview with MS. But because the interviewer was so impressed by my resume, she was going to give me a phone interview. Problem was that she went on vacation the day of.

Plus they don''t pay that much.

Share this post


Link to post
Share on other sites