#### Archived

This topic is now archived and is closed to further replies.

# Token

## Recommended Posts

Nacho    205
Hi guys! Can you tell me what is a token? Thanks!

##### Share on other sites
Oluseyi    2103
A token is a single discrete element. Its specific usage depends on context. With respect to compilers and parsers, a token is a single language element such as an identifier (variable or function name), an operator or another form of lexical symbol. With regard to string manipulation, tokens are what are obtained after the string has been separated by delimiters - special symbols such as whitespace (decided by the programmer).

For example, if I decide to use whitespace (space, newline, tab, ...) as separators, then tokenizing the string "Every good boy deserves favor" results in the following tokens:
Everygoodboydeservesfavor

I wanna work for Microsoft!

##### Share on other sites
Jono    122
Wow, and there me thinking token was when you had finnished your bong

##### Share on other sites
Nacho    205
Thanks Oluseyi! I think I got the idea.

##### Share on other sites
Nacho    205
Thanks Oluseyi! I think I got the idea.

##### Share on other sites
Nacho    205
Thanks Oluseyi! I think I got the idea.

##### Share on other sites
Nacho    205
And by the way, Who doesn´t want to work in Microsoft??

##### Share on other sites
Supercytro    122
Trying to start a new trend by triple-posting

##### Share on other sites
Oluseyi    2103
quote:
Original post by Ignacio Liverotti
And by the way, Who doesn´t want to work in Microsoft??

You''d be surprised at how vehemently opposed a lot of people are to that lovable, cuddly-wuddly firmie-wirmie called Microsoftie-woftie...

*ahem*

I wanna work for Microsoft!

##### Share on other sites
Big B    337
quote:
Original post by Oluseyi
[quote]Original post by Ignacio Liverotti
And by the way, Who doesn´t want to work in Microsoft??

You''d be surprised at how vehemently opposed a lot of people are to that lovable, cuddly-wuddly firmie-wirmie called Microsoftie-woftie...

*ahem*

I wanna work for Microsoft!

During a co-op placement round, I missed a message that said I had a job interview with MS. But because the interviewer was so impressed by my resume, she was going to give me a phone interview. Problem was that she went on vacation the day of.

Plus they don''t pay that much.

##### Share on other sites
Nacho    205
Yeah! But I heard you get your own office there!

##### Share on other sites
Dean Harding    546
quote:
Original post by Ignacio Liverotti
Yeah! But I heard you get your own office there!

Heh, not likely, they have over 30,000 employees. I mean, the Redmond campus is big, but it''s not that big

codeka.com - Just click it.