You will be delighted to hear that e.g. Euro bank notes have had RFIDs since around 2005. The only remarkable thing about Euros is that the EU made this public knowledge, other nations did the same, they only didn't tell everyone.
Any bill you have in your wallet makes you trackable, and every bill spent can be tracked back to you. No secrets.
As for cell phones, they need not be "smart" for your service provider and/or secret services to trivially and routinely track your position, and to eavesdrop not only on communications but also to use the phone as a remote microphone. That kind of stuff has been done since the 1990s.
If you don't have a passport, you sure do have some form of ID card or drivers license, there's hardly a way around them. They all have ISO 14443 RFIDs nowadays too. Contrary to common propaganda, these chips do not have an active range of 5-10cm but upwards of 3 meters. They also are not exclusively readable with the PIN.
Which means no more and no less than you're trackable and identifiable pretty much everywhere in every city. Why do you think they don't want to see your ID when you enter an airplane now? Because they've already seen it when you're still 3 meters away.
If you want to worry about something, worry about this shit, not about the NSA trying to hack your computer. If they do want your computer's contents, they'll break into your house and ask you for the password while you're wearing a black sack over your head and are being beaten with a hose. That's cheaper and faster.