Well, I fixed all of the problems with the mouse selecting the proper objects. Then I added the check to see if the clicked gems were adjacent to each other. After that, I added the code to animate the swapping of the gems. I'll add the match logic this weekend.
Here is a little movie of what I have done so far.