As a fellow male INFJ, I'll try and explain this from his perspective.
First off let me explain it from the view as a man.
Women seem very unaware of how we navigate the convoluted realm that is dating.
The biggest misperception women make about us is that we're nonchalant and/or unaware. In fact, we are extremely aware and see red and green flags just as well as women. And as an INFJ, those insights are magnified greatly. It's difficult for other non NiFe's to understand the depth of what we see in others, since Ni is a subconscious process in every not Ni dom typing. And for us, it can be difficult to put into words as well, which is why we usually process/receive that info in "feelings."
So now I'll try and explain to you how exactly you made him feel. Know that some of this may come off as somewhat harsh, but you're 100% ok and your experience is 100% normal and not out of the ordinary for shy/nervous people in the dating world. I know, because I'm very shy and nervous around others in similar situations,
First of all, he would have gotten a bad feeling about you. The reason is because of your behavior. You seemed very disorganized, unsure of what you wanted, and generally frantic, awkward, creepy, unsettling, and the age old term "crazy." Imagine it from his shoes. Some woman wanted to meet up with you, and was suspicious of you and thought you were pretending to be someone else because of you happened to share the same age and location. That's crazy and will be a huge red flag off the start. And you would have likely shown a small combination of behavior and/or conversation that would allow him, as an INFJ, to put together the image of why you were suspicious of him. Basically, he would be aware that you were suspicious of him and exactly why you were. That would likely be very off-putting, but he'd be willing to brush it off.
Second of all, you asked to spend time with him somewhere, yet when you got there, told him you didn't want to spend time with him. What? At this point he probably understands you were shy and nervous, but most likely made his decision to not spend time with you anymore. You likely exhibited very awkward and generally creepy behavior that would scare anyone away, regardless of personality type.
My advice is to take a step back and view your behavior from the outside. What would you feel if someone behaved that way around you? Empathize.
Then know that this was a one time blunder, and in no way affects you now or in the future, so don't let it stay in your head. We all have our embarrassing moments, and they last as long as they occur. After that, we can let go as it does not affect us anymore. This is no different. My advice for you is not to let fear rule your decisions -- that's a personal lesson I've had the displeasure of learning myself.