Can you make folder icons not popup contents of the folder?

I just want to use them kinda like shortcuts that I can drag to. So when you click or hover the contents of the folder popping up is distracting.

Is there a way to disable that? I can make the little triangle showing it will popopen go away but not the function.