READ SOMETHING INTO

to think that a situation, action, etc. has a meaning or importance that it does not really have. [ex - It was only a casual remark. I think you're reading too much into it.]