Sometimes I feel like I am stuck between my own manager and the other manager from the client's side, what should I do?

Talk to your manager about it, but keep it cool and professional. Sometimes just being clear about your role helps a lot.