Are There Restrictions on Building Temples on Others Land According to Hindu Scriptures?

Are There Restrictions on Building Temples on Others Land According to Hindu Scr