You look in the underlying treaty, the Vienna Convention on Diplomatic Relations. For example, Art 22 (3) says "The premises of the mission, their furnishings and other property thereon and the means of
transport of the mission shall be immune from search, requisition, attachment or execution". The diplomatic courier "shall enjoy personal inviolability and shall not be liable to any form of arrest or detention". Art. 31 is most of what you are probably interested in:
- A diplomatic agent shall enjoy immunity from the criminal jurisdiction of the receiving State. He shall also enjoy immunity from
its civil and administrative jurisdiction, except in the case of:
(a) a real action relating to private immovable property situated in
the territory of the receiving State, unless he holds it on behalf of
the sending State for the purposes of the mission; (b) an action
relating to succession in which the diplomatic agent is involved as
executor, administrator, heir or legatee as a private person and not
on behalf of the sending State; (c) an action relating to any
professional or commercial activity exercised by the diplomatic agent
in the receiving State outside his official functions.
2. A diplomatic agent is not obliged to give evidence as a witness.
No measures of execution may be taken in respect of a diplomatic agent except in the cases coming under sub-paragraphs (a), (b) and (c)
of paragraph 1 of this Article, and provided that the measures
concerned can be taken without infringing the inviolability of his
person or of his residence.
The immunity of a diplomatic agent from the jurisdiction of the receiving State does not exempt him from the jurisdiction of the
sending State.
Nothing in the treaty forbids the police from physically preventing a diplomat from robbing a bank, they just can't be arrested for it.
An eviction involves hauling the diplomat into court, and physically ejecting them from the premise, neither of which is allowed. This is directly encoded in US law under
28 USC 1609.