Aside from the direction of text, it's also worth noting that ancient Hebrew did not include punctuation as we know it in English. Including it in quotes therefore can look doubly odd.
Therefore, although (American) English places the punctuation inside the quote, I recommend breaking with this when using quotation marks around Hebrew text. For example,
The text states that "כבוד מלכותו לעולם ועד", meaning "the glorious kingdom is forever."
This is based on what looks best to me, not a language authority. Let's look at some example alternatives.
The text states that "כבוד מלכותו לעולם ועד," meaning "the glorious kingdom is forever."
The text states that ",כבוד מלכותו לעולם ועד" meaning "the glorious kingdom is forever."
The first example, recommended by Sopharch, makes the Hebrew read extremely unnaturally (equivalent to ",hello"). Again, this is both from the directionality and the absence of commas in ancient Hebrew. However, it avoids the awkward bottom-left-to-top-right white area of my recommended style.
The second example, which places the comma where it would be read, looks odd as one scans the entire sentence. It also suffers from the unnatural inclusion of the comma.
Of course, one could forgo correctness for consistency (or claim British English) and write,
The text states that "כבוד מלכותו לעולם ועד", meaning "the glorious kingdom is forever".
Finally, once could dispense with the quotation marks entirely, relying on the change in alphabet to convey that the Hebrew is a quote.
The text states that כבוד מלכותו לעולם ועד, meaning "the glorious kingdom is forever."
Personally I prefer this last style.