Last time we rented we put the deposit into a savings account. The landlords got the book needed to access it and we were the people needed to access it. That way we also collected interest on the deposit (which I think is technically mandatory in Germany).

And good thing we did that because we did have some trouble after we moved out.