You should be able to make the structure strong enough
as I mentioned before the key will be accurate tight fitting joints.
However, I'm worried about the stability of the structure
Is it possible to tie the top shelf to the wall one end and long edge?