This is somewhat akin to sucking up a milkshake trough a large straw with the end partially blocked.
The gaps around the drum are just too constrictive and short of rebuilding the whole of the upper part of the sander not very much air will flow though those gaps.
It is still worth collecting some air from the top pipe but the lack of flow means more fine dust will escape from the gaps at the sides.