I tried doing that (see this related thread), but I was told this:

Your view propagates mouse clicks directly to the items,therefore they become selected.Thats why disabling mouse events for the scene does not work.