I don't think you can get away without freetype if you are going to do anything related to GUI. If you're not interested in GUI, configure Qt ignoring freetype and then compile QtCore (and maybe other modules you need) only.