Update:

We added the new files to an existing component. Shows they are still not installed!
So it's the files themselves that are not added on update. (How can I change this thread's title?)

Looks like there's something I seriously don't yet understand about installer framework. Any pointers appreciated.