I would not worry too much about the buildkey. For example I was able to load a plugin built with gcc from an executable built with MSVC 8.
The identifier is used for deciding whether a plugin can be loaded or not. AFAIK there's no option for you to decide which version to load, Qt simply requires that the identifiers match.
Bookmarks