I figured it out. In the dialog box that wasn't closing out properly, I had several checkboxes, and for some reason, one of the checkboxes had Qt::ApplicationModal set

Anyway, set it to Qt::NonModal like all of the rest, and it works fine now.

Thanks to all who replied.