I got it working.
The solution was to use IndexAt() with the event->pos() from mousePressEvent.
Then I had to create a pointer to the attached model in order to use fileinfo on it.
I then insert the resulting filename into an Urllist and set the mimeData with it.

Qt Code:
  1. QFileSystemModel *tempmodel = qobject_cast<QFileSystemModel *>(model());
  2. QModelIndex tempindex = indexAt(event->pos());
  3. QMimeData *mimeData = new QMimeData;
  4. QList<QUrl>urllist;
  5. QString filename=tempmodel->filePath(tempindex);
  6. urllist.append(QString("file:"+filename));
  7. mimeData->setUrls(urllist);
To copy to clipboard, switch view to plain text mode 

Now setPixmap is working as expected and mimeData contains allways the currently dragged Item.