* Michael R. Hines (address@hidden) wrote:
On 02/06/2014 08:26 PM, Dr. David Alan Gilbert wrote:
Hi Isaku,
I hit a seg in qemu_rdma_cleanup in the code changed by your
'[PATCH] rdma: clean up of qemu_rdma_cleanup()'
migration-rdma.c ~ 2241
if (rdma->qp) {
rdma_destroy_qp(rdma->cm_id);
rdma->qp = NULL;
}
Your patch changed that to free cm_id at that point rather than
qp; but in my case cm_id is NULL and so rdma_destroy_qp segs.
given that there is a :
if (rdma->cm_id) {
rdma_destroy_id(rdma->cm_id);
rdma->cm_id = NULL;
}
later down, and there is now no longer any destroy of rdma->qp
I don't understand your change.
Your change text says:
'- RDMAContext::qp is created by rdma_create_qp() so that it should be
destroyed
by rdma_destroy_qp(). not ibv_destroy_qp()'
but the diff is:
if (rdma->qp) {
- ibv_destroy_qp(rdma->qp);
+ rdma_destroy_qp(rdma->cm_id);
rdma->qp = NULL;
should that have been rdma_destroy_qp(rdma->qp)?
Dave (who doesn't yet know enough RDMA to be dangerous)
--
Dr. David Alan Gilbert / address@hidden / Manchester, UK
Hi Michael,
Responding for Isaku..... Thanks for reporting the bug, but I need some help
in tracking down the cause of the bug, see below.
Actually, the parameter "rdma->cm_id" to the function is correct, it's just
that the variable never got initialized in the first place, which
means that either
the connection never got established or an early error happened during
the migration that required cleaning up the identifier.
Can you describe the conditions of the migration and the environment?
1. Did you migrate only one VM? Was the host under heavy load?
2. Did your migration lose connectivity? Did one of the hosts crash?
3. Was the connection abruptly broken for some reason?
4. Did you ever cancel the migration at some point and restart?
5. Did you use libvirt?
This is my 1st attempt with RDMA and I'm using softiwarp and
getting an early error, I've not tracked down why yet, hence why I'm
only really reporting the cleanup seg.
outgoing:
rdma_get_cm_event != EVENT_ESTABLISHED after rdma_connect: No such file or
directory
RDMA ERROR: connecting to destination!
migration: setting error state
migration: setting error state
migrate: RDMA ERROR: connecting to destination!
(qemu)
incoming:
ibv_poll_cq wc.status=5 Work Request Flushed Error!
ibv_poll_cq wrid=CONTROL RECV!
messages from qemu_rdma_poll
I've not 100% sure which side fails first yet, but I believe that
incoming fails after outgoing calls rdma_connect but before it calls
rdma_get_cm_event; but as I say I'm new to RDMA and it's my 1st time
trying to debug it.