From Old French congié (modern congé), from commeatus ("passage, permission to leave"), from commeo ("I go and come"), from con- + meo ("I go, I pass")
Occasionally I find this word, but I can't help being curious about the change from "-mm-" to "-ng-".