Light the grill. In a large saucepan of boiling, salted water, simmer the potatoes until almost tender, about 5 minutes. Drain, transfer to a large bowl and toss with the olive oil, salt, black pepper and cayenne. Grill over moderate heat for about 15 minutes, turning, until tender and lightly charred. Serve warm.