Azerbaijan and Armenia have started exchanging prisoners, a move stipulated in the cease-fire agreement between the two neighbors that ended recent fighting over the breakaway Nagorno-Karabakh territory.