Exact matrix product solutions in the Heisenberg picture of an open quantum spin chain