We show that the critical value for the contact process on a vertex-transitive graph G with finitely many edges added and/or removed is the same as the critical value for the contact process on G. This gives a partial answer to a conjecture of Pemantle and Stacey.