It is not hard to do at all. I did it with my TB still on, but yes, it would be easier with it off. When you take off the valve cover, you will lift up on it, then lift up the passenger side enough to clear the cam cover and pull toward the passenger side of the car - then it will come out easy. I would say to replace this part and see if it solves your problem. I did it on mine and it worked great without having to do anything with the spark plug tubes. seeing as it only is happening with those to cylinders makes me think it is the exact problem i had. I changed my spark plugs at the same time, so i cleaned the inside of the tubes with good paper towels that wouldn't leave fragments behind and then stuffed paper towels half way down in the holes so that nothing could drop down in there while i was working on it (i.e. a bolt when you are removing it or dirt or whatever)
some more tips since you havn't done this before - clean all the surfaces well before reassembly like bryan says. get a little bit of gasket sealer and use it for the following because you dont need to put it everwhere - the gasket will do a fine job of sealing itself. After it is all clean - put a little bit of gasket sealer in the valve cover grove itself where the gasket will go - but just a SMALL dab in the corners and the tops of where the cams are. I do this because these gaskets are reusable and if/when the next time i take my valve cover off, i want the gasket to stick to the valve cover and come off easy. So that is all you want to use the sealer for - just enough to make it stick - you dont want it gooping up and smearing out. 2nd place you want it is in the 'corner' where the cam cover comes back to the flat surface of the head. You want to put just a small dab in on all four of these places (one for each side of both of the cams). I'm not sure how well to explain the location without a pic - but so you have the raised part where the cam is at and it is a half circle and then you have the flat level plane of the head - where the two meet is a sharp angle and it doesn't hurt to have just a bit of sealer there. a ghetto diagram is below - X marks the spot(pretend the periods are white spaces since this code supresses all blank space)
.............................................
..........__.....................__.......
......../.....\................../.....\.....
___x........x_______x........x__
oh ya - also the screws/bolts dont need to be super tight - let the gasket do its job. You will probably be able to take them off using your hand strength (unless you are real weak )