Yes there is some video out there, like this one:

The passenger side is accessible with relative ease. For the driver side, you will need to remove the intake planum, so new gasket for that. Use gasket where Nissan did. They are already prone to leak so I dont see RTV lasting longer. You will also be close to some other maintenance item. To have paid to do them seperatly, do your knock sensor now. You need to remove the lower planum to get access to it but you are really close to it. It will save you some trouble later. I believe there is also a small 90 coolant house that is prone to failure at the front but it is usually done when doing the timing belt and water pump.

 

Read This Thread Here. Theres Some Tips & Tricks To Get That Plenum Off:

Replaced Valve Cover Gaskets

I finally got around to replacing my Valve Cover Gaskets. For the 1st time since owning the truck which i bought at 64k and 13 years old - I no longer have any oil leaks. It leaked since the day i bought it and has gotten worse over time. I read plenty of nightmare stories about not getting the...

www.clubfrontier.org

 

I bought some RED RTV Permatex Gasket Maker, will that work or should I just buy a completely new rubber gasket? Any help is appreciated, thank you.

If me, I would buy good quality gaskets or gasket kit. That's what I did on my '98 Frontier, but that one is easy to do.

 

^^ditto^^ I would get a gasket set that comes with the grommets. Some like to put a little black RTV sealant on the surface of the gasket, but if the valve cover flange is not bent and the gasket is properly torqued, it's not necessary. I would recommend getting the 90-degree coolant hose at the back of the plenum from Nissan, as it is a lot easier to just cut the hose and remove the upper plenum and replace it as opposed to trying to get it disconnected without damage within the limited confines.

I just bought a gasket set from O'Reilly Autoparts:
https://www.oreillyauto.com/detail/...136b8458d/fel-pro-valve-cover-gasket-set/vs50251r1/4312137/2004/nissan/frontier

The set came with an O-Ring, Does anyone happen to know where it goes?

 

^^ditto^^ I would get a gasket set that comes with the grommets. Some like to put a little black RTV sealant on the surface of the gasket, but if the valve cover flange is not bent and the gasket is properly torqued, it's not necessary. I would recommend getting the 90-degree coolant hose at the back of the plenum from Nissan, as it is a lot easier to just cut the hose and remove the upper plenum and replace it as opposed to trying to get it disconnected without damage within the limited confines.

 

Once I remove the valve cover, do I need to pressure wash it or put degreaser to clean off all the gunk on it?

 

You don't "need to". But I would.
I think I'd just use dishwash liquid, simple green, and a brush, then hose off with water and dry it.