There is a gasket, and I prefer to use gaskets over RTV, given a choice - especially for maintenance items. Saves cleaning with fluid changes...
You can use RTV - if you do, use RTV Black. Blue isn't worth the tube it comes in, and Red or Copper is just overkill for the job...
While you have everything torn down, it's not a bad idea to put a threaded stud in the topmost hole - for future changes you can just loosen that nut, remove the bolts, and then tap the cover loose and drain the gear oil without the big splash from the cover falling in the drain pan...
5-90