An argument formed on the basis of the clothing can't stand, anyway. Both Male and Female Black Mages wear pants in Final Fantasy: Tactics:
Linkage to the concept art of both Black Mage genders.
Female Black Mage Sprite.
Male Black Mage Sprite.
Besides, the Black Wizard (more powerful form of the Black Mage) in Final Fantasy I is obviously Male:
