Baphomet is like mixing Pashupati mixed with Ardhanarishvara (visual representation of the pure consciousness and pure energy as one) or Cernunnos and Sheela Na Gig. Cernunnos has the circle and the serpent to represent the masculine and feminine polarity, Baphomet has the Caduceus.
The goat head represents the ego/animal-self defeated by achieving the non-dual state, but also fertility because your sexuality and urge to create by making the physical union of the masculine and feminine. That's why people say they're "horny" when they want to have sex.
This world truly is one of dual nature.