Ridgetop
Herd Master
I don't mind doing work, but I really really REALLY hate doing the same thing twice.
Well, I don't do "cute" in any sense of the word so I can't address that. There are some very nice (ornate/ornamental) steel fencing products that would do the trick but may be cost prohibitive.
Certainly not as good as the old creosote stuff DH and I used to paint our post ends with almost 50 year ago, however you can't get any of the good stuff any more.
As to "cute" fencing, the goats won't care. I would rather have a fence they can't get out of and that I don't have to replace every year. Keep "cute" for the front gate and porch and do sturdy and permanent for everywhere else. Livestock is much more destructive than their sweet appearance leads you to believe.
Like Greybeard and Baymule said: I hate doing the job over again.