As Leader of the guild you can perform the following command:
- Target yourself
- /guilddelete -OR-
- /guild delete
I have never done this, however, I suspect you will have your guild hall packed up with all the stuff in a moving crate.
Hope this helps!
~TheFiddler~