Chicken broth substitute?

You can use water. It will need extra seasoning. If you are using canned vegetables in your gumbo be sure and add the liquid from them. What kind of rue are you using? A beer adds an interesting level of flavor to gumbo. I've never had gumbo with mushrooms in it.