Goldfish Tank Setup. Rinse your gravel before adding it to the aquarium. Choosing natural gravel rather than dyed gravel will be better for the health of your goldfish. You should plan at least three to four inches of gravel to the bottom of the tank (or on top of the undergravel filtration system).