Sponges have no organs or tissues, so they can be said to have no anatomy. They do have spicules or spongin fibers as a supporting, skeleton-like system, and they have in/out holes because they are filter feeders.
Source: https://www.enchantedlearning.com/subjects/invertebrates/sponge/