Kazui was told by "someone" that if he visits a small secret shrine, and he does a very certain ritual, it'll open the gate to hell for him to enter.
The goldfish are the one that lead Kazui to that spot each night. We can only wonder who told Kazui the ritual but it is a bit obvious maybe.