I found out that you can deactivate Sumire by having nobody in her range, but I don't think this is gonna be of much help. I couldn't lock the sweeper with my only two blocks.