If Bikou or anyone else had been the ones knocking on the door, then perhaps they may have heeded Kuroka's words. However, Shirou wasn't Bikou or Kuroka's other acquaintances. Moreover, as an accomplice, and as a friend, he couldn't stand by and do nothing.