The voiceover makes clear that Deckard thinks Gaff's a lame faggot that speaks gutter talk. And Gaff's not some mysterious super detective, he's just a lesser cop that's pissed Bryant called in a retired guy to give the case to rather than promoting Gaff and giving him the job.