Trouble getting Turn Signal Flasher Relay off

I bought a new Turn Signal Flasher Relay and I'm trying to remove the old one, but it won't pop out. I'm worried about putting anymore strength in to it because I don't want to break the housing. I'm just using my hands right now. Should I get some mini pliers? Am I missing something? Is there a special clip I need to release first? I'm tugging on the relay (black) and it just won't give. I've also tried pressing down on that darker beige clip with no luck.

Image attached.