I know it's an old topic, but there's something nobody reported above that might have been helpful to OP alekdavis. The release handle at the back of the console has its own spring, so if the end of the cable to the latch slips out of its holder or the cable attachment part of the handle breaks, the handle will still have spring tension to pull it back down when released. What the OP should have done was to first remove the slide-out cupholder/tray (a strong pull, or a few rearward raps with the soft side of a fist, or a small rubber mallet inside the tray or on each side will do). Then, either lying on his back or using a mirror or smartphone camera, raise the release handle and see if the cable fitting is properly seated, with the cable coming out from between the two plastic fins. See attached photo for how the cable should look. If the cable isn't where it belongs, pulling the cable with long-nosed pliers should release the console from its mounting to enable removing the console for easier inspection and reattachment of the cable (or possibly other repair if the handle's cable attach point has broken).
Also, I'm sure poster DONBAA has figured it out by now, but for anyone who hasn't, once the latch is released and you can lift the back of the console up, slide the console back about an inch to unhook it from the front, then you can lift it out completely. If there's some kind of debris lodged somewhere so you can't slide it back, you're on your own. In DONBAA's photo, there's something yellow up at the front of the console, to the right of the front hook. It doesn't look big enough or substantial enough to prevent the console from being removed, but maybe its appearance in the photo is deceiving.