Scammed by a taxi driver

Semi-rant/advice needed here so I’ll try to explain. I was out in town on Saturday night with a few friends, started west end then into garage, standard. Without being specific I stay about 30-40 mins outside city centre by taxi as does one of my mates. We came out of the garage at closing time so probably about 3am and the two of us were both pretty far gone, I look over and my pals already at a taxi with the door open so I get in, most of the time we barter a little with the drivers and agree for about £60 to get down the road, I assume he’s already done this (first mistake). First red flag should have been when he asked if we want to get home fast, I say yes and he gets us up to 120mph on the M8 before pulling into the hard shoulder since the coolant on his merc was leaking and he needed to top up. Finally gets us down the road and drops my friend off first, agrees to drop me off 5 mins along the road.

At this point I ask the driver if my friend had already squared him up for the journey he says no and I’ll need to lift £75 in cash. He takes me to a cash machine and I lift the money, already planning the text to my pal in the morning to ask for half. Morning rolls round and while hanging I get a text from my mate asking for £21 for my half of the journey, turns out he’d booked the guy through Uber and prepaid it by card, he either hadn’t told me or I’d forgotten this but being three sheets to the wind I’m not sure. I understand that I should have clarified with my friend once in the car if it was an Uber/already paid for but should I not be able to trust a taxi driver not to rip me off? His car was Uber as well as a registered taxi with a meter etc. My friend has lodged a complaint with Uber but I have a suspicion that’ll lead absolutely no where so what’s my recourse?

TL;DR: Taxi driver sneakily charges me £75 in cash since I was unaware my friend had already paid him for the journey through Uber.