Or you could put bluetooth receivers in the TVs. Since it’s an RF signal you won’t even have to point the phone directly at the TV.
Or we could get a box that receives bluetooth commands and fires an IR LED at the TV. I’m sure someone could rig this together with a microcontroller easily.