President Barack Obama insisted Wednesday that higher taxes for the wealthy had to be a part of any deal on averting the fiscal cliff looming at year-end. \"We cannot afford to extend the Bush tax cuts for the wealthy,\" he said, while saying tax breaks for middle class families should stay in place.