Rather you than me is an expression used when someone has something unpleasant or arduous to do. It is meant in a good natured way of expressing both sympathy and having a bit of a laugh at their expense.
(informal)used for saying that you would not like to do something that another person is going to do‘I'm going climbing tomorrow.’ ‘Rather you than me!’
mainly UK(US usuallybetter you than me)›said by someone who does not want to do the thing that someone else is doing:"I'm having two teeth out next week." "Rather you than me."