You need to look again mate, Palace player knocked him from behind (outside the box), then tackled.
I actually think it's a red but a free kick on the edge of the box.
Aye looking again at half time I think I agree with you about the contact being outside the box. Still made the most of it though, think he coul just as easily stayed on his feet and had a chance on goal.