Tony Pulis's side are through to a fifth round tie against Reading – but only after they were pushed all the way by their League One hosts.
The teams were 1-1 after 90 minutes and following extra-time, before Lee Angol's poorly struck spot-kick allowed West Brom to snatch at 4-3 win on penalties.