The bank which has been beset by technical issues says it is not clear how many customers are involved or how much money was inadvertently withdrawn.
Those affected made withdrawals between 4:15pm on Easter Monday and 4:15pm on Tuesday.
Ulster Bank has apologised to customers and says they will not be left out of pocket as a result.
