It is the single selection that is likely to be killing performance, since it contains an OR. Select statements do not have to have any WHERE clause.
For the OP - you should trace via ST05 to check how the SQL optimiser is actually constructing the select from the database.