A one-to-many JoinColumnsOrFormulas does not exist; a one to many relationship would allow us to write a query as:
parent outer join child on
parent.col1 = child.col2 // POSSIBLE using @JoinColumn
and parent.col2 = some_formula // POSSIBLE using @JoinFormula
and child.some_col = some_formula // NOT POSSIBLE
where child is null
Here the child.some_col = some_formula cannot go into a where clause and there is no way to join?
A many-to-one JoinColumnsOrFormulas works
child inner/outer join parent on parent.some_col = some_formula works fine

So, how do we do a left outer join on collection with additional join clauses, there is none.

Only way left is doing a full left outer join on collection and filtering those that you don't need I guess. Another option is using a not in.