I built a collection that is the exact one pictured in your example.
Shown below is Test App I put together to display it

On left is the full collection, and I gathered it liek this
in onselect of the button below it
ClearCollect(SampleTable,
{Name:"Apple", Colour:"Red"},
{Name:"Apple", Colour:"Green"},
{Name:"Grapes", Colour:"Red"},
{Name:"Grapes", Colour:"Green"},
{Name:"Pear", Colour:"Green"},
{Name:"Courgette", Colour:"Green"},
{Name:"Cucumber", Colour:"Green"})
on the right is the narrowed collection, which was collected like so
OnSelect
ClearCollect(FruitTable,
Filter(SampleTable, And(Colour="Green", Or(Name="Apple", Name="Grapes"))=false))
If that is not working for you same as in my screenshot, there's something wrong with how it's been written when plugged in on your side. (Unless results bring in more than 2k items, or 500 if you haven't chanegd default items count)
I would recommend making another screen in your app and recreating the above so that you can see it in action and get a better understanding of how it is working for when you apply it to your own data