Separate the remove from the formula.
You can insert a check box for the delete when checked and on the OnCheck, put:
ForAll( RenameColumns(Filter(GalleryName.AllItems, CheckboxName.Value = true), "IDColumn", "ID1"),
Remove(Datasource,
LookUp(Datasource,
IDColumn = ID1)) )
------------
If you like this post, give a Thumbs up. Where it solved your request, Mark it as a Solution to enable other users find it.