Hi @Vinith46 ,
Could you please share a bit more about the Search formula you used in your Gallery?
Do you want to search your SP List records (25000 records) based on the ID (Number) and Name column (Text)?
Based on the needs that you mentioned, I have made a test on my side, regardless of which Filter function or Search function you used in your app, you would faced a Delegation warning issue with your formula.
If you have faced a Delegation warning issue with your formula, it means that PowerApps could not delegate the data process to your SP List data source, you could only process data locally. In default, you could only process 500 records at most. You could change the limit to maximum value -- 2000.
More details about the Dlegeation in PowerApps, please check the following article:
https://docs.microsoft.com/en-us/powerapps/maker/canvas-apps/delegation-overview
As an alternative solution, you could bulk-save your SP List records into multiple separated collections in your app. Then save the multiple collections into a Single one Collection (MergedCollection). Then use the MergedCollection as data source within your app instead of your Original SP List data source.
Please check and see if the alternative solution mentioned wihtin the following thread would help in your scenario:
https://powerusers.microsoft.com/t5/General-Discussion/Pulling-in-large-ish-SQL-tables/m-p/243777#M71518
On your side, please take a try with the following workaround:
Concurrent(
ClearCollect(Col1, Filter('YourSPList', ID >= 1 & ID <= 2000)),
ClearCollect(Col2, Filter('YourSPList', ID >= 2001 & ID <= 4000)),
ClearCollect(Col3, Filter('YourSPList', ID >= 4001 & ID <= 6000)),
ClearCollect(Col4, Filter('YourSPList', ID >= 6001 & ID <= 8000)),
ClearCollect(Col5, Filter('YourSPList', ID >= 8001 & ID <= 10000)),
ClearCollect(Col6, Filter('YourSPList', ID >= 10001 & ID <= 12000)),
ClearCollect(Col7, Filter('YourSPList', ID >= 12001 & ID <= 14000)),
...
...
ClearCollect(Col11, Filter('YourSPList', ID >= 20001 & ID <= 22000)),
ClearCollect(Col12, Filter('YourSPList', ID >= 22001 & ID <= 24000)),
ClearCollect(Col13, Filter('YourSPList', ID >= 24001 & ID <= 26000))
);
ClearCollect(MergedCollection, Col1, Col2, Col3, Col4, ..., Col11, Col12, Col13)
Then set the Items property of the Gallery to following:
Filter(MergedCollection, TextSearchBox1.Text in ID || TextSearchBox1.Text in Name)

Note: Please make sure you have changed the "Data row limit for non-delegable queries" option within Advanced settings to 2000 (maximum value). The TextSearchBox1 represents the Text Input box (where you type the search text) in your app.
Please take a try with above solution, then re-load your app, check if the issue is solved.
More details about changing the Delegation limit, please check the following article:
https://docs.microsoft.com/en-us/powerapps/maker/canvas-apps/delegation-overview#changing-the-limit
Best regards,