@Anonymous
There are two aspects to deal with, one is record limit and one is delegation.
Record limit will "limit" the number of records you can retrieve from a datasource in ONE call (max is 2000).
Delegation is the ability to "push" a query to the datasource to "filter" the information before it is sent back - thus limiting the number of records returned to just what you want.
SOME functions and operators can be delegated to the datasource (in this case, you want to consult the SharePoint Connector Reference for those functions and operators).
IF a function or operator CAN be delegated, then you will get only the results based on that statement BUT still limited to the maximum records of 2000. If that becomes an issue than you would want to take a serious look at why your query would return so much data and what you would need it for anyway.
IF a function or operator CANNOT be delegated, then PowerApps has to pull down all the records and do the function or operator locally. There you will always be limited by the maximum records.
If you have a list of 2001 records and 2001 is one that matches the user name that you are trying to filter for, and you try to do it against the 'Created By'.Email - the query cannot be delegated (that type of column is considered a Complex Type and cannot support any form of delegation...even if the function or operator does) - you will never get it, and your results will be inaccurate.
In your case we talked about using StartsWith - that is because (if you look at the connector reference) that function CAN be delegated AND, in this case, we have created a Text Column with the user information - which is NOT a complex type. So, in the example above. You would get result 2001 in your formula because you are now filtering with a column that can be delegated (simple type) and a function that can be delegated (StartsWith).
NOW...with all that said - maximum records always applies. So, taking the example above - if ALL of your records had the same user email, you would STILL only get 2000.
I hope that helps clear it up some for you.