Currently the address fields have issue configuring to the custom components and you will hit this. This was blocked by composite control team I beleive as address was one composite control in legacy interface. We are evaluating to make this consistent.
For your scenario, you can create custom fields on the entity for address components like street, city etc. Write the client API to populate these fields from any address 1,2,3 user chooses and bind these to the custom component.
I build one using azure cognitive to autofill address (control bound to just one dummy field) and as user types dropwon is populaed based on the search results from azure. On user selection fields are populaed back to the individual address fields (custom again as OOB address fields cannot be configured to components)..
Let me know if you need to see that code 🙂