Hi I figured out the solution, very silly one, but works.
My flow has more than 10 actions including nested For each applies. To investigate the issue, I made a copy of the flow, and remove each step to see if I can update then, and finally figured it's Sharepoint list update action make the difference.
So, I removed all Update Sharepoint list actions, and update the flow with my new changes, update ran successfully. I readded back those update actions at the end of the flow, they were in the middle of the flow. In my case, it doesn't matter the position and order of these action.
I don't know if it helps.