Hi @aggneha9821 ,
There are few methods to achieve this.
Method 1: You Can change or make in Excel Template itself the Column into Number Format as shown in below image.

Method 2:
After writing it to the excel you can change the A column format to Number format.You Run Vbscript action.
Use below Vbscript.
Set objExcel = CreateObject("Excel.Application")
objExcel.Visible = True
Set objWorkbook = objExcel.Workbooks.Open("C:\path\to\your\file.xlsx")
Set objWorksheet = objWorkbook.Worksheets(1)
Set objRange = objWorksheet.UsedRange.Columns(1)
objRange.NumberFormat = "0"
objWorkbook.Save
objWorkbook.Close
objExcel.Quit
Methods 3:
You can pass send keys using Sends key action.

(Note:- if you got your solution you can mark as solution and gives kudos)
Thanks & Regards
Vishnu Reddy