Answered

How to do large file data transfer on premises

(0) Share

Report

Posted on by v-upsi Microsoft Employee

Hi,

I have to perform large file data transfer on prem my avg file is 10 gib to 2 tib of size, can you please suggest which connector should i use to perform for this large file data transfer.

Please help on this.

All responses (2)

Answers (2)

Verified answer

v-upsi Microsoft Employee on at

Like (1)

Report

Re: How to do large file data transfer on premises

Hi @JisungHan .
Thanks for your suggestion/help on this.
I had tried with File System and it did not work as mentioned in documentation that it's only allow 30 MB file.
I will check for FTP how can I use this for my use case. I also came to know about Azure Data Factory which is mainly for large file data migration. But don't know will it suitable for my use case or not. And it also support on prem to on prem, on prem to Azure Storage and vise versa.

https://docs.microsoft.com/en-us/connectors/azuredatafactory/

Thanks,
Upendra Singh
Verified answer

JisungHan on at

Like (1)

Report

Re: How to do large file data transfer on premises

Hi @v-upsi ,

I am afraid there is no way to deal with files that is over 1GB.

As far as I know, there are two ways that we can create or upload files:

1. File System: maximum 30MB:

[Ref: https://docs.microsoft.com/en-us/connectors/filesystem/]

2. FTP: Uploading grater than 50 MB files by enabling Allow chunking option

[Ref: https://docs.microsoft.com/en-us/connectors/ftp/]

There is no specific file size limitation in the official document so you can test this from your end. There are many way to create FTP service on a PC through third party applications such as Filezilla

Hope this helps, thanks!

Best regards,

Jisung Han