File is larger than the maximum size supported by datastore.

This happens because by default VMware ESX running VMFS3 uses 1M blocksize with a limitation of 256 GB disk size for the guest virtual machine. However it is possible to change or rather increase the size of disk drive that you can create for the virtual machine. If you can change block size to 2M on VMFS3 filesystem on your ESX server you can create disk drive upto 512GB size for the virtual machine.VMware Recommends following block size to create large disk drive on virtual machines :

1M Block Size max VMFS-3 = 256G
2M Block Size max VMFS-3 = 512G
4M Block Size max VMFS-3 = 1024G
8M Block Size max VMFS-3 = 2048G

File size larger than 2048 GB is not supported on VMFS3 filesystem, using VMFS2 you can go upto 16 M block size but that option is not available on VMFS3 filesystems.To changethe block size on a VMFS3 filesystem you can use vmkfstools command from command line ro reformat the parition. The vmkfstools command can be run on ESX server :

#vmkfstools –create vmfs3 –blocksize 2M vmhba1:0:0:2