remove spatial_size #643

Job	Run time
linux (linux.12xlarge, cpu) / linux-job	39s
linux (linux.g5.4xlarge.nvidia.gpu, cuda, 11.8) / linux-job	8m 19s
macos (macos-12) / macos-job	2m 26s
macos (macos-m1-12) / macos-job	1m 12s
windows (windows.4xlarge, cpu) / windows-job	2m 0s
windows (windows.g5.4xlarge.nvidia.gpu, cuda, 11.8) / windows-job	10m 40s
	25m 16s

Provide feedback