xla

929415ae - Route scalar values to device data to achieve graph convergence by have scalar leaf nodes being all device data.

Route scalar values to device data to achieve graph convergence by have scalar leaf nodes being all device data. Cache the most common scalars to avoid keep sending them to device, and issues related to fragmentation.