fix some parameter setting does not work for CPU DDP and bf16 fail in… (#527)
* fix some parameter setting does not work for CPU DDP and bf16 fail in DDP path
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
* if number_machine > 1, get the ip and port accelerate config set
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
* if main_process_ip and port is set by user, use them, else use default "127.0.0.1" when DDP is used in one machine
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>