pytorch

f44fca88 - Update NNPI backend to v0.6.0.5 (#4539)

Update NNPI backend to v0.6.0.5 (#4539) Summary: Updating to NNPI Backend version v0.6.0.5 Pull Request resolved: https://github.com/pytorch/glow/pull/4539 Test Plan: Imported from GitHub, without a `Test Plan:` line. **Glow Dev Mode Testing ICEREF** ``` buck test //glow: -- NNPI ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/844425092762063/ **Glow Opt Mode Testing ICEREF** ``` buck test mode/opt //glow: -- NNPI ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/8444249313953808/ **Glow Opt Mode Testing On Device** ``` buck test mode/opt -c glow.nnpi_use_inf_api=true //glow: -- NNPI -j 1 ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/5629499560791922/ **Net_runner defaults OPT ICEREF** ``` buck test mode/opt //glow/fb/test:net_runner_nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/1970324865910264/ **Net_runner defaults OPT CARD** ``` USE_INF_API=1 buck test mode/opt //glow/fb/test:net_runner_nnpi ``` FAIL https://www.internalfb.com/intern/testinfra/testconsole/testrun/6192449501601838/ **Net_runner tiny ctr_mbl_feed_2020q1 OPT CARD** ``` USE_INF_API=1 LD_LIBRARY_PATH=third-party-buck/platform007/build/fb-nnpi/lib ./buck-out/opt/gen/glow/fb/test/net_runner_nnpi --logfiledb ~/test/161676462_0.predictor --opt_net ~/test/debug_optimized_net_0.pb_txt --use_input ~/test/inputs.pb.recordio --glow-nnpi-memory=13000000 --glow-num-devices=2 --ref_impl=glow --test_impls=glow,c2_fp16 --caffe2_fbgemm_fake_fp16_clamp --glow_global_fp16 --glow_clip_fp16 --glow_global_fused_scale_offset_fp16 --fbgemm_deserialize_to_original_format --inference_threads 16 --load_model_by_blob --glow_global_fp16_placeholders --glow_global_fp16_constants --glow_clip_fp16_skip_inputs --glow_nnpi_lower_all_batch_matmul=false --glow_nnpi_num_parallel_chunks=6 --print_latency ``` success **Net_runner FP16 OPT CARD** ``` USE_INF_API=1 LD_LIBRARY_PATH=third-party-buck/platform007/build/fb-nnpi/lib ./buck-out/opt/gen/glow/fb/test/net_runner_nnpi --opt_net buck-out/opt/gen/glow/fb/test/instagram_ctr_model_debug_optimized_net/debug_optimized_net_0.pb_txt --logfiledb buck-out/opt/gen/glow/fb/test/instagram_ctr_model_tiny/105533872_0.predictor --use_input buck-out/opt/gen/glow/fb/test/instagram_ctr_model_inputs_pb/inputs.pb --inference_threads=1 --glow_global_fp16 --glow_global_fused_scale_offset_fp16=1 --glow_clip_fp16 ``` FAIL P131738351 **numerics tests on IceRef** ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_batchmatmul_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/1688849890354625/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_batchnorm_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/1125900069449763/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_fc_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974535833584/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_op_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974535833516/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_int8_ops_nnpinnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/2533274820486771/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_sls_4bit_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974536132077/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/4222124677262742/ ``` buck test //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp32nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/1688849890355133/ Previously disabled tests `test_slws_fused_8bit_rowwise_acc32_nnpi` and `test_small_sls_acc32` still FAIL https://www.internalfb.com/intern/testinfra/testconsole/testrun/7599824383821851/ **numerics tests on Card** ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_batchmatmul_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/4222124677263984/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_batchnorm_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/1125900069450391/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_fc_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/1688849890354230/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_op_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974535833691/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_int8_ops_nnpinnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/3659174723845865/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_sls_4bit_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974536135102/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp16nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/2251799842675543/ ``` buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp32nnpi ``` https://www.internalfb.com/intern/testinfra/testconsole/testrun/2533274820487658/ Previously disabled tests `test_slws_fused_8bit_rowwise_acc32_nnpi` and `test_small_sls_acc32` still FAIL https://www.internalfb.com/intern/testinfra/testconsole/testrun/1407375046178756/ Reviewed By: arunm-git Differential Revision: D21697616 Pulled By: hl475 fbshipit-source-id: 3732324986eb40e644686cdd10e44951678508a7