Update NNPI backend to v0.6.0.5 (#4539)
Summary:
Updating to NNPI Backend version v0.6.0.5
Pull Request resolved: https://github.com/pytorch/glow/pull/4539
Test Plan:
Imported from GitHub, without a `Test Plan:` line.
**Glow Dev Mode Testing ICEREF**
```
buck test //glow: -- NNPI
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/844425092762063/
**Glow Opt Mode Testing ICEREF**
```
buck test mode/opt //glow: -- NNPI
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/8444249313953808/
**Glow Opt Mode Testing On Device**
```
buck test mode/opt -c glow.nnpi_use_inf_api=true //glow: -- NNPI -j 1
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/5629499560791922/
**Net_runner defaults OPT ICEREF**
```
buck test mode/opt //glow/fb/test:net_runner_nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1970324865910264/
**Net_runner defaults OPT CARD**
```
USE_INF_API=1 buck test mode/opt //glow/fb/test:net_runner_nnpi
```
FAIL https://www.internalfb.com/intern/testinfra/testconsole/testrun/6192449501601838/
**Net_runner tiny ctr_mbl_feed_2020q1 OPT CARD**
```
USE_INF_API=1 LD_LIBRARY_PATH=third-party-buck/platform007/build/fb-nnpi/lib ./buck-out/opt/gen/glow/fb/test/net_runner_nnpi --logfiledb ~/test/161676462_0.predictor --opt_net ~/test/debug_optimized_net_0.pb_txt --use_input ~/test/inputs.pb.recordio --glow-nnpi-memory=13000000 --glow-num-devices=2 --ref_impl=glow --test_impls=glow,c2_fp16 --caffe2_fbgemm_fake_fp16_clamp --glow_global_fp16 --glow_clip_fp16 --glow_global_fused_scale_offset_fp16 --fbgemm_deserialize_to_original_format --inference_threads 16 --load_model_by_blob --glow_global_fp16_placeholders --glow_global_fp16_constants --glow_clip_fp16_skip_inputs --glow_nnpi_lower_all_batch_matmul=false --glow_nnpi_num_parallel_chunks=6 --print_latency
```
success
**Net_runner FP16 OPT CARD**
```
USE_INF_API=1 LD_LIBRARY_PATH=third-party-buck/platform007/build/fb-nnpi/lib ./buck-out/opt/gen/glow/fb/test/net_runner_nnpi --opt_net buck-out/opt/gen/glow/fb/test/instagram_ctr_model_debug_optimized_net/debug_optimized_net_0.pb_txt --logfiledb buck-out/opt/gen/glow/fb/test/instagram_ctr_model_tiny/105533872_0.predictor --use_input buck-out/opt/gen/glow/fb/test/instagram_ctr_model_inputs_pb/inputs.pb --inference_threads=1 --glow_global_fp16 --glow_global_fused_scale_offset_fp16=1 --glow_clip_fp16
```
FAIL P131738351
**numerics tests on IceRef**
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_batchmatmul_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1688849890354625/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_batchnorm_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1125900069449763/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_fc_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974535833584/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_op_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974535833516/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_int8_ops_nnpinnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/2533274820486771/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_sls_4bit_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974536132077/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/4222124677262742/
```
buck test //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp32nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1688849890355133/
Previously disabled tests `test_slws_fused_8bit_rowwise_acc32_nnpi` and `test_small_sls_acc32` still FAIL
https://www.internalfb.com/intern/testinfra/testconsole/testrun/7599824383821851/
**numerics tests on Card**
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_batchmatmul_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/4222124677263984/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_batchnorm_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1125900069450391/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_fc_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1688849890354230/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_op_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974535833691/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_int8_ops_nnpinnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/3659174723845865/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_sls_4bit_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/5910974536135102/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp16nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/2251799842675543/
```
buck test -c glow.nnpi_use_inf_api=true //caffe2/caffe2/contrib/fakelowp/test:test_sls_8bit_nnpi_fp32nnpi
```
https://www.internalfb.com/intern/testinfra/testconsole/testrun/2533274820487658/
Previously disabled tests `test_slws_fused_8bit_rowwise_acc32_nnpi` and `test_small_sls_acc32` still FAIL
https://www.internalfb.com/intern/testinfra/testconsole/testrun/1407375046178756/
Reviewed By: arunm-git
Differential Revision: D21697616
Pulled By: hl475
fbshipit-source-id: 3732324986eb40e644686cdd10e44951678508a7
