1개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
0
Unfortunately Neo doesn't support quantization for Jetson Devices. It means you can only compile FP32 models and they will be FP32 after compilation.
I know this is not what you're looking for, but FYI, Neo supports int8 model optimization only for TFLite and targeting CPU not GPU. Check here some supported models: https://docs.amazonaws.cn/en_us/sagemaker/latest/dg/neo-supported-edge-tested-models.html
답변함 2년 전
관련 콘텐츠
- AWS 공식업데이트됨 2년 전