I’m using Azure Read API on my application to read a few lines of text on some labels and I have an average response time of 1s. I know it is possible to install locally a Docker image (for security reasons etc) to perform the same operation, but what I’m more interested in is performance. ..
Upon first launch and after a period of inactivity, our custom-speech-to-text docker container takes a long time to reply (10+ seconds vs sub 1 second response times for subsequent invocations). Here is the docker-compose lines used to run the container: msasr: image: mcr.microsoft.com/azure-cognitive-services/speechservices/custom-speech-to-text:2.6.0-amd64 volumes: – ./MS_ASR_20201202:/usr/local/models restart: always deploy: resources: limits: cpus: ‘4’ memory: 4G ..