This might be due to your host controller not allowing you to allocate more bandwidth.
We can check the maximum bandwidth allocated by the Host to our device for these conditions:
1. Burst length: 15, single ISO packet
2. Burst length: 7, two ISO packets
3. Burst length: 5, three ISO packets.
You can also try for the above mentioned configurations.