An Azure real-time data ingestion service.
Very high number of Throttled Requests in Event Hub - how can we debug?
Recently, we have started experiencing a high number of Throttled Requests in a few of our systems that use Azure Event Hubs.
After adding logs to our consumers and producers, we have concluded that on average we send / receive 100 messages per second (generally less), which doesn't look like a problem given Event Hub's 1.000 message / second limit (we are on the Standard pricing tier).
In Monitoring > Diagnostic Settings I allowed logs to be sent to a Log Analytics Workspace.
Unfortunately, the existing logs aren't quite helpful.
Ideally, I'd like to understand which particular consumer / producer is responsible for the high amount for requests.
Any ideas?