Rate Limiting in WorkPoint 365

In high-volume multi-tenant solutions like WorkPoint 365, where multiple customers are constantly working with the platform, ensuring fair and timely resources to all customers is crucial. Without proper management, a single customer solution that generates a large number of events can delay the processing of events from other customers, leading to performance bottlenecks.

Several mechanisms exist in WorkPoint 365 to prevent this, but to improve this further, starting from WorkPoint 365 version 4.18, we have introduced rate limiting in the WorkPoint 365 backend. This enhancement ensures that no single customer’s event load can negatively impact the overall system performance.

The purpose of rate limiting in event processing is to prevent scenarios where one or more customer solutions send a lot of events to the event receiver, generating a large queue of events which slows down processing of events on all customer solutions at the same time.

If a customer solution has a high amount of events within a short period if time some events will be paused in a separate queue which is specific to that customer solution, and the solution is flagged as being rate limited. If this happens, the customer solution's administration dashboard page displays a banner, letting administrators know that the solution is currently rate limited. The paused events will following be resumed and all events will be processed eventually.

The introduction of rate limiting on the event processing in WorkPoint marks a significant improvement on how events are processed across multiple customer solutions. By isolating and managing high-volume event sources, this change ensures that all customers experience consistent and reliable performance. Administrators are kept informed through real-time notifications, allowing for proactive management of event loads. This architectural enhancement not only improves the system's robustness but also enhances the overall user experience for all WorkPoint customers.