Title
Mobile Commons: RCA - 2022/01/27 - Database overload – Groups Slowness
Information
Title: Mobile Commons DB high load – Groups Slowness
DATE, TIME AND DURATION
START TIME: 2022-01-27 10:55 AM Eastern Time RESOLUTION TIME: 2022-01-27 3:20PM Eastern Time
OVERVIEW
On January 27, 2022, Mobile Commons Support received reports around extremely slow uploaded, static and A/B test groups.
ROOT CAUSE
The investigation showed that this slowness was related to a spike in complex insertion DB queries. Many users across the platform triggered multiple duplicate attempts to create static copies of the same dynamic groups. This added an extremely high/unnecessary load on the DB and affected the groups' creation performance across the platform.
CORRECTIVE ACTION
- Short-term: Immediately started working on cleaning up the duplicate/unwanted DB jobs and restored the normal system performance
- Long-Term: Added a backend code in place to not allow triggering multiple static versions of the same dynamic group when there is a backend job already in progress for the same process.
Keywords RCA import document upload RCA_2022.01.27 raexternalrequest
Solution ID
220518093648563
Last Modified Date
05/18/2022 09:46:12 AM
Renew Date
05/18/2023
Status
Published
Author
Taxonomy
- Mobile Commons > RCA-Root Cause Analysis > 2022
Collections
- UMM Support
Upland RightAnswers Portal - Version 2024R2