Setup a tool to verify consistency between streaming and non-streaming #52

Open
opened 2021-01-22 09:45:33 +00:00 by hj · 0 comments
Owner

One of the bugs that keeps on reappearing is when something is present in polling endpoints but doesn't arrive in streaming, making streaming mode unreliable. Biggest issue however that this very hard to detect because you can't see what you're missing until you switch the client and actually notice the discrepancy (i.e. i noticed lack of muted users' posts in streaming only when i realized that gondola bot posts (whom i muted due to spam that one time) appear in husky but not in pleromafe).

We could make a minimal FE/Client that would monitor both streaming and polling APIs at the same time and notify the user when polled TL has data that wasn't present in streaming API and what missing status/notification is. We could also direct users to said tool if they notice the dropouts so that we can investigate easier.

One of the bugs that keeps on reappearing is when something is present in polling endpoints but doesn't arrive in streaming, making streaming mode unreliable. Biggest issue however that this very hard to detect because you can't see what you're missing until you switch the client and actually notice the discrepancy (i.e. i noticed lack of muted users' posts in streaming only when i realized that gondola bot posts (whom i muted due to spam that one time) appear in husky but not in pleromafe). We could make a minimal FE/Client that would monitor both streaming and polling APIs at the same time and notify the user when polled TL has data that wasn't present in streaming API and what missing status/notification is. We could also direct users to said tool if they notice the dropouts so that we can investigate easier.
Sign in to join this conversation.
No labels
BE
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
pleroma/pleroma-meta#52
No description provided.