Skip to content

chore: enable crustdata member enrichment source and bump cadence (CM-886)#3790

Merged
skwowet merged 3 commits intomainfrom
improve/CM-886
Jan 29, 2026
Merged

chore: enable crustdata member enrichment source and bump cadence (CM-886)#3790
skwowet merged 3 commits intomainfrom
improve/CM-886

Conversation

@skwowet
Copy link
Member

@skwowet skwowet commented Jan 28, 2026

Changes

  • Re-enable Crustdata in the enrichment sources list so it participates in the daily workflow.
  • Run the enrichment schedule hourly (skip overlap still applies) and extend retry backoff to 5/10/20 with 4 attempts to smooth rate‑limit spikes.

Note

Medium Risk
Changes cadence/concurrency and retry behavior for production workflows, which can impact load, cost/credits usage, and processing latency if the new schedule or throttling assumptions are off.

Overview
Updates the Temporal schedule for members-enrichment-multiple-sources to run hourly instead of daily while keeping overlap skipping, increasing how often enrichment is attempted.

Re-enables MemberEnrichmentSource.CRUSTDATA in getMembersToEnrich so it participates in the multi-source enrichment runs.

Throttles SERP enrichment by reducing maxConcurrentRequests from 300 to 10, and makes enrichment activities more resilient by increasing retry attempts (3→4) and max backoff (10m→20m) in enrichMember.

Written by Cursor Bugbot for commit 9c38c0b. This will update automatically on new commits. Configure here.

@skwowet skwowet self-assigned this Jan 28, 2026
@github-actions

This comment was marked as spam.

2 similar comments
@github-actions

This comment was marked as spam.

@github-actions
Copy link
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@skwowet skwowet changed the title chore: enable crustdata member enrichment source and bump cadence chore: enable crustdata member enrichment source and bump cadence (CM-886) Jan 28, 2026
Copy link

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

@skwowet skwowet merged commit cc44620 into main Jan 29, 2026
15 checks passed
@skwowet skwowet deleted the improve/CM-886 branch January 29, 2026 04:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant