You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As part of day-to-day operation of Data.gov, there are many Operation and Maintenance (O&M) responsibilities. Instead of having the entire team watching notifications and risking some notifications slipping through the cracks, we have created an O&M Triage role. One person on the team is assigned the Triage role which rotates each sprint. This is not meant to be a 24/7 responsibility, only East Coast business hours. If you are unavailable, please note when you will be unavailable in Slack and ask for someone to take on the role for that time.
You are responsible for all O&M responsibilities this week. We've highlighted a few so they're not forgotten. You can copy each checklist into your daily report.
Note: Catalog Auto Tasks
You will need to update the chart values manually. Click the Action link in each issue and grab the values from monitor task output and check runtime.
Solr leader was restarted last night causing harvesting issues. Manually ran db-solr-sync and tracking-update to ensure all datasets are properly indexed.
Solr leader restart has no impact on public users. It only affects catalog-admin users and some backend activity.
Looking at the past three month logs, solr leader restarted 8 times. Comparing the timing to catalog-admin activity, it seems to be semi-closely related to the spike of API requests to /harvest/object/*, which is mostly originated from geoplatform.com automated script. If we can coordinate with geoplatform.com team and give them a time windows when Solr leader restart has minimal impact on our system, that would be ideal. I am thinking it is 6pm ET. Their script can last up to 5 hours, so it should be finished by 11pm ET, that is the window that we dont expect any activity from admin users or backend harvesting.
This is good research here, Fuhu. I like seeing the clear correlation. I don't like that we need to coordinate this; the system should be able to throttle itself.
As part of day-to-day operation of Data.gov, there are many Operation and Maintenance (O&M) responsibilities. Instead of having the entire team watching notifications and risking some notifications slipping through the cracks, we have created an O&M Triage role. One person on the team is assigned the Triage role which rotates each sprint. This is not meant to be a 24/7 responsibility, only East Coast business hours. If you are unavailable, please note when you will be unavailable in Slack and ask for someone to take on the role for that time.
Check the O&M Rotation Schedule for future planning.
Acceptance criteria
You are responsible for all O&M responsibilities this week. We've highlighted a few so they're not forgotten. You can copy each checklist into your daily report.
Daily Checklist
Weekly Checklist
Monthly Checklist
ad-hoc checklist
Reference
The text was updated successfully, but these errors were encountered: