tag:status.enterprisealumni.com,2005:/historyEnterpriseAlumni Status - Incident History2024-03-28T11:40:01-07:00EnterpriseAlumnitag:status.enterprisealumni.com,2005:Incident/77981072021-08-19T10:57:13-07:002021-08-19T10:57:13-07:00Intermittent issues with new user registration<p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>10:57</var> MST</small><br><strong>Resolved</strong> - This incident has been resolved and all systems are operational.</p><p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>09:44</var> MST</small><br><strong>Update</strong> - An interim bypass has been enabled to ensure no impact to customers while SAP resolves this issue. All users can now successfully register to the platform.</p><p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>08:57</var> MST</small><br><strong>Identified</strong> - The issue has been isolated to our downstream vendor SAP who has been contacted and a P2 ticket escalated. Resolution expected within 30 minutes.</p><p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>04:49</var> MST</small><br><strong>Investigating</strong> - Alumni community, we are aware that some customers are experiencing intermittent issues associated with new user registration. We are actively investigating.<br /><br />This does not impact access to the portal for registered users or admins. <br /><br />We will keep you updated until the service is fully restored. We apologize for any inconvenience and thank you for your patience.</p>tag:status.enterprisealumni.com,2005:Incident/69180732021-05-04T14:55:38-07:002021-05-04T14:55:38-07:00SSO Login / Intermittent Failure<p><small>May <var data-var='date'> 4</var>, <var data-var='time'>14:55</var> MST</small><br><strong>Resolved</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>10:53</var> MST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>10:41</var> MST</small><br><strong>Identified</strong> - The issue has been raised with our downstream vendor (SAP) and are expecting a deployed solution within 24hrs. Impacted customers have been alerted and customers can still access the system by the provided direct logon URL.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>10:36</var> MST</small><br><strong>Investigating</strong> - We are investigating a global issue where certain customers logging in via SSO are experiencing a "time out" error. Impacted customers have been alerted and customers can still access the system by the provided direct logon URL.</p>tag:status.enterprisealumni.com,2005:Incident/69181862021-05-03T05:38:00-07:002021-05-04T10:53:55-07:00SSO Login / Customer Reported Intermittent Failure<p><small>May <var data-var='date'> 3</var>, <var data-var='time'>05:38</var> MST</small><br><strong>Resolved</strong> - Singular customer has noted a time out with the SAML requests for customers logging in via SSO. The impact is only for Administrator Accounts and we have been unable to reproduce. We will continue to monitor the situation.</p>tag:status.enterprisealumni.com,2005:Incident/60344582021-01-15T16:29:48-07:002021-01-15T16:29:48-07:00Messaging: Transactional Emails Sending Duplicates<p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>16:29</var> MST</small><br><strong>Resolved</strong> - The issue has been resolved, all impacted end users have received a notification.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>14:56</var> MST</small><br><strong>Investigating</strong> - We are currently investigating an issue where our downstream email delivery provider is sending duplicate transactional emails to users. This issue is limited in scope to new user registration reminders only and no other messaging or communications module is impacted.</p>tag:status.enterprisealumni.com,2005:Incident/47265772020-07-28T14:30:05-07:002020-07-28T14:30:05-07:00Technical Incident - Mail and Stat Delays, v2/v3 API Calls and Site Down<p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>14:30</var> MST</small><br><strong>Resolved</strong> - This incident has been resolved: We have recovered the remaining impacted services and are continuing to monitor system performances. https://status.sendgrid.com/incidents/c2k6nqpr9t7p</p><p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>12:52</var> MST</small><br><strong>Monitoring</strong> - Sendgrid has implemented a fix and is currently monitoring the situation. All systems seem to be operating.</p><p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>12:07</var> MST</small><br><strong>Identified</strong> - Note from sendgrid: We believe we have identified the source of the issue which has been affecting our services. Our team has tested the remediation steps and are now working toward recovering all remaining impacted services. We will provide another update in 30 minutes or sooner as they become available. We sincerely apologize for the inconvenience this has caused and thank you for your patience. (https://status.sendgrid.com/)</p><p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>09:56</var> MST</small><br><strong>Investigating</strong> - Our downstream messaging provider (SendGrid) is experiencing an outage. We are seeing mail and stat delays (including Legacy and New Marketing Campaigns). Mail is being accepted but could be stuck in queue. Users may be experiencing a higher volume of v2/v3 API call errors, especially 5xx errors around 9:45 AM MT. Details can be found: https://status.sendgrid.com/incidents/c2k6nqpr9t7p</p>tag:status.enterprisealumni.com,2005:Incident/36559332020-03-07T00:30:33-07:002020-03-07T00:30:33-07:00Scheduled Maintenance<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>00:30</var> MST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>22:30</var> MST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>18:53</var> MST</small><br><strong>Scheduled</strong> - On Friday 3/6 at 1030pm PST, there will be scheduled maintenance period for approximately 2 hours. We will be using this time to upgrades element of our infrastructure and speed up the overall service of the application. <br /><br />To ensure uptime and stability of the platform, we are performing this upgrade on a overnight and on a weekend to ensure minimal impact.<br /><br />During this maintenance window, the platform may be inaccessible and any communications scheduled for delivery will be paused. All operations around the platform including any intelligent events or automations will resume immediately after the maintenance window.</p>tag:status.enterprisealumni.com,2005:Incident/36128802020-02-25T14:30:00-07:002020-02-25T15:19:30-07:00Site speed impact for EU customers<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>14:30</var> MST</small><br><strong>Resolved</strong> - We identified a degradation in service (site speed) for certain EU visitors. This issue has been resolved and all services are restored.</p>tag:status.enterprisealumni.com,2005:Incident/34270532020-01-14T17:59:15-07:002020-01-14T17:59:15-07:00LinkedIn Authentication Service<p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>17:59</var> MST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>17:59</var> MST</small><br><strong>Update</strong> - LinkedIn has resolved this issue. All services are now operational.</p><p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>16:04</var> MST</small><br><strong>Update</strong> - No new updates have been provided by LinkedIn at this time, we continue to monitor the situation.</p><p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>13:10</var> MST</small><br><strong>Monitoring</strong> - LinkedIn has communicating that a fix is being prepared and they expect to have services restored shortly. Please follow this thread for additional information released by LinkedIn: https://twitter.com/LinkedInHelp</p><p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>09:35</var> MST</small><br><strong>Identified</strong> - LinkedIn Service is currently experiencing performance issues that prevent some users from signing up or authenticating into the platform. They have identified and are working on resolution. Status can be monitored directly here: https://twitter.com/LinkedInHelp</p>tag:status.enterprisealumni.com,2005:Incident/32555852019-11-25T17:30:57-07:002019-11-25T19:36:23-07:00Messaging Service : Intermittent Failure<p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>17:30</var> MST</small><br><strong>Resolved</strong> - All services are now operational. All messaging services have been restored.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>16:19</var> MST</small><br><strong>Identified</strong> - Our Ops Teams are investigating an issue with some customers seeing a failure when connecting an event to a mail campaign. This does not impact any scheduled or automated mailings. The issue is identified and expect resolution in < 60 minutes.</p>tag:status.enterprisealumni.com,2005:Incident/31076722019-10-15T06:30:00-07:002019-10-15T16:36:08-07:00New Marketing Campaigns: Delayed Send<p><small>Oct <var data-var='date'>15</var>, <var data-var='time'>06:30</var> MST</small><br><strong>Resolved</strong> - Our Ops Teams are investigating an issue with some customers seeing a perpetual "loading" on new send campaigns. This does not apply to system, automated or timed campaigns and only impacts a small subset of customers.</p>tag:status.enterprisealumni.com,2005:Incident/23088732019-04-10T11:52:31-07:002019-04-10T11:52:31-07:00Messaging Gateway Infrastructure Upgrade<p><small>Apr <var data-var='date'>10</var>, <var data-var='time'>11:52</var> MST</small><br><strong>Completed</strong> - The planned upgrade has been completed.</p><p><small>Apr <var data-var='date'> 9</var>, <var data-var='time'>03:01</var> MST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>16:53</var> MST</small><br><strong>Scheduled</strong> - During this maintenance window, there will be a degradation of service on the messaging gateway. Any prescheduled or queued emails will be sent as expected. New campaigns can be created but sending can only be scheduled once the maintenance window has closed.<br /><br />This upgrade will improve a number of functional components of the mass mailer service. <br /><br />No other services are impacted.</p>tag:status.enterprisealumni.com,2005:Incident/22398642019-03-09T08:30:10-07:002019-03-09T08:30:10-07:00Messaging Editor Upgrades<p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>08:30</var> MST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>06:30</var> MST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>11:19</var> MST</small><br><strong>Scheduled</strong> - We will update several, important parts of the system to make it more scalable, more secure, and ready for future growth. Among other areas, we will optimize the system database and update the application authorization service. The changes to the authorization service, in particular, are a prerequisite to substantial performance improvements that will be rolled out in Q2.<br /><br />Although the maintenance window is 2.5 hours, we expect actual downtime to be about 90 minutes. We will make every effort to ensure that maintenance is performed as quickly as possible.<br /><br />Services not directly related to the editor itself, such as delivery of images, will not be impacted. In other words, images in messages already created or sent, will display correctly.</p>tag:status.enterprisealumni.com,2005:Incident/22153172019-02-20T01:45:38-07:002019-02-20T15:58:34-07:00Alumni Scorecard / Rolling Reports: Intermittent Issues<p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>01:45</var> MST</small><br><strong>Resolved</strong> - The incident is resolved and all reporting is working as expected.</p><p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>19:57</var> MST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>16:47</var> MST</small><br><strong>Identified</strong> - We are currently experiencing intermittent outages within the reporting and insights module of the application. We have identified the issue and are working on a fix.</p>tag:status.enterprisealumni.com,2005:Incident/21993922019-02-14T02:30:40-07:002019-02-14T02:30:40-07:00Infrastructure Upgrades<p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>02:30</var> MST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>00:00</var> MST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>19:45</var> MST</small><br><strong>Scheduled</strong> - As part of an upgrade to the EnterpriseAlumni infrastructure including the disaster recovery and CDN customers will experience an outage of their Alumni site. The site will show the maintenance window message during this time.<br /><br />Although the window is 2.5 hours, actual downtime is expected to be around 60 minutes and we will make every effort to ensure the work is performed as quickly as possible.</p>tag:status.enterprisealumni.com,2005:Incident/21543662019-01-17T11:09:16-07:002019-01-17T11:09:16-07:00IE Access To Administration<p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>11:09</var> MST</small><br><strong>Resolved</strong> - Issue resolved, impacted customers have further details via JSD.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>09:11</var> MST</small><br><strong>Monitoring</strong> - A fix is being tested to resolve the IE issue some customers might be experiencing. This is only impacting certain modules in the admin console for older versions of Internet Explorer.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>07:57</var> MST</small><br><strong>Investigating</strong> - Some customers will notice a degradation of performance and in some issues the non-loading of administrator pages in Internet Explorer.</p>tag:status.enterprisealumni.com,2005:Incident/20598152018-12-24T04:30:43-07:002018-12-24T04:30:43-07:00Migration: Universal Login<p><small>Dec <var data-var='date'>24</var>, <var data-var='time'>04:30</var> MST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>24</var>, <var data-var='time'>04:00</var> MST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>02:38</var> MST</small><br><strong>Scheduled</strong> - Some end users will see a potential degradation of service for up to 30 minutes as the authentication gateway (IDP) is updated to support universal login.</p>tag:status.enterprisealumni.com,2005:Incident/20670952018-11-27T02:00:59-07:002018-11-27T12:22:23-07:00IDP Migration<p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>02:00</var> MST</small><br><strong>Resolved</strong> - Some customers may see a degradation of service during an upgrade of our roles and permissions resource.</p>tag:status.enterprisealumni.com,2005:Incident/20597332018-11-26T05:00:34-07:002018-11-26T05:00:34-07:00Scheduled Maintenance: Upgrade of DNS architecture to support rapid rollover in the event of a DR requirement.<p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>05:00</var> MST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>04:00</var> MST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>01:26</var> MST</small><br><strong>Scheduled</strong> - All customers & end users may see a degradation of performance during the scheduled maintenance period.</p>tag:status.enterprisealumni.com,2005:Incident/17778302018-05-23T19:44:25-07:002018-11-23T23:57:40-07:00Social Login Failure<p><small>May <var data-var='date'>23</var>, <var data-var='time'>19:44</var> MST</small><br><strong>Resolved</strong> - There is a current service outage with LinkedIn that is causing intermittent failure for users trying to login or new users trying to associate their LinkedIn profile.
<br />
<br />We have escalated this issue and have no estimation of downtime impact at this time.
<br />
<br />This issue will be tracked as ticket EA-182 and all updates re status and resolution will be updated directly in the ticket
<br />
<br />
<br />Impact:
<br />Some users trying to sign up or login are met with a LinkedIn error message preventing them from accessing the platform</p>