Blog from September, 2013

The network gear on the 6th floor rebooted. All network functionality should be back now. We will investigate a reason for outage (RFO). Thank you. - Danny Eaton (x5233, dannyeaton@rice.edu)

The network issue in Oshman's Design Kitchen has been resolved. Thanks John Thompson! - Danny Eaton (x5233, dannyeaton@rice.edu)

IT/NTDCO is aware of a network outage in Oshman's Design Kitchen at this time. Technical Services has been dispatched and are enroute for investigation. An update will be forthcoming. - Danny Eaton (x5233, dannyeaton@rice.edu)

The storage system maintenance has been completed.

The scheduled upgrade of the Symantec Endpoint Encryption / PGP Server has been completed.

Please report any issues or questions to the Rice IT Help
Desk at 713-348-HELP / help@rice.edu.

Storage system maintenance for storage.rice.edu and rnas.rice.edu will begin shortly. Expect brief disconnects. Reconnecting should be possible after the maintenance ends.

IT Networking has completed maintenance on the Internet security devices. Please contact IT Operations at x4989 if you are experiencing Internet connectivity problems.

The scheduled storage maintenance for today 9/26/2013 at 6:30 AM has been completed. Some systems may require reconnecting or refreshing links to the storage system.

The scheduled storage maintenance for today 9/26/2013 will begin in 10 minutes.

IT Networking will be performing maintenance on the Rice Internet equipment for a duration of 45 minutes. During this time, users may experience intermittent connectivity to the Internet.

IT is begins a maintenance window on our storage servers early Thursday morning at 6:30AM, and again Thursday evening at 7:30PM.

If you are connected to your storage space at these times, you may notice a brief connection interruption during these hours.

Updates will be posted to the IT web site: it.rice.edu

On Thursday, September 26, at 6:00 AM, IT will update the tools we use to identify, track and block intrusions to the Rice network.

No service interruptions are anticipated, although traffic between the Rice network and the public Internet may slow some during the work.

Updates will be posted to the IT web site: it.rice.edu

IT is updating the tools we use to identify, track and block intrusions to the Rice network. This maintenance will occur at 6AM Thursday morning. No service interruptions are anticipated, although traffic between the Rice network and the public Internet may slow some during the work. Updates will be posted to the IT web site: it.rice.edu

IT is performing maintenance on our storage servers early Thursday morning at 6:30AM and again Thursday evening at 7:30PM. If you are connected to your storage space at these times, you may notice a brief connection interruption at 6:30AM and again at 7:30PM. Updates will be posted to the IT web site: it.rice.edu

The external email service provider, Gmail, has reported service issues* for some of their customers. Rice.edu mail servers are not affected and continue to perform at full functionality.

Some Rice undergraduates may be experiencing slow traffic for their Rice mail. Faculty, staff or graduate students who forward their rice.edu email to Google may also experience delays.

Google anticipates service will be restored by 6:00 PM CST.

*select Gmail on the Google App Status page http://www.google.com/appsstatus to review details.

IT has found and resolved the wireless and VPN authentication issue.

IT is currently investigating wireless and VPN authentication issues.

IT has received reports that outbound email delivery performed slowly. IT investigated and the problem is now resolved. Email delivery should be back to normal.

If you are still experiencing problems, please contact the Help Desk at 713-348-HELP (4357).

A primary MySQL database server locked up and was restarted. This service affected Blog sites, Sakai, and some web sites. All sites should be back online at this time.

The hardware replacement has been completed. - Danny Eaton (x5233, dannyeaton@rice.edu)

A network device in Will Rice College power cycled, and is back up at this time. Network connectivity should be restored. Please contact the IT Service Help Desk for any issues. - Danny Eaton (x5233, dannyeaton@rice.edu)

IT has discovered a failing network component in Herzstein Hall that is impacting a section of the building. We will replace the failing component at 6:00 PM today. This will temporarily interrupt networking while the equipment reboots (about 15 minutes). Thank you for your patience. Danny Eaton (x5233, dannyeaton@rice.edu)

Multiple buildings on the campus have experienced wireless network outage. Services are back online. Network management is investigating for the root cause.

The Rice Primary Data Center was not affected by the campus wide power outage. Email and core services remain functional. Non-core services blogs.rice.edu and wiki.rice.edu remained functional as well, although docs.rice.edu was down. All IT services are currently functioning in full production mode. Updates will be posted to the IT web site: it.rice.edu.

The scheduled maintenance to the storage cluster for virtual machines has been completed.

At 7:00 PM on Thursday evening, September 12, the IT Security Office will enable a test license of Proofpoint's anti-spam and anti-phishing module for outbound rice.edu mail.

This action will not filter outbound messages, only automate logs with details on the number of outbound messages containing digital markers for spam and phishing messages. These records are required for the next step in preventing blacklisting, which interfere with Rice email delivery. Updates will be posted to the IT web site: it.rice.edu.

IT is repairing equipment that supports virtual servers tonight at 7:30 PM. The virtual servers in turn support an array of web sites, applications, and databases. The work lasts less than one minute and no service interruptions are anticipated. Updates will be posted to the IT web site: it.rice.edu

Networking detected an issue in the Brown College wireless network, and has reset the APs in that building. We apologize for the temporary interruption. Connectivity should be back up and functional at this time. Danny Eaton (x5233, dannyeaton)

Power has been restored and all networking gear is back up. Thank you for your patience. - Danny Eaton (x5233, dannyeaton@rice.edu)

Baker College update

Rice Network/Technical Services have identified the issue as
a power outage. Facilities has been made aware and dispatching appropriate personel. Network service should resume when power is restored. Danny Eaton

One of the network devices in Old Baker (North section) has had a failure. The Rice Network/Tech Services team is aware, and working on a resolving the situation. We will update you when possible. - Danny Eaton (713-348-5233, dannyeaton@rice.edu)

Wireless service has been restored. Please report any other issues to the helpdesk.

IT received reports that several Rice.edu web sites' "search" feature was experiencing problems. The issue was found and resolved. Rice website search results have been restored to full functionality.

Wireless network outage on multiple buildings across the campus. Network management is investigating.

We believe that the issues with both of these services have been corrected.

wiki.rice.edu/issues.rice.edu

These services are back up and running. We are still investigating a full fix. Some issues may still be occurring.

We are currently experiencing problems with the host that supports these two services. We are working to restore these services as quickly as possible.

Rice IT successfully reconfigured a third Internet link to Amazon Cloud Services after campus systems that rely on the utility suffered degraded performance issues.

When the primary external Internet connection to Amazon Cloud Services stopped functioning properly, local Rice systems using storage and database space in the commercial cloud appeared to be offline. The secondary Internet link to Amazon's cloud quickly filled with traffic and resulted in continued performance degradation.

IT will leave the work-around configuration in place until Amazon Cloud Services are again available through their primary link.

IT has learned from one of our Internet service providers that two of the preferred links between Internet2 and Amazon Cloud Services are experiencing issues. These connection issues may create the perception that some services used by the Rice community are offline.

Rice IT is re-configuring our internet routers to use a third link. We expect to have this configuration complete by 12:45 PM. Once complete, services should improve for the affected sites.

Updates will be posted to the IT website: it.rice.edu

Riceprint.rice.edu, a print queue used by Rice staff, has been returned to service. Please report any further printing issues to the Help Desk: 713.384.4357 or helpdesk@rice.edu.

riceprint.rice.edu

Riceprint is not accepting print jobs at this time. IT is looking into the issue.