Blog from May, 2013

The storage maintenance scheduled for tonight has been completed.

The planned User home directory maintenance will begin at 7:00pm.

Users with NetIDs which have a first letter of A through I will be done this evening.

A read only period will be followed by a temporary loss of connection for each group. Reconnecting should be possible shortly thereafter.

On Saturday, June 1, FE&P will replace the ATS (automatic transfer switch for electric power) for the Mudd Lab building. This means the power to Mudd will be interrupted from 8:30 am until 9:00 pm (latest).

Critical campus services and systems based in Mudd Lab and connected to our emergency generator power sources will continue to function as usual. All other systems will be dark, including Mudd offices, labs, printers/plotters, and common areas.

In order to prepare for a smooth transition to emergency power, the campus telephone system will be restarted at 7:00 am on June 1 and will be unavailable for approximately 15 minutes. Once the electrical work is complete, the campus telephone system will again be restarted. This work will occur during a period of the lowest possible call volume. At present, we expect to do this around 9:00 pm. During both of these times, disaster call routing will be in effect, so that calls to Rice's emergency numbers (e.g. RUPD at 713-348-6000) will continue to function.

The Mudd Lab will be dark and unavailable for use on Saturday morning, June 1.

Contact the Help Desk at 713.348.4357 or helpdesk@rice.edu with questions about equipment status if your department has a non-critical server in Mudd 230 or Mudd 109.

Updates will be posted to the IT website: it.rice.edu

Between May 31 and June 3, each Rice community member's personal storage.rice.edu folder will be frozen in read-only mode for a short time during the scheduled storage maintenance window.

Beginning Friday, May 31, 2013, at 7:00 PM and continuing through Sunday, June 2, the storage migration will affect individual storage folders in alphabetical order.

This storage migration and equipment realignment is a necessary part of IT's system and network updates for the new academic year. The selection of this time and date was made after careful consideration of fiscal year end deadlines. If you notice any connectivity issues after 5:00 AM Monday morning, June 3, please email helpdesk@rice.edu.

Updates will be posted to the Rice IT web site: http://it.rice.edu

Web Sites restored

Several Rice web sites were offline due to database maintenance earlier today. These sites have been returned to service. If you notice any issues with your rice.edu web site, please report the problem to helpdesk@rice.edu.

A small number of Rice web sites have become unavailable due to database maintenance. Access to these sites will be restored shortly.

Technical services has restored networking services in Anderson Biology. Thank you. - Danny Eaton (x5233, dannyeaton@rice.edu)

One of the network devices in Anderson Biology 3rd floor is down. Technical Services (Jeremy Reichert) is en route to investigate. Update when possible. - Danny Eaton (x5233, dannyeaton@rice.edu)

On Saturday, June 1, FE&P will replace the ATS (automatic transfer switch for electric power) for the Mudd Lab building.

This means the power to Mudd will be interrupted for several hours beginning at 9:00 AM.

Systems that are currently powered via emergency power or generator power will continue to function normally.

All other systems will be dark, including Mudd offices and common areas.

Please shut down and power off all office computers and other electric-powered devices in Mudd offices and the common areas, as well as the systems in 230 and 109 that are NOT on emergency power or generator power.

Updates will be posted to the IT website: it.rice.edu

The storage maintenance for VM servers has been completed. No systems were off line during the work.

The VM server maintenance has begun

You can now access your mail.

Kerberos, one of the components of the university's central authentication system, is scheduled for a brief maintenance window this morning (Sunday) at 8AM, following the email system maintenance.

The maintenance window lasts less than one minute and no service interruptions are anticipated. Updates will be posted to the IT web site:
it.rice.edu

Rice's VM (virtual machine) storage servers will undergo maintenance tonight, Sunday, from 8PM to 11PM. Each storage server will be isolated and its data presentation migrated to a cluster partner before maintenance is performed.

No service interruptions are anticipated. Updates will be posted to the IT web site: it.rice.edu

Central Mail maintenance begins at 7:00am

Kerberos, one of the components of the university's central authentication system, is scheduled for a brief maintenance window Sunday morning at 8AM, following the email system maintenance.

The maintenance window lasts less than one minute and no service interruptions are anticipated. Updates will be posted to the IT web site:
it.rice.edu

Rice's VM (virtual machine) storage servers will undergo maintenance Sunday night, from 8PM to 11PM. Each system will be isolated and its data migrated to a backup cluster before the server goes offline for maintenance.

No service interruptions are anticipated. Updates will be posted to the IT web site: it.rice.edu

A maintenance window for Email services on the Central Mail System is scheduled for early Sunday morning, May 19, between 7:00am and 8:00am.

IMPACT: All Rice email accounts on the Central Mail System will temporarily lose the ability to read, send, or otherwise manage email
during this period.

Incoming messages will be queued for distribution when the maintenance is complete. No messages will be lost during the scheduled outage.

Updates will be posted to the IT website:http://it.rice.edu/

The issues with vmstorage2 have been resolved. The virtual machine clients are returning to service.

The vsphere storage element vmstorage2 is offline the following servers are offline.

comp301a.rice.edu
wsmysql3.rice.edu )
guttural.ad.rice.edu
comp301b.rice.edu
tableau.ad.rice.edu
wscms3.ad.rice.edu
ott-inteum.ad.rice.edu
jumpbx2.ad.rice.edu
m.rice.edu
sakai-n4.rice.edu
resourcedev.ad.rice.edu
AltirisDS3.ad.rice.edu
sakai-n5.rice.edu
wscms6.ad.rice.edu
monitor-test.rice.edu
AltirisSWSDEV2
AltirisReports.ad.rice.edu
AltirisDS4.ad.rice.edu
sakai-n3.rice.edu
rec1.ad.rice.edu
wsstatic2.rice.edu
Windows 7 SVS Trey
AltirisSS1.ad.rice.edu
testshib.rice.edu
wsphp2.rice.edu
ea2vm1.rice.edu
altiriswfd-1
sai-web.ad.rice.edu
winlicense3.ad.rice.edu
AltirisNS1.ad.rice.edu
Jonesdev.ad.rice.edu
resourceprod1.ad.rice.edu
plone-n1.rice.edu
coban
owlstats.rice.edu
ciscopi.rice.edu
AltirisTraining.ad.rice.edu
brlqa1.ad.rice.edu
idp-n2.rice.edu
arcGIS.ad.rice.edu
AltirisLinuxDev
jonesdev2.ad.rice.edu
ws3.ad.rice.edu
fluent.ad.rice.edu
tonala.ad.rice.edu
SOREN-1.ad.rice.edu
pdsql1.ad.rice.edu
wspgsql2.rice.edu
EMSTERM.ad.rice.edu
wssectest.ad.rice.edu
wscms1.ad.rice.edu
onweb-1.ad.rice.edu
grouper-n1.rice.edu
wsmysql4.rice.edu
kms1.ad.rice.edu
ADMISSIONS3.ad.rice.edu
barrywin7.ad.rice.edu
terminal-it.ad.rice.edu
exchangetools.ad.rice.edu
wsdevcms9.ad.rice.edu
mediacosmos-pil.ad.rice.edu
gscsdev2.ad.rice.edu
onapp-7.ad.rice.edu

The storage issues for vsphere appear to be resolved. All affected Linux systems have been restarted (see list @ end) If you are still having issues, please issue a ticket with the appropriate team.

Linux systems restarted:
fmsxi01.rice.edu
newruf.rice.edu
sakai-dev.rice.edu
netid-n2.rice.edu
horde-test.rice.edu
fmsxi05.rice.edu
ldap4.rice.edu
ediscovery-n1.rice.edu
netid-n3.rice.edu
wsphp1.rice.edu
wssw.rice.edu
wspgsql1.rice.edu
fmsxi02.rice.edu
tmcloud2.rice.edu
wsdrupal2.rice.edu
fmsxi03.rice.edu
wsredcapmysql2.rice.edu
svn-n2.rice.edu
radius-c.net.rice.edu
linuxtester
sakai-n1.rice.edu
sakai-n2.rice.edu
fmsxi07.rice.edu
apply-dev.rice.edu
apply-n1.rice.edu
wsredcapphp2.rice.edu
rh6rpm.build.rice.edu
wsmysql5.rice.edu
testcas-dev.rice.edu
testcas.rice.edu
grouper-n2.rice.edu
uportal-n3.rice.edu
ea18.rice.edu
directory-n1.rice.edu
www1.rice.edu
wspython1.rice.edu_TEST
mediacore.rice.edu
wsphp3.rice.edu
fmsxi06.rice.edu

The VMstorage3 and VMstorage4 storage resources have been restored. System Administrators are now restarting the virtual servers using those resources.

The restarting of the virtual servers is proceeding as quickly as possible.

Notification will be sent out when we believe all servers have been restarted.

The HA partner of vmstorage3, vmstorage4 is also having issues. Possibly from picking up the load from vmstorage3.

Staff is investigating.

vmstorage3 is having connectivity issues with vsphere. IT is investigating

The following guests may be having issues:
wssw.rice.edu
wspython1.rice.edu_1
wsphp1.rice.edu
wspgsql1.rice.edu
wsdrupal2.rice.edu
wscms4.ad.rice.edu
wscf2.ad.rice.edu
wscf1.ad.rice.edu
ws-bobby.ad.rice.edu
ws-alice.ad.rice.edu
wrkclsd.ad.rice.edu
winlicense4.ad.rice.edu
Win8SVSVDI
win7vdi-3
win7vdi-2
win7vdi-1
Win7TreySVS
Win7SVSTrey64Bit
Win7SVSsjs
win7mech-3
win7mech-2
win7mech.ad.rice.edu
win7base64
TreyTest
tmcloud2.rice.edu
TFoundation.ad.rice.edu
statsvdi-3
statsvdi-2
statsvdi-1
sakai-dev.rice.edu
ryon-lab-vdi.ad.rice.edu
rtir.rice.edu
RT355124_406
rt3.rice.edu
riceantivirus-a.ad.rice.edu
rdw1.ad.rice.edu
proxy-n2.rice.edu
pipe-8.ad.rice.edu
pipe-7.ad.rice.edu
pipe-6.ad.rice.edu
orarest1.rice.edu
opensim.rice.edu
openmanage.ad.rice.edu
onwebtest.ad.rice.edu
onwebdev.ad.rice.edu
onapp-5.ad.rice.edu
newruf.rice.edu
netid-n3.rice.edu
netid-n2.rice.edu
lyrics-3.ad.rice.edu
lyrics-2.ad.rice.edu
lyrics-1.ad.rice.edu
linux_x86_64_seqrw
learnws1.ad.rice.edu
ldap4.rice.edu
labstream.ad.rice.edu
jonesprod4.ad.rice.edu
jgsps4.ad.rice.edu
itadmin-vdi1.ad.rice.edu
itadmin-vdi Template
idfinder-db.ad.rice.edu
horde-test.rice.edu
hd3.ad.rice.edu
gmigration00.rice.edu
Fmsxi08.ad.rice.edu
fmsxi05.rice.edu
Fmsxi04.ad.rice.edu
fmsxi03.rice.edu
fmsxi02.rice.edu
fmsxi01.rice.edu
emsdev.ad.rice.edu
EMS2.ad.rice.edu
ediscovery-n1.rice.edu
eaworkstation.ad.rice.edu
ea-w1.ad.rice.edu
deepfreeze2.ad.rice.edu
cybersport.ad.rice.edu
apply-n1.rice.edu_CLONE20120907
altiriswfd-5
altiriswfd-4
AltirisSS2.ad.rice.edu
AltirisSD3.ad.rice.edu
AltirisDS2.ad.rice.edu
ADMISSIONS2.ad.rice.edu

The building maintenance started at 8 AM. Services may be down and up during. An all clear will come when complete. Danny Eaton (x5233, dannyeaton@rice.edu)

The power at the Library Service Center is having issues, causing the network equipment to reboot. - Danny Eaton (x5233, dannyeaton@rice.edu)

GRB - West

The 2nd floor network equipment is down due to a power issue. FE&P is aware. Additionally, the elevator is being worked on in this area today. - Danny Eaton (x5233, dannyeaton@rice.edu)