Advancing High Performance Computing Research Through International Cooperation
Welcome to the Universidade de São Paulo-Rice University Blue Gene Collaboration
In 2012, Universidade de São Paulo (USP) and Rice University joined efforts to address some of the hardest scientific questions through the use of High Performance Computing. To initiate this collaboration, our universities co-invested in a 24,576 core Blue Gene/P supercomputer (right-up picture). At the time, it was in the top500 list, making it one of the most powerful supercomputers in the world. After three years, the collaboration has upgraded to a 1-rack BG/Q (right-down picture), which has 1024 nodes with 16 cores/node, in total of 16384 cores, reached peak performance of 209 TFlop/s ( the previous BGP has peak performance as 84 TFlop/s). With ~2.5 times the computing power of the BG/P, this collaboration is helping USP and Rice build scientific and computational collaborations that will bring both universities to the forefront of research computing. Participants in this collaboration come from all areas of scientific training and currently include researchers in biophysics, materials science, atmospheric science, renewable energy, hard and soft condensed matter, bioinformatics, statistics, quantum chemistry, and more. The collaboration continues to grow, and we are optimistic that this momentum will continue to build. To facilitate the inclusion of both the USP and Rice communities, we provide information on what resources, opportunities and support are available, and how to gain access.
We would once again like to welcome you to our scientific community!
A message from STI - USP
In the context of academic cooperation agreement, STI - USP has the task of technically advising the committee of teachers responsible for the agreement and ensure the implementation of the policies defined by the committee.
We maintain an open channel of communication with the Rice University for:
- Resolution or routing questions from researchers from USP;
- Discussion of technical solutions;
- Inclusion of new researchers and research groups in the list of persons entitled to use the BG;
- Event organization to facilitate the exchange of experiences and knowledge about HPC for scientific development.
We hope that the computational resources provided by the agreement to contribute positively to the success of their scientific papers and their research. Consequently, we expect that fosters advances in scientific production of USP.
Who can use the BG?
Since this is a joint resource, different policies apply to the Rice and USP communities.
If you are a member of the USP community: The policies that determine access for USP users are determined by the oversight committee at USP. Here, we will make every effort to post the most up-to-date information on those policies, but they are solely at the discretion of the committee, and may change at any time. At the moment, the committee has not restricted allocations. Accordingly, any member of the USP research community may be granted access on a temporary basis. When the committee issues any future allocation policies, those policies will supersede any prior access. See below for details on obtaining an account. If you have questions about the status of operations at USP, please contact STI - USP at firstname.lastname@example.org.
If you are a member of the Rice community: If you are interested in accessing this resource, please file an RT ticket with RCSG. The form can be accessed here.
At 11/10/2015, the BGQ is updated for its XL compilers, and changed scheduling policies based on the needs from users. Generally speaking, the "compute" queue/class is no longer active. The new queues are: usp, rice, devel.
The devel queue allows 30 minutes for testing/debugging, and is accessible for all users. the other two queues (usp, rice) are the regular queues for running jobs.
For the USP users, add these two lines into the job script:
# @ class = usp
# @ group = usp
For the non-USP users, e.g. Rice users, add these two lines in the job script:
# @ class = rice
# @ group = rice
How to gain access to the BG?
For potential USP users: If you would like to access this resource, you must have a faculty sponsor at USP. To request an account, follow these steps:
1) Send the following information from your USP email address to email@example.com: Your name, position (i.e. grad student, post-doc, professor), department, the name of the PI (make sure to cc the PI when making the request, since they will need to confirm the request), software you want to use on the BG, estimated number of cores per calculation, and a 1-2 paragraph description of the types of calculations you want to perform.
2) After you receive confirmation from firstname.lastname@example.org, request a Rice Guest Account here. When requesting the Rice Account, indicate email@example.com as your sponsor (DO NOT select "BlueGene USP Allocation" as the sponsor), and forward the firstname.lastname@example.org approval email to that address. It is VERY important that you provide a valid email address, and that you do not use non-English characters, when you request an account. If we can not contact you, then your accounts may be terminated without notice. Finally, if you do not obtain approval from email@example.com first, the Rice Guest Account will not be approved. When your guest account is approved, you will be assigned a Rice NetID. This will be your login information for all resources located at Rice, so don't lose it. Typically, the Rice ID will be activated within 24 hours.
3) Once the Rice ID is active, you need to request that an account is created on the BG/Q. To obtain the BG/Q account, request a regular user account, as described here. Again, indicate Paul Whitford as your sponsor. Assuming you have completed the first two steps, then your account will be approved and created. You will also be added to the USP BGQ listserve. If you don't receive confirmation within 3 business days about the listserve, or BG/Q account, please inquire with the sponsor (firstname.lastname@example.org).
Once your account is activated on the BG, you will need to connect via secure shell (bgq.rice.edu). If you are not on the Rice network, this is accomplished by tunneling a connection through gw.crc.rice.edu. gw.crc.rice.edu will use your Rice NetID account information.
For potential Rice users: The allocation policies are still being determined for Rice users. If you are interested in accessing this resource, please file an RT ticket with CRC. The form can be accessed here.
More Information (click links below)
October 17th-18th, 2016: 4th HPC Workshop at USP June 2nd, 2015: BG/P decommissioned and BG/Q activated May 20th, 2015: Press release on USP-Rice collaboration April 17th, 2015: 3rd HPC Workshop at USP April 14, 2014: 2nd HPC Workshop at USP December 6-7, 2012: HPC Workshop at USP August 1st, 2012: The BG/P USP-Rice agreement officially went into effect. March 2012: Blue Gene Agreement Signed by USP and Rice Early 2012: Installation of the BG/P at Rice
Events and Updates
October 17th-18th, 2016: 4th HPC Workshop at USP
June 2nd, 2015: BG/P decommissioned and BG/Q activated
May 20th, 2015: Press release on USP-Rice collaboration
April 17th, 2015: 3rd HPC Workshop at USP
April 14, 2014: 2nd HPC Workshop at USP
December 6-7, 2012: HPC Workshop at USP
August 1st, 2012: The BG/P USP-Rice agreement officially went into effect.
March 2012: Blue Gene Agreement Signed by USP and Rice
Early 2012: Installation of the BG/P at Rice
Search the page