Getting Started Using the National Research Platform
•Download as PPTX, PDF•
0 likes•95 views
SoX Monthly Workshop Remote Presentation September 29, 2023
Recommended
More Related Content
Similar to Getting Started Using the National Research Platform
Similar to Getting Started Using the National Research Platform (20)
More from Larry Smarr
More from Larry Smarr (20)
Recently uploaded
Recently uploaded (20)
Getting Started Using the National Research Platform
- 1. “Getting Started Using the National Research Platform” SoX Monthly Workshop Remote Presentation September 29, 2023 Dr. Larry Smarr Founding Director Emeritus, California Institute for Telecommunications and Information Technology; Distinguished Professor Emeritus, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD http://lsmarr.calit2.net
- 2. The December 2022 Pacific Research Platform Video Highlights 3 Different Applications Out of 1000 Nautilus Namespace Projects Pacific Research Platform Video: https://pacificresearchplatform.org/media/pacific-research-platform-video/
- 3. NSF CC*DNI Grant $7.3M 10/2015-10/2020 Extended 2 Years – Ended 10/2022 (GDC) 2015-2022: The Pacific Research Platform NSF Grants Were Built on the CENIC Regional Optical Network Source: John Hess, CENIC Supercomputer Centers
- 4. 2015-2022: UCSD Designs PRP Data Transfer Nodes (DTNs) -- Flash I/O Network Appliances (FIONAs) FIONAs Solved the Disk-to-Disk Data Transfer Problem at Near Full Speed on Best-Effort 10G, 40G and 100G FIONAs Designed by UCSD’s Phil Papadopoulos, John Graham, Joe Keefe, and Tom DeFanti Add Up to 8 Nvidia GPUs Per 2U FIONA To Add Machine Learning Capability Up to 240TB Storage https://nationalresearchplatform.org/fiona/
- 5. 2018/2019: PRP Game Changer! Using Google’s Kubernetes to Orchestrate Containers Across the PRP User Applications Clouds Containers
- 6. https://nationalresearchplatform.org/ 2023 - The National Research Platform Unifies The Previous 8 Years of NSF Grants
- 7. 2023: NRP’s Nautilus is a Multi-Institution Hypercluster Which Creates a “Cyberinfrastructure Commons” ~200 FIONAs on 30 Partner Campuses Networked Together at 10-100Gbps Sept. 29, 2023
- 8. The PRPNRP Has Emphasized Expanding Diversity and Inclusion The Expansion from PRP in 2015 to the NRP in 2023: – 6 States Now 45 States – 19 Campuses Now 135 Campuses – 9 Minority Serving Institutions Now 24 MSIs – 2 NSF EPCoR States Now 20 EPSCoR States, 2 Territories, and Wash DC
- 9. The Key Role of Regional Optical Network Meetings to Engage More Campuses in Using NRP www.thequilt.net/quilt-circle/snapshot-scaling-a-national-research-platform/ See https://nationalresearchplatform.org/events/fourth-national-research-platform-4nrp/ for slides and videos of all 4NRP presentations Jen Leasure President & CEO, The Quilt
- 10. Non-MSI Institutions Minority Serving Institutions EPSCoR Institutions NRP’s Nautilus Hypercluster Is Hosted On Campuses Across the United States Interconnected By Quilt and I2 238 GPUs over CENIC CSUSB + SDSU 88 GPUs over CENIC UCI + UCR + UCM + UCSC + UCSB 511 GPUs over CENIC UCSD + SDSC 21 GPUs over MREN UIC 184 GPUs over GPN U. Nebraska-L 8 GPUs over FLR FAMU 12 GPUs over NYSERNet NYU 21 GPUs over SoX Clemson U 9 GPUs over GPN U S. Dakota + SD State 4 GPUs via Albuquerque GigaPoP U New Mexico 12 GPUs over NYSERNet U Delaware 2 GPUs over OARnet CWRU 1 GPU over CENIC/PW U Hawaii 1 GPU over CENIC/PW U Guam 144 GPUs over NEREN MGHPCC 8 GPUs over GPN U Oklahoma 16 GPUs over GPN U Missouri
- 11. 12 Campuses Connected by SoX, FLR, or MARIA Have 1 or More Users Who Have Logged Onto Nautilus Total: 52 Nautilus Users
- 12. 6 Campuses Connected by SoX, FLR, or MARIA Have Created 1 or More Nautilus Namespaces Total: 17 Nautilus Namespaces
- 13. In the Last 12 Months, Only 2 Campuses Connected by SoX, FLR, or MARIA Have Used Nautilus GPUs or CPUs
- 14. The NRP Web Site Helps Users Get Started Using NRP’s Nautilus https://nationalresearchplatform.org/nautilus/
- 15. California State University San Bernardino is an Excellent Example of How to Help Your Faculty and Students Use NRP www.csusb.edu/academic-technologies-innovation/xreal-lab-and-high-performance-computing/high-performance-computing Their Campus HPC Program Enabled CSUSB Faculty & Students to Use More NRP GPU-Hours In the Last 12 Months Than 8 of the 10 UC Campuses!
- 16. The CSUSB HPC Team Is the Major Reason For CSUSB Having the Largest NRP Utilization of 23 CSUs • Dr. Sam Sudhakar – Chief Financial Officer and Vice President, Finance, Technology, & Operations • Gerard Au – Chief Information Officer • Dr. Bradford Owen – AVP for Faculty Development, Chief Academic Technologies Officer • Dr. Dung Vu – HPC Consultant, Analyst/Programmer • James MacDonell – HPC Consultant, Information Security Analyst • Prof. Youngsu Kim – HPC Faculty Fellow, Asst. Prof. of Mathematics
- 17. A Key Reason CSUSB Has The Largest CSU Nautilus Usage: They Installed and Publicized the JupyterHub “Easy Button” https://csusb-jupyter.nrp-nautilus.io/hub/login Slide Adapted from Prof. Youngsu Kim Over 150 Total Users!
- 18. CSUSB Provides Human and On-Line Support For Faculty, Students, and Staff to Easily Use JupyterHub to Access NRP www.csusb.edu/faculty-center-for-excellence/idat/high-performance-computing/jupyterhub-nrp
- 19. University of Missouri’s Grant Scott Has Built a Model Program for Data Intensive Computing and ML/AI Using NRP https://engineering.missouri.edu/2023/engineers-share-expertise-around-nautilus-with-great-plains-network/
- 20. University of Missouri is Leveraging Jupyter Hubs on Nautilus for STEM & AI/ML Experiential Learning Has 16 GPUs On-Site Now - Adding 44 with a New CC* Award
- 21. Customized Jupyter Hubs on Nautilus Support Multiple Courses and Certificates – Computer Science Undergraduate Classes – Computer Science HPC Classes – Undergraduate Data Science – HPC Emphasis Graduate Data Science – State & Federal Government Training Programs
- 22. UCSD Recently Submitted an NSF Proposal With FAMU and Mizzou’s Scott Grant Driving Outreach PI Tom DeFanti, UCSD “Florida A&M University (FAMU) will host equipment, train CISE campus researchers and students, and design custom outreach mechanisms for the Southeast U.S.”
- 23. NRP Support and Community: • US National Science Foundation (NSF) awards and subawards to UCSD --CNS-1456638, CNS-1730158, CNS-2100237, CNS-2120019 --ACI-1540112, ACI-1541349, OAC-1826967, OAC-2029306, OAC-2112167 • DOD DURIP awards to UCSD • UC Office of the President, Calit2 and Calit2’s UCSD Qualcomm Institute • San Diego Supercomputer Center and UCSD’s Research IT and Instructional IT • CENIC, Pacific Wave/PNWGP, StarLight/MREN, The Quilt, Great Plains Network, NYSERNet, Open Science Grid, Internet2, DOE ESnet, NCAR/UCAR & Wyoming Supercomputing Center, AWS, Google, Microsoft, Cisco, Juniper, Arista