By Nick Brown, Senior Research Fellow at EPCC, University of Edinburgh
May the 13th saw the commencement of the 39th International Supercomputing Conference (ISC) in sunny Hamburg. With almost 4,000 attendees it is the largest High Performance Computing (HPC) conference in Europe. This year attendees were treated to a 5 day program packed with new technology, exciting talks and thought provoking discussions.
Featured in this program were two dedicated RISC-V sessions organised by the RISC-V HPC SIG focused on engaging and educating the HPC community to drive further adoption of RISC-V.
HPC Next: The RISC-V Ecosystem
Firstly, the HPC SIG hosted an hour long Birds of a Feather (BoF) session on RISC-V. The idea of BoFs is to explore a specific topic with the audience; a two way discussion on the concerns and challenges of the audience with the experience of the panel. This allows the panel to explore different ideas and gauge reactions. Many in the audience would not have used RISC-V technology before – and are simply interested in learning more and challenging their preconceptions.
In the anticipation that this would prove popular, the organisers hosted us in the largest hall available to BoFs, which ultimately proved justified as we filled the room with standing room only!
The session involved panellists Teresa Cervero from BSC, Oliver Perks from Rivos, Andrew Richards from Codeplay and Daniele Gregori from E4 Computer Engineering, and was chaired by Nick Brown from EPCC. After a short introduction by each panellist we dove straight into the interactive session, using Mentimeter to enable anonymous questions and voting on topics.
One of the most interesting outcomes is that we asked audience members to vote on the aspect of RISC-V that they felt is most important for HPC, and the results are illustrated below.
ISC participants represent a broad cross section of the HPC industry, all the way from hardware manufacturers and supercomputing centers down to end users. It surprised us that the HPC community valued the open nature of RISC-V as its most important feature, we expected participants to be driven by more operational concerns such as performance and power efficiency which came second.
However, the HPC community has a long history of embracing and establishing open standards, both in hardware and software so maybe this is not so surprising. These software standards, such as MPI and OpenMP, have ensured software portability between systems for decades and therefore the community can already see the benefit of openness.
During the Q&A we discussed a full range of topics concerning RISC-V, from ISA specification to software development and community.
On the hardware side it was asked whether RISC-V will enable application specific hardware specialisation. The panel discussed this at length, with the point being made that whilst RISC-V enables flexibility in the implementation, vendors must still adhere to market forces. Vendors are free to make a variety of different choices that then suit their customer base, however there must be a financial justification.
The commercial and community aspects of RISC-V were also discussed, where audience members asked how commercial companies can be encouraged to adopt RISC-V and another attendee asked whether there needs to be a single company driving the standard. The panel discussed how there are a large number of companies already invested in RISC-V, developing both hardware and software solutions based upon the standard, and that RISC-V International is the organisation that drives all of this forward and connects the community together.
On the software side we discussed activities around developing and optimising the software building blocks for HPC, the libraries and tools required by users and supercomputing centres. The panel was able to highlight several activities such recent work enhancing BLAS libraries to take advantage of RISC-V vectorization, and discuss initiatives such as RISE which, amongst other things, have recently released a RISC-V software development optimization guide https://gitlab.com/riseproject/riscv-optimization-guide . The HPC SIG are currently undertaking a gap analysis of RISC-V in HPC to understand, across the community, what is being done and what needs to be prioritised. It was also queried whether lessons can be learnt from the relatively recent porting of HPC software to the Arm architecture, with the panel sharing that whilst there is still specialist work needed especially to optimise for RISC-V, this previous work has led to both specific code level improvements and also lessons learnt by the community that make this task much easier.
The level of interest shown in RISC-V by the HPC community was very encouraging to see. There is clearly an appetite for hardware, and a willingness to contribute to the software ecosystem.
The RISC-V for HPC workshop
On the last day of the conference ISC hosts a day dedicated to workshops. Each can be thought of as a mini-conference, with their own set of speakers and research papers. We had a half day workshop at ISC exploring RISC-V for HPC, and this built upon very successful and popular workshops last year at both SC and ISC. Presentations from the workshop can be downloaded here:
https://riscv.epcc.ed.ac.uk/community/workshops/isc24-workshop/
A keynote was given by Carlos Puchol, who leads the EUPilot project which is using RISC-V to develop accelerators as part of the European Processor Initiative (EPI). This project involves numerous European partners, from both academia and vendors, to develop RISC-V hardware solutions and further enhance the software ecosystem. The workshop included five research papers, which covered a range of topics including benchmarking RISC-V CPUs, further developing the software ecosystem, and machine learning on RISC-V. Additionally we wanted to provide to the audience a view of some of the more mature aspects of the ecosystem. Consequently, Oliver Perks gave a talk on the RISE initiative, demonstrating to the audience that this is a serious undertaking with big players investing in the RISC-V software ecosystem.
Volker Politz from Semidynamics, Karel Masařík from Codasip, and Daniele Gregori from E4 Computer Engineering, each gave talks about their hardware products and their views on the role of RISC-V in HPC. Not only did this demonstrate that there is real hardware and IP available that people can buy and leverage for their workloads, but furthermore it was interesting to hear the opinions that drive some of the commercial decisions. An interesting discussion was held, for instance, around the difference between an open ISA standard and an open microarchitecture. It was interesting to see that there was some misunderstanding in the wider HPC community around the separation between the two, and the fact that a healthy and vibrant commercial hardware ecosystem can co-exist with an open ISA. This is potentially where we need to consider some education, as clearly not all of the wide range of HPC community members necessarily understand the differences between these two concepts.
RISC-V on The Show Floor
Whilst we may be a few years from mainstream RISC-V adoption in HPC, we are starting to see a few examples of real hardware based on the RISC-V ISA appear. Some of these were visible on the show floor where attendees were able to demo them.
For example, BSC were showcasing the RISC-V based VEC chip, which is part of the EPI project under the EPAC accelerator. Whilst there is still on-going development work around VEC, BSC were allowing users to have an early glimpse of the technology by seeing hands on demos running on the chip. Tenstorrent were also present with a booth in the exhibition, demoing their RISC-V based AI accelerators.
The workshop was a great success, and if the number of attendees is anything to go by, RISC-V will be a major force in HPC very soon. If you missed the event this time then the good news is that we will be doing this again at SuperComputing (SC24) which will be in Atlanta, where we will host another workshop on RISC-V for HPC on the afternoon of Monday 18th November. For this workshop we are trialling two research paper submission dates, to help give those who require visas a bit more time. The early submission date is the 1st of July, and the main submission deadline is the 9th of August. For more details, see https://riscv.epcc.ed.ac.uk/community/workshops/sc24-workshop/ .