An interview with Beowulf pioneer Thomas Sterling on the iconic Beowulf Bash
as published in HPCwire and iSGTW
With each successive year, the SC conference kicks off on Monday with a bigger bang. The Technical Sessions are already in full swing as exhibitors
scramble to complete their booths prior to the Gala Opening Monday evening. But the celebration surrounding the opening of a new SC doesn’t end
there, as those in the know leave the convention center and head to the biggest open HPC community party of the year: the Beowulf Bash.
Before packing my bags for SC12 in Salt Lake City, I caught up with one of the iconic Beowulf pioneers, Thomas Sterling, to get his views on what makes
the Beowulf Bash so special.
“I may not have gone where I intended to go, but I think I have ended up where I needed to be.”-Douglas Adams, “The Long Dark Teatime of the Soul”
Addison Snell: Thomas, the SC12 Beowulf Bash is being held Monday night at the Clark Planetarium, a great location, with a theme that the HPC community will appreciate: The Hitchhiker’s Guide to the Galaxy.
Thomas Sterling: Douglas Adams was just fabulous. I think he would’ve appreciated the ironies of Beowulf clusters, how the inmates
had taken over the asylum. There’s no better example of an Improbability Computer than a Beowulf cluster.
Snell: For those who don’t remember their HPC history, remind us what Beowulf was all about.
Sterling: The Beowulf Project was a NASA project started in 1993 to find an option for lower-cost computing, at a time when a gigaflop
could cost close to a million dollars. It was a time when workstation farms were being employed for throughput computing with experimental software,
and it occurred to us that we could use the same approach with lower-end PC processors.
These commodity clusters were a paradigm shift. UNIX workstation clusters with high-end interconnects didn’t optimize for performance per cost. We
went with Linux and low-end Ethernet. Meanwhile open-source software as a paradigm for delivering functionality came along at exactly the right
time.
Snell: How did the community around Beowulf start to grow?
Sterling: The concept of community happened more than it was planned. It was clear that to successfully ply this technology we would
need adopters, so we did outreach to universities. Jack Dongarra organized conference at Emory University where we presented the first of a series
of tutorials, and it became the highest subscribed tutorial at SC97. I wrote the book How to Build a Beowulf.
We didn’t anticipate the community we were creating, but people understood that they own their clusters; they are not owned by them. There was a natural
attraction to students. It allowed them to try things themselves. Everyone was empowered to be part of the community.
Snell: How did the Beowulf Bash get started?
Sterling: I can take neither credit nor blame for starting the Beowulf Bash. It was first done by Don Becker, Todd Needham, Doug Eadline,
and a number of other people as a small party of young geeks. But it instantaneously created its own culture, a party where you could let your
hair down and be yourself and not try to impress each other, like you had to at the “good” parties, the vendor parties. This was the party for
the other people, the rest of us.
Snell: With the community focus and sense of empowerment, do you think there is a commonality with what we’re seeing with
GPU computing today?
Sterling: Yes, I do think so, and for the same reasons. GPUs emerged from purpose-built graphics engines and in some cases get a demonstrative
benefit in performance per dollar. A lot of people find that exciting and want to try it out. Again it’s the concept of empowerment. I don’t anticipate
that the current configurations are the final solutions, but the interest of people in using them is driving us there.
Snell: What do you think the will future bring for the Beowulf Bash?
Sterling: Everybody likes a good bottle of beer. I really hope that companies will continue to sponsor this relatively low-cost event
that attracts a different element across the HPC community. This is a different personality that encourages people to be creative. That’s what
Beowulf did for HPC.