{"id":32218,"date":"2025-07-23T22:06:10","date_gmt":"2025-07-23T22:06:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/32218\/"},"modified":"2025-07-23T22:06:10","modified_gmt":"2025-07-23T22:06:10","slug":"htcondor-celebrates-40-years-powered-by-community","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/32218\/","title":{"rendered":"HTCondor celebrates 40 years powered by community"},"content":{"rendered":"

The high-throughput computing community \u2014 including scientists, researchers, developers, administrators and facilitators \u2014 gathered at UW\u2013Madison on June 3 to celebrate 40 years of \u201cThe Condor Project,\u201d now known as\u00a0HTCondor<\/a>.<\/p>\n

\"MironMiron Livny<\/p>\n

The brainchild of\u00a0Miron Livny<\/a>, lead investigator of research computing at the Morgridge Institute and director of the\u00a0Center for High-Throughput Computing<\/a>, HTCondor uses a vast network of computing resources to power a wide range of research projects across the globe.<\/p>\n

HTCondor distributes computing power by matching and prioritizing jobs with available machines depending on the needs of the user and the properties of their dataset. This workload management system streamlines the influx of large datasets and computational inquiries that are born from curiosity-driven research.<\/p>\n

\u201cWe are powerful enablers of scientific discovery,\u201d Livny says in his opening remarks to kick off Throughput Computing Week HTC25, an annual conference which took place the week of June 2-6 this year.<\/p>\n

In addition to 40 years of HTCondor, this year\u2019s conference recognized several other milestones for high-throughput computing resources developed at UW\u2013Madison: 20 years of\u00a0OSG<\/a>, 5 years of\u00a0PATh<\/a>, and 2 years of\u00a0Pelican<\/a>.<\/p>\n

This suite of technologies support hundreds of registered users and institutions studying astrophysics, genomics, climate systems, artificial intelligence, wildlife populations, and more. While the research areas are varied, they all share the same problem: massive amounts of scientific data requiring massive amounts of computing power.<\/p>\n

Erik Wright, assistant professor of biomedical informatics at the University of Pittsburgh, leads research in\u00a0antibiotic resistance<\/a>\u00a0and is the number one user of these high-throughput computing resources in the field of biology.<\/p>\n

\u201cAll of us across all these different domains are connected by the\u00a0unfathomable\u00a0scale of the things that we study,\u201d he says in his Keynote Presentation at HTC25, leaning into the overarching theme of community during the conference. \u201cThis is a game changer for research.\u201d<\/p>\n

At the HTCondor Celebration event, several speakers offered their reflections from the past 40 years. Each one of them emphasized that the impact of the Condor Project has never come just from building the technologies, but from building a community.<\/p>\n

\u201cWe are powerful enablers of scientific discovery.\u201d<\/p>\n

Miron Livny<\/p>\n

The concept of community in this space didn\u2019t grow out of necessity but rather was planted at the very beginning in Livny\u2019s PhD dissertation as a guiding principle for what was to come: a shared resource built from communities of computers\u00a0and\u00a0communities of people.<\/p>\n

\u201cIt\u2019s really the underpinning element of what I\u2019m trying to do with my involvement at the Morgridge Institute, it\u2019s the community and it\u2019s the people,\u201d Livny says.\u00a0<\/p>\n

As an independent research institute, Morgridge has a distinct approach to pursue \u201cfearless science<\/a>\u201d \u2014 giving scientists the freedom to drive innovation and pursue high-risk, high-reward endeavors.<\/p>\n

\u201cThe flexibility that Morgridge provides to Miron and his team is a fantastic example of how we can support scientific collaborations with UW\u2013Madison and other partners,\u201d says Morgridge CEO\u00a0Brad Schwartz<\/a>. \u201cIt\u2019s a remarkable advance in their field. They have created a resource that they continue to improve upon, and in return, that facilitates the achievements others. This is the hallmark of a highly impactful breakthrough.\u201d<\/p>\n

Livny says the success of the past 40 years was built on relationships and trust \u2014 and this is just the beginning.\u00a0<\/p>\n

\u201cWe created an ecosystem of people who depend on us, their science depends on us. This is a non-trivial responsibility that we must continue and carry on as we celebrate 50, 60, 70 years, because we are not done yet.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"The high-throughput computing community \u2014 including scientists, researchers, developers, administrators and facilitators \u2014 gathered at UW\u2013Madison on June…\n","protected":false},"author":2,"featured_media":32219,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[46],"tags":[191,27071,27072,27073,74],"class_list":{"0":"post-32218","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-computing","8":"tag-computing","9":"tag-htcondor","10":"tag-miron-livny","11":"tag-research-computing","12":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/32218","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=32218"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/32218\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/32219"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=32218"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=32218"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=32218"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}