Summer is on its way, and for many Pittsburgh families, that means signing students up for camps and other enrichment activities.
But access to summer learning programs is scarce in some parts of Allegheny County, especially in the wake of Pittsburgh Public Schools’ decision not to offer its Summer B.O.O.S.T. program last year.
In 2024, district administrators told board members that they weren’t getting a “return on investment” for the program, which provided K-7 students a free, five-week opportunity for summer learning. At B.O.O.S.T, kids received about three hours of math and reading instruction each day before transitioning to basketball, cooking and other activities.
The program was born out of Summer Dreamers Academy, a highly-regarded free summer learning program meant to give low-income kids the kind of enriching summer experience many of their wealthier peers could afford.
Children from higher-income families are almost three times more likely to participate in a structured summer program than low-income kids, who also tend to lose more ground academically during the summer months by comparison.
“[Summer Dreamers Academy] was in the first wave of school districts coming out there and saying, ‘We’re offering a program for kids that’s not like a remedial summer school. We’re offering a camp,’” said Catherine Augustine, a senior researcher at the RAND Corporation who has studied summer learning in Pittsburgh and across the U.S.
Following the onset of the pandemic, Summer Dreamers Academy rebranded as Summer B.O.O.S.T., with an emphasis on helping kids make up ground lost during COVID. The district used federal pandemic relief funds to cover most of the programming, which cost about $1,700 per child.
And the program proved to be popular. In its first year, in 2021, hundreds of interested students were turned away.
But enrollment in B.O.O.S.T. didn’t necessarily result in academic improvement. An independent evaluation of the program WESA obtained through a records request found that, compared to students who did not attend B.O.O.S.T. at all, there was no significant impact on reading or math scores.
That lackluster conclusion cost PPS $272,298, according to contracts approved by the school board. PPS declined multiple interview requests for this story.
Still, the researchers with Gibson Consulting Group and the University of Pittsburgh who observed the program in 2023 and 2024 did spot one meaningful trend in the data: the more days that a student attended B.O.O.S.T., the higher they scored on fall math assessments compared to students who attended B.O.O.S.T. for fewer days.
The attendance hurdle
Marshall Garland, one of the evaluation’s authors and a research scientist at the University of Southern California, stopped short of asserting that longer B.O.O.S.T. attendance definitively caused higher math scores. He said there are many factors influencing student achievement, such as household income, parent involvement, and student engagement.
“I mean, one thing we know from the literature is if you get kids to attend regularly and consistently, particularly at recommended thresholds or benchmarks, there are positive effects,” Garland said.
“The problem is confidently attributing that to the program as opposed to something that we’re not measuring.”
Researchers recommend that educators aim for a 75% attendance rate or higher for the duration of their program.
But in many places across the U.S., attendance rates have remained stubbornly low as educators work to bring them back up to pre-pandemic levels. At PPS, more than a third of students (36%) are chronically absent this year, meaning they’ve missed 10% of school days or more.
Chronic absenteeism rates in the district peaked at 44% during the 2021-2022 school year, up from 30% in 2018-2019.
While attendance during the school year is compulsory and required by law, summer learning attendance isn’t, meaning students who could benefit from summer learning aren’t compelled to attend.
And their families have many competing options during the summer, such as traditional summer camps, days at the waterpark, and visiting family.
According to the B.O.O.S.T. evaluation, only a third of the kids completed the majority of the program, meaning most kids likely didn’t get the full benefit.
“The key lever here we have, I think, for these types of programs to improve student outcomes — assuming the program is enriching and effective — is getting kids to attend,” Garland said.
Despite low attendance, PPS still had to pay the teachers it hired to run B.O.O.S.T. each day. Gibson researcher Jennifer McMurrer said that could have made the program less cost-effective.
In 2024, the program cost roughly $2.1 million for the whole summer, with about 1,300 students attending for at least one day. McMurrer and her colleagues conducted multiple observations of B.O.O.S.T. classrooms and sometimes found just 11 to 12 kids assigned to three or four teachers.
“[Districts] plan for that [full] capacity,” she said. “…When the students don’t show up, you can’t just tell the teacher not to come. That’s a tough situation to be in.”
But designing a program that’s both academically impactful and enticing to kids can be challenging, said Karen Dreyer, executive director of Allegheny Partners for Out-of-School-Time.
“I think that programs that run in the school have to work really hard to not feel like school,” she said. “One of the beautiful things about out-of-school time learning is the variety of spaces and places.”
Research shows that, in order to move the needle on test scores, summer learning programs should offer at least 90 minutes of math instruction and two hours of reading instruction each day for five to six weeks.
Emily Morton, a senior researcher with NWEA, said part of the problem was that, after the pandemic, the summer programs districts offered were shorter than recommended. In some cases, they provided less academic instruction per day.
NWEA looked at summer programs at 10 large school districts across the U.S. in 2022 and 2023. Researchers found small, positive effects on math test scores, but little to no impact on reading.
“Our sort of working hypothesis for this is that it’s somewhat of a common phenomenon that school tends to have a larger effect on math than reading,” said Morton.
She added that students are perhaps more likely to read at home in the summer than they are to practice math, “which might sort of wash out the effects.” Morton noted, however, that it’s an area requiring further exploration.
Filling the gap
In a statement, PPS officials said that they will still offer some school-based summer programs, but any more information is lacking.
District spokesperson Ebony Pugh also said PPS will continue its partnership with the Carnegie Library of Pittsburgh to encourage summer reading.
While many experts say Allegheny County has a rich summer learning ecosystem for Pittsburgh students to attend, access varies greatly. Augustine and her colleagues at RAND issued a report this spring that identified 38 high-needs neighborhoods, including several within city borders, that offer very few after-school and summer programs.
“For kids without means, for parents who are looking for programs that are free, there are many fewer options,” Augustine said. “So I think school districts play a critical role in providing free summer programs and should continue to do that.”
The new dashboard allows viewers to see more than 500 programs across Allegheny County, the ages they serve, proximity to school and public transit, and cross-reference measures of socioeconomic need.
A new report from the Afterschool Alliance shows roughly half of all Pennsylvania parents who want to enroll their kids in a summer program couldn’t, with 48% citing cost as the main barrier.
While state and local funding for summer learning has increased over time, some of the federal funds propping up these programs were tied to COVID relief funds that have not been sustained.
About half of districts nationwide anticipated decreased funding for summer programs last year, although a majority of school superintendents have maintained their commitment to providing similar opportunities.
Some of the summer programs that remain in Pittsburgh provide time for reading and math, while others focus more on the arts, STEM and time outdoors. University of Pittsburgh professor Tom Akiva said the benefits of these activities shouldn’t be underestimated.
Research into summer programming more broadly finds recreational and youth employment programs can also benefit students in terms of their social and emotional well-being and ability to make good decisions, as well as career and health outcomes.
“The problem with all this, though, is that people don’t think that stuff counts,” Akiva said. “They think only school achievement counts, so we need a broader view of what counts as learning.”
Garland and McMurrer, two of the Summer B.O.O.S.T. evaluation’s authors, said that only looking at easily measurable progress can obscure “important dimensions of student wellbeing,” as well as long-term benefits that might not appear for a couple of years.
“It can be impactful for many reasons: enrichment and experiences, a safe place for kids to go in the summer, and for parents and families to know that their children are safe with people that they trust and that they know from the school year,” McMurrer said.
Academic boosts, she said, are just one of many datapoints districts should weigh as they shape summer learning going forward.