From Pilot to Program: Making the Match Hold

A high-fit assignment exists first as a hypothesis about a participant, a program, and a labor market. The harder question is whether that fit survives delivery. This chapter translates the World Bank’s design principles into practical requirements for Mentoring and Challenges: employers must help make the mechanism credible, participants must be able to use it, and providers must measure more than enrollment. The goal is a pilot-to-scale pathway that preserves the network or signaling mechanism instead of simply increasing the number of seats.

Scale is often described as a volume problem. If Mentoring helps some women, recruit more mentors; if Challenges is inexpensive online, enroll more participants. But a program is not its visible format. Mentoring’s value depends on meaningful access to professionals and relevant hiring networks. Challenges’ value depends on tasks, review, and employer interpretation. Scaling the outer form while losing those relationships can produce a larger program with a weaker effect.

Employers are part of the intervention

The World Bank’s five principles begin with contextual tailoring, but the principle has a specific implication for these programs: the target labor market must help define what counts as useful evidence and useful access. Employers are not only the destination at the end of a pipeline. They are part of the mechanism.

For Mentoring, employer involvement means more than asking mentors to encourage participants. The network must connect to actual opportunities and current hiring practices. A mentor who understands a sector’s roles, tools, and recruitment expectations can help a participant avoid generic advice. A referral matters most when it reaches a team that is hiring, when the participant’s skills are relevant, and when the contact can interpret a nontraditional background. Providers should therefore examine whether introductions lead to substantive conversations, interviews, feedback, or other access—not simply count how many introductions were reported.

For Challenges, employers must influence the work being signaled. Industry-designed assignments are valuable because they resemble tasks that hiring managers recognize. Expert review matters because the portfolio should communicate more than effort or completion. Employers can help define the standards, review sample work, and explain how a project will be discussed in an interview. The South African certification example in the World Bank guidebook makes the same point in another setting: a signal worked better when it was standardized, publicly credible, and useful to both job seekers and employers.

This is why a portfolio can lose value when its tasks or reviewers are not trusted. If the assignments are disconnected from current roles, the artifact may demonstrate persistence without demonstrating relevant ability. If review is perfunctory, the employer has little reason to treat it as independent evidence. If the credential is not recognized by anyone on the hiring side, the participant bears the burden of explaining why it matters. A signal is not portable merely because it is digital; it travels when its meaning travels with it.

The World Bank’s principle of private-sector engagement also changes how outcomes should be defined.