Article

Randomized controlled trials

As governments seek to incorporate more empirical evidence into their decision-making, many are conducting RCTs.

By Steer

As governments seek to incorporate more empirical evidence into their decision-making, many are conducting Randomized Controlled Trials (RCTs), the type of experiments used to approve medical treatments, to test the effectiveness of their programs. Transportation planners could also use RCTs to better model human behavior or evaluate design decisions, policies and programs.

Randomized Controlled Trials (RCTs) are simple experiments where one randomly-selected group receives a treatment of some kind, and is then compared to a another randomly-selected untreated group. Medical researchers have long used RCTs to test the effectiveness of treatments, but the technique is only recently becoming common in public policy.

For example, development economists are adopting RCTs as a tool to evaluate poverty alleviation policies before applying them at a large scale. In some cases, such trials have shown well-intended programs to be ineffective or even harmful; at a minimum, they have shown that human response to policies can be very sensitive to context.

The behavioral parameters in transportation forecasting models, such as the value of time and modal preferences, can also be context-specific. For this reason, transportation planners often observe actual travel behavior to estimate those parameters for a specific project. When the data required for robust revealed-preference studies are not available, planners rely on stated-preference surveys or studies from other cities, which may be less accurate. To test designs, policies or programs that can be implemented on a small scale with relatively little investment, transportation planners can use RCTs to create data that reveal actual behavior in the local context.
As one example from the passenger rail sector, planners could use RCTs to measure the ridership impact of specific amenities, such as on-board Wi-Fi. An agency could mail to a random group of residents a code to use Wi-Fi for free on commuter trains. If the group that received the code then rode the train more than a random group that did not receive a code, the agency might consider providing free Wi-Fi for all its passengers.

As another example, RCTs could be used to evaluate Transportation Demand Management (TDM) programs designed to discourage commuters from driving alone to work. TDM measures, such as subsidized transit passes, showers for cyclists and parking fees, can all be tested with RCTs, enabling transportation management associations to focus on providing the programs proven to work in their context.

In medical research, RCTs can raise serious ethical concerns, since experimental treatments may cause harmful side-effects and effective treatments are withheld from the control group, which could potentially benefit from them. Similarly, RCTs could also cause unrest amongst participants when applied in public policy. Some trials could create unrealistic expectations amongst travelers which may cause complaints if, following the trial, a successful program fails to be rolled out. They may also be misleading if they are applied to programs which require a minimum degree of implementation or other complimentary policies to become effective. For example, a single bike rack is unlikely to cause a huge uptake in cycling. However, a series of bike racks connected by a network of new bike paths are more likely to have an impact. While it’s important to consider these potential issues, they should not be overstated and nullify the benefits of the method.

Transportation planners already utilize a variety of techniques to inform decision-making with empirical evidence. RCTs could be an additional tool for investigating how scalable transportation measures affect travel behavior in a particular context.

Off

Subscribe to our newsletter, The Edit

We are Steer

Yes, you are in the right place. After 40 years, we have changed our name from Steer Davies Gleave to mark our growing international footprint and our expanding portfolio into sectors beyond transport.

Explore our new website to learn more about Steer: who we are, how we work and what our future holds.

Related insights

  • 20 Jun 2025
    Article

    Does the comprehensive spending review offer overlooked opportunities for London?

    Edmund Cassidy
    Associate Director

    New funding offers London boroughs a chance to unlock long-term regeneration.

    Read more

  • 17 Dec 2024
    Article

    Steer Leads Multi-Consultancy Team on Culture Mile BID’s New Vision for a Connected, Greener Neighbourhood

    By Steer

    The strategy aims to transform the City of London’s Culture Mile into a more connected, accessible, and vibrant cultural neighbourhood.

    Read more

  • 12 Dec 2024
    Article

    Steer analysis offers data-driven, transit-oriented view of green and grey belt potential

    Oliver Russell
    Associate

    Steer has launched an online story map showcasing the potential for sustainable, well-connected green and grey belt development.

    Read more

  • 18 Jul 2024
    Article

    The King’s Speech: Our key takeaways on planning, transport and the energy transition

    By Steer

    King Charles sets out the new Labour Government’s legislative agenda which intends to ‘take the brakes off Britain’.

    Read more

  • 26 Apr 2024
    Article

    How can cycling infrastructure be improved in cities around the world? Our consultants give their thoughts

    By Steer

    Last week it was announced that cycling has overtaken car trips as a favoured mode share in central Paris.

    Read more

  • 31 May 2022
    Article

    Crossrail – it wasn’t quick or easy, but it is wonderful

    Adrian Cole
    Consulting Director
    Victoria Rees
    Associate Director

    As Crossrail completes its first week of passenger service, it's a good opportunity to reflect on the work that led to this milestone.

    Read more

  • 20 May 2021
    Article

    Planning Reforms — a chance to get things right

    In the recent Queen’s Speech, the Government reconfirmed its desire to speed up the development process.

    Read more

  • 21 Apr 2021
    Article

    Is flexibility the answer?

    Undoubtedly, the COVID-19 pandemic has imposed a sudden stop to our daily routine and reshaped our mobility needs and priorities.

    Read more

  • 22 Jan 2021
    Article

    TfL Streetspace judicial review: lessons for transport planners and engineers

    The High Court upheld a judicial review brought by the London taxi trade against TfL's Streetspace Plan.

    Read more

  • 21 Dec 2020
    Article

    Our Urban Dynamic Model reimagined for COVID-19

    By Steer

    Our Urban and Regional Dynamic Models have been reimagined for COVID-19.

    Read more

  • 26 Nov 2020
    Article

    Better thinking for levelling up

    Neil Chadwick
    Director

    How the UK Government appraises its spending decisions and subsequently evaluates these.

    Read more

  • 22 Sep 2020
    Article

    Steer report analyses the implementation of electric buses in Santiago, Chile

    By Steer

    Its’ geography and variety of climatic zones makes Chile significantly vulnerable to the impacts of climate change.

    Read more