12 KPIs to Evaluate Success of Urban Micro-mobility Programs

By Ian Sacs, Market Manager, Ramboll

Ian Sacs contributes to the sustainable development of liveable cities around the world by seeking optimal transportation and parking solutions to best fit unique local conditions. Prior to joining Ramboll, Ian worked for over a decade on redevelopment and policy projects in the New York City market, and served as the Director of Transportation and Parking for the City of Hoboken, New Jersey for three years. He is registered as a Professional Engineer (P.E.) in the State of New York, B.S. Civil and Environmental Engineering, Florida International University (2000), M.S. Civil Engineering, The University of Tennessee (2001).

Feb 24, 2020 | Mobility | 6 comments


Who will you meet?

Cities are innovating, companies are pivoting, and start-ups are growing. Like you, every urban practitioner has a remarkable story of insight and challenge from the past year.

Meet these peers and discuss the future of cities in the new Meeting of the Minds Executive Cohort Program. Replace boring virtual summits with facilitated, online, small-group discussions where you can make real connections with extraordinary, like-minded people.


 

Is micro-mobility helping or hurting our cities? There are many questions helping to frame this issue in communities all around the world.

  • Are the benefits to users of this new niche of transportation services greater than the frustrations experienced by those in our communities who don’t use them?
  • Does improved connectivity outweigh new injuries and, in some cases, fatalities documented since their introduction?
  • Does micro-mobility encourage a shift away from single occupancy car trips more than vehicles such as e-scooters eat into walking, bicycling, and public transport trips?
  • To what extent can we justify the reduction of some longer-distance walking trips as an improvement to equity?
  • Will the vehicles we are planning for today even be here tomorrow?

Presently, we have a basic profile of micro-mobility through statistics such as vehicle and trip counts, but it is clear from our conversations with many cities, operators, and other stakeholders, that we all seek better ways to measure how well these programs are working in our communities. While every city is unique, and while micro-mobility is arriving at different times and in varying scales to cities, we submit it is still possible to identify common themes that span the globe from which we can measure success.

In the past few years, micro-mobility services have been arriving at unprecedented speed and scale to cities that are oftentimes ill-prepared to manage them. Typically, these services are introduced by private operators and are deployed as a “floating” system, meaning that only the vehicles themselves are physically present in public spaces. Legislation does not clearly define these new vehicles, and new business models do not fit neatly into existing methods of managing private businesses in public spaces.

The transportation community has responded by producing several helpful publications on the topic of micro-mobility, bringing more clarity and understanding to this phenomenon, documenting the growth and expansion of programs in cities, and providing guidance on good practices. Nonetheless, cities and operators still find it difficult to know if their micro-mobility programs are serving the community well, and how well the elements of their programs compare to other cities around the world. What is still needed is an easier way to measure what it means to have a successful program.

At Ramboll Smart Mobility we wanted to push the discussion away from general statistics about micro-mobility, and towards the identification of strategic goals and tangible key performance indicators (KPI). The KPIs can be measured by any city to better understand how successful and sustainable they are in providing new mobility options to their communities, and where they can improve.

We have thus identified a set of common strategic goals that we believe any city or operator would want to achieve. We have done so by considering perspectives, anecdotes, experiences, and factual data from a range of stakeholders and participants in the micro-mobility community, including: 15 cities, public transit agencies, micro-mobility operators, surveys of the general public, micro mobility focused data management services, and regional expert organizations. We then used a simple methodology to propose some potential KPIs that can be adopted by cities to gauge the sustainability of their micro-mobility programs, as well as compare themselves to other cities around the world.

There is an intentional emphasis on e-scooters in the study, but the effort and the outcomes are intended to apply to micro-mobility as a whole.

The Scope of the Study

The study was possible thanks to contributions from many sources. In the early stages of structuring our effort, we recognized that while there were quite a few publications available and being released about micro-mobility, many of them were focused on a specific city or region or contained general advice and metrics about micro-mobility programs. We wanted to build on these publications to expand the ways of describing micro-mobility programs beyond the summary statistics of fleet size and trip counts, towards metrics that enabled cities to better gauge the success of their efforts.

Our team collected and reviewed the state of practice available via existing studies, publications, and articles to better understand what cities were up to and how their efforts related to the establishment of universal strategic goals. This effort was admittedly not comprehensive, but the spectrum of references considered allowed us to form a strong basis for more targeted input sources. With this foundation we then pursued three data input channels.

  1. Operational Data: Our team was able to evaluate some of the data available to the City of Hoboken, NJ via its data management platforms, RideReport, and Populos. In addition, we discussed the use of specific data sets with both Lime and Voi.
  2. Municipal Interviews: A major source of our inputs came from one-to-one interviews with municipal officials, operators, and other major actors in the micro-mobility theatre, such as NACTO in North America and POLIS in Europe. We conducted short interviews via phone or online conferencing during which we asked targeted questions about local activities related to the themes presented herein, and specifically about approaches to the strategic goals.
  3. Public Surveys: Several public surveys had already been conducted in cities such as Portland and Paris. We considered these results and worked in collaboration with the City of Hoboken to identify more targeted questions that could build upon the in-depth survey already planned for the ending days of Hoboken’s six month micro-mobility pilot program. In addition, a City Councilmember in Hoboken had polled the local constituency with a single-question email survey using data analytics by Involved to gather opinions about the pilot program. These data were useful in validating the City’s survey as well as identifying interesting trends.

 

In total, our research included 15 cities: six in North America, seven in Europe, and two in Asia-Pacific:

Figure 1: Overview of contributors to the study

We believe the outcome is a strong representation of the successes and challenges that cities of all sizes are experiencing, from unique legislative hurdles faced each location, to the universal needs that every city shares as critical to delivering successful micro-mobility services in their communities.

Measuring the Value and Sustainability of Micro-Mobility Programs

Every city is unique. The people, the cultures, the urban form, the institutional organization, topography, and even the weather impact the way in which transportation services function. While every conversation about micro-mobility is shaped by the influences of the local context, we have approached this project with the premise that we could nonetheless identify common themes that weigh on the minds of the people in any city. These themes are the essential elements that contribute to providing local communities the best possible successful micro-mobility program, including success with respect to the environment, economy, and social well-being. We believe that, regardless of the local context, there are a set of universal strategic goals that every city can agree are important to realize a sustainable micro-mobility program.

In our collaboration with cities and operators experiencing micro-mobility first-hand, as well as other authorities and stakeholders closely connected to the management of micro-mobility programs, we have derived the following twelve universal strategic goals:

Figure 2: 12 suggested strategic goals to achieve sustainable mobility, Ramboll 2020

The goals were established to allow our discussions to focus on specific metrics that would be useful in better gauging the success of local micro-mobility programs.

The 12 Strategic Goals & Associated KPIs

In relation to the goals, we have suggested a range key performance indicators (KPIs) that can be used to gauge the progress of an individual city and to allow basis for benchmarking across cities.

Strategic Goal

KPIs

Connectivity
  • Share of micro-mobility trips that would otherwise be a car trip
  • Share of micro-mobility trips longer than 1 km that would otherwise be a walking trip
  • Share of micro-mobility trips combined with public transport
  • Share of users who say that micro-mobility “makes it easier to get around town”
Climate
  • Share of micro-mobility trips that would otherwise be a fossil fuel car trip
  • Share of micro-mobility trips less than 1 km (.6 miles) that would otherwise be a walking or cycling trip
  • Lifecycle carbon footprint of micro-mobility vehicle by passenger km/mile
  • Share of users who say micro-mobility “facilitated access to public transport” versus “replaced a public transport trip”
  • Trip purpose of “new” micro-mobility trips
Equity
  • Availability, distance, and usage by geography
  • Availability and usage by time of day
  • Distance to scooters
  • Ridership by age and gender
  • Pricing and payment options provided by operators
Resilience
  • Capacity in bike lanes
  • Capacity for parking
  • Capacity in public transport
  • Percentage of space allocated to micro-mobility facilities
  • “Robustness” of the service
Local economy
  • Number of trips ending along main street / total trips
  • Trip volumes along commercial corridors
  • Users’ trip purpose
  • Number of customers at local businesses arriving by e-scooter/micro-mobility
Safety
  • Available infrastructure
  • Other safety measures implemented
  • Offered safety training or information
  • Hospital injury data: crash and injury types
  • Micro-mobility crashes as a percentage of all crashes
Innovation
  • Number of tests and pilots projects
  • Involvement of local community
Compliance
  • Degree of rider compliance with local regulation
  • Citations issued to users for noncompliance/total rides
  • Types of compliance concerns noted by the public
  • Initiatives to improve compliance
  • Policies and fines used to improve compliance
Acceptance
  • Acceptance of the systems among users and non-users
  • Value of the system to the community
  • Importance of specific infrastructure elements or policies to improve acceptance
Management
  • Which model is used to manage micro-mobility (voluntary cooperation, pilot program, permitting / licensing scheme)
  • Effectiveness of the mechanisms used to manage micro-mobility
  • Number of city staff assigned to micro-mobility programs, per ride
Data access
  • Data sharing agreement with operators
  • Data sharing platforms used
  • Types of data collected
Costs
  • Which model is used to manage micro-mobility (voluntary cooperation, pilot program,  permitting /licensing scheme)?
  • Effectiveness of the mechanisms used to manage micro-mobility
  • Number of City staff assigned to the micro-mobility program per ride

Discussion

Leave your comment below, or reply to others.

Please note that this comment section is for thoughtful, on-topic discussions. Admin approval is required for all comments. Your comment may be edited if it contains grammatical errors. Low effort, self-promotional, or impolite comments will be deleted.

6 Comments

  1. It appears that you have not included race, ethnicity, disability, and low income status under “Equity.” You should have.

    Reply
    • Hi Marc, you are correct that the article above does not explicitly address the equity elements you listed. We will be sure to take these into consideration as we work with specific communities to develop suitable KPIs. Your feedback is appreciated, thanks! -ian

      Reply
  2. Very interesting!
    Ian, management and costs are measured with the same KPIs? or, was it a mistake on the costs’ ones?
    Thank you.

    Reply
    • Hi Pedro, thanks for your comment. And thanks for catching this error. We will work to get this edited. Meantime, here are the correct KPIs for costs:

      Proposed KPIs to measure costs:
      • Elements that are considered in the overall
      program costs to the city
      • Cost of the program to the city per ride
      • Cost per ride for operators
      • Pricing structure

      Reply
  3. Hi,

    I am Carla Giaume, a master student in Local Economic Development at the London School of Economics. I found your study extremely interesting, especially the methodology you used to asses the topic.
    I was wondering if I could have access to the final report you published and to the data you used for your results. I am writing my master dissertation on the topic of micro-mobility and e-scooters and these data could be really helpful for me.

    Thank you in advance for your help.

    Best regards,

    Carla Giaume

    Reply

Submit a Comment

Your email address will not be published. Required fields are marked *

Read more from MeetingoftheMinds.org

Spotlighting innovations in urban sustainability and connected technology

Taking a Look into Our Adaptation Blind Spots

Taking a Look into Our Adaptation Blind Spots

In my business, we’d rather not be right. What gets a climate change expert out of bed in the morning is the desire to provide decision-makers with the best available science, and at the end of the day we go to bed hoping things won’t actually get as bad as our science tells us. That’s true whether you’re a physical or a social scientist.

Well, I’m one of the latter and Meeting of the Minds thought it would be valuable to republish an article I penned in January 2020. In that ancient past, only the most studious of news observers had heard of a virus in Wuhan, China, that was causing a lethal disease. Two months later we were in lockdown, all over the world, and while things have improved a lot in the US since November 2020, in many cities and nations around the world this is not the case. India is living through a COVID nightmare of untold proportions as we speak, and many nations have gone through wave after wave of this pandemic. The end is not in sight. It is not over. Not by a longshot.

And while the pandemic is raging, sea level continues to rise, heatwaves are killing people in one hemisphere or the other, droughts have devastated farmers, floods sent people fleeing to disaster shelters that are not the save havens we once thought them to be, wildfires consumed forests and all too many homes, and emissions dipped temporarily only to shoot up again as we try to go “back to normal.”

So, I’ll say another one of those things I wish I’ll be wrong about, but probably won’t: there is no “back to normal.” Not with climate change in an interdependent world.

Bleutech Park: Vegas’ New Eco Entertainment Park

Bleutech Park: Vegas’ New Eco Entertainment Park

I caught up with Steph Stoppenhagen from Black & Veatch the other day about their work on critical infrastructure in Las Vegas. In particular, we talked about the new Bleutech Park project which touts itself as an eco-entertainment park. They are deploying new technologies and materials to integrate water, energy, mobility, housing, and climate-smart solutions as they anticipate full-time residents and park visitors. Hear more from Steph about this new $7.5B high-tech biome in the desert.

Urban Simulation Tech Models Effects of Shared Mobility in Reducing Congestion

Urban Simulation Tech Models Effects of Shared Mobility in Reducing Congestion

Planning for new, shared modes of transit that will rival private vehicles in access and convenience requires a paradigm shift in the planning process. Rather than using traditional methods, we need to capture individual behavior while interacting with the systems in questions. An increasing number of studies show that combining agent-based simulation with activity-based travel demand modeling is a good approach. This approach creates a digital twin of the population of the city, with similar characteristics as their real-world counterparts. These synthetic individuals have activities to perform through the course of the day, and need to make mobility decisions to travel between activity locations. The entire transportation infrastructure of the city is replicated on a virtual platform that simulates real life scenarios. If individual behavior and the governing laws of the digital reality are accurately reproduced, large-scale mobility demand emerges from the bottom-up, reflecting the real-world incidences.

The Future of Cities

Mayors, planners, futurists, technologists, executives and advocates — hundreds of urban thought leaders publish on Meeting of the Minds. Sign up below to follow the future of cities.

You have Successfully Subscribed!

Wait! Before You Leave —

Wait! Before You Leave —

Subscribe to receive updates on the Executive Cohort Program!

You have Successfully Subscribed!

Share This