12 KPIs to Evaluate Success of Urban Micro-mobility Programs
Is micro-mobility helping or hurting our cities? There are many questions helping to frame this issue in communities all around the world.
- Are the benefits to users of this new niche of transportation services greater than the frustrations experienced by those in our communities who don’t use them?
- Does improved connectivity outweigh new injuries and, in some cases, fatalities documented since their introduction?
- Does micro-mobility encourage a shift away from single occupancy car trips more than vehicles such as e-scooters eat into walking, bicycling, and public transport trips?
- To what extent can we justify the reduction of some longer-distance walking trips as an improvement to equity?
- Will the vehicles we are planning for today even be here tomorrow?
Presently, we have a basic profile of micro-mobility through statistics such as vehicle and trip counts, but it is clear from our conversations with many cities, operators, and other stakeholders, that we all seek better ways to measure how well these programs are working in our communities. While every city is unique, and while micro-mobility is arriving at different times and in varying scales to cities, we submit it is still possible to identify common themes that span the globe from which we can measure success.
In the past few years, micro-mobility services have been arriving at unprecedented speed and scale to cities that are oftentimes ill-prepared to manage them. Typically, these services are introduced by private operators and are deployed as a “floating” system, meaning that only the vehicles themselves are physically present in public spaces. Legislation does not clearly define these new vehicles, and new business models do not fit neatly into existing methods of managing private businesses in public spaces.
The transportation community has responded by producing several helpful publications on the topic of micro-mobility, bringing more clarity and understanding to this phenomenon, documenting the growth and expansion of programs in cities, and providing guidance on good practices. Nonetheless, cities and operators still find it difficult to know if their micro-mobility programs are serving the community well, and how well the elements of their programs compare to other cities around the world. What is still needed is an easier way to measure what it means to have a successful program.
At Ramboll Smart Mobility we wanted to push the discussion away from general statistics about micro-mobility, and towards the identification of strategic goals and tangible key performance indicators (KPI). The KPIs can be measured by any city to better understand how successful and sustainable they are in providing new mobility options to their communities, and where they can improve.
We have thus identified a set of common strategic goals that we believe any city or operator would want to achieve. We have done so by considering perspectives, anecdotes, experiences, and factual data from a range of stakeholders and participants in the micro-mobility community, including: 15 cities, public transit agencies, micro-mobility operators, surveys of the general public, micro mobility focused data management services, and regional expert organizations. We then used a simple methodology to propose some potential KPIs that can be adopted by cities to gauge the sustainability of their micro-mobility programs, as well as compare themselves to other cities around the world.
There is an intentional emphasis on e-scooters in the study, but the effort and the outcomes are intended to apply to micro-mobility as a whole.
The Scope of the Study
The study was possible thanks to contributions from many sources. In the early stages of structuring our effort, we recognized that while there were quite a few publications available and being released about micro-mobility, many of them were focused on a specific city or region or contained general advice and metrics about micro-mobility programs. We wanted to build on these publications to expand the ways of describing micro-mobility programs beyond the summary statistics of fleet size and trip counts, towards metrics that enabled cities to better gauge the success of their efforts.
Our team collected and reviewed the state of practice available via existing studies, publications, and articles to better understand what cities were up to and how their efforts related to the establishment of universal strategic goals. This effort was admittedly not comprehensive, but the spectrum of references considered allowed us to form a strong basis for more targeted input sources. With this foundation we then pursued three data input channels.
- Operational Data: Our team was able to evaluate some of the data available to the City of Hoboken, NJ via its data management platforms, RideReport, and Populos. In addition, we discussed the use of specific data sets with both Lime and Voi.
- Municipal Interviews: A major source of our inputs came from one-to-one interviews with municipal officials, operators, and other major actors in the micro-mobility theatre, such as NACTO in North America and POLIS in Europe. We conducted short interviews via phone or online conferencing during which we asked targeted questions about local activities related to the themes presented herein, and specifically about approaches to the strategic goals.
- Public Surveys: Several public surveys had already been conducted in cities such as Portland and Paris. We considered these results and worked in collaboration with the City of Hoboken to identify more targeted questions that could build upon the in-depth survey already planned for the ending days of Hoboken’s six month micro-mobility pilot program. In addition, a City Councilmember in Hoboken had polled the local constituency with a single-question email survey using data analytics by Involved to gather opinions about the pilot program. These data were useful in validating the City’s survey as well as identifying interesting trends.
In total, our research included 15 cities: six in North America, seven in Europe, and two in Asia-Pacific:
We believe the outcome is a strong representation of the successes and challenges that cities of all sizes are experiencing, from unique legislative hurdles faced each location, to the universal needs that every city shares as critical to delivering successful micro-mobility services in their communities.
Measuring the Value and Sustainability of Micro-Mobility Programs
Every city is unique. The people, the cultures, the urban form, the institutional organization, topography, and even the weather impact the way in which transportation services function. While every conversation about micro-mobility is shaped by the influences of the local context, we have approached this project with the premise that we could nonetheless identify common themes that weigh on the minds of the people in any city. These themes are the essential elements that contribute to providing local communities the best possible successful micro-mobility program, including success with respect to the environment, economy, and social well-being. We believe that, regardless of the local context, there are a set of universal strategic goals that every city can agree are important to realize a sustainable micro-mobility program.
In our collaboration with cities and operators experiencing micro-mobility first-hand, as well as other authorities and stakeholders closely connected to the management of micro-mobility programs, we have derived the following twelve universal strategic goals:
The goals were established to allow our discussions to focus on specific metrics that would be useful in better gauging the success of local micro-mobility programs.
The 12 Strategic Goals & Associated KPIs
In relation to the goals, we have suggested a range key performance indicators (KPIs) that can be used to gauge the progress of an individual city and to allow basis for benchmarking across cities.
Leave your comment below, or reply to others.
Please note that this comment section is for thoughtful, on-topic discussions. Admin approval is required for all comments. Your comment may be edited if it contains grammatical errors. Low effort, self-promotional, or impolite comments will be deleted.
Read more from MeetingoftheMinds.org
Spotlighting innovations in urban sustainability and connected technology
Based on our observations and experiences, we’ve written a white paper describing a Smart City-Public Health Emergency collaboration framework. We define a structured approach to broadly consider and maximize collaboration opportunities between the smart city innovation community and municipalities for the COVID-19 outbreak. It integrates the CDC Public Health Emergency and Response Capabilities standards with components of a smart city innovation ecosystem. The CDC defined capability standards are organized into six domains. Each intersection in the framework represents a collaboration point where the smart city’s innovation ecosystem and digital capabilities can be used to augment the municipalities’ public health emergency response needs.
Social distancing is becoming the new normal, at least for those of us who are heeding the Center for Disease Control’s warnings and guidelines. But if you don’t have reliable, high-speed broadband, it is impossible to engage in what is now the world’s largest telecommunity. As many schools and universities around the world (including those of my kids) are shut down, these institutions are optimistically converting to online and digital learning. However, with our current broadband layout, this movement will certainly leave many Americans behind.
Accenture analysts recently released a report calling for cities to take the lead in creating coordinated, “orchestrated” mobility ecosystems. Limiting shared services to routes that connect people with mass transit would be one way to deploy human-driven services now and to prepare for driverless service in the future. Services and schedules can be linked at the backend, and operators can, for example, automatically send more shared vehicles to a train station when the train has more passengers than usual, or tell the shared vehicles to wait for a train that is running late.
Managing urban congestion and mobility comes down to the matter of managing space. Cities are characterized by defined and restricted residential, commercial, and transportation spaces. Private autos are the most inefficient use of transportation space, and mass transit represents the most efficient use of transportation space. Getting more people out of private cars, and into shared feeder routes to and from mass transit modes is the most promising way to reduce auto traffic. Computer models show that it can be done, and we don’t need autonomous vehicles to realize the benefits of shared mobility.