Lindsey Jones

Personal site and blog for Lindsey Jones' research on disaster risk reduction, climate change adaptation and resilience

Menu

Skip to content
  • About me
  • Papers
  • CV
  • My Research
  • Subjective toolkits
  • Blog

Guide to subjectively evaluating resilience

Quick links:
Click here for a practical guide on administering the SERS tool 

Click here for survey wording and tips & tricks running SERS

Click here for a how-to manual on phone surveys for resilience 

 Click here for insights on running a phone panel survey in Myanmar

A number of people have asked for further information on subjective evaluations of resilience.

Below are tools and methodological guides for how to carry out self-assessments of resilience (as well as the strengths and weaknesses of different approaches). Many of these are based on experiences in having run resilience assessments across Africa and Asia.

What are subjective evaluations of resilience?

Traditionally, resilience has been measured using objective approaches. Here, ‘objective’ refers to measurements that are based on external judgements and observations (i.e. not from the perspective of those being directly affected or measured).

Subjective approaches to resilience measurement take an entirely different approach. They challenge the assumption that outside experts know more about the resilience of others. Instead, they start from the premise that people have a valid understanding of their own ability to deal with current and future risks. To capture these insights, subjective approaches rely heavily on people’s own perceptions, judgements and preferences and try to factor them into the measurement process.

Why measure resilience subjectively?

Screenshot 2019-09-24 at 13.12.56

For a start, subjective evaluations capture bottom-up insights from those who matter most: people experiencing shocks and stresses on the ground. Second, they help reduce the burden of choosing hundreds of proxy indicators. Rather, people are asked to consider the factors that contribute to their own resilience and self-evaluate accordingly. Third, subjective evaluations are often much shorter than traditional objective approaches. Not only does this mean that surveys are cheaper and quicker to administer, but also it opens up new possibilities for resilience data collection – including the option of administering them via mobile phone surveys.

What can subjective evaluations be used for?

Pretty much anything that other sources of evaluative data can be used for. This includes: understanding resilience on the ground; comparing the resilience of different groups; tracking changes in resilience over time; and evaluating the effectiveness of resilience-building interventions.

How to carry out resilience self-assessments

First of all, it’s important to understand some of the theory and background as to how subjective and objective methods for resilience measurement compare. For a thorough review see this paper in WIRES Climate Change.

Screenshot 2019-09-24 at 13.13.24Once you’ve decided that you want to run a subjective assessment, you now have to consider how to design your survey module. There are a number of different approaches out there. The approach that I’ve helped to design is called Subjectively-Evaluated Resilience Score, or SERS for short.

SERS is designed to be both simple to use and methodologically robust. Most importantly, it is flexible, allowing evaluators to tailor it to their own needs and mould it to suit a range of different resilience frameworks. SERS is a self-assessed questionnaire module that focuses on household resilience. It works by asking individuals to answer a range of questions about their household’s resilience. Each question targets a specific resilience-related capacity, with answers standardised using a Likert scale. Questions are designed to be cognitively simple, helping ensure that respondents clearly understand each question and can provide a quick and reasoned self-assessment.

Running SERS is straightforward. It is a small survey module that can be placed in any household survey and typically takes roughly three to five minutes to administer. Before starting the module, a survey enumerator reads out a short opening statement. Nine short questions are then asked, with respondents rating the extent to which they agree or disagree with each (ranging from Strongly agree to Strongly disagree).

Screenshot 2019-09-24 at 14.22.47

Once answers to each of the questions have been gathered, they are numerically converted. An individual’s answers are then tallied up and used to compute an overall resilience score for each household.

For a full breakdown of SERS questions and details of how to calculate SERS scores see this brief: ‘Running the Subjectively-Evaluated Resilience Score’

Most importantly, SERS can be designed in a number of different ways. The evaluator’s choices in terms of opening statements, wording, question order and question weighting can each have important implications for how the resilience scores are calculated. Care should be taken in deciding each.

To walk you through the key steps in tailoring your own SERS survey module, please refer to this: ‘How-to Guide on subjective evaluations of resilience’

Alternatively, click on the follow resources below to explore more or get in touch with me through the contact detail tab to explore options for collaboration:

Screenshot 2019-09-24 at 13.13.41

Screenshot 2019-09-24 at 13.14.10

Screenshot 2019-09-24 at 13.17.27

Screenshot 2019-09-24 at 13.18.49

Share this:

  • Twitter
  • Facebook

Like this:

Like Loading...
Widgets
Blog at WordPress.com.
  • Follow Following
    • Lindsey Jones
    • Already have a WordPress.com account? Log in now.
    • Lindsey Jones
    • Customise
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...
 

    %d bloggers like this: