Advancing Social Media Measurement for Foundations: A Re-Cap (Part Two)

(Beth Kanter is a Master Trainer and the author of Beth's Blog, one of the longest running and most popular blogs for nonprofits, and co-author of the highly acclaimed book, The Networked Nonprofit, published by J. Wiley in 2010, and its new follow-up, Measuring the Networked Nonprofit, published in 2013 by J. Wiley.)

Kanter-100In my post yesterday, we discussed what working transparently means and its benefits, and I left you with the cliff-hanger on how to measure your return on investment. Transparency is like any other measurement challenge; you first need to be clear about what you are measuring. There are different ways to measure transparency. The first is assessing the impact of a change in transparency on your foundation by measuring the change in the benefits of that transparency – in this case efficiency or trust. The second way is a self-evaluation to determine how transparent your organization is.

The transition to transparency may be discomforting, but the benefits of inviting people in and sharing in a foundation’s strategy development far outweigh the potential downsides.

How to Measure Improvements in Efficiency
To measure efficiency you need to have a chat with your accounting and operations departments to figure out what your leadership team is already tracking for efficiency metrics. If they aren’t already doing it, then chances are that someone in one of those departments knows how to do it and can help you. Typical efficiency metrics include:

  1. Percent reduction in response time from inquiry to satisfied resolution
  2. Percent reduction in staff hours responding to queries
  3. Percent increase in satisfaction and knowledge of employees

The benefits of increased transparency can also be quantified by a relationship survey (see Chapter 7).

How to Measure Improvements in Trust
Several studies have shown that the more transparent people perceive an organization to be, the more likely they are to trust that organization. The more the organization provides honest, open, and occasionally vulnerable communications, the more people trust the institution. Amazingly, the ability to be open and transparent was found to be more influential than competence in terms of willingness to trust. In other words, people care more about your willingness to be open and transparent than whether you are competent enough to do what you say you are going to do!

How to Measure Your Own Transparency
While the field of transparency measurement is relatively nascent, thanks to the work of Rawlins and others there are established techniques to quantify it in your own organization. There are two elements to measuring transparency. The first is “How do I know just how transparent we are?” The second is: “Do our stakeholders perceive us as transparent? And, consequently, do they trust us?”

Measurement of transparency examines four separate but equal components:

  1. Participation – The organization asks for feedback, involves others, takes the time to listen, and is prompt in responding to requests for information.
  2. Substantial – The organization provides information that is truthful, complete, easy to understand, and reliable.
  3. Accountable – The organization is forthcoming with bad news, admits mistakes, and provides both sides of a controversy.
  4. Absence of secrecy – The organization doesn’t leave out important but potentially damaging details, the organization doesn’t obfuscate its data with jargon or confusion, and the organization is not slow to provide data or only discloses data when required.

In Measuring the Networked Nonprofit, we recommended using survey or focus group questions based on the work of Brad Rawlins or the Who Has Glass Pockets? assessment, which your foundation can use to audit its own transparency. Typically a survey like this is administered either as a group discussion, or as a written survey followed by a group discussion of the results. Some of the areas of discussion that should emerge as a result of such an exercise are outlined below:

Is your organization participative?

  1. Do we involve stakeholders to help identify the information we need?
  2. Do we ask the opinions of stakeholders before making decisions?
  3. Do we take the time with stakeholders to understand who we are and what we need?

Do we provide substantial information?

  1. Do we provide detailed information to stakeholders?
  2. Do we make it easy to find the information stakeholders need?
  3. Are we prompt when responding to requests for information from stakeholders?
  4. Are we forthcoming with information that might be damaging to the organization?
  5. Do we provide information that can be compared to industry standards?
  6. Do we present more than one side of controversial issues?

Are we accountable?

  1. Do we provide information in a timely fashion to stakeholders?
  2. Do we provide information that is relevant to stakeholders?
  3. Do we provide information that could be verified by an outside source?
  4. Do we provide information that can be compared to previous performance?
  5. Do we provide information that is complete?
  6. Do we provide information that is easy for stakeholders to understand?
  7. Do we provide accurate information to stakeholders?
  8. Do we provide information that is reliable?
  9. Do we present information in language that is clear?
  10. Are we open to criticism?
  11. Do we freely admit when we make mistakes?

Secrecy

  1. Do we provide only part of the story to stakeholders?
  2. Do we leave out important details in the information we provide to stakeholders?
  3. Do we provide information that is full of jargon and technical language that is confusing to people?
  4. Do we blame outside factors that may have contributed to the outcome when reporting bad news?
  5. Do we provide information that is intentionally written in a way to make it difficult to understand?
  6. Are we slow to provide information to stakeholders?
  7. Do we only disclose info when it is required?
  8. Do we only disclose “good” news?

Measuring Stakeholder Perceptions
The second part of transparency measurement is assessing whether your stakeholders perceive you as transparent. To measure whether your supporters and stakeholders perceive you as transparent you need to ask them whether they agree or disagree with the following statements. These questions could be added to grantee perception reports or other surveys that are routinely conducted by foundations.

  1. The organization wants to understand how its decisions affect people like me.
  2. The organization provides information that is useful to people like me for making informed decisions.
  3. I think it is important to watch this organization closely so that it does not take advantage of people like me.
  4. The organization wants to be accountable to people like me for its actions.
  5. The organization wants people like me to know what it is doing and why it is doing it.
  6. This organization asks for feedback from people like me about the quality of its information.
  7. This organization involves people like me to help identify the information I need.
  8. Provides detailed information to people like me.
  9. Makes it easy to find the information people like me need.
  10. Asks the opinions of people like me before making decisions.

The transition to transparency may be discomforting, but the benefits of inviting people in and sharing in a foundation’s strategy development far outweigh the potential downsides. Imagine how much stronger your network's reactions, input, and suggestions will make your organization—and how exciting it will feel to share your great work with more people. And, with a measurement strategy in place, you can know for sure that your effort has paid off, and that your organization is changing from the inside out.

--Beth Kanter

About the author(s)