imperfect metrics

Big Data Are Great—But Imperfect Metrics Work for Nonprofit Boards!

 

Big Data Are Great—But Imperfect Metrics Work for Nonprofit Boards!

By Eugene Fram

Nonprofit boards need to expand their evaluations of nonprofit managers and their organizations adding more behavioral impacts * to their evaluations.

For example, a nonprofit might count the number of volunteers that have been trained. But boards must go to the next level in the 21st century.
In the case of volunteers, they must seek to understand the impacts on those trained. They need, for instance, to understand how well these volunteers are assisting clients and how they are representing the nonprofit to the clients. The training is a process, but it determines their relationships with clients and yields impact data.

Qualitative data must be developed to the next level, and the average nonprofit CEO will argue that he/she doesn’t have the staff or expertise to develop impact data. Engaging an outside organization to complete a simple project can cost thousands of dollars. (more…)

Advertisements

Going For Impact: A Non-Profit Blueprint For the Second Half of the Year  

 

Going For Impact: A Non-Profit Blueprint For the Second Half of the Year

By Eugene Fram     Free  Digiatl Image

For organizations and individuals, the end of the calendar year is the traditional planning period – the time used for self-assessment, strategizing and putting in place “game plan” for improvement and growth for the 12 months to come.

For many nonprofits, June 30th is the end of the fiscal and planning year. Yet the blueprint also offers the same opportunities to focus on improvement and growth.

But in today’s volatile, hyper-competitive and uncertain environment, this one-a-year exercise isn’t enough.

It just isn’t. Especially for nonprofits. And their boards of directors.

Here’s the good news: The year’s midpoint – upon us now – is a great point for an interim review. It’s a good time to review your game plan. Develop a vision goes beyond reviewing current budget projections against actuals and other compliance requirements.

I have identified five areas of focus – the last being a kind of “action plan” you can use to implement what’s of interest. Adopting just one of the many suggestions can yield a substantial return on investment.   They are: 

  • Your Leadership
  • Your Talent Pool
  • Your Fundraising
  • Your Impact Data
  • Your “Fix-It” Points

(more…)

How Often Do Nonprofit Board Members Need to Question Strategic Norms?

 

How Often Do Nonprofit Board Members Need to Question Strategic Norms?

By Eugene Fram

A new nonprofit director has a lot to learn. Considering that his/h term of service will be relatively short (typically four to six years), he/s must quickly learn the “ropes” to participate in a meaningful way. In this process, colleagues and leadership will acquaint him/h with prevailing board systems and culture—often ignoring the depth of expertise she/h can employ. Example: An expert in financial strategies may be asked to assist the CFO with accounting details, far below the person’s skill level. Oftentimes the new board member also is greeted with a mantra that says, “We’ve always done it this way.” As the director moves in his path from novice to retiree, during a short tenure, there is little opportunity to suggest innovations that differ from the accepted fundamentals and to successfully advocate for change. (more…)

Are Your Board and Staff Ready For Change?

Free Digital Image

Are Your Board and Staff Ready For Change?

By: Eugene Fram

“Ideally, change takes place only when is “a critical mass of board and staff want … it. A significant … portion of leadership must realize that the status quo won’t do” * Based on my experiences, this ideal is rarely achieved because:

  • The CEO needs to support the changes being suggested and/or mandated by a majority of the board.   But, if not fully invested in the change, he/s can accede to board wishes for action but move slowly in their implementations. The usual excuse for slow movement is budget constraint.

(more…)

Once Again: How Should Nonprofits Conduct Board Evaluations?

Once Again: How Should Nonprofits Conduct Board Evaluations?

By: Eugene Fram

Recent (2017) data from BoardSource show that only about 58% of boards have had “formal, written self-assessment of board performance at some point. Only 40% of all boards have done an assessment in the past two Years,” a recommended practice. With the rapid turnover of directors that nonprofit boards traditionally experience, this seems inexcusable. As a “veteran” nonprofit director, following is what I think can be done to improve the situation. (more…)

Developing Meaningful Relationships Within Nonprofit Boards

Developing Meaningful Relationships Within Nonprofit Boards

By: Eugene Fram

For several decades, I have suggested that nonprofit Board Chairs and CEOs have a responsibility to be sure that each board member perceives his/h continuing relationship as being meaningful. Following are some organizational guidelines that can assist Board Chairs and CEOs in this effort.*

  1. Developing or hiring strong executive leadership: Obviously when hiring externally it is necessary to engage a person with a managerial background. But many nonprofit CEOs can be appointed after years of being an individual contributor or leading a small department. These experiences condition them to do too much themselves, rather than to assume a strong management posture. This involves focusing more on strategy, on talent development, interacting more with the board/community and creating a long-term vision.

(more…)

Measuring Nonprofits’ Impacts: A Necessary Process for the 21st Century

Measuring Nonprofits’ Impacts: A Necessary Process for the 21st Century

By Eugene Fram   Free Digital Image

Nonprofit boards and CEOs in the United States are being overwhelmed with requests from foundations and governmental agencies to move from providing outcome data to providing impact data. One nonprofit with which I am well acquainted has been required to reform its IT program to meet the requirements of a local governmental IT program, so that impacts can be assessed. It will be interesting to see how this scenario plays out.

Unfortunately, outcomes and impact are often unrelated, which is why a program that seems to produce better outcomes may create no impact at all. Worse, sometimes they point in opposite directions, as can happen when a program works with harder-to- service populations resulting in seemingly worse conditions, but (has) higher value-added impact. … Rigorous evaluations can measure impact (to a level of statistical accuracy), but they are usually costly (a nonstarter for many nonprofit), difficult and slow. * But how do the medium and small size nonprofits measure actual results in the outside world such as enhanced quality of life, elevated artistic sensitivity and community commitment?

A Compromise Solution:

To close the gap, funders and recipients would need to agree to apply imperfect metrics over time. These are metrics that can be anecdotal, subjective or interpretative. Also they may rely on small samples, uncontrolled situational factors, or they cannot be precisely replicated. ** This would require agreement and trust between funders and recipients as to what level of imprecision can be accepted and perhaps be improved, to assess impacts. It is an experimental approach

How To Get to Impact Assessment:

1. Agree on relevant impacts: Metrics should be used to reflect organizational related impacts, not activities or efforts. Impacts should focus on a desired change in the nonprofit’s universe, rather than a set of process activities.
2. Agree on measurement approaches: These can range from personal interviews to comparisons of local results with national data.
3. Agree on specific indicators: Outside of available data, such as financial results, and membership numbers, nonprofits should designate behavioral impacts for clients should achieve. Do not add other indicators because they are easily developed or “would be interesting to examine.” Keep the focus on the agreed-upon behavioral outcomes.
4. Agree on judgment rules: Board and management need to agree at the outset upon the metric numbers for each specific indicator that contributes to the desired strategic objective. The rules can also specify values that are “too high” as well as “too low.”
5. Compare measurement outcomes with judgment rules to determine organizational impact: Determine how may specific program objectives have reached impact levels to assess whether or not the organization’s strategic impacts have been achieved.

Lean Experimentation

The five-point process described above closely follows the philosophy of lean experimentation, *** now suggested for profit making and nonprofit organizations.

Lean allows nonprofits to use imperfect metrics to obtain impact data from constituents/ stakeholders over time. Under a lean approach, as long as the organizations garners some positive insights after each iteration, it continues to improve the measurement venues and becomes more comfortable with the advantages and limitations of using these metrics.

Organizationally the nonprofit can use this process to drive change over time by better understanding what is behind the imperfect metrics, especially when a small sample can yield substantial insights, and actually improve the use of the metrics.

* http://ssir.org/articles/entry/the_promise_and_peril_of_an_outcomes_mindset
** https://nonprofitquarterly.org/2012/07/24/using-imperfect-metrics-well-tracking-progress-and-driving-change/
*** http://ssir.org/articles/entry/the_promise_of_lean_experimentation