imperfect metrics

Are Your Board and Staff Ready For Change?

Free Digital Image

Are Your Board and Staff Ready For Change?

By: Eugene Fram

“Ideally, change takes place only when is “a critical mass of board and staff want … it. A significant … portion of leadership must realize that the status quo won’t do” * Based on my experiences, this ideal is rarely achieved because:

  • The CEO needs to support the changes being suggested and/or mandated by a majority of the board.   But, if not fully invested in the change, he/s can accede to board wishes for action but move slowly in their implementations. The usual excuse for slow movement is budget constraint.

(more…)

Advertisements

Once Again: How Should Nonprofits Conduct Board Evaluations?

Once Again: How Should Nonprofits Conduct Board Evaluations?

By: Eugene Fram

Recent (2017) data from BoardSource show that only about 58% of boards have had “formal, written self-assessment of board performance at some point. Only 40% of all boards have done an assessment in the past two Years,” a recommended practice. With the rapid turnover of directors that nonprofit boards traditionally experience, this seems inexcusable. As a “veteran” nonprofit director, following is what I think can be done to improve the situation. (more…)

Developing Meaningful Relationships Within Nonprofit Boards

Developing Meaningful Relationships Within Nonprofit Boards

By: Eugene Fram

For several decades, I have suggested that nonprofit Board Chairs and CEOs have a responsibility to be sure that each board member perceives his/h continuing relationship as being meaningful. Following are some organizational guidelines that can assist Board Chairs and CEOs in this effort.*

  1. Developing or hiring strong executive leadership: Obviously when hiring externally it is necessary to engage a person with a managerial background. But many nonprofit CEOs can be appointed after years of being an individual contributor or leading a small department. These experiences condition them to do too much themselves, rather than to assume a strong management posture. This involves focusing more on strategy, on talent development, interacting more with the board/community and creating a long-term vision.

(more…)

Measuring Nonprofits’ Impacts: A Necessary Process for the 21st Century

Measuring Nonprofits’ Impacts: A Necessary Process for the 21st Century

By Eugene Fram   Free Digital Image

Nonprofit boards and CEOs in the United States are being overwhelmed with requests from foundations and governmental agencies to move from providing outcome data to providing impact data. One nonprofit with which I am well acquainted has been required to reform its IT program to meet the requirements of a local governmental IT program, so that impacts can be assessed. It will be interesting to see how this scenario plays out.

Unfortunately, outcomes and impact are often unrelated, which is why a program that seems to produce better outcomes may create no impact at all. Worse, sometimes they point in opposite directions, as can happen when a program works with harder-to- service populations resulting in seemingly worse conditions, but (has) higher value-added impact. … Rigorous evaluations can measure impact (to a level of statistical accuracy), but they are usually costly (a nonstarter for many nonprofit), difficult and slow. * But how do the medium and small size nonprofits measure actual results in the outside world such as enhanced quality of life, elevated artistic sensitivity and community commitment?

A Compromise Solution:

To close the gap, funders and recipients would need to agree to apply imperfect metrics over time. These are metrics that can be anecdotal, subjective or interpretative. Also they may rely on small samples, uncontrolled situational factors, or they cannot be precisely replicated. ** This would require agreement and trust between funders and recipients as to what level of imprecision can be accepted and perhaps be improved, to assess impacts. It is an experimental approach

How To Get to Impact Assessment:

1. Agree on relevant impacts: Metrics should be used to reflect organizational related impacts, not activities or efforts. Impacts should focus on a desired change in the nonprofit’s universe, rather than a set of process activities.
2. Agree on measurement approaches: These can range from personal interviews to comparisons of local results with national data.
3. Agree on specific indicators: Outside of available data, such as financial results, and membership numbers, nonprofits should designate behavioral impacts for clients should achieve. Do not add other indicators because they are easily developed or “would be interesting to examine.” Keep the focus on the agreed-upon behavioral outcomes.
4. Agree on judgment rules: Board and management need to agree at the outset upon the metric numbers for each specific indicator that contributes to the desired strategic objective. The rules can also specify values that are “too high” as well as “too low.”
5. Compare measurement outcomes with judgment rules to determine organizational impact: Determine how may specific program objectives have reached impact levels to assess whether or not the organization’s strategic impacts have been achieved.

Lean Experimentation

The five-point process described above closely follows the philosophy of lean experimentation, *** now suggested for profit making and nonprofit organizations.

Lean allows nonprofits to use imperfect metrics to obtain impact data from constituents/ stakeholders over time. Under a lean approach, as long as the organizations garners some positive insights after each iteration, it continues to improve the measurement venues and becomes more comfortable with the advantages and limitations of using these metrics.

Organizationally the nonprofit can use this process to drive change over time by better understanding what is behind the imperfect metrics, especially when a small sample can yield substantial insights, and actually improve the use of the metrics.

* http://ssir.org/articles/entry/the_promise_and_peril_of_an_outcomes_mindset
** https://nonprofitquarterly.org/2012/07/24/using-imperfect-metrics-well-tracking-progress-and-driving-change/
*** http://ssir.org/articles/entry/the_promise_of_lean_experimentation

Nonprofit & Business Directors Must Be Vigilant – Board Liability Costs Could Be $2.2 Million!

Nonprofit & Business Directors Must Be Vigilant – Board Liability Costs Could Be $2.2 Million!

By: Eugene Fram

The personal cost of director inattentiveness is made painfully clear in an important federal appeals court decision. The U.S. Court of Appeals decided the decision, in re Lemington Homes, on January 26, 2015 for the Third Circuit. … [T]hese difficult facts arose from a small, nonprofit organization. … (more…)

Why Are Some Nonprofit Boards Missing the Mark? What to Do?

Why Are Some Nonprofit Boards Missing the Mark? What to Do?

By Eugene Fram     Free Digital Image

Stephen Miles of the Miles group (http://milesgroup.com) recognizes that many business boards are coming up short in performance. As founder and CEO of a strategy and talent development agency, Miles has identified five areas of potential improvement for commercial boards. I believe these categories are also quite relevant to nonprofit board operations in the following ways:

Knowledge Gaps

Many new board directors are in the dark about some of the operating issues facing their organizations. Such information gaps are less prevalent in trade and professional associations because most directors are in associated fields or are in practitioner positions. However, new directors of community based charitable organizations and human services focused nonprofits should be much more attuned to discussions at initial board meetings. Current methods of orienting new directors don’t seem to be doing the job. This is critical for those boards with rapid turnover. For example, one board with which I am acquainted has 80% of its membership with no more than 18 months tenure.

Orientations can take a variety of forms, ranging from brief pre-board session to pre-meeting phone calls from the CEO or Board Chair. These updates will provide the new board member with information that should make his/her participation in the board meeting more meaningful.

Lack of Self-Assessment

“When it comes to the (business) boards (assessing their) own performance, this is often done by using the check-in-the box exercise, (along) with some form of gentle peer review,” reports Miles. In the nonprofit environment, board self-assessments are not usually a priority because nonprofit directors often have time constraints. In addition, nonprofits need to more broadly examine qualitative outcomes, such as community impacts. But business boards are also beginning to move in the same direction, and at this time seem to be behind nonprofits!.*

The media, Internal Revenue Service, foundations and accreditation organizations are asking for more information and transparency to ensure that nonprofits have quality processes to overview management impacts. Few nonprofit boards can afford rigorous third party directed board self-assessment, the gold standard. However a self-review deficit might leave some board members with significant personal liabilities.** Consequently, it is my personal opinion that nonprofit boards need to make good faith efforts to have reasonable self-reviews, understanding that management and board members may hesitate to negatively reflect on volunteer directors who have adopted poor decisions.

Self-Delusion

“Management Capture” occurs when a board too readily accepts a delusional view from management that organizational performance is significantly better than reality. As a result, some board self-examinations may take place only after a crisis has been resolved. So it is mandatory that the boards develop rigorous impact measures, both quantitative and qualitative by which to judge organizational and board performance. Models for self- board assessments are available from professional groups and consultants.

Recruitment Shortcomings & Board Inexperience

Miles maintains that most for-profit directors lack real experience in succession planning: this is also true of nonprofit directors. Even in for-profit boards where a chief executive is temporarily incapacitated, there often is no plan for interim succession. Plus there is always the possibility that a CEO will leave quickly for a variety of reasons. Planning for his/her unanticipated exit should be an ongoing board concern.

One root cause for having a nonprofit culture of board inexperience is that often there are too few directors who have served on other for-profit or nonprofit boards and know how to be role models for newer recruits. Also, normally serving one or two terms, lasting three years, some experienced nonprofit directors may not be motivated to serve in this role because there are no financial incentives offered. However, as demonstrated in the Penn State debacle, a director’s reputational risks can be substantial. How a board evaluates and improves its organizational talent pool is critical to performance. Miles characterizes the optimal board as composed of ” … directors who are active in their roles engaging individually and collectively (to engage with) other directors and (overview) management.” It is a tall order in today’s nonprofit environment.

For-profit organizations or nonprofit organizations, in my opinion, have five identical basic board guidelines. For Deloitte Partners, a worldwide accounting and financial advisory firm, these constitute board responsibilities that can’t be delegated to management. The board has responsibilities to have: a viable governance structure, annual assessments of (board and) organizational performance, driven strategic planning, improved management talent and assured organizational integrity.

A relentless pursuit of these lofty goals will enable nonprofits to be “on the mark.”

*For nonprofit qualitative outcomes, see: Jerry Talley & Eugene Fram (2010) “Using Imperfect Metrics Well: Tracking Progress & Driving Change,” Leader to Leader, winter, 52-58. For commercial boards see: Emily Chasan, (2012), “New Benchmarks Crop Up in Companies’ Financial Reports,” CFO Journal Section, Wall Street Journal, November 11th,

** For examples, see the Intermediate Sanctions Act, Section 4958 of the Internal Revenue Service Code. Also see the Expanded IRS 990 form guidelines for board structure and performance–38 new questions related to nonprofit governance.

NONPROFITS NEED A BRAND THAT RESONATES!

NONPROFITS NEED A BRAND THAT RESONATES!

By: Eugene Fram       Free Digital Photo

How do people see your organization? Is your nonprofit clearly perceived, and the unique nature of its work, fully understood in the community or industry?

Nonprofit board members occasionally talk about the organizational brand image but rarely take tangible steps to define it. Yet the creation of a strong brand is a major factor in generating public respect, support and significant funding sources. Potential donors need to believe implicitly in the impact of the nonprofit on its clients. They also need to understand the realities implied in the brand image that fail to match the realities of the organization’s operations. For example, some family services agencies (actually multi-human service groups), have long struggled with a brand perception that they offer only family reproduction services.

Following are some guidelines that may help improve a current image or further clarify the mission which fuels the dedicated efforts of boards, staff and volunteers: (more…)