Topic 6: Measuring the Value of Medical Affairs

Introduction

A reader requested a discussion of different approaches for measuring the value of medical affairs.  This is a critical question and one that I touched on briefly when I discussed strategic planning in MA as it relates to launch.  But it is equally important overall for MA.

Like any function in pharma, MA must be able to communicate its value.  Value can be a tricky concept, however, for a non-commercial function like MA.  Value is ultimately a company-specific question.  It stems from the company achieving its strategic goals, which is why defining goals is so important.  Having said this, there are some general categories of value measures that we can discuss as well as some best practices around measuring value.

Value measures in MA typically fall into two types:

1. Objective measures


2. Subjective measures

Objective Measures

In MA, objective measures tend to focus around activity-based measurements.  Since MA cannot be seen as promotional, the other available objective measures like prescriptions written, sales numbers, profitability, etc. are not relevant.

Activity-based measures have both strengths and weaknesses.  On the strength side activity based measures are:

• Easy and cost efficient to gather


• Easy to explain to non-MA colleagues


• Non-controversial

Unfortunately, activity based measures also are:

• Not outcomes focused


• Not usually tied to the direct concerns of the organization


• Potentially misleading

While it may be interesting to know that the MSL group conducted 150 meetings with KOLs in the last quarter, it tends to beg the question – So What?  Activity-based measures tend to focus on the tactics (e.g. reach out to KOLs) rather than the goals (e.g. ensure broad awareness of the latest disease state information).

Activity-based measurement is very appropriate for certain MA functions.  For example, on CME funding, which by definition must be a hands off process, the only important measure is activity-based: Did the organization fund the number of CME programs it had intended to fund?

Or, in the Medical Information function, the key measures relate to answering inquiries and responding.  Activity-based measures (e.g. total number of inquiries managed, average turn-around on inquiries, number of inquiries requiring a second contact) are very appropriate for this type of service.

Finally, activities with multi-year goals like post-approval clinical trials, use activity-based measures to ensure that the overall program is on track.  So activity-based measures like patient recruitment and data collection provides valuable insight.

Activity-based measures are a necessary for MA’s ability to track progress against its goals, but they not sufficient to account for all of MA’s goals.

Subjective Measures

Most MA organizations have goals that require a more subjective type of measure.  Some of these goals relate to the degree of awareness or understanding in the healthcare community.  Measuring understanding or awareness is not as simple as measuring the number of discussions about a certain topic.  Instead, to measure progress on these types of goals, MA needs to gather more subjective data.  Simply put – it needs to ask.

For goals related to subjective measures, the only practical way to measure success is through research.  Unless a company is very lucky and finds that one of its objectives just happens to align with a topic that is already the subject of someone else’s research, this almost always means conduct primary research.

Research-based measures have their own strengths and weaknesses.  The strength of research-based measures include:

• Direct connection to goals related to healthcare community awareness and understanding


• Insight into the knowledge and beliefs of the healthcare community


• May provide insight into other, unmet needs

Research-based measures have some significant drawbacks, including:

• Expensive to conduct, leading to limited number of data points


• Subject to research bias


• May be taxing to the community that the organization is trying to serve

For research-based measures to be understandable, they usually need to be measured against a baseline.  For example, the measure of awareness of new disease-state information in the healthcare community after the efforts of the MA organization is only relevant if the measure of awareness before the efforts were known.  This requires the development of a baseline which both adds to the cost and requires good up-front planning.

But by far the biggest challenge of research-based metrics is the lack of experience and budget to conduct such research.  Many MA organizations do not have experience conducting this type of “market research”.  Without such experience, it can be daunting to initiate the research and structure it in the best manner.  Additionally, many MA organizations do not have money in the budget to conduct this research in a high quality manner.  This is both a product of the lack of experience and the view that this type of research is outside of the mission of medical affairs.

Best Practices

Clearly most MA organizations can benefit from a set of mixed objective and subjective measures.  Developing such a set of measures starts analyzing the strategy and goals outlined in the MA strategic plan.   From there a set of potential measures can be defined and prioritized.  Overall, MA should have between 5 and 10 metrics.  Specific functions within MA may have from 3 to 5 additional detailed metrics.  Once these metrics are defined, the approach for gathering each metric can be identified.  The activity-based metrics are typically gathered from existing tracking systems while the research-based metrics require more active management.

Once the research-based metrics are defined, a draft of a research outline can be developed, specifying the key questions, the research targets, the number of responses expected and the number of research samples to be taken.  This outline can be used as the basis for developing a request for proposal from a research company.

One caution – many organizations are tempted to combine this research with research already being conducted by the commercial market research function.  This may be a problem if the marketing questions are, in themselves, seen as promotional.  Most of my MA clients have been unwilling to risk this crossing of the line but some organizations do follow this practice.  Please work with your compliance function to discuss this approach.  Many organizations are not even comfortable with using research companies that are primarily commercially oriented but, frankly, there is little reason to avoid these companies.

After the approach to both activity- and research-based metrics is in place the next step is to determine how the results will be communicated and to whom.  This should become an ongoing process so it should be automated and standardized as much as possible.

Closing Thoughts

Explaining the value of MA remains one of the primary responsibilities of MA management.  For MA to be perceived as valuable to the organization, its progress against its strategies and goals has to be proven.

What has your experience been with value and measures in MA?  Leave your comments below.

Click on the email link to the right to suggest a topic for future posts.