How to Evaluate Fund Manager Skill Beyond Returns

01

How do you evaluate fund manager skill beyond returns?

‍ By analysing the quality of investment decisions — how positions are initiated, sized, and exited — rather than relying solely on performance metrics, which describe what happened to a portfolio without revealing how or why it happened

This is the question that allocators, fund selectors, and CIOs are increasingly asking. And it is a harder question than it first appears. Few sophisticated allocators rely on raw returns alone. Over the past two decades, the evaluation toolkit has expanded considerably: volatility measures, drawdown profiles, Sharpe ratios, trailing performance across multiple horizons, factor exposures, and increasingly granular performance attribution. These are meaningful advances. They provide a far richer picture of a portfolio’s behaviour than a simple return number ever could.

‍ Yet all these metrics share a common feature: they only describe the portfolio at aggregate level. They tell the allocator what happened to the overall  and — how volatile it was, how deep its drawdowns were, how its risk-adjusted returns compared to peers. What they cannot reveal is the quality of the individual decisions that produced those outcomes. A favourable Sharpe ratio does not distinguish between a manager who made deliberate, well-structured decisions and one who held positions that happened to work in a particular market regime. A low drawdown may reflect disciplined risk management — or it may simply reflect a benign environment. Trailing performance captures the result of thousands of decisions without offering any insight into whether those decisions were skilful or fortunate.

‍ The gap, in other words, is not between simple and sophisticated metrics. It is between portfolio-level observation and decision-level evidence. Risk systems measure exposure. Attribution explains performance. Order management systems record execution. But none of these tools answer the questions that matter most for assessing repeatable skill: how does conviction evolve across the lifecycle of a position? How do scaling decisions affect outcomes? Is exit discipline consistent, or does it erode under pressure?

This is the gap that behavioural analysis fills. It operates at the level of the individual investment decision. It begins by reconstructing the full lifecycle of each position from initial entry through sizing adjustments to eventual exit, and then analyses the patterns within those decisions, to separate process-driven skill from outcome-driven narratives. For allocators, it provides an evidence layer that no amount of portfolio-level sophistication can replicate. 

Fastnet AMS is an independent behavioural analytics firm working with financial institutions across Europe and the US. Founded in Ireland, we specialise in making investment decision skill measurable, comparable, and transparent.

Request a diagnostic → · About the Insights Book →

02

03

What are decision-quality metrics?

Built on the complete record of investment decisions — and the full lifecycle of each one, from entry through scaling to exit — decision-quality metrics make the needed shift from what happened to how it happened. A broad set of these metrics exist, each designed to connect a strategy's outcomes directly to the underlying decision behaviour that drove them. The following are among the most revealing: 

  • Hit ratio and win/loss asymmetry 

    The hit ratio measures the proportion of investment decisions that contributed positively to performance. On its own, it provides useful context. Research across hundreds of portfolios shows that even the best managers typically get it right about half the time. What matters more is the relationship between winning and losing decisions: do gains from successful positions outweigh losses from unsuccessful ones? A manager with a moderate hit ratio but strong win/loss asymmetry may be far more skilled than one who is right more often but captures less upside and absorbs deeper losses. 

  • Timing efficiency 

    Timing examines how a manager selects the moment to act — whether to enter, scale, reduce, or exit a position. It operates on two dimensions: the efficiency of the outcome after the decision is made, and the context in which the decision was taken, which can reveal the behavioural patterns driving it. 

    On the entry side, a manager may be buying into strong momentum already built, expecting it to continue, or into recent weakness, expecting a reversal. In practice, both approaches typically coexist within a portfolio, but their behavioural weight is rarely equal — and the balance between them is itself a revealing characteristic of the manager's process. 

    On the exit side, timing analysis provides a lens into two distinct capabilities: the manager's willingness to cut losses when a position moves against them, and their ability to lock in gains before they erode. How a manager handles partial and full exits under adverse conditions reveals how risk management operates in practice, not just in documentation. 

    Across both entry and exit, a specific manager's timing profile — and how it compares to peers — gives allocators a direct window into how investment discipline is actually implemented throughout the lifecycle of a position. 

  • Sizing discipline

    Sizing discipline examines whether a manager's conviction is reflected in how positions are weighted. When a manager expresses high conviction in an idea, is that reflected in a meaningful position size — or does the portfolio remain broadly spread regardless of conviction levels? Conversely, do low-conviction positions persist at weights that consume capital and attention disproportionate to their expected contribution? The relationship between stated conviction and actual position sizing is one of the most direct indicators of whether a portfolio is being managed deliberately or assembled passively. For allocators, it reveals whether the manager's process translates thinking into action — or whether the portfolio's construction tells a different story from the one presented in meetings. 

  • Alpha generation pattern 

    The Manager Alpha Cycle provides a way to deepen the assessment of investment skill by analysing how a manager generates, sustains, and preserves alpha over the life of a position. It charts the pattern and timing of outperformance across three phases: 

    Alpha formation. This initial phase is shaped by the manager's ability to capture early opportunities and respond to changing market conditions. It reflects strategic agility and market insight — and connects directly to the entry timing and conviction sizing patterns discussed above. 

    Alpha preservation. Here the focus shifts to protecting value. Decision-making around profit-taking, risk reduction, and rebalancing becomes crucial. This phase reveals how actively a manager manages a position once the initial thesis has played out — and whether gains are defended or left exposed. 

    Alpha decay or extension. Depending on how well the position is managed as circumstances evolve, alpha may erode or continue compounding. This final phase is often the most diagnostic: it separates managers who recognise when a position's contribution is fading from those who hold on past the point where skill is adding value. 

  • Decision sequencing

    Decision sequencing examines how a manager acts on the back of previously made decisions — considering both the type of prior action and the performance achieved since it was taken. This reveals where in the lifecycle of a position the manager actually generates value. Some managers create most of their returns at initial entry: the first buy captures the majority of the gain, and subsequent decisions add comparatively little. Others use the initial position as a foothold, with follow-on scaling decisions driving the bulk of performance. Neither pattern is inherently superior, but understanding which one characterises a manager is essential for assessing how their process is likely to perform across different environments. 

    Sequencing also reveals how a manager responds to evolving performance. Does the manager scale up on the back of positive momentum, or add to positions that have weakened? Does the manager reduce proactively, or only after losses have compounded? These reactions connect directly to the conviction and risk management profile of the strategy. 

Finally, the sell decision becomes a critical sequencing event in its own right. How much performance is locked in — or given back — at the point of exit provides a direct measure of the manager's ability to convert accumulated value into realised returns. 

Behavioural evidence in due diligence

Allocators invest significant effort in verifying a manager’s operation: compliance frameworks, risk controls, team structure, systems integrity, organisational stability. This verification is essential. It confirms that the infrastructure around the investment process is sound and that the manager’s claims about how they operate can be substantiated.

But this verification stops at the boundary of the investment process itself. It can confirm that a risk management framework exists — it cannot tell you whether the manager actually follows it when a position is down 20%. It can confirm that an investment committee meets regularly — it cannot tell you whether conviction is managed consistently between those meetings. It can verify that a sell discipline is documented — it cannot reveal whether exits are timed deliberately or delayed by behavioural inertia.

Behavioural evidence closes this gap. It extends the logic of verification — the principle that what a manager claims to do should be observable and substantiated — into the domain where it matters most: the actual investment decisions. In doing so, it does not replace existing due diligence; it makes it more robust and expands its scope into territory that has historically relied on the manager’s own narrative.

A four-stage framework, developed through practical application with multi-manager teams, illustrates how behavioural evidence integrates into this process

  1. Discovery 

    Before meeting a manager, the allocator reviews behavioural data to prepare targeted questions aligned with specific decision patterns — areas where behaviour diverges from stated process, or where conviction management shows unusual characteristics. This preparation moves the conversation beyond generic questions about investment philosophy and into focused, investigative dialogue from the outset. 

  2. Confirmation 

    During manager meetings, behavioural evidence serves as a cross-reference. When a manager describes their approach to risk management, the allocator can compare those statements against what the data shows about actual behaviour during drawdowns or periods of heightened volatility. This is not adversarial — it is the use of multiple information sources to validate positions and identify where narrative and reality may diverge.

  3. Engagement 

    Behavioural analysis focuses as much on the skills behind results as on the outcomes themselves, which enables a collaborative dialogue between the allocator and the manager. When both sides can reference the same evidence base, the relationship shifts from assessment to partnership. The higher level of transparency strengthens the long-term alignment needed to achieve the desired strategic outcome. 

  4. Monitoring 

    Once a manager is selected, behavioural metrics provide an ongoing monitoring framework. Rather than waiting for quarterly performance reports, allocators can track specific decision-quality indicators over time — spotting drift in timing discipline, conviction patterns, or exit behaviour before it shows up in the return numbers. This enables early, evidence-based conversations with managers rather than reactive responses to underperformance. 

This is where behavioural evidence is most valuable — and most differentiated from traditional due diligence. When a manager is underperforming, the track record says one thing: results are poor. But the track record cannot distinguish between a manager whose process has broken down and one whose process remains intact through a period where their approach is simply out of favour.

Research across large sets of portfolios shows that even the best managers typically get it right about half the time. This indicate that drawdown and adverse performance are a structural feature of active management.  

What separates the best managers from the rest is not the absence of these difficult periods, but how they respond when they occur. Some managers treat drawdowns as information — an input that prompts reassessment, deliberate action, and structured re-evaluation of the investment thesis. Others treat them as threats, leading to reactive behaviour, delayed decisions, and eventually forced exits at the worst possible moment.

Behavioural analysis enables allocators to distinguish between these two responses. A manager whose decision quality remains consistent during drawdowns — maintaining disciplined exit criteria, continuing to size positions according to conviction, and sequencing decisions deliberately — is demonstrating resilient skill that the performance numbers alone would obscure. Conversely, a manager whose process erodes under pressure — whose conviction weakens, whose exit discipline deteriorates, or whose decision timing slows significantly — may be revealing structural weaknesses that preceded the underperformance.

This distinction has profound implications for the divest-or-retain decision. Traditional due diligence, limited to performance data, often leads allocators to terminate managers at precisely the wrong moment. Behavioural evidence introduces a second question alongside “are results poor?”: is the process that generates those results still intact?

04

Evaluating a manager during underperformance

Behavioural due diligence: a practical checklist

For allocators looking to integrate behavioural evidence into their selection and monitoring process, the following questions provide a practical starting framework:

  • What does the manager’s exit discipline look like? How much of peak performance is retained before positions are closed? How does this compare to peers in the same style category?

  • How does conviction translate into position sizing? Are high-conviction ideas reflected in meaningful position weights, or is the portfolio broadly spread regardless of conviction levels?

  • What happens to decision quality during drawdowns? Does the manager’s process remain consistent when positions are under pressure, or does behaviour change measurably?

  • Is there evidence of behavioural drift over time? Has the manager’s decision-making behaviour in recent periods shifted from earlier patterns? Are exit speeds, conviction levels, or sizing patterns evolving without a clear strategic reason?

  • How does the manager’s process differ from peers in the same style? Two managers with similar mandates and comparable returns may have entirely different behavioural profiles. Understanding these differences helps allocators assess where genuine differentiation lies.

  • What is the manager’s optimal holding horizon? At what point does the manager’s skill create the most value, and where does behavioural drift begin to erode it? This is often the most revealing metric in long-term monitoring.

 These questions are not designed to replace existing due diligence processes. They are intended to deepen them — to provide allocators with a structured, evidence-based layer that complements qualitative assessment and performance review.

05

  • Behavioural due diligence evaluates a manager’s decision-making patterns — conviction consistency, exit discipline, sizing behaviour, and response to drawdowns — as evidence of repeatable process quality. It provides a structured, evidence-based layer that complements traditional performance review and qualitative assessment.

  • Three years of returns reflect market conditions as much as manager ability. A strong record may indicate genuine skill, favourable style tailwinds, or both — the returns alone cannot distinguish between them. Behavioural evidence from decision-quality analysis reveals whether the process behind the performance is consistent and repeatable, regardless of the market environment in which it was generated.

  • Traditional due diligence primarily evaluates what happened: the returns, the risk profile, the factor exposures. Behavioural due diligence evaluates how it happened: the patterns in how investment decisions were made, how conviction was managed, and how consistently the process was applied over time. The two approaches are complementary — together they provide a far more complete picture of manager capability than either alone.

  • Yes. Behavioural analysis is arguably most useful during periods of underperformance. It can reveal whether a manager’s decision process remains intact under pressure or whether process erosion is contributing to the drawdown. Research across more than 57,000 investment cycles shows that how managers respond to positions that fall 20% or more reveals more about their skill than the drawdown itself.

  • Behavioural analysis is built from transaction and position-level data — the history of buy, scale, reduce, and sell decisions across the portfolio. This data is typically already captured within a manager’s order management or portfolio accounting systems. The analytical process is descriptive and diagnostic; it does not require access to proprietary research or investment models, and it does not generate investment signals or recommendations.