Saturday, November 17, 2007

Herding Behavior in the Stock Market: A Look at Volume Concentration

Some of the best thinking occurs when we approach old topics in fresh ways. Consider the topic of sentiment. Through our normal lenses, we parse the world into bulls and bears. Suppose, however, we look at sentiment differently and measure it as the degree to which traders behave in more vs. less differentiated ways. If traders respond to markets in a non-differentiated way, they move as a herd, and we would expect transacted volume to be lopsided toward advancing or declining stocks. In a differentiated mode, market participants discriminate between better and worse investments and apportion volume to advancing and declining issues accordingly.

My measure of Volume Concentration takes the difference between advancing and declining volume on the NYSE and divides that by the sum of advancing and declining volume. This gives us an index that ranges from +100 (all directional volume is concentrated in advancing stocks) to -100 (all directional volume is concentrated in declining stocks), with the zero level denoting a market in which directional volume is evenly divided between advancing and declining issues.

I went back to 1965 and found that the average level of daily Volume Concentration is just a bit above zero, with a standard deviation of 38. For practical purposes, I set a two standard deviation threshold to represent herding behavior. Whenever the Volume Concentration Index (VCI) exceeds +75 or falls below -75, we'll call that herding sentiment.

What we find historically is that, since 1965 (N = 10,754 trading days), there have been relatively few days of herding sentiment. Specifically, we've had 160 days of herding in which volume has been highly concentrated in advancing issues and 223 days of herding in which volume has been highly concentrated in declining issues. Thus, a bit under 4% of all trading days meet our strict criterion of herding.

A look at the distribution of herding sentiment finds that it tends to occur in clusters. I examined the number of herding days over a moving 250 day period. The average for the entire sample was 8.6. We saw repeated readings over 15 during the market bottom and recovery around October, 1966; May, 1970; December, 1974; October, 1978; March, 1980; August, 1982; October, 1987; October, 1990; and March, 2003. The pattern is that we see herding behavior as traders panic on market declines toward the end of bear markets and then herding behavior as investors pour into markets to grab value at the start of bull markets. Indeed, one might say that it is precisely this transition of herding to the downside and herding to the upside--short-term panicky participants disgorging falling stocks and longer-term participants grabbing them as they rise--that makes for major market bottoms.

Interestingly, we're seeing just such a clustering of herding days presently in the market. Out of the past 250 trading sessions, fully 28 have qualified as herding days--far more than the average of 8.6. Indeed, going back to 1965, the only times we've had more than 20 days of herding in a 250-day period have been late 1974 into 1975 and late 1987 into 1988. Those were very important market lows.

One possible implication of the data is that the current market weakness, which has extended episodically from March through the present but is clearest in the housing and financial sectors, represents a decline of historic proportions despite its mildness when measured by price action in the large cap indexes. If the historical pattern holds in the present case, we should see an explosion of buying (herding to the upside) once investors perceive it's safe to return to the water. To be sure, this could occur at lower price levels. Nonetheless, the dates of high herding noted above--late 1966, mid 1970, late 1974, late 1978, early 1980, late 1982, late 1987, late 1990, and early 2003--were times to be thinking about owning stocks for the long run, not disgorging them with the crowd.

At periods of comparable extreme herding--late 1974 and late 1987--there were precious few reasons to think about owning shares. The current period offers similarly gloomy prospects. History has favored contrarian bulls at such times.

There is one other possible implication of the data that we will only know in the fullness of time. We have had readings continuously above 20 since August of this year. It may well be that, owing to the concentration of capital among hedge funds, pension funds, sovereign wealth funds, and the like--combined with the competitive need to contain risk and manage it daily--that we are seeing a secular rise in herding behavior. If this is true--and it is only a hypothesis--it has important implications for volatility and money management challenges for daytraders and portfolio managers alike.

Herding-as-sentiment in general, and the VCI as a specific measure of herding, provide us with an interesting framework for analyzing historical price patterns in the stock market. In a future post, I will take a more granular look at what happens historically after days of extreme herding.

RELATED POST:

What Drives Investor Sentiment?
.

9 comments:

PARANOMASIA said...

Clever idea! Also glad to see you took the sample back to 1965.

Deb said...

Thanks for sharing your hard work. I am learning so much here.

bryan said...

Great work, Doc.

Paul J said...

Dear Doctor,

Thank you for this data. I don't think I've ever seen something exactly like this before.

If it's not too much trouble, would you tell us:

1. How many of the recent 28 herding days were showing bearish sentiment? Or were they all bearish?

2. It would be nice to see a graph of this. And the exact dates and VCI number for each herding day. Excuse me if I'm asking for too much. But I'll appreciate whatever additional data you can give us, if any.

I also want to take this opportunity to say that I greatly appreciate your websites (this one and your eponymous one). To me, your sites are must-reads.

I appreciate the fact that you are giving away such valuable information for free. I remember your great post about abundance not too long ago. By being generous and practicing abundance, I'm sure you are getting much in return. I agree that that's the way this world works.

Thank you, please keep up the great work, and I wish you the best.

Sincerely,

paulj

High Probability Trader said...

Great post Dr.,
I noticed this last month that the market on close trade balance has had a big impact on the closing prices of stocks more so than any other period I've traded.

Bill Luby said...

Brett,

Given the consistently high quality of your commentary, I could probably stop in an thank you for all your superb work on any random day.

This post, however, is one of the most interesting posts I've read all year -- on a number of levels. Excellent research and some interesting analysis on top of this.

Kudos,

-Bill

g said...

Dr. Steenbarger,
I ran across your TraderFeed blog and visited your website... and one word summarizes my impression... WOW!!!

For 6 hours today, I read many of your articles. THANK YOU for the outstanding trading advice! I had many "lightbulb" and "aha!" moments.

To acknowledge my gratitude, I've put $$$ where my mouth, or fingers are in this case, and used PayPal to pass along an advance on what will no doubt be a small portion in my investing returns. I've invested and traded for 15 years, and I'm thankful I've done well, but on occasion I've lacked discipline.

My plan will (not may) be to incorporate planning, practicing, and reviewing into the daily routine.

My guess is you've touched many more people than you realize (people are too busy, lazy, or arrogant to write).

Thanks again,
Steve Mann
Winston-Salem, NC
steve_mann_dba@yahoo.com

steve said...

Mr. Moderator,
I feel terrible. I had, and continue to have every intention of using PayPal (or other means) to pass along a token of my appreciation for Dr. Steenbarger's great work.

After posting my earlier comment, I went to what I thought was a PayPal button. My eyesight is not what it used to be and I thought the button had the title "Trader Food Feed Me". After posting my comment, I clicked on the button (intending to carry out my commitment), but it returned to TraderFeed.

Now I've looked a little closer at the button and I believe it says "Trader Feed Feed Me". The font is not very readable.

How do I pass along a contribution to Dr. Steenbarger?
Steve Mann
golfclubteeball@gmail.com

Brett Steenbarger, Ph.D. said...

Thanks for the many warm, supportive comments. I will be posting more data relevant to the strategy in upcoming posts. I very much appreciate the offer of a contribution, Steve, but truly the thanks is plenty reward. I'm very touched by the sentiment--

Brett