Another Socionomic coincidence

One reason I don’t listen to the media

 Financial Writing Reflects Stock Market Trends

By Euan Wilson & Robert Prechter, originally published in the April 2012 Socionomist Download Complete Issue (1.22 MB)

Power laws are a fascinating, complex and useful way to understand collections of data. (See Robert Prechter’s discussion of power law arrangements in nature and social mood in The Wave Principle of Human Social Behavior, pp. 43-46).

Of particular note in the power law universe is Zipf’s Law, which states that word frequencies in books are approximately predictable. The second most common word in a written work will appear about half as often as the first, and so on.

Last summer, authors Aaron Gerow of Trinity College Dublin and Professor Mark Keane of University College Dublin presented a paper titled “Mining the Web for the ‘Voice of the Herd’ to Track Stock Market Bubbles.” Zipf’s Law provided the authors’ guiding principle as they compared financial news reports to market activity. In the end, they made a provocative claim: The diversity of language in financial reports trended inversely to the trends of the markets they covered.

In other words, as markets rose, the language people used to describe them became more uniform. Conversely, as those markets dropped, descriptive language became more diverse.

The authors measured the frequency of common verb and noun phrases in finance articles and then compared each week’s findings to the stock market. They found that as markets rose, the dominant power law sets became even more dominant.

Gerow and Keane’s Experiment The researchers used automated Web searches to find articles relating to the Dow Jones Industrial Average, the Financial Times Stock Exchange and the Nikkei 225 from January 1, 2006 until January 1, 2010. The articles, exposés, editorials and popular pieces appeared in the New York Times, the Financial Times and the BBC.1 The searches yielded 17,713 articles containing more than 10 million words during the four-year span.

The authors split the entire selection into weeklong windows averaging 87 articles each and then calculated the power law distribution for the words used in each. They then compared the differences week-to-week to determine how frequent the most common verb-phrases and noun-phrases were over time.

The researchers discovered that the most common phrases became even more common when the market rose and that unusual phrases became more common when the market fell. The correlations between verb phrases and the market’s price direction were particularly notable, with a strong positive correlation of 0.79 for the DJIA, 0.78 for the FTSE and 0.73 for the Nikkei, where the range is between negative one and one. Figure 1 illustrates this correlation.

Figure 1

Figure 1

The Socionomic Angle By now you may have surmised that the findings relate to socionomics. They provide one more example of social mood’s impact on group behavior.

Why would financial reporters’ expressions resemble each other more when positive mood was increasing and less when negative mood was increasing? The Wave Principle of Human Social Behavior (HSB) offers a good place to start: “A waxing positive social mood appears to correlate with a collective increase in concord … a desire for togetherness … and feelings of alignment with others. A waxing negative social mood appears to correlate with a collective increase in discord … a desire to separate from others … and feelings of opposition to others” (p. 228). So, perhaps in times of increasing social mood, the herd is happily scribing together in many similar ways. When negative mood is increasing, the herd is panicking together in many diverse ways.

Evoking Leo Tolstoy’s observation in the famous opening line of Anna Karenina, Keane offered the following analogy: “Maybe it’s a bit like happy families are all happy in the same way, but unhappy families are unhappy in many different ways.”2

There is a socionomic parallel to their idea in music. HSB noted, “in bull markets, most people like similar styles of music; in bear markets, the dominant types are often very different.” Basically, there are many ways to explain and express the emotions arising from negative mood, but positive mood tends toward narrower bounds of expression.

Another Explanation? The Socionomics Institute’s research fellow at Cambridge University, Matt Lampert, noticed that there may be another way to look at Gerow and Keane’s data. Take a look at Figure 2. Observe that both the Dow (blue line) and word homogeneity (red line) peaked in 2007 and then moved lower together for about a year. But the two lines diverged between August 2008 and March 2009 (see arrows), even though the market was still falling. Word homogeneity trended higher for six months before reaching an interim peak around the time of the Dow’s bottom in March 2009. Then both lines reversed course for three months, still moving in opposite directions, before getting back in sync. In all, the two lines went in opposite directions for about nine straight months, moving contrary to the authors’ hypothesis.

Figure 2

Figure 2

We suspect that the trends of these lines may point to a more subtle socionomic explanation for their behavior. That is, the lines actually reflect the shifts in consensus that occur among investors within both up and down trends. Early in a trend, there is much debate. Late in a trend, most people are in accord about the market’s direction and the reasons for it. Late in the 2002-2007 advance (where the authors’ limited data begin), investors were mostly in agreement. Then, early in the ensuing decline, there was much debate. Later in the decline, word usage among reporters became more homogenous again, reflecting a newly emergent consensus, though this time toward the market’s downside. Then early in the ensuing uptrend, they were again debating for a while before reaching a consensus. For a socionomist, then, the authors’ conclusion that rising markets generate report consensus and falling markets generate diversity might be overly simplistic. To test this possibility would require a longer-term statistical investigation.

Gerow and Keane’s research is an important first step in demonstrating that the diversity of financial commentary indeed varies with the stock market. This idea is highly compatible with socionomics.

Euan Wilson writes   for The Socionomist.

Robert Prechter is Executive Director of the Socionomics Institute.


1Gerow, A., & Keane, M. T. (2011). Mining the web for the “voice of the herd” to track stock market bubbles. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, 2244-2249. 2Word herd. (2011, July 31). The Economist, 68.

Socionomics InstituteThe   Socionomist is designed to help readers understand and anticipate   waves of social mood. We also present the latest essays in the field of socionomics,   the study of social mood; we anticipate that many of the hypotheses will be   subjected to scientific testing in future scholarly studies.

The Socionomist is published by the Socionomics   Institute, Robert R. Prechter, Jr., president. Alan Hall, Ben Hall, Matt   Lampert and Euan Wilson contribute to The Socionomist. Mark Almand,   executive editor. Chuck Thompson, editor.

We are always interested in guest submissions. Please email    manuscripts and proposals to Ben Hall via   Mailing address: P.O. Box 1618, Gainesville, Georgia, 30503, U.S.A. Phone:  770-536-0309.

All contents copyright © 2011 Socionomics Institute.    All rights reserved. Feel free to quote, cite or review, giving full credit.  Typos and other such errors may be corrected after initial posting.

For  subscription matters, contact Customer Service: Call 770-536-0309  (internationally) or 800-336-1618 (within the U.S.). Or email

For  our latest offerings: Visit our website,,  listing BOOKS, DVDs and more.

Correspondence is welcome, but volume of mail often precludes    a reply. Whether it is a general inquiry, socionomics commentary or a research  idea, you can email us at

Most economists, historians and sociologists presume that    events determine society’s   mood. But socionomics hypothesizes the opposite: that social mood determines   the character of social events. The events of history—such as investment   booms and busts, political events, macroeconomic trends and even peace and war—are   the products of a naturally occurring pattern of social-mood fluctuation. Such   events, therefore, are not randomly distributed, as is commonly believed, but   are in fact probabilistically predictable. Socionomics also posits that the   stock market is the best available meter of a society’s aggregate mood,  that news is irrelevant to social mood, and that financial and economic decision-making  are fundamentally different in that financial decisions are motivated by the  herding impulse while economic choices are guided by supply and demand. For  more information about socionomic theory, see (1) the text, The     Wave Principle of Human Social Behavior © 2011, by Robert Prechter;  (2) the introductory documentary History’s     Hidden Engine; (3) the video Toward       a New Science of Social Prediction, Prechter’s 2004 speech before   the London School of Economics in which he presents evidence to support his   socionomic hypothesis; and (4) the Socionomics Institute’s website,  At no time will the Socionomics Institute make specific recommendations about  a course of action for any specific person, and at no time may a reader, caller  or viewer be justified in inferring that any such advice is intended.

Leave a comment

Comment Here:

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: