[This blog post is a repost of http://blog.atos.net/sc/?p=273 ]
“A storm is coming…” (Sarah Conner in “The Terminator”, 1984).
There is more than one doomsday movie that refers to robots or artificial life forms taking over the world. Skynet, introduced in the movie “The Terminator” (James Cameron, 1984), is such a computer based entity that, in the end, almost destroys all of mankind, while it was built with the best intentions.
This scenario came to my mind when I was reading a whitepaper the
Atos Scientific Community. In this paper, called “
Computational Finance”, the authors show that;
“…New mathematical algorithms, the latest high-performance computer systems and high-frequency trading(HFT) are taking over from human stockbrokers “
On top of this, the effect on the financial markets stability is not fully understood, leading to extreme volatility of the large stock exchanges and their indexes. That does not sound good. Putting our current predicament in an historic perspective:
“In the early 2000s, the biggest banks and hedge funds developed and expanded algorithmic trading. Complex investment strategies and orders, which would have previously needed several days to process and experienced specialists to process them, could be settled in minutes or hours, with almost no human interaction. “
And apparently it did not stop there, because nowadays even more complex methodologies are introduced:
“The current focus is on so-called high-frequency trading (HFT), a sub-class of algorithmic trading strategies aimed at taking advantage of high-performance computing and low-latency communication networks. Hundreds of stocks are bought and sold in the blink of an eye, with some orders lasting only a handful of microseconds. “
Clearly, in a collaborative or competitive arena, where timing of decisions makes a big difference, it is easily understood why such an approach on technology is embraced; and research shows that it is now commonplace:
“It is estimated that at the New York Stock Exchange (NYSE), more than 60 percent of trades are currently carried out without direct human intervention. “
By now I am getting worried, because without proper understanding of the relationships between the complex algorithms and interdependencies in the program, we could end up in a situation that is… let’s call it “
as of yet undefined”. A situation that apparently already occurred, although on a small scale with only one index:
“Recent events, such as the May 6 2010 stock market crash, when the DOW Jones took the single largest plunge in its history, made the trend for high-performance computing headline news and led people, from the simple newspaper reader to regulatory institutions, to try to figure out just how prevalent HFT really is. The fact is, no one really knows.”
Again, not very reassuring. The current situation can be analyzed in great detail to explain the different financial models and mathematical concepts currently being used and also the technology that supports this progress. The conclusion is crystal clear:
“In order to properly address this issue, it is required to fully assess the current state of art of both new mathematical concepts (used for modeling, forecasting and risk assessment) and the latest associated technological solutions (.e.g. High performance / low latency computing).”
And
“With the combination of new Market expectations, Advanced mathematical models and high performance computing leads to new business opportunities: banks & trading agencies, Stock Exchanges, and regulation authorities will new a new set of services, from real-time information flow using sentiment analysis to Intelligent Watchdogs for early anomaly detection.”
So, while the whitepaper is an interesting read of where we are and why all this technology is used in the stock markets, it also cries out that we need to get proactive in understanding what we are doing in order to avoid future catastrophic events. What do you think; are we re-enacting 'The Boy Who Cried Wolf', or is Skynet already active?
The whitepaper can be downloaded here
