Yes, Virginia, HFT and Liquidity are Not All They Are Cracked Up to Be

You may have seen a big outbreak in the academic literature and business media of defenses of liquidity for liquidity’s sake, evidently prompted by increased interest in and in the EU, implementation of transaction taxes as a way to tame speculation and secondarily raise revenues.

And other efforts to curb market manipulation are underway. For instance, the SEC and the FBI are joining forces to try to rein in predatory HFT, but are finding it an uphill battle due to the fragmentation of information:

While some of the alleged tactics are the same as those used in the past, the new challenge is how they are executed. Algorithm-driven trades are issuing thousands of quotes in microseconds across numerous trading platforms, including “dark pools” that are off-exchange.

“Unless there is evidence of intent to manipulate, it’s hard to derive intent from raw trading data,” said one government official.

To bring a manipulation case, the government would have to find a way to show a person programmed the code to manipulate trades….

Among the challenges authorities face is a lack of comprehensive market data to work from. Until recently, the SEC had relied on official trade confirmations from what is known as the consolidated tape, a record of all transactions executed that does not include cancelled orders.

Since 2011, high-volume traders are required to report their equity trade data to the SEC. The SEC began using tools from Tradeworx, a high-frequency trading group, at the end of last year to provide it a real-time glimpse into stock trading.
But a plan to build a so-called consolidated audit trail is not expected to be completed for several years. The SEC’s team of quantitative analysts will help decipher the data received from the high-volume traders.

Even with these impediments, however, people who are knowledgeable about HFT practices can describe how it is in fact detrimental. A useful piece by former Goldman derivatives expert Wallace Turbeville explains in depth why it is extractive. Some analysts have suggested that HFT is destructive in volatile markets by withdrawing activity when it is most badly needed, but adds liquidity in normal markets. Turbeville debunks the idea that it plays a positive role even when markets are functioning normally.

A big reason for Turbewille’s clear, negative reading is that (mirabile dictu!) he defines the purpose of financial intermediation as facilitating real economy activity. From the start of his article at Demos:

The prior article in this series points out that the most important social purpose of the financial markets is to facilitate the movement of funds from (a) holders that seek investment opportunities to (b) businesses and governments who need to put investment capital to work in productive ways and to individuals who seek to borrow for their current needs. This function is referred to in this series as “Capital Intermediation.” The article describes findings that the cost of Capital Intermediation has increased significantly over the 35 years of financial market deregulation in the United States, despite advances in information technology and quantitative analysis that intuitively should have increased efficiencies in the process. Instead, Capital Intermediation has become less efficient.

The article starts by defining three type of traders: Value Investors (even momentum investors who operate on longer timeframes than HFT types can wind up being Value Investors), Market Makers and Information Traders (HFT and algos). As Turbeville explains:

It is obvious that a market participant is a liquidity provider only if the prices he or she quotes can be relied upon by other market participants, specifically Value Investors and those Information Traders who at the time are acting as liquidity takers. A price quote that appears on a screen is useless as a source of liquidity if it is not available when it comes time to transact. An Information Trader provides meaningful liquidity when his or her quoted prices represent levels that are reliable and meaningful to the participants who are liquidity takers. Sometimes an Information Trader provides such quotes and sometime it does not. When it is active, but not providing such quotes, it is a liquidity taker..

Therefore, Information Trader volume in the deregulated markets sometimes lowers transaction costs and at other times causes transaction cost to skyrocket. But in all cases it is designed to extract value well in excess of the bid/ask spread for the trader who generates the volume. And even when it reduces the cost of a given transaction, if it does not, on a net cost/benefit basis, make Capital Intermediation more efficient, it serves no social benefit. The evidence discussed below strongly suggests that high-speed algorithmic Information Traders extract far more value than they add, burdening the Capital Intermediation process….

The point is made eloquently by Eric Hunsader, the founder of Nanex, a high speed market date feed service.

In summary, HFT algos reduce the value of resting orders [for example, a Market Maker’s orders] and increase the value of how fast orders can be placed and cancelled. This results in the illusion of liquidity. We can’t understand why this is allowed to continue, because at the core, it is pure manipulation.29

One simplified way to think about the world prior to HFT was that one of the reasons in over the counter markets (and HFT is moving into OTC markets like foreign exchange) is that the market-makers had an incentive to be aggressive (which meant offer good prices most of the time to customers) because they would gain information advantages. It was all network effects: more customers would deal with you, including the ones that tended to be good market bellwethers; you’d be better able to place inventory or move a big trade discreetly. And having a broader view of the market (in bond king Salomon’s ad lingo, “market intelligence”) most importantly allowed you to manage your inventory better. HFT traders not only syphon off information, they introduce noise into trading:

Trading tactics are dictated by information. Some information is in the form of earnings reports, crop yields, political events and similar data. These types of information are directly related to the fundamental value of businesses and assets and are used to adjust the price of securities and derivatives to objectively sound levels. (As discussed above, fundamental value refers to the intrinsic value of a stock, bond or derivative based on available information.37) It has long been known that asymmetrical distribution of information that is directly relevant to fundamental value can distort the intermediation function of the markets.38

Another type of information relates to non-fundamental motivations that are predictive of market behavior by individual participants in a market. Tactics based on this type of information are driven by the expected short-term behavior of other market participants based on specific stimuli, not based on generally available information on supply and demand and company data. If, for example, a trader knows that a buyer who is relatively insensitive to price is currently in the market, he or she can corner the market for the specific category of securities sought by the buyer and exploit this price insensitivity.

This type of asymmetry can affect prices broadly as well as securing profit for an algorithmic trader in a single set of trades. This happens when the trading provides misleading signals as to fundamental value. The signals are generally not intentional; rather they arise from the perceptions others in the market have when they see the trades executed by an algorithmic trader using aggressive tactics.

Here is how it works: There is an assumption that trading is motivated by views on fundamental value. Traders must operate under this assumption to protect themselves from unforeseen large price moves based on fundamental value information. As a result, a reported trade will be interpreted as a statement about the buyer’s or seller’s perception of fundamental value, at least until other information contradicts this assumption. A trader with a view as to fundamental value will be forced to question his or her view when he or she sees a trade that is not in line with his or her perception of fundamental value. Trading behavior based on non-fundamental information is indistinguishable from trading based on fundamental information to other market participants (unless the trader is using software designed to detect an HFT tactic, which sometimes happens). Trading against the non-fundamental trader entails risks that he or she has superior fundamental information, and since no trader can afford infinite losses, the fundamental trader will, at a minimum, change his or her price of indifference or perhaps exit the market.39

And HFT now dominates equity trading:

It has been estimated that today 73% of equity trading volume is a result of algorithmic and high frequency trading.3 HFT has changed fundamental characteristics of markets. It has been estimated that at the end of the Second World War, the average holding period for stocks was 4 years. By the turn of the millennium, it was 8 months. By 2008, the average holding period declined to 2 months. And it has been estimated that, at least for actively traded shares, it had declined to 22 seconds by 2011.4 Obviously, trading that churns the market has increased tremendously.

A market with an average holding period of 22 seconds has nothing to do with investing and everything to do with profiting from churn.

Turbeville provides some eye-popping examples of how predatory some of the strategies are, such as:

The best indication of the level of aggressive algorithmic strategies is provided in a study of the practice of “Quote Stuffing.”34 This is a tactic in which HFTs flood an exchange or other transaction-matching venue with quotes to buy or sell in order to slow down the venue’s processing times. HFTs do this so that aggressive tactics can be implemented without intervention from other traders. They also employ Quote Stuffing to slow down one exchange so that price differences between that exchange and another that is operating normally can be exploited.35 Therefore, when quote stuffing occurs, it is highly likely that an aggressive tactic is underway. The study reaches the following conclusion:

We find that quote stuffing is pervasive with several hundred events occurring each trading day and it impacts over 74% of US listed equities. Our results suggest that, in periods of intense quoting activity, stocks experience decreased liquidity, higher trading costs and increased short term volatility.

Quote stuffing operations have been estimated to “consume 97% of computer system resources that the whole market has to bear.”36

Now that you understand how HFTs can use quote stuffing to displace other participants, let’s look at one of the ways they make money:

A classic aggressive strategy involves hunting and trapping “whales.” It is a good example of aggressive HFT strategy.

It is initiated by a “pinging” operation. This involves placing multiple orders designed to detect the presence of a market participant with a large position that it is in the process of accumulating or liquidating. “High frequency traders employ pattern recognition software to detect large institutional orders sitting in dark pools or other liquidity venues.”41 When it pings, the algorithmic trader places orders to buy and/or sell in an array of prices inside the bid/ask spread. If the potential target market participant starts walking through the orders, it becomes clear that a large position is in play that could consume all of the liquidity on one side of the market (bid or ask). Traders sometimes refer to the potential target as a “whale.” Often, a whale intends to buy or sell a large block for structural reasons and is relatively less sensitive to price than other buyers and sellers. If the trader’s order strategy reveals price insensitivity, the whale becomes a target.

For example, an investment fund might have experienced large redemptions from its investors that require liquidation of investments under the terms of the fund. The fund is compelled to sell promptly and is relatively insensitive to price. It is a properly motivated whale.

Once a whale is sighted and its price insensitivity is confirmed, it becomes clear that dominating the other side of the market will give the algorithmic trader control of the bid/ask pricing mechanism. In our example, the algorithmic trader would meet the offers of all of the bidders for the shares that the whale seeks to sell, becoming the sole and dominant purchaser in the marketplace. The algorithmic trader establishes a narrow band of absolute market power controlling the particular securities or derivatives that the whale seeks to buy or sell. The whale will be compelled to either abandon the market or transact at the price demanded by the algorithmic trader.

In an instant, the algorithmic trader cancels all “pinging” orders and buys the market in order to extract as much value as possible. It will also likely flood the trading venue with orders to create congestion and slow other market participants who are also watching and might intervene. The whale must transact at the price required by the algorithmic trader to accumulate or liquidate the position, as appropriate. When the transaction with the whale is accomplished, the quote stuffing orders are all cancelled.

In the final step, the algorithmic trader liquidates the position acquired from the whale immediately, but at a new bid/ask spread reestablished at market levels that are more competitive. The algorithmic trader intends that its profit from moving the bid/ask spread to take advantage of the whale’s price insensitive motivation will exceed the potential loss from the operation if the whale detects that it is being taken advantage of. For this reason, the strategy is most useful if all of the steps can be executed quickly, before detection is possible.

By displacing the entire side of a bid/ask spread, the HFT eliminates all meaningful depth of buying or selling interest for a short time period. As a result, the observed spread in the market is meaningless. Various studies that examine the narrowing of bid ask spreads in the modern marketplace miss the crucial point that HFT tactics like the one described are missing the point that the narrowing is an illusion.42 If the study draws the conclusion that HFT narrows spreads, it is simply misleading.

And the prevalence of this sort of strategy turns the logic of investing on its head. From a 2011 speech by the Bank of England’s Andy Haldane, The Race to Zero:

As of today, the lower limit for trade execution appears to be around 10 micro-seconds. This means it would in principle be possible to execute around 40,000 back-to-back trades in the blink of an eye. If supermarkets ran HFT programmes, the average household could complete its shopping for a lifetime in under a second. Imagine.

It is clear from these trends that trading technologists are involved in an arms race. And it is far from over. The new trading frontier is nano-seconds – billionths of a second. And the twinkle in technologists’ (unblinking) eye is pico-seconds – trillionths of a second. HFT firms talk of a “race to zero”. This is the promised land of zero “latency” where trading converges on its natural (Planck’s) limit, the speed of light….

This has added a new dimension to the “adverse selection” problem in economics – of uninformed traders suffering at the hands of the informed. Being informed used to mean being smarter than the average bear about the path of future fundamentals – profits, interest rates, order flow and the like. Adverse selection risk meant someone having a better informed view on these fundamentals.

Adverse selection risk today has taken on a different shape. In a high-speed, co-located world, being informed means seeing and acting on market prices sooner than competitors. Today, it pays to be faster than the average bear, not smarter. To be uninformed is to be slow. These uninformed traders face a fundamental uncertainty: they may not be able to observe the market price at which their trades will be executed. This is driving through the rear-view mirror, stock-picking based on yesterday’s prices.

It would actually be pretty simple to end the parasitic role of HFT, say, by requiring all orders to remain open for a second. It’s astonishing to see the SEC blandly permit the rise of this practice and now be scrambling to try to curb it. But no one seems to question predatory finance until it has become so well entrenched that it’s difficult, both politically and practically, to uproot it. Until we solve the problem of cognitive capture, however, we are certain to have finance become even more predatory.

Print Friendly, PDF & Email


  1. Danny

    Increasing liquidity into an economy that is operating below potential can be bad or good depending on how the liquidity enters the economy. If all new liquidity is channeled towards the banking system which in turn may fund speculative activities then new liquidity may be of no benefit. If liquidity is distributed economy wide it should be beneficial for increasing demand.

  2. Kevin

    A one second timer would do nothing. Participants would just rush to have their order into the book as soon as the timer started again. Are you going to have a market maker keep their quotes in the market for a second? Who would bother taking that risk?

    1. Yves Smith Post author

      Did you read the article? Bona fide market markers do leave orders on for more than a second because they have humans, not algos, making the decisions. We’ve had market makers leaving orders open for that long and longer for over 200 years, in case you managed to miss that. You are seriously defending a regime that allows people who can execute 40,000 trades a second?

      I’ve noticed these HFT posts attract an unusual amount of HFT meal ticket defenders in comments.

  3. Garyj

    Not sure i have even come across a more foolish assumption….

    “Here is how it works: There is an assumption that trading is motivated by views on fundamental value”


  4. AbyNormal

    the SEC doesn’t have the reach to even sugar coat it

    ex: 11/29/12

    The giant warrant december semester in OMXS30, a security equivalent to a basket consisting of the Stockholm Stock Exchange’s 30 largest companies, and where trade is very important for the overall pricing of the stock market.

    The order was on buy side of the order book and covered more than 4.2 billion futures, to a unit price of almost 107,000 dollars. It gives a theoretical value of 459 561 500 030 000, ie nearly 460 trillion dollars. Sweden’s gross domestic product, by comparison, amounted in 2011 to more than 3500 billion.

    an informed commenter to the above ‘news’:
    Considering the morons that bought the Algo/HFT systems never stopped to think once about the term “life”, these bot or built creatures are designed to learn and recompile themselves to survive. Their food is real data. So somewhere there really is 460 trillion in exposure somewhere.

    Most agencies that use AI fail to set security boundries to their bots. The executives are more throughly managed by ACL’s and given less information and access to information than a bot is given. A bot will always reflect it’s known reality with the information is finds and acts on.

  5. jake chase

    As an individual trader, I do not see any problem with HFT. Even if all the orders away from the market are phony, so what? As a trader I watch the executions and the volume. With a chart program showing five minute increments, it is quite easy to see what is happening, and often to predict what will happen next. As for fundamentals, who can say what they are? Financial statements have become fictional, consistent dilution from stock options extracts most of the growth in those companies where growth exists. Markets move because of changes in crowd psychology. Crowds aren’t moved by reason, but by emotion. Reasons are assigned after the fact and are pretty much bs.

    I get a kick out of the idea of a crowd down at the SEC pouring over order data to see whether ‘manipulation’ is occuring. The only things likely to come out of that are a small increase in employment and a large increase in eye strain.

    1. RalphR

      There’s a saying in poker: “if you’re at the table a half an hour and you haven’t figured out who the mark is, that means it’s you.”

      Guess we know where you fit in the trading ecosystem, even if you don’t.

        1. jake chase

          I just scanned this TPP quickly, but doesn’t it potentially prevent the US from limiting China’s acquisition of US assets with its mountain of Treasury bills?

          I know rich people aren’t particularly smart, but Jesus…

  6. Benoit Essiambre

    This is the wrong fight to pick. When HFT lets a couple silicon valley guys replace 100 wall street traders by a computer we’re all better for it.

    I welcome HFT if just so the little guys can stick it to the big guys.

    Sure there should be restrictions so that they can’t flood the system to manipulate the timing of other’s trades but there isn’t any reason why the exchanges couldn’t take care of this. If I was an exchange I would boot users who try to crash my system to gain an advantage.

    HFT is also a problem that solves itself, as computers from different firms are put online and compete with each other, the margins become thinner and thinner for all of them.

    1. Yves Smith Post author

      Apparently you did not read the post and look not to understand how HFT works.

      1. HFT does not add to liquidity because the overwhelming majority of prices they post are immediately cancelled. They are fishing for information, not bona fide orders.

      2. That means the bid-asked spreads you see do not reflect where you can actually execute a trade

      3. In addition, if you read the article, bid asked spreads GENERALLY are not an indicator of liquidity. I’m not going to spoon feed you. Go to the top of the post and read the underlying article.

    2. R Foreman

      It might be more accurate to say that firms use HFT because if they don’t then others WILL use it. By not using it a firm is cutting it’s own throat. From what I’ve seen, between HFT, off-market (dark) pools, and the Fed/Banks manipulating bond/stock markets respectively, there are fewer and fewer retail ‘investors’ willing to risk their nest-egg in this maelstrom, and this has been the case for several years now. ZeroHedge regularly documents equity fund outflows, and they are persistent and significant in size. People (individual accounts) are moving their money out of these markets, and that is a bad forboding for the powers that be, whose intent was to keep people in the market and prop up the ponzi scheme.

      I’ve said it before, I think the Fed will end up as bag-holder of last resort.

  7. Glen

    Liquidity in markets is akin to plasticity in neurology. I would not look to economic research but to neuroscience.

    1. Glen

      To add to the above Yves, if you really are interested in the similarities, perhaps you should contact Dr. Helen Scharfman at the NYU Langone Medical Center. While offering insight she may be able to make contacts for research funding which is hard to come by.

  8. Tiercelet

    I’m sorry, when I read things like this:
    They also employ Quote Stuffing to slow down one exchange so that price differences between that exchange and another that is operating normally can be exploited.
    I immediately wonder how anybody can fail to see this for what it is, what we in the tech world call a denial of service attack. It’s intentionally breaking someone else’s system (and the market in the process).

    The correct response to someone generating those levels of requests would be a ban on subsequent requests (and if that results in them executing a bunch of disadvantageous trades, all the better…)

  9. jflleni

    RE HFT (High Frequency Trading):

    It should be (and is) trivial to find out what’s going on in HFT without being misled by “fragmentation of information”: that huge NSA snoop ranch just being finished in Utah, described as watching for terrorism, could easily monitor and record all the world’s trading transactions, bar none.

    After all, terrorists can only blow up airplanes and buildings at this point; greedy and irresponsible HFT plutocrats could blow up the world as we know it.

  10. craazyman

    this is kind of a circular argument. what if yera holder of cash who wants to put it to productive work by investing in a prop trading company? and if yer a prop trading company who needs cash for current needs? isn’t this capital intermediation?

    there’s an infinite loop here. the only way to get outside the loop is to get outside the idea of money, but without the idea of money there is no idea of intermediation or of business. where is Master Po?

    it requires at least 2 bong hits and a Bass Ale to solve this one. Or 1 Bass Ale and 3 bong hits. It’s fungible.

    having said all that. I say pull the f*cking plug on these guys and tax their assets off. some things are just self-evident. this is one of them and it’s beyond money and outside of money.

    1. Emperor Wang of Market Mongo

      Really. Where’s a Chinese hacker when you need one? Or wouldn’t be something if Anonymous hacked the system and overwrote all the quote symbols with a *** or ****?

      2 bong hits and a Bass Ale = 3
      1 Bass Ale and 3 bong hits = 4

      Just say’n

    2. AbyNormal

      beer and/or bong hits are unaffordable so ive taken to buyin dips in a medicinal marijuana Chewing Gum product

      in the meantime (an before the Chewing Gum product hits the nearest boones farm market) id sure like to take a peek at Emperor Wangs market(s)

      1. Emperor Wang of Market Mongo

        A favorite beverage in our Mongopoly Online Catalog is Mongolian Spice Beer. It’s made from sandworm extract and we guarantee you can find your way home from anywhere in the universe, with or without a designated driver.

        In the smokeable herb category, there are many, but a favorite causes hallucinations of a 6 foot diameter pizza, and the pizza taste great too! Lots of fun at parties, we’re told.

  11. tw

    I have seen the described activities frequently on Canadian exchanges. These guys began taking over in 2009 and their level of sophistication is substantial. Part of the problem with the HFT debate revolves around using the term “front running” which is term that applies to gatekeepers and order handlers who have a feduciary duty to their clients. It does not apply to competitive market environments that are FIFO in nature.

    The sec needs to put their “box” right between the servers of the exchange and the participants. That way the analysis can be real time. They also need software, people and tools to match the speed and capability of participants, in other words they need money and expertise. In the meantime there are several practical steps than can be taken.

    1) a ratio of transactions to cancellations, whereby 1 transaction for say every 3-5 cancellations, or no rebates and you are charged based on cancellations. 2) bandwidth charges for using valuable pipe, and overloading it, squeezing out other participants. 3) banning of all dark pools or vastly increasing their transparency. Too much activity has been driven off exchange, and the public markets now generate less meaningful outcomes for participants 4) minimum transaction sizes for rebates. Way too many bs 100 share orders stacked (1000 shares entered as 10 orders of 100) in order to pull orders as transactions take place. Market makers were required to transact displayed volume but these so called market makers are not held to the same standard. 500 share minimums for rebates 5) all code and it’s creators names held on file and open for examination and testing by the sec at any time.

    If the sec wants to get creative with its enforcement, then taking away the profits, total profits generated by an entity, unless it expressly admits appropriate culpability (reputation risk) is the only sufficient answer. The HFT crowd has done well to exploit the incompetence of the sec and the exchanges, but they are being held to a far lower standard than a human trader. A real trader would be up on charges for many of the activities that these programs engage in. Why is that ok?

  12. Kaleberg

    HFT is just a combination of two cons, playing the wire and bait and switch. If a party has earlier access to information, they have an advantage. If a party can present a price and renege, they have an advantage. It seems amazingly obvious.

  13. Art

    IMHO it would be pretty simple to eliminate some of the down side to the present system. Insertion of a random delay, technically called a “dither”, before registration of each order would put the cat among the pigeons. It would be considerably harder to game the system if you couldn’t time your moves closely.

    The range of possible delays would be worked out to keep things moving while still stabilizing and normalizing trading. A range of zero to one second sounds good to me but I’d leave it to the experts. An intersting variation would be to allow the dither range to be dynamic. Perhaps linked to the trade volume of the venue being used. Anyone trying to flood the system would see longer delays. This also serves to correct the backlog by slowing things down to allow the system more time to work things through.

Comments are closed.