Big Data in Finance

Apr 26, 2014

- By Asad Dossani, Author, The Lucrative Derivative Report

Asad Dossani
The financial industry has experienced rapid change and development in recent years. One of the important revolutions taking place is the impact of big data in finance. Big data refers to the analysis of large datasets. In the technology sector, this has been primarily used to market custom products to each consumer based on their past behavior.

In finance, the data revolution has resulted in the increased prominence of algorithmic trading. Algorithmic trading is rule based trading with specific buy and sell instructions for any given trade based on previous price behavior. In many ways, it is a sophisticated form of technical analysis, something that has been around for a long time.

The rise in algorithmic trading has occurred for two reasons. The first is increased availability of data. It is possible for anyone to get daily data for free for any asset you could want to trade. Live intraday charts are also freely available to anyone with a brokerage account. The second reason is the increased computing power and ability to process large datasets. As our computers become powerful, it is easier and faster to crunch numbers and develop numerical trading strategies.

The primary advantage of algorithmic trading is its rule based approach that rules out discretionary trading decisions. This means that all emotion is removed from the trading process, and once a trading strategy has been determined; there is no room for human intervention. This type of approach is increasingly popular due to its positive results.

The primary engine of algorithmic trading is backtesting. Backtesting is when we test our trading strategies on historical data to see how they would perform. This is really where the big data comes into play. We can only create these algorithms by analyzing large datasets of historical price data.

We won't know for sure whether big data in finance will remain in place forever. What we do know is this: the use of big data in finance is rising, and the use of algorithmic trading in finance is increasingly popular. For now, the big data and algorithmic trading are here to stay.

As investors, we have a great opportunity to take advantage of this data revolution in finance. I am working on algorithmic trading strategies, and I hope to share some of these with you in the future.

In this week's Equitymaster club forum, we are asking the question: "How do you plan to take advantage of the data revolution in finance?" Please login and post your views.

Equitymaster's Top 5 Stock Picks For 2020...

We've just released our Special Report - Equitymaster's Top 5 For 2020.

In this report you will get full details of our Top 5 stock picks that could be a part of your portfolio for a long time to come.

And today you can claim an Absolutely Free Copy of this report!

How can you do that?

Just Click here for full details...

is a financial analyst and columnist. He actively trades his own and others' funds, investing primarily in currency, commodity, and stock index derivative products. Prior to this, he worked at Deutsche Bank as an analyst in the FX derivatives team. He is a graduate of the London School of Economics. Asad is a keen observer of macroeconomic trends and their effects on global financial markets. He is deeply passionate about educating investors, and encouraging individuals to take part in and profit from financial markets. To put it colloquially, he wishes to take Wall Street products and turn them into Main Street profits!

Disclaimer: The views mentioned above are of the author only. Data and charts, if used, in the article have been sourced from available information and have not been authenticated by any statutory authority. The author and Equitymaster do not claim it to be accurate nor accept any responsibility for the same. The views constitute only the opinions and do not constitute any guidelines or recommendation on any course of action to be followed by the reader. Please read the detailed Terms of Use of the web site.

Recent Articles

A New Infrastructure Boom March 26, 2019
Selva Freigedo talks about the potential in 5G network and how it could transform the way we communicate.
A 40 Somethings Guide to YouTube Hits March 20, 2019
Vivek dwells into a new YouTube phenomenon.
As the Economy Slows Down, Maruti and Two-Wheeler Companies Cut Production March 19, 2019
The country's largest car maker has cut production by more than a fourth.
In Supporting Demonetisation, RBI Behaved Like an Old Uncle Not Willing to Take a Stand March 13, 2019
The minutes of the meeting of the RBI Board which happened before demonetisation have been released.

Equitymaster requests your view! Post a comment on "Big Data in Finance". Click here!

3 Responses to "Big Data in Finance"

Binodgopal Mukherjee

May 2, 2014

Thanks Asad.

The advantage of new technology, if it helps to reduce risk and increase our income, we the retail investors should try to know the same and then apply.

So, why don't you take us to a step by step guide for algo trading.



Anil R. Punjabi

Apr 27, 2014

Hello Asad !

i read your weekend editions of 'The Daily Reckoning'. Thanks for writing such sensible stuff.

As Warren Buffett has said: We need to know only two investing theories: one, how to value a business and two, the meaning of market prices. Such a valuable insight.

Why do we need to know about algorithmic trading and so many other techniques, which have a value of their own but may not be suited for many, if not most of us.

Long term investing is what your fund house has been advocating and i am fully in agreement with that.

Keep up the good work !





Apr 27, 2014

Thanks Asad for sharing the details regarding algorithmic trading.
In my opinion algorithmic trading is best applicable for Financial institutes / Banks and not for retail investors as backtesting usually works on historic data. As Investors/Mid-term traders we may need to apply discretion to take decisions based on how price action unfolds.

Equitymaster requests your view! Post a comment on "Big Data in Finance". Click here!