Travel Space is combining an unusual set of technical challenges
– mathematics, speed, accuracy, scalability. An additional issue has been increasingly putting pressure on travel technology companies: the size of data. With a joined effect of globalization, new flight destinations, low-cost flights, different points of sale, strong growth in Eastern Europe, Middle East and Asia-Pacific, data is growing – and this is just the beginning.
Storage is not the issue as capacity storage has been growing steadily in recent years (adding a few TB to an existing setup is cost efficient) – the challenge is how to access this mass set of data with sub-second timing and to “manage” this data in an efficient way. Big Data is becoming the stealth secret weapon of the Search Travel Space.
In 2010, The Economist published on its cover page “The data deluge” and as a natural answer, capital funding has been running to Big Data companies – with some funds having dedicated teams on this sub-component of Cloud Computing. And indeed – the challenge is up to the investment (and its return).
In one of the visionary Jules Verne’s books, ”Journey to the Center of the Earth”, this quote is striking – “Science, my lad, is made up of mistakes, but they are mistakes which it is useful to make, because they lead little by little to the truth.” When exploring the Big Data field, and in order to handle in a scalable way hundreds of billions of records, we did experiment. Vayant has tuned around a dozen different solutions and by mixing them in just the right way, we ended up relying solely on a mix of Non-SQL solutions. Yes, it works!
The complexity of the area is to ensure the proper alignment of three parameters:
the hardware (the balance between cost, memory/drive/CPU), the Db/Storage architecture, and the software. I strongly believe the reason why we solved this challenge is because we gave our teams the chance to fail with different solutions until the right equation was found. They did not give up, they forgot the past, and they just cranked it out. As data is growing and as some of it expires, one key challenge is to manage past data – recycling it for efficiency.
Vayant’s latest FastSearch product is built on this philosophy – lightning fast to enable the most dynamic user interface – even if behind the scene searches trigger Terabytes of data processing and scanning. A natural roll-over is in motion, where we are migrating this to our core foundation OneSearch product for the benefit of our customers. If you can do it for one, it will work for the others.
About Big Data:
Tnooz published a set of interesting articles on BigData and Travel such as htt
p://www.tnooz.com/2011/09/20/news/big-data-bringing-the-magic-back-to-travel-technology/ and http://www.tnooz.com/2012/01/04/how-to/big-data-and-the-infinite-possibilities-for-the-travel-industry/ – and their next Tnooz Live will be around this topic.








