Integration in the Age of Big Data

Michael Vizard, April 17th, 2013

Even to the most casual observer it’s pretty apparent that developers will be accessing ever increasingly larger amounts of data via an API. The challenge is finding the right cloud-based platform capable of facilitating the integration of all that data at acceptable performance levels.

As part of an effort to rise to that challenge Actian has moved to acquire Pervasive Software, which gives it access to a platform based on a high-performance data integration engine called DataRush that is optimized for multicore processors.

According to Actian CTO Mike Hoskins, who assumes the same role at Actian that he had a Pervasive Software, APIs have moved from a state of absolute badness to relative goodness as more organizations than ever care enough about them to build them in a way that is not only accessible, but also devote the resources needed to maintain them over the long haul.

What’s needed, says Hoskins, are lightweight data integration platforms that are specifically optimized for latest generation of advanced multicore processors. Hoskins says most existing data integration platforms deployed in the cloud today are based on middleware technologies that were developed decades ago. In contrast, the data integration platform that Pervasive Software built provide a frictionless path for integrating data via RESTful APIs or SOAP no matter how large any given set of data might get.

Actian, in the meantime, brings to the deal a Vector analytics database that is optimized for Big Data applications, along with the Ingres relational database and the Versant object-oriented database.

Hoskins says that as more organizations begin to manage data as a true business asset, the mechanisms through which accessing that data gets simplified becomes critically important. In fact, Hoskins says it’s not so much the amount of data that is the biggest challenge facing IT as much as it is the rate at which organizations are being required to process it.

Ultimately, the issue facing IT organizations comes down to managing scale in the age of Big Data integration. Hoskins is making the case that legacy middleware architectures will never be able to keep pace with those requirements.

Unfortunately, by the time most IT organizations figure all that out it might just be too late. Swapping out middleware platforms is never easy. Fortunately, with investments being made in APIs, the cost of switching between one cloud integration platform and another is becoming relatively trivial.

Both comments and pings are currently closed.

Comments are closed.

Follow the PW team on Twitter

ProgrammableWeb
APIs, mashups and code. Because the world's your programmable oyster.

John Musser
Founder, ProgrammableWeb

Adam DuVander
Executive Editor, ProgrammableWeb. Author, Map Scripting 101. Lover, APIs.