DataTurbine is a robust real-time streaming data engine that lets you quickly stream live data from experiments, labs, web cams and even Java-enabled cell phones. It acts as a “black box” to which applications and devices send and receive data. Think of it as express delivery for your data, be it numbers, video, sound or text. For ecological applications, DataTurbine is useful for moving data in near real time from sensors to field stations to data centers. DataTurbine handles time series data over networks with intermittent connectivity. It is vendor-neutral, so it works with sensors and dataloggers from a variety of manufacturers and research labs.
DataTurbine is a buffered middleware product, not simply a publish/subscribe system. In distributed systems, middleware is the software layer that lies between the operating system and the applications running at individual sites (Middleware). DataTurbine can receive data from various sources (sensors, web cams, etc.) and send data to various sinks (visualization interfaces, analysis tools, databases, etc). It has “TiVO” like functionality that lets applications pause and rewind live streaming data.
DataTurbine is open source and free. There is also an active developer and user community that continues to evolve the software and assist in applications. The development and publication of DataTurbine is currently supported by the Office of Cyberinfrastructure at the National Science Foundation and by the Gordon and Betty Moore Foundation.
Continue reading ‘The Open Source DataTurbine Initiative: empowering the scientific community with streaming data middleware’