The best of two worlds: integrating IBM infosphere streams with apache YARN

Z Nabi, R Wagle, E Bouillet - … Conference on Big Data (Big Data …, 2014 - ieeexplore.ieee.org
2014 IEEE International Conference on Big Data (Big Data), 2014ieeexplore.ieee.org
The seamless confluence of data in motion and data at rest has the potential to redefine the
Big Data analytics landscape in a diverse range of domains. To make this happen, existing
data intensive computing frameworks need to be repurposed and integrated at control, data,
and management levels. Towards this end, we present the system level integration of IBM
InfoSphere Streams with Apache YARN. Our design leverages the key differentiating
features of the two frameworks to blend high throughput batch-processing with near line …
The seamless confluence of data in motion and data at rest has the potential to redefine the Big Data analytics landscape in a diverse range of domains. To make this happen, existing data intensive computing frameworks need to be repurposed and integrated at control, data, and management levels. Towards this end, we present the system level integration of IBM InfoSphere Streams with Apache YARN. Our design leverages the key differentiating features of the two frameworks to blend high throughput batch-processing with near line-rate, low latency stream-processing. In addition, both frameworks are able to share resources and offer the same interfaces that their users are accustomed to. Using two real-world examples, we illustrate how such a system can be used in production.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果