Paper Abstract and Keywords |
Presentation |
2007-07-03 13:35
Data Stream Processing Architecture on PC Clusters Hiroyuki Uchiyama, Hiroki Akama (NTT Cyber Space Labs.), Shuichi Nishioka (Resonant), Ichibe Naito, Noburou Taniguchi, Tomohiro Hasegawa, Fumiaki Miura, Masashi Yamamuro, Norihiko Sakurai (NTT) DE2007-76 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Enormous and various data streams are generated from miscellaneous data sources such as RFID sensors, web logs, cellular phones logs and web cams. To deal with these data streams, we propose an architecture which receives data streams, executes flexible operations defined by users and stores/alerts the results to views/applications via simple interfaces. This architecture is composed of PC servers and has features:(1)scalability for the processing of the operations, (2)dynamic insertions/updates/deletions of the operations, (3)automatic distribution and execution of executable file which includes all operations. We describe a prototype system based on the architecture and a video monitoring application implemented on the prototype system. Finally, we evaluate the scalability for the numbers of PC servers and the distribution overheads of operators. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Data Stream Management System / Scalability / PC cluster / / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 107, no. 131, DE2007-76, pp. 327-332, July 2007. |
Paper # |
DE2007-76 |
Date of Issue |
2007-06-25 (DE) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
DE2007-76 |
|