Paper Abstract and Keywords |
Presentation |
2023-09-22 11:20
A prototype system for interactively combining more than 1000 pieces of table formatted big data and interactively overviewing of it
-- Performance measurement of overviewing (displaying, searching, tabulating, and sorting) more than 3 trillion records of virtual table formatted data -- Shinji Furusho (NNI Technologies), Atsushi Iizawa (Ricoh IT Solutions), Hiroshi Tezuka (Bird's-eye View Engineering Institute), Yukio Yamamoto (ISAS), Takashi Matsuhisa, Manabu Iida (SEC), Tadashi Nagao (Layman's Admin) DE2023-24 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
The virtual tabular data, created with the purpose of facilitating the distribution of diverse tabular big data, is a virtual and hierarchical combination of actual and virtual tabular data sets on the network. It is designed to cater to specific usage needs and can be immediately generated with minimal memory consumption. Additionally, it features a high-speed and versatile virtual index, utilizing Natural Number Indexing (NNI), across all columns. The network system created from these actual and virtual tabular data sets is referred to as IoD (Internet of Data). Through IoD, save, transfer, and overview of tabular big data can be achieved on a single PC, enabling its distribution. In this study, we combined over 1000 instances of tabular big data on a single PC, generating over 3 trillion virtual tabular data records, and validated its performance. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
tabular big data / virtual tabular big data / virtual index / NNI / IoD / / / |
Reference Info. |
IEICE Tech. Rep., vol. 123, no. 192, DE2023-24, pp. 78-83, Sept. 2023. |
Paper # |
DE2023-24 |
Date of Issue |
2023-09-14 (DE) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
DE2023-24 |
Conference Information |
Committee |
DE IPSJ-DBS IPSJ-IFAT |
Conference Date |
2023-09-21 - 2023-09-22 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Kitakyushu International Conference Center |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Bigdata management, information retrieval, knowledge discovery, etc. |
Paper Information |
Registration To |
DE |
Conference Code |
2023-09-DE-DBS-IFAT |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
A prototype system for interactively combining more than 1000 pieces of table formatted big data and interactively overviewing of it |
Sub Title (in English) |
Performance measurement of overviewing (displaying, searching, tabulating, and sorting) more than 3 trillion records of virtual table formatted data |
Keyword(1) |
tabular big data |
Keyword(2) |
virtual tabular big data |
Keyword(3) |
virtual index |
Keyword(4) |
NNI |
Keyword(5) |
IoD |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Shinji Furusho |
1st Author's Affiliation |
NNI Technologies (NNI Technologies) |
2nd Author's Name |
Atsushi Iizawa |
2nd Author's Affiliation |
Ricoh IT Solutions (Ricoh IT Solutions) |
3rd Author's Name |
Hiroshi Tezuka |
3rd Author's Affiliation |
Bird's-eye View Engineering Institute (Bird's-eye View Engineering Institute) |
4th Author's Name |
Yukio Yamamoto |
4th Author's Affiliation |
Japan Aerospace Exploration Agency (ISAS) |
5th Author's Name |
Takashi Matsuhisa |
5th Author's Affiliation |
SEC (SEC) |
6th Author's Name |
Manabu Iida |
6th Author's Affiliation |
SEC (SEC) |
7th Author's Name |
Tadashi Nagao |
7th Author's Affiliation |
Layman's Admin (Layman's Admin) |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2023-09-22 11:20:00 |
Presentation Time |
25 minutes |
Registration for |
DE |
Paper # |
DE2023-24 |
Volume (vol) |
vol.123 |
Number (no) |
no.192 |
Page |
pp.78-83 |
#Pages |
6 |
Date of Issue |
2023-09-14 (DE) |
|