上海科技大学知识管理系统

本发明提供一种对科学数据文件进行读写优化的中间件系统及方法，包括：接收用户的数据写入请求，并根据写入科学数据的区域掩码信息构建空间网格，并对相同区域的网格数据块进行合并以构建连续非等宽数据块；根据连续非等宽数据块的区域掩码信息进行分组以得到含有区域分组信息的分组非等宽数据块，并对其进行编码及构建索引以得到含有索引信息的编码非等宽数据块；和//或，根据用户的区域读取信息检索对应的数据块并发出数据块读取指令；读取和写入科学数据对应的元数据；读取和写入编码非等宽数据块。本申请通过改变用户读写请求的语义，以达到改变用户的数据组织方式并提升数据读写性能的目的；并且减少了区域性数据读取的内存占用量。

The present invention provides a middleware system and method for read//write optimization of a scientific data file. The method comprises : receiving a data write request of a user, constructing a spatial grid according to regional mask information written into scientific data, and merging grid data blocks in the same region to construct a continuous non-equal-width data block; performing grouping according to the regional mask information of the continuous non-equal-width data block to obtain grouped non-equal-width data blocks comprising regional grouping information, and coding the grouped non-equal-width data blocks and constructing indexes to obtain coded non-equal-width data blocks comprising index information; and//or retrieving a corresponding data block according to regional reading information of the user and sending a data block reading instruction; reading and writing metadata corresponding to the scientific data; and reading and writing the coded non-equal-width data blocks. According to the present application, by changing the semantics of a read//write request of the user, the objectives of changing a data organization mode of the user and improving data read//write performance are achieved; and the memory footprint of regional data reading is reduced.