Research of LOB Data Compression and Read-Write Efficiency in Oracle Database

Authors

  • Jianjun Wang Gansu Provincial Earthquake Administration, Lanzhou
  • Yingang Zhao Anqiu Earthquake Station, Weifang
  • Gaochuan Liu China Earthquake Networks Center, Beijing

DOI:

https://doi.org/10.5334/dsj-2019-008

Keywords:

Oracle LOB, compression, database read method, speed test

Abstract

Aiming at the problems of huge storage space, low exchange speed and low read-write speed of the current specific oracle database, the read-write speed and exchange speed tests are performed on the compressed and uncompressed Clob and Blob data by three compression algorithms, including Bzip2, Gzip and GzipIO respectively. The read speed test is performed by the direct read, substr read, and substr+threadPool read techniques. The results show that: (1) Blob is superior to Clob in terms of storage, exchange, or read-write speed; (2) For the specific database, Blob+Gzip is the optimal storage structure of the minute and second data. The read-write speed is greatly improved, and the overall capacity of the database is reduced to 7% (or less). The exchange rate of the second data is at least 7.89 times of the present rate, and the station data can be exchanged to the disciplinary center within 2–3 hours (currently 1.5 days); (3) The simplest and most widely used direct read method by software developers has poor database read efficiency, while the substr+threadPool technique shows higher database read efficiency no matter for Clob or Blob, for compressed or uncompressed, which brings a leap-forward improvement in the read speed of LOB data. The results of this paper are of high reference significance to the LOB data storage design and software development.

Author Biographies

Jianjun Wang, Gansu Provincial Earthquake Administration, Lanzhou

Wang Jianjun, male, born in 1975, senior engineer, Master’s degree, engaged in seismic electromagnetic observation method research and technical management.

Yingang Zhao, Anqiu Earthquake Station, Weifang

Zhao Yingang, male, engineer, Bachelor’s degree, engaged in seismic monitoring and seismic software research and development.

Downloads

Published

2019-02-08

Issue

Vol. 18 (2019)

Section

Research Papers

License

Copyright (c) 2019 The Author(s)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms.  If a submission is rejected or withdrawn prior to publication, all rights return to the author(s):

  • Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

  • Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

  • Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

Submitting to the journal implicitly confirms that all named authors and rights holders have agreed to the above terms of publication. It is the submitting author's responsibility to ensure all authors and relevant institutional bodies have given their agreement at the point of submission.

Note: some institutions require authors to seek written approval in relation to the terms of publication. Should this be required, authors can request a separate licence agreement document from the editorial team (e.g. authors who are Crown employees).