Research of LOB Data Compression and Read-Write Efficiency in Oracle Database

Authors

  • Jianjun Wang Gansu Provincial Earthquake Administration, Lanzhou
  • Yingang Zhao Anqiu Earthquake Station, Weifang
  • Gaochuan Liu China Earthquake Networks Center, Beijing

DOI:

https://doi.org/10.5334/dsj-2019-008

Keywords:

Oracle LOB, compression, database read method, speed test

Abstract

Aiming at the problems of huge storage space, low exchange speed and low read-write speed of the current specific oracle database, the read-write speed and exchange speed tests are performed on the compressed and uncompressed Clob and Blob data by three compression algorithms, including Bzip2, Gzip and GzipIO respectively. The read speed test is performed by the direct read, substr read, and substr+threadPool read techniques. The results show that: (1) Blob is superior to Clob in terms of storage, exchange, or read-write speed; (2) For the specific database, Blob+Gzip is the optimal storage structure of the minute and second data. The read-write speed is greatly improved, and the overall capacity of the database is reduced to 7% (or less). The exchange rate of the second data is at least 7.89 times of the present rate, and the station data can be exchanged to the disciplinary center within 2–3 hours (currently 1.5 days); (3) The simplest and most widely used direct read method by software developers has poor database read efficiency, while the substr+threadPool technique shows higher database read efficiency no matter for Clob or Blob, for compressed or uncompressed, which brings a leap-forward improvement in the read speed of LOB data. The results of this paper are of high reference significance to the LOB data storage design and software development.

Author Biographies

Jianjun Wang, Gansu Provincial Earthquake Administration, Lanzhou

Wang Jianjun, male, born in 1975, senior engineer, Master’s degree, engaged in seismic electromagnetic observation method research and technical management.

Yingang Zhao, Anqiu Earthquake Station, Weifang

Zhao Yingang, male, engineer, Bachelor’s degree, engaged in seismic monitoring and seismic software research and development.

Downloads

Published

2019-02-08

Issue

Section

Research Papers