Integral data compression for FPS 64‐BIT processors

Improved I/O and reduced storage

G. J B Hurst, Michel Dupuis

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Compression of two‐electron integral data is used to reduce integral storage and I/O requirements with FPS M64 Series (formerly FPS‐X64) processors. Schemes are developed and implemented in assembly language to compress floating‐point values to a fixed‐point accuracy, and unsigned integer numbers. The floating‐point scheme stores only the significant bits of the mantissa and a short, biased exponent. The unsigned integers are packed into fixed‐length fields just long enough to hold the largest value. The packing procedures are tested on FPS‐164 and FPS‐264 processors (since renamed M64/145 and M64/60 by FPS) and incorporated into HONDO to compress two‐electron integral files. Reduction factors of 0.2–0.4 are obtained for floating‐point compression and 0.3–0.5 for index packing, with typical overall factors around one‐third. The advantages of improved I/O and storage efficiency are accompanied by a small increase in processor time to perform the packing and unpacking. Timing changes for HONDO are presented, and both packing schemes dramatically reduce SCF elapsed times with FPS‐264 processors. It is concluded that compression effectively extends external storage capacities, improves I/O efficiency, and can reduce the elapsed time of I/O bound calculations.

Original languageEnglish
Pages (from-to)148-157
Number of pages10
JournalJournal of Computational Chemistry
Volume9
Issue number2
DOIs
Publication statusPublished - 1988

Fingerprint

Data compression
Data Compression
Packing
Compression
Mantissa
Integer
Storage Capacity
Biased
Timing
Exponent
Series
Requirements

ASJC Scopus subject areas

  • Chemistry(all)
  • Computational Mathematics

Cite this

Integral data compression for FPS 64‐BIT processors : Improved I/O and reduced storage. / Hurst, G. J B; Dupuis, Michel.

In: Journal of Computational Chemistry, Vol. 9, No. 2, 1988, p. 148-157.

Research output: Contribution to journalArticle

@article{82a01fd0738e4c8b97a0c482919a9d36,
title = "Integral data compression for FPS 64‐BIT processors: Improved I/O and reduced storage",
abstract = "Compression of two‐electron integral data is used to reduce integral storage and I/O requirements with FPS M64 Series (formerly FPS‐X64) processors. Schemes are developed and implemented in assembly language to compress floating‐point values to a fixed‐point accuracy, and unsigned integer numbers. The floating‐point scheme stores only the significant bits of the mantissa and a short, biased exponent. The unsigned integers are packed into fixed‐length fields just long enough to hold the largest value. The packing procedures are tested on FPS‐164 and FPS‐264 processors (since renamed M64/145 and M64/60 by FPS) and incorporated into HONDO to compress two‐electron integral files. Reduction factors of 0.2–0.4 are obtained for floating‐point compression and 0.3–0.5 for index packing, with typical overall factors around one‐third. The advantages of improved I/O and storage efficiency are accompanied by a small increase in processor time to perform the packing and unpacking. Timing changes for HONDO are presented, and both packing schemes dramatically reduce SCF elapsed times with FPS‐264 processors. It is concluded that compression effectively extends external storage capacities, improves I/O efficiency, and can reduce the elapsed time of I/O bound calculations.",
author = "Hurst, {G. J B} and Michel Dupuis",
year = "1988",
doi = "10.1002/jcc.540090207",
language = "English",
volume = "9",
pages = "148--157",
journal = "Journal of Computational Chemistry",
issn = "0192-8651",
publisher = "John Wiley and Sons Inc.",
number = "2",

}

TY - JOUR

T1 - Integral data compression for FPS 64‐BIT processors

T2 - Improved I/O and reduced storage

AU - Hurst, G. J B

AU - Dupuis, Michel

PY - 1988

Y1 - 1988

N2 - Compression of two‐electron integral data is used to reduce integral storage and I/O requirements with FPS M64 Series (formerly FPS‐X64) processors. Schemes are developed and implemented in assembly language to compress floating‐point values to a fixed‐point accuracy, and unsigned integer numbers. The floating‐point scheme stores only the significant bits of the mantissa and a short, biased exponent. The unsigned integers are packed into fixed‐length fields just long enough to hold the largest value. The packing procedures are tested on FPS‐164 and FPS‐264 processors (since renamed M64/145 and M64/60 by FPS) and incorporated into HONDO to compress two‐electron integral files. Reduction factors of 0.2–0.4 are obtained for floating‐point compression and 0.3–0.5 for index packing, with typical overall factors around one‐third. The advantages of improved I/O and storage efficiency are accompanied by a small increase in processor time to perform the packing and unpacking. Timing changes for HONDO are presented, and both packing schemes dramatically reduce SCF elapsed times with FPS‐264 processors. It is concluded that compression effectively extends external storage capacities, improves I/O efficiency, and can reduce the elapsed time of I/O bound calculations.

AB - Compression of two‐electron integral data is used to reduce integral storage and I/O requirements with FPS M64 Series (formerly FPS‐X64) processors. Schemes are developed and implemented in assembly language to compress floating‐point values to a fixed‐point accuracy, and unsigned integer numbers. The floating‐point scheme stores only the significant bits of the mantissa and a short, biased exponent. The unsigned integers are packed into fixed‐length fields just long enough to hold the largest value. The packing procedures are tested on FPS‐164 and FPS‐264 processors (since renamed M64/145 and M64/60 by FPS) and incorporated into HONDO to compress two‐electron integral files. Reduction factors of 0.2–0.4 are obtained for floating‐point compression and 0.3–0.5 for index packing, with typical overall factors around one‐third. The advantages of improved I/O and storage efficiency are accompanied by a small increase in processor time to perform the packing and unpacking. Timing changes for HONDO are presented, and both packing schemes dramatically reduce SCF elapsed times with FPS‐264 processors. It is concluded that compression effectively extends external storage capacities, improves I/O efficiency, and can reduce the elapsed time of I/O bound calculations.

UR - http://www.scopus.com/inward/record.url?scp=84988112466&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988112466&partnerID=8YFLogxK

U2 - 10.1002/jcc.540090207

DO - 10.1002/jcc.540090207

M3 - Article

VL - 9

SP - 148

EP - 157

JO - Journal of Computational Chemistry

JF - Journal of Computational Chemistry

SN - 0192-8651

IS - 2

ER -