Large-scale electrophysiology: Acquisition, compression, encryption, and storage of big data

Research output: Contribution to journalArticle

73 Citations (Scopus)

Abstract

The use of large-scale electrophysiology to obtain high spatiotemporal resolution brain recordings (>100 channels) capable of probing the range of neural activity from local field potential oscillations to single-neuron action potentials presents new challenges for data acquisition, storage, and analysis. Our group is currently performing continuous, long-term electrophysiological recordings in human subjects undergoing evaluation for epilepsy surgery using hybrid intracranial electrodes composed of up to 320 micro- and clinical macroelectrode arrays. DC-capable amplifiers, sampling at 32 kHz per channel with 18-bits of A/D resolution are capable of resolving extracellular voltages spanning single-neuron action potentials, high frequency oscillations, and high amplitude ultra-slow activity, but this approach generates 3 terabytes of data per day (at 4 bytes per sample) using current data formats. Data compression can provide several practical benefits, but only if data can be compressed and appended to files in real-time in a format that allows random access to data segments of varying size. Here we describe a state-of-the-art, scalable, electrophysiology platform designed for acquisition, compression, encryption, and storage of large-scale data. Data are stored in a file format that incorporates lossless data compression using range-encoded differences, a 32-bit cyclically redundant checksum to ensure data integrity, and 128-bit encryption for protection of patient information.

Original languageEnglish (US)
Pages (from-to)185-192
Number of pages8
JournalJournal of Neuroscience Methods
Volume180
Issue number1
DOIs
StatePublished - May 30 2009

Fingerprint

Data Compression
Electrophysiology
Information Storage and Retrieval
Action Potentials
Computer Security
Neurons
Epilepsy
Electrodes
Brain

Keywords

  • Cyclic redundancy codes
  • Data compression
  • Data encryption
  • EEG analysis
  • Multiscale electrophysiology format
  • Quantitative analysis
  • Range encoding

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Large-scale electrophysiology : Acquisition, compression, encryption, and storage of big data. / Brinkmann, Benjamin; Bower, Mark R.; Stengel, Keith A.; Worrell, Gregory Alan; Stead, Squire Matthew.

In: Journal of Neuroscience Methods, Vol. 180, No. 1, 30.05.2009, p. 185-192.

Research output: Contribution to journalArticle

@article{4a754e8f691a441dba14adc9766d98ec,
title = "Large-scale electrophysiology: Acquisition, compression, encryption, and storage of big data",
abstract = "The use of large-scale electrophysiology to obtain high spatiotemporal resolution brain recordings (>100 channels) capable of probing the range of neural activity from local field potential oscillations to single-neuron action potentials presents new challenges for data acquisition, storage, and analysis. Our group is currently performing continuous, long-term electrophysiological recordings in human subjects undergoing evaluation for epilepsy surgery using hybrid intracranial electrodes composed of up to 320 micro- and clinical macroelectrode arrays. DC-capable amplifiers, sampling at 32 kHz per channel with 18-bits of A/D resolution are capable of resolving extracellular voltages spanning single-neuron action potentials, high frequency oscillations, and high amplitude ultra-slow activity, but this approach generates 3 terabytes of data per day (at 4 bytes per sample) using current data formats. Data compression can provide several practical benefits, but only if data can be compressed and appended to files in real-time in a format that allows random access to data segments of varying size. Here we describe a state-of-the-art, scalable, electrophysiology platform designed for acquisition, compression, encryption, and storage of large-scale data. Data are stored in a file format that incorporates lossless data compression using range-encoded differences, a 32-bit cyclically redundant checksum to ensure data integrity, and 128-bit encryption for protection of patient information.",
keywords = "Cyclic redundancy codes, Data compression, Data encryption, EEG analysis, Multiscale electrophysiology format, Quantitative analysis, Range encoding",
author = "Benjamin Brinkmann and Bower, {Mark R.} and Stengel, {Keith A.} and Worrell, {Gregory Alan} and Stead, {Squire Matthew}",
year = "2009",
month = "5",
day = "30",
doi = "10.1016/j.jneumeth.2009.03.022",
language = "English (US)",
volume = "180",
pages = "185--192",
journal = "Journal of Neuroscience Methods",
issn = "0165-0270",
publisher = "Elsevier",
number = "1",

}

TY - JOUR

T1 - Large-scale electrophysiology

T2 - Acquisition, compression, encryption, and storage of big data

AU - Brinkmann, Benjamin

AU - Bower, Mark R.

AU - Stengel, Keith A.

AU - Worrell, Gregory Alan

AU - Stead, Squire Matthew

PY - 2009/5/30

Y1 - 2009/5/30

N2 - The use of large-scale electrophysiology to obtain high spatiotemporal resolution brain recordings (>100 channels) capable of probing the range of neural activity from local field potential oscillations to single-neuron action potentials presents new challenges for data acquisition, storage, and analysis. Our group is currently performing continuous, long-term electrophysiological recordings in human subjects undergoing evaluation for epilepsy surgery using hybrid intracranial electrodes composed of up to 320 micro- and clinical macroelectrode arrays. DC-capable amplifiers, sampling at 32 kHz per channel with 18-bits of A/D resolution are capable of resolving extracellular voltages spanning single-neuron action potentials, high frequency oscillations, and high amplitude ultra-slow activity, but this approach generates 3 terabytes of data per day (at 4 bytes per sample) using current data formats. Data compression can provide several practical benefits, but only if data can be compressed and appended to files in real-time in a format that allows random access to data segments of varying size. Here we describe a state-of-the-art, scalable, electrophysiology platform designed for acquisition, compression, encryption, and storage of large-scale data. Data are stored in a file format that incorporates lossless data compression using range-encoded differences, a 32-bit cyclically redundant checksum to ensure data integrity, and 128-bit encryption for protection of patient information.

AB - The use of large-scale electrophysiology to obtain high spatiotemporal resolution brain recordings (>100 channels) capable of probing the range of neural activity from local field potential oscillations to single-neuron action potentials presents new challenges for data acquisition, storage, and analysis. Our group is currently performing continuous, long-term electrophysiological recordings in human subjects undergoing evaluation for epilepsy surgery using hybrid intracranial electrodes composed of up to 320 micro- and clinical macroelectrode arrays. DC-capable amplifiers, sampling at 32 kHz per channel with 18-bits of A/D resolution are capable of resolving extracellular voltages spanning single-neuron action potentials, high frequency oscillations, and high amplitude ultra-slow activity, but this approach generates 3 terabytes of data per day (at 4 bytes per sample) using current data formats. Data compression can provide several practical benefits, but only if data can be compressed and appended to files in real-time in a format that allows random access to data segments of varying size. Here we describe a state-of-the-art, scalable, electrophysiology platform designed for acquisition, compression, encryption, and storage of large-scale data. Data are stored in a file format that incorporates lossless data compression using range-encoded differences, a 32-bit cyclically redundant checksum to ensure data integrity, and 128-bit encryption for protection of patient information.

KW - Cyclic redundancy codes

KW - Data compression

KW - Data encryption

KW - EEG analysis

KW - Multiscale electrophysiology format

KW - Quantitative analysis

KW - Range encoding

UR - http://www.scopus.com/inward/record.url?scp=67349111264&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67349111264&partnerID=8YFLogxK

U2 - 10.1016/j.jneumeth.2009.03.022

DO - 10.1016/j.jneumeth.2009.03.022

M3 - Article

C2 - 19427545

AN - SCOPUS:67349111264

VL - 180

SP - 185

EP - 192

JO - Journal of Neuroscience Methods

JF - Journal of Neuroscience Methods

SN - 0165-0270

IS - 1

ER -