Array requirements for scientific applications and an implementation for microsoft SQL server

László Dobos, Alexander Szalay, José Blakeley, Tamás Budavári, István Csabai, Dragan Tomic, Milos Milovanovic, Marko Tintor, Andrija Jovanovic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper outlines certain scenarios from the fields of astrophysics and fluid dynamics simulations which require high performance data warehouses that support array data type. A common feature of all these use cases is that subsetting and preprocessing the data on the server side (as far as possible inside the database server process) is necessary to avoid the client-server overhead and to minimize IO utilization. Analyzing and summarizing the requirements of the various fields help software engineers to come up with a comprehensive design of an array extension to relational database systems that covers a wide range of scientific applications. We also present a working implementation of an array data type for Microsoft SQL Server 2008 to support large-scale scientific applications. We introduce the design of the array type, results from a performance evaluation, and discuss the lessons learned from this implementation. The library can be downloaded from our website at http://voservices.net/sqlarray/.

Original languageEnglish (US)
Title of host publicationProceedings - EDBT/ICDT 2011 Workshop on Array Databases, AD'11
PublisherAssociation for Computing Machinery
Pages13-19
Number of pages7
ISBN (Print)9781450306140
DOIs
StatePublished - 2011
EventEDBT/ICDT 2011 Workshop on Array Databases, AD'11 - Uppsala, Sweden
Duration: Mar 25 2011Mar 25 2011

Publication series

NameACM International Conference Proceeding Series

Conference

ConferenceEDBT/ICDT 2011 Workshop on Array Databases, AD'11
Country/TerritorySweden
CityUppsala
Period3/25/113/25/11

Keywords

  • Abstract data types
  • Array types
  • Database server programming
  • Extensibility

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Array requirements for scientific applications and an implementation for microsoft SQL server'. Together they form a unique fingerprint.

Cite this