A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Filters
[Poster] Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems
2022
Zenodo
Preserved Fulltext
Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems ...
A new prefetching scheme by looking at how data are accessed instead of how applications access it. ...
. • HCompress Profiler • Runs a exhaustive benchmark to capture system and compression characteristics for predefined and user-defined inputs ...
doi:10.5281/zenodo.6862310
fatcat:3nrbly6eevfb5jodnyw4pv4y5m
[Poster] Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems
2022
Zenodo
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems ...
A new prefetching scheme by looking at how data are accessed instead of how applications access it. ...
Complex data placement among the tiers of a deep memory and storage hierarchy
Current Situation • Server-Push • Event are captured by kernel's inotify utility • Prefetched data is push to the hierarchy ...
doi:10.5281/zenodo.6876917
fatcat:327v7goz6zbx7ctgn7zgoafdci
[Poster] Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems
2022
Zenodo
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems ...
A new prefetching scheme by looking at how data are accessed instead of how applications access it. ...
• Data Centric (Score Incorporates) • Recency, Frequency, and Sequencing • Hierarchical Placement • The engine calculates placement of prefetch data based on multi-tiered storage and data characteristics ...
doi:10.5281/zenodo.6859369
fatcat:7friw3rjxrcylctqt6ddmbygze
XRootd, disk-based, caching proxy for optimization of data access, data placement and data replication
2014
Journal of Physics, Conference Series
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Extensions to the Hadoop file-system have been developed to allow for an immediate fallback to network access when local HDFS storage fails to provide the requested block. ...
Extensions to the Hadoop file-system have been developed to allow foran immediate fallback to network access when local HDFS storage fails to provide the requested block. ...
The first stage happened in the US in 2011 by exposing all Tier 1 and Tier 2 storage to the collaboration via the XRootd system [3] and by implementing a comprehensive monitoring framework [4] . ...
doi:10.1088/1742-6596/513/4/042044
fatcat:zfdqrgib2fdfbjjtghudvkbkju
Tombolo: Performance enhancements for cloud storage gateways
2016
2016 32nd Symposium on Mass Storage Systems and Technologies (MSST)
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Object-based cloud storage has been widely adopted for their agility in deploying storage with a very low up-front cost. ...
We also provide insights on how to build such cloud gateways, especially with respect to caching and prefetching techniques. ...
We thank the members of the NetApp ATG group and ADSL research group for their suggestions and comments. ...
doi:10.1109/msst.2016.7897076
dblp:conf/mss/YangSUKFZAA16
fatcat:avvx4affuzfv3dwuajxnabqlp4
Automatic and Scalable Data Replication Manager in Distributed Computation and Storage Infrastructure of Cyber-Physical Systems
2017
Scalable Computing : Practice and Experience
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
infrastructure of cyber-physical systems, using tiering storage with SSD (solid state disk) and HDD (hard disk drive). ...
Cyber-Physical System (CPS) is a rising technology that utilizes computation and storage resources for sensing, processing, analysis, predicting, understanding of field-data, and then uses communication ...
This work was completed during Zhengyu Yang, Janki Bhimani and Jiayin Wang's internship at Storage Software Group and Performance and Datacenter Team, Memory Solution Lab, Samsung Semiconductor Inc. ...
doi:10.12694/scpe.v18i4.1330
fatcat:w42pkr7klbgahknuuseqjhqfea
VENU: Orchestrating SSDs in hadoop storage
2014
2014 IEEE International Conference on Big Data (Big Data)
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
To this end, we present VENU, a dynamic data management system for Hadoop. ...
In addition, we design placement and retrieval schemes to efficiently use the SSD cache. ...
They propose a re-design of HDFS into a multi-tiered storage system that seamlessly integrates heterogeneous storage technologies such as HDDs and SSDs into HDFS and propose data placement and retrieval ...
doi:10.1109/bigdata.2014.7004234
dblp:conf/bigdataconf/RIB14
fatcat:zhqbashywvaxpe75d7tyaeykci
Energy-aware data prefetching for multi-speed disks
2006
Proceedings of the 3rd conference on Computing frontiers - CF '06
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Power consumption of disk based storage systems is becoming an increasingly pressing issue for both commercial and scientific application domains. ...
Specifically, we propose and experimentally evaluate a compiler-directed energyaware data prefetching scheme for scientific applications that process disk-resident data sets. ...
A couple of recent papers (e.g., providing multi-speed setting for server disks [5, 14] , power-aware storage cache management schemes [32, 33] , and compiler-guided disk power management schemes [25 ...
doi:10.1145/1128022.1128038
dblp:conf/cf/SonK06
fatcat:emhmyihoqzhtjjppbv6aplcswm
Netco
2018
Proceedings of the ACM Symposium on Cloud Computing - SoCC '18
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
We consider a common setting where storage is disaggregated from the compute in data-parallel systems. ...
We design a system Netco, which prefetches data into the cache (based on workload predictability), and appropriately divides the cache space and network bandwidth between the prefetches and serving ongoing ...
The primary method to increase the interconnect bandwidth today, is to pay for an even larger compute tier and/or storage tier [1, 10] . ...
doi:10.1145/3267809.3267827
dblp:conf/cloud/JalapartiDGAFKM18
fatcat:a5iuiv5sfjcbpdbrzs3ud3ooqi
Advection-Based Sparse Data Management for Visualizing Unsteady Flow
2014
IEEE Transactions on Visualization and Computer Graphics
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
In this work, we explore a novel advection-based scheme to manage flow field data for both efficiency and scalability. ...
We demonstrate our method using a prototype system that works on workstation and also in supercomputing environments. ...
Qingdong Cai for providing the TB-scale turbulence simulation data. This work is supported by NSFC No. 61170204. ...
doi:10.1109/tvcg.2014.2346418
pmid:26356969
fatcat:4m4nxsxalnhxfaskwlpfmigoim
Profiler and compiler assisted adaptive I/O prefetching for shared storage caches
2008
Proceedings of the 17th international conference on Parallel architectures and compilation techniques - PACT '08
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
scheme targeting shared storage caches. ...
We implemented this new I/O prefetching scheme using a compiler and the PVFS file system running on Linux, and the empirical data collected clearly underline the importance of adapting I/O prefetching ...
Figure 6 shows the architecture of a typical modern storage system interfaced with a computation system. ...
doi:10.1145/1454115.1454133
dblp:conf/IEEEpact/SonMOKKK08
fatcat:ffawp3we5zbz7g2nti664ja4la
Multiuser prefetching with queuing prioritization in heterogeneous wireless systems
2006
Proceedings of the 3rd international conference on Quality of service in heterogeneous wired/wireless networks - QShine '06
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2006; you can also visit the original URL.
The file type is application/pdf.
We study the performance of a multi-user prefetching strategy in a two-tier heterogeneous wireless network. ...
We propose to alleviate the system traffic load through optimizing a prefetch thresholding algorithm, accounting for server queuing prioritization. ...
Acknowledgments The authors would like to thank the anonymous reviewers for their helpful comments and Mr. Da Wang for his contribution to part of the computer simulation and technical discussion. ...
doi:10.1145/1185373.1185417
dblp:conf/qshine/LiangD06
fatcat:d2bt6p7fjfbedgasrqh4w6t3ea
How Could a Flash Cache Degrade Database Performance Rather Than Improve It? Lessons to be Learnt from Multi-Tiered Storage
2014
USENIX Symposium on Operating Systems Design and Implementation
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
We believe that some lessons learnt from multi-tiered storage systems can be applied to flash cache management. ...
Multi-tiered storage systems migrate data based on long-term I/O monitoring, carefully ensuring that the background data migration does not adversely affect foreground I/O performance. ...
We apply the lessons learned from the data migration process of multi-tiered storage systems to flash cache population. ...
dblp:conf/osdi/KimKISMDC14
fatcat:t3vr433ymrdk5msnnf3cnhmxju
Prefetch throttling and data pinning for improving performance of shared caches
2008
2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
We show that these two schemes can be applied in isolation or combined together, and they can be applied at a coarse or fine granularity. ...
data pinning schemes to improve performance of I/O prefetching. ...
ACKNOWLEDGMENT We would like to thank our shepherd, Xiaosong Ma, for her useful feedback, and the anonymous reviewers for their insightful comments. ...
doi:10.1109/sc.2008.5213128
dblp:conf/sc/OzturkSKK08
fatcat:clyktl2e2zadxprz3ux4el55oy
On caching and prefetching of virtual objects in distributed virtual environments
1998
Proceedings of the sixth ACM international conference on Multimedia - MULTIMEDIA '98
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2003; you can also visit the original URL.
The file type is application/pdf.
Prefetching object mod~by predicting those which~e &dy to be used in the near fnture and dotioading them in advance wiU lead to a Mar improvement. Third, the bt.ernet often tiers from disconnection. ...
The caching mechanism is further complemented with severs object prefetching m echanLms for predicting future acc~ed objects. ...
There are mmy eye tracking systems a~dable for detecting he of sight 120]. ...
doi:10.1145/290747.290769
dblp:conf/mm/ChimGLLS98
fatcat:2ygmvrbv35fivoei5agietndoi
« Previous
Showing results 1 — 15 out of 544 results