We propose and develop PETS, a new method that allows the tuning of associated parameters at the same time, using resource bottleneck awareness to adjust ...

Abstract—Spark tuning with its dozens of parameters for performance improvement is both a challenge and time con- suming effort. Current techniques rely on ...

Perez et al. [16] leveraged fuzzy logic for tuning 12 parameters of Spark. In [9], the authors used a search-based optimization technique that exploits ...

Bibliographic details on PETS: Bottleneck-Aware Spark Tuning with Parameter Ensembles.

This work presents a more elaborate solution in the form of self-adaptive executors which are able to continuously monitor the underlying system resources ...

PETS: Bottleneck-Aware Spark Tuning with Parameter Ensembles. TBG Perez, W ... Leveraging Spark Performance with Bottleneck-Aware Tuning, Caching and Scheduling.

“PETS: Bottleneck-Aware Spark Tuning with Parameter Ensembles.” Proc. Of the 27th International Conference on Computer Communication and Networks (ICCCN) ...

PETS: Bottleneck-Aware Spark Tuning with Parameter Ensembles. ICCCN 2018: 1-9. [+][–]. Coauthor network. maximize. Note that this feature is a work in progress ...

Panagiotis [8] proposes to tune a large number of Spark parameters using trial and error rule base created with few measurements. Their focus has been more on ...

Dependency-aware network adaptive scheduling of data-intensive parallel jobs. S ... Pets: Bottleneck-aware spark tuning with parameter ensembles. TBG Perez, W ...