Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/31362
Title: | From Conditional Independence to Parallel Execution in Hierarchical Models | Authors: | NEMETH, Balazs HABER, Tom LIESENBORGS, Jori LAMOTTE, Wim |
Issue Date: | 2020 | Source: | Computational Science – ICCS 2020, p. 161 -174 | Series/Report: | Lecture Notes in Computer Science | Series/Report no.: | 12137 | Abstract: | Hierarchical models describe phenomena by grouping data into multiple levels. Due to the size of these models, parallel execution is required to avoid prohibitively long computing time. While it is occasionally possible to specify some of these models using parallel building blocks, this limits expressivity. Therefore, a more general generative specification is preferred. To leverage parallel computing capacity, these specifications can be annotated, but doing so effectively assumes that the modeler has expertise from computer science. This paper outlines how to identify parallel parts automatically by leveraging the conditional independence property in the graphical model extracted from the dataflow graph of model specifications. Computation related to random variables with the same depth in the graphical model are identified as candidates for parallel execution. Since subsequent proposals in the parameter space exploration of the model are clustered together, the results show that the well known longest processing time scheduling heuristic deals adequately with load imbalance. The proposed parallelization is evaluated on two pharmacometrics models, a domain where hierarchical models with load imbalance are common due to the numeric simulation of pharmacokinet-ics and pharmacodynamics of human subjects. The varying number of measurements taken per subject further exacerbates load imbalance. | Keywords: | High performance computing;Descriptive language;Probabilistic modelling;Automatic parallelization;Dataflow;Hierarchical models | Document URI: | http://hdl.handle.net/1942/31362 | ISBN: | 978-3-030-50370-3 978-3-030-50371-0 |
DOI: | 10.1007/978-3-030-50371-0_12 | Rights: | Springer Nature Switzerland AG 2020 | Category: | C1 | Type: | Proceedings Paper | Validations: | vabb 2022 |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Nemeth2020_Chapter_FromConditionalIndependenceToP.pdf Restricted Access | Published version | 397.61 kB | Adobe PDF | View/Open Request a copy |
WEB OF SCIENCETM
Citations
1
checked on Oct 7, 2024
Page view(s)
52
checked on Sep 7, 2022
Download(s)
38
checked on Sep 7, 2022
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.