maggicl/bachelorThesis
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

report work

Browse source
This commit is contained in:
Claudio Maggioni 2021-06-10 14:34:44 +02:00
parent 53ce702157
commit cd33279754
3 changed files with 22 additions and 9 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

BIN
report/Claudio_Maggioni_report.pdf
View file

Binary file not shown.

27
report/Claudio_Maggioni_report.tex
View file

@ -618,7 +618,19 @@ traces.
This section aims to use some of the tecniques used in section IV of
the Ros\'a et al.\ paper\cite{dsn-paper} to find patterns and interpendencies
between task and job events by gathering event statistics at those events.
between task and job events by gathering event statistics at those events. In
particular, Section~\ref{tabIII-section} explores how tasks of the success of a
task is inter-correlated with its own event patterns, which
Section~\ref{figV-section} explores even further by computing task success
probabilities based on the number of task termination events of a specific type.
Finally, Section~\ref{tabIV-section} aims to find similar correlations, but at
the job level.
The results found the the 2019 traces seldomly show the same patterns in terms
of task events and job/task distributions, in particular highlighting again the
overall non-trivial impact of \texttt{KILL} events, no matter the task and job
termination type.
\subsection{Unsuccessful Task Event Patterns}\label{tabIII-section}
\input{figures/table_iii}
@ -659,7 +671,7 @@ cluster, albeit with event count averages having different magnitudes. Notably,
cluster E registers the highest per-event average, with \texttt{FAIL}ed tasks
experiencing 111.471 \texttt{FAIL} events out of \texttt{112.384}.
\subsection{Conditional Probability of Task Success}
\subsection{Conditional Probability of Task Success}\label{figV-section}
\input{figures/figure_5}
In this analysis we measure the conditional probability of task success given a
@ -699,11 +711,11 @@ show very oscillating probability distribution function curves for
\texttt{EVICT} and \texttt{FINISH} curves. \texttt{KILL} behaviour is instead
homogeneous even on a single cluster basis.
\subsection{Unsuccessful Job Event Patterns}
\subsection{Unsuccessful Job Event Patterns}\label{tabIV-section}
\input{figures/table_iv}
This analysis uses very similar techniques to the ones used in
section~\ref{tabIII-section}, but focusing at the job level instead. The aim is
Section~\ref{tabIII-section}, but focusing at the job level instead. The aim is
to better understand the task-job level relationship and to understand how
task-level termination events can influence the termination state of a job.
@ -713,10 +725,10 @@ breakdown of the same data for the 2019 traces is shown in
figure~\ref{fig:tableIV-csts}.
Considering the distribution of number of tasks in a job, the 2019 traces show a
decrease for the mean figure (e.g. for \texttt{FAIL}ed jobs, with a mean 60.5
decrease for the mean figure (e.g.\ for \texttt{FAIL}ed jobs, with a mean 60.5
tasks per job in 2011 and a mean 43.126 tasks per job in 2019) and a fluctuation
of the 95-th percentile figure (e.g. for \texttt{FAIL}ed jobs it rose from 110
to 200, but for \texttt{KILL}ed job the figure decreased from 400 to 178).
of the 95-th percentile figure (e.g.\ for \texttt{FAIL}ed jobs it rose from 110
to 200, but for \texttt{KILL}ed job the figure decreased from 400 to 178).
Considering the distribution of the number of task-wise termination events
instead, the 2019 traces show values generally one or two orders of magnitude
@ -735,6 +747,7 @@ percentiles overall. Event-wise, for \texttt{EVICT}ed, \texttt{FINISH}ed,
and \texttt{KILL}ed jobs again the distributions are similar to the aggregated
one. For some clusters (namely B, C, and D), the mean number of \texttt{FAIL} and
\texttt{KILL} task events for \texttt{FINISH}ed jobs is almost the same.
Additionally, it is noteworthy that cluster A has no \texttt{EVICT}ed jobs.
\section{Analysis: Potential Causes of Unsuccessful Executions}

4
report/figures/table_iv.tex
View file

@ -31,7 +31,7 @@ FINISH & 3.074 (2) & 0.005 & 0.153 & 1.778 & 0.014 \\
\caption{Mean number of tasks and event distribution per job type for between
2011 and 2019 (all clusters aggregated) traces. The tables show and
mean and 95-th percentile for the number of tasks in a job, and
additionally show the mean of job-wise total of task termination events.}
additionally show the mean of job-wise total of task termination events.}\label{fig:tableIV}
\end{figure}
\begin{figure}[p]
@ -86,7 +86,7 @@ FINISH & 4.278 (14) & 0.005 & 0.153 & 1.778 & 0.014 \\
\caption{Mean number of tasks and event distribution per job type for each
cluster in the 2019 traces. The tables show and
mean and 95-th percentile for the number of tasks in a job, and
additionally show the mean of job-wise total of task termination events.}
additionally show the mean of job-wise total of task termination events.}\label{fig:tableIV-csts}
\end{figure}