report work
This commit is contained in:
parent
53ce702157
commit
cd33279754
3 changed files with 22 additions and 9 deletions
Binary file not shown.
|
@ -618,7 +618,19 @@ traces.
|
||||||
|
|
||||||
This section aims to use some of the tecniques used in section IV of
|
This section aims to use some of the tecniques used in section IV of
|
||||||
the Ros\'a et al.\ paper\cite{dsn-paper} to find patterns and interpendencies
|
the Ros\'a et al.\ paper\cite{dsn-paper} to find patterns and interpendencies
|
||||||
between task and job events by gathering event statistics at those events.
|
between task and job events by gathering event statistics at those events. In
|
||||||
|
particular, Section~\ref{tabIII-section} explores how tasks of the success of a
|
||||||
|
task is inter-correlated with its own event patterns, which
|
||||||
|
Section~\ref{figV-section} explores even further by computing task success
|
||||||
|
probabilities based on the number of task termination events of a specific type.
|
||||||
|
Finally, Section~\ref{tabIV-section} aims to find similar correlations, but at
|
||||||
|
the job level.
|
||||||
|
|
||||||
|
|
||||||
|
The results found the the 2019 traces seldomly show the same patterns in terms
|
||||||
|
of task events and job/task distributions, in particular highlighting again the
|
||||||
|
overall non-trivial impact of \texttt{KILL} events, no matter the task and job
|
||||||
|
termination type.
|
||||||
|
|
||||||
\subsection{Unsuccessful Task Event Patterns}\label{tabIII-section}
|
\subsection{Unsuccessful Task Event Patterns}\label{tabIII-section}
|
||||||
\input{figures/table_iii}
|
\input{figures/table_iii}
|
||||||
|
@ -659,7 +671,7 @@ cluster, albeit with event count averages having different magnitudes. Notably,
|
||||||
cluster E registers the highest per-event average, with \texttt{FAIL}ed tasks
|
cluster E registers the highest per-event average, with \texttt{FAIL}ed tasks
|
||||||
experiencing 111.471 \texttt{FAIL} events out of \texttt{112.384}.
|
experiencing 111.471 \texttt{FAIL} events out of \texttt{112.384}.
|
||||||
|
|
||||||
\subsection{Conditional Probability of Task Success}
|
\subsection{Conditional Probability of Task Success}\label{figV-section}
|
||||||
\input{figures/figure_5}
|
\input{figures/figure_5}
|
||||||
|
|
||||||
In this analysis we measure the conditional probability of task success given a
|
In this analysis we measure the conditional probability of task success given a
|
||||||
|
@ -699,11 +711,11 @@ show very oscillating probability distribution function curves for
|
||||||
\texttt{EVICT} and \texttt{FINISH} curves. \texttt{KILL} behaviour is instead
|
\texttt{EVICT} and \texttt{FINISH} curves. \texttt{KILL} behaviour is instead
|
||||||
homogeneous even on a single cluster basis.
|
homogeneous even on a single cluster basis.
|
||||||
|
|
||||||
\subsection{Unsuccessful Job Event Patterns}
|
\subsection{Unsuccessful Job Event Patterns}\label{tabIV-section}
|
||||||
\input{figures/table_iv}
|
\input{figures/table_iv}
|
||||||
|
|
||||||
This analysis uses very similar techniques to the ones used in
|
This analysis uses very similar techniques to the ones used in
|
||||||
section~\ref{tabIII-section}, but focusing at the job level instead. The aim is
|
Section~\ref{tabIII-section}, but focusing at the job level instead. The aim is
|
||||||
to better understand the task-job level relationship and to understand how
|
to better understand the task-job level relationship and to understand how
|
||||||
task-level termination events can influence the termination state of a job.
|
task-level termination events can influence the termination state of a job.
|
||||||
|
|
||||||
|
@ -713,10 +725,10 @@ breakdown of the same data for the 2019 traces is shown in
|
||||||
figure~\ref{fig:tableIV-csts}.
|
figure~\ref{fig:tableIV-csts}.
|
||||||
|
|
||||||
Considering the distribution of number of tasks in a job, the 2019 traces show a
|
Considering the distribution of number of tasks in a job, the 2019 traces show a
|
||||||
decrease for the mean figure (e.g. for \texttt{FAIL}ed jobs, with a mean 60.5
|
decrease for the mean figure (e.g.\ for \texttt{FAIL}ed jobs, with a mean 60.5
|
||||||
tasks per job in 2011 and a mean 43.126 tasks per job in 2019) and a fluctuation
|
tasks per job in 2011 and a mean 43.126 tasks per job in 2019) and a fluctuation
|
||||||
of the 95-th percentile figure (e.g. for \texttt{FAIL}ed jobs it rose from 110
|
of the 95-th percentile figure (e.g.\ for \texttt{FAIL}ed jobs it rose from 110
|
||||||
to 200, but for \texttt{KILL}ed job the figure decreased from 400 to 178).
|
to 200, but for \texttt{KILL}ed job the figure decreased from 400 to 178).
|
||||||
|
|
||||||
Considering the distribution of the number of task-wise termination events
|
Considering the distribution of the number of task-wise termination events
|
||||||
instead, the 2019 traces show values generally one or two orders of magnitude
|
instead, the 2019 traces show values generally one or two orders of magnitude
|
||||||
|
@ -735,6 +747,7 @@ percentiles overall. Event-wise, for \texttt{EVICT}ed, \texttt{FINISH}ed,
|
||||||
and \texttt{KILL}ed jobs again the distributions are similar to the aggregated
|
and \texttt{KILL}ed jobs again the distributions are similar to the aggregated
|
||||||
one. For some clusters (namely B, C, and D), the mean number of \texttt{FAIL} and
|
one. For some clusters (namely B, C, and D), the mean number of \texttt{FAIL} and
|
||||||
\texttt{KILL} task events for \texttt{FINISH}ed jobs is almost the same.
|
\texttt{KILL} task events for \texttt{FINISH}ed jobs is almost the same.
|
||||||
|
Additionally, it is noteworthy that cluster A has no \texttt{EVICT}ed jobs.
|
||||||
|
|
||||||
\section{Analysis: Potential Causes of Unsuccessful Executions}
|
\section{Analysis: Potential Causes of Unsuccessful Executions}
|
||||||
|
|
||||||
|
|
|
@ -31,7 +31,7 @@ FINISH & 3.074 (2) & 0.005 & 0.153 & 1.778 & 0.014 \\
|
||||||
\caption{Mean number of tasks and event distribution per job type for between
|
\caption{Mean number of tasks and event distribution per job type for between
|
||||||
2011 and 2019 (all clusters aggregated) traces. The tables show and
|
2011 and 2019 (all clusters aggregated) traces. The tables show and
|
||||||
mean and 95-th percentile for the number of tasks in a job, and
|
mean and 95-th percentile for the number of tasks in a job, and
|
||||||
additionally show the mean of job-wise total of task termination events.}
|
additionally show the mean of job-wise total of task termination events.}\label{fig:tableIV}
|
||||||
\end{figure}
|
\end{figure}
|
||||||
|
|
||||||
\begin{figure}[p]
|
\begin{figure}[p]
|
||||||
|
@ -86,7 +86,7 @@ FINISH & 4.278 (14) & 0.005 & 0.153 & 1.778 & 0.014 \\
|
||||||
\caption{Mean number of tasks and event distribution per job type for each
|
\caption{Mean number of tasks and event distribution per job type for each
|
||||||
cluster in the 2019 traces. The tables show and
|
cluster in the 2019 traces. The tables show and
|
||||||
mean and 95-th percentile for the number of tasks in a job, and
|
mean and 95-th percentile for the number of tasks in a job, and
|
||||||
additionally show the mean of job-wise total of task termination events.}
|
additionally show the mean of job-wise total of task termination events.}\label{fig:tableIV-csts}
|
||||||
\end{figure}
|
\end{figure}
|
||||||
|
|
||||||
|
|
||||||
|
|
Loading…
Reference in a new issue