diff --git a/report/Claudio_Maggioni_report.pdf b/report/Claudio_Maggioni_report.pdf index c2a05749..cb529fc0 100644 Binary files a/report/Claudio_Maggioni_report.pdf and b/report/Claudio_Maggioni_report.pdf differ diff --git a/report/Claudio_Maggioni_report.tex b/report/Claudio_Maggioni_report.tex index 3386baec..91b99344 100644 --- a/report/Claudio_Maggioni_report.tex +++ b/report/Claudio_Maggioni_report.tex @@ -618,7 +618,19 @@ traces. This section aims to use some of the tecniques used in section IV of the Ros\'a et al.\ paper\cite{dsn-paper} to find patterns and interpendencies -between task and job events by gathering event statistics at those events. +between task and job events by gathering event statistics at those events. In +particular, Section~\ref{tabIII-section} explores how tasks of the success of a +task is inter-correlated with its own event patterns, which +Section~\ref{figV-section} explores even further by computing task success +probabilities based on the number of task termination events of a specific type. +Finally, Section~\ref{tabIV-section} aims to find similar correlations, but at +the job level. + + +The results found the the 2019 traces seldomly show the same patterns in terms +of task events and job/task distributions, in particular highlighting again the +overall non-trivial impact of \texttt{KILL} events, no matter the task and job +termination type. \subsection{Unsuccessful Task Event Patterns}\label{tabIII-section} \input{figures/table_iii} @@ -659,7 +671,7 @@ cluster, albeit with event count averages having different magnitudes. Notably, cluster E registers the highest per-event average, with \texttt{FAIL}ed tasks experiencing 111.471 \texttt{FAIL} events out of \texttt{112.384}. -\subsection{Conditional Probability of Task Success} +\subsection{Conditional Probability of Task Success}\label{figV-section} \input{figures/figure_5} In this analysis we measure the conditional probability of task success given a @@ -699,11 +711,11 @@ show very oscillating probability distribution function curves for \texttt{EVICT} and \texttt{FINISH} curves. \texttt{KILL} behaviour is instead homogeneous even on a single cluster basis. -\subsection{Unsuccessful Job Event Patterns} +\subsection{Unsuccessful Job Event Patterns}\label{tabIV-section} \input{figures/table_iv} This analysis uses very similar techniques to the ones used in -section~\ref{tabIII-section}, but focusing at the job level instead. The aim is +Section~\ref{tabIII-section}, but focusing at the job level instead. The aim is to better understand the task-job level relationship and to understand how task-level termination events can influence the termination state of a job. @@ -713,10 +725,10 @@ breakdown of the same data for the 2019 traces is shown in figure~\ref{fig:tableIV-csts}. Considering the distribution of number of tasks in a job, the 2019 traces show a -decrease for the mean figure (e.g. for \texttt{FAIL}ed jobs, with a mean 60.5 +decrease for the mean figure (e.g.\ for \texttt{FAIL}ed jobs, with a mean 60.5 tasks per job in 2011 and a mean 43.126 tasks per job in 2019) and a fluctuation - of the 95-th percentile figure (e.g. for \texttt{FAIL}ed jobs it rose from 110 - to 200, but for \texttt{KILL}ed job the figure decreased from 400 to 178). +of the 95-th percentile figure (e.g.\ for \texttt{FAIL}ed jobs it rose from 110 +to 200, but for \texttt{KILL}ed job the figure decreased from 400 to 178). Considering the distribution of the number of task-wise termination events instead, the 2019 traces show values generally one or two orders of magnitude @@ -735,6 +747,7 @@ percentiles overall. Event-wise, for \texttt{EVICT}ed, \texttt{FINISH}ed, and \texttt{KILL}ed jobs again the distributions are similar to the aggregated one. For some clusters (namely B, C, and D), the mean number of \texttt{FAIL} and \texttt{KILL} task events for \texttt{FINISH}ed jobs is almost the same. +Additionally, it is noteworthy that cluster A has no \texttt{EVICT}ed jobs. \section{Analysis: Potential Causes of Unsuccessful Executions} diff --git a/report/figures/table_iv.tex b/report/figures/table_iv.tex index 4f6669c8..9ca277da 100644 --- a/report/figures/table_iv.tex +++ b/report/figures/table_iv.tex @@ -31,7 +31,7 @@ FINISH & 3.074 (2) & 0.005 & 0.153 & 1.778 & 0.014 \\ \caption{Mean number of tasks and event distribution per job type for between 2011 and 2019 (all clusters aggregated) traces. The tables show and mean and 95-th percentile for the number of tasks in a job, and - additionally show the mean of job-wise total of task termination events.} + additionally show the mean of job-wise total of task termination events.}\label{fig:tableIV} \end{figure} \begin{figure}[p] @@ -86,7 +86,7 @@ FINISH & 4.278 (14) & 0.005 & 0.153 & 1.778 & 0.014 \\ \caption{Mean number of tasks and event distribution per job type for each cluster in the 2019 traces. The tables show and mean and 95-th percentile for the number of tasks in a job, and - additionally show the mean of job-wise total of task termination events.} + additionally show the mean of job-wise total of task termination events.}\label{fig:tableIV-csts} \end{figure}