diff --git a/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 1_00000000.jpeg b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 1_00000000.jpeg new file mode 100644 index 0000000..1526c1a Binary files /dev/null and b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 1_00000000.jpeg differ diff --git a/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 2_00000000.jpeg b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 2_00000000.jpeg new file mode 100644 index 0000000..0ab0424 Binary files /dev/null and b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 2_00000000.jpeg differ diff --git a/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 3_00000000.jpeg b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 3_00000000.jpeg new file mode 100644 index 0000000..c292093 Binary files /dev/null and b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 3_00000000.jpeg differ diff --git a/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 4_00000000.jpeg b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 4_00000000.jpeg new file mode 100644 index 0000000..cda3a4b Binary files /dev/null and b/Reports/Thesis/images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 4_00000000.jpeg differ diff --git a/Reports/Thesis/sections/results.tex b/Reports/Thesis/sections/results.tex index 630256c..4ad407f 100644 --- a/Reports/Thesis/sections/results.tex +++ b/Reports/Thesis/sections/results.tex @@ -47,14 +47,4 @@ A lot of data is available but only the most relevant data needs to be used. Exp \input{sections/results/gru} - -\newpage -\subsection{Diffusion} -% TODO: needed to explain again? -Another type of model that can be used to generatively model the NRV is the diffusion model. This type of model is very popular for image generation. In the context of images, the diffusion model is trained by iteratively adding noise to a training image until there is only noise left. From this noise, the model tries to reverse the diffusion process to get the original image back. To sample new images using this model, a noise vector is sampled and iteratively denoised by the model. This process results in a new image. - -This training process can also be used for other data types. An image is just a 2D grid of data points. A time series can be seen as a 1D sequence of data points. The diffusion model can thus be trained on the NRV data to generate new samples for a certain day based on a given input. - -Once the diffusion model is trained, it can be used efficiently to generate new samples. The model can generate samples in parallel, which is not possible with autoregressive models. It combines the parallel sample generation of the non-autoregressive models while the quarter NRV values still depend on each other. A batch of noise vectors can be sampled and passed through the model in one batch to generate the new samples. The generated samples contain the 96 NRV values for the next day without needing to sample every quarter sequentially. - -TODO: Visualization of the diffusion model in the context of the NRV data. +\input{sections/results/diffusion} diff --git a/Reports/Thesis/sections/results/diffusion.tex b/Reports/Thesis/sections/results/diffusion.tex new file mode 100644 index 0000000..080c667 --- /dev/null +++ b/Reports/Thesis/sections/results/diffusion.tex @@ -0,0 +1,42 @@ +\subsection{Diffusion} +Another type of model that can be used to generatively model the NRV is the diffusion model. This type of model is very popular for image generation. In the context of images, the diffusion model is trained by iteratively adding noise to a training image until there is only noise left. From this noise, the model tries to reverse the diffusion process to get the original image back. To sample new images using this model, a noise vector is sampled and iteratively denoised by the model. This process results in a new image. + +This training process can also be used for other data types. An image is just a 2D grid of data points. A time series can be seen as a 1D sequence of data points. The diffusion model can thus be trained on the NRV data to generate new samples for a certain day based on a given input. + +Once the diffusion model is trained, it can be used efficiently to generate new samples. The model can generate samples in parallel, which is not possible with autoregressive models. It combines the parallel sample generation of the non-autoregressive models while the quarter NRV values still depend on each other. A batch of noise vectors can be sampled and passed through the model in one batch to generate the new samples. The generated samples contain the 96 NRV values for the next day without needing to sample every quarter sequentially. + +The model is trained in a completely different way than the quantile regression models. A simple implementation of the Denoising Diffusion Probabilistic Model (DDPM) is used to perform the experiments. More complex implementations with more advanced techniques could be used to improve the results. This is out of the scope of this thesis. The goal is to show that more recent generative models can also be used to model the NRV data. These results can then be compared to the quantile regression models to see if the diffusion model can generate better samples. + +% TODO: In background information? +First of all, the model architecture needs to be chosen. The model takes multiple inputs which include the noisy NRV time series, the positional encoding of the current denoising step and the conditional input features. The model needs to predict the noise in the current time series. The time series can then be denoised by subtracting the predicted noise in every denoising step. Multiple model architectures can be used as long as the model can predict the noise in the time series. A simple feedforward neural network is used. The neural network exists of multiple linear layers with ReLu activation functions. To predict the noise in a noisy time series, the current denoising step index must also be provided. This integer is then transformed into a vector using sine and cosine functions. The positional encoding is then concatenated with the noisy time series and the conditional input features. This tensor is then passed through the first linear layer and activation function of the neural network. This results in a tensor of the hidden size that was chosen. Before passing this tensor to the next layer, the positional encoding and conditional input features are concatenated again. This process is repeated until the last layer is reached. This provides every layer in the neural network with the necessary information to predict the noise in the time series. The output of the last layer is then the predicted noise in the time series. The model is trained by minimizing the mean squared error between the predicted noise and the real noise in the time series. + +Other hyperparameters that need to be chosen are the number of denoising steps, number of layers and hidden size of the neural network. Experiments are performed to get an insight into the influence these parameters have on the model performance. Results are shown in Table \ref{tab:diffusion_results}. + +\begin{figure}[h] + \centering + \begin{tikzpicture} + % First row + % Node for Image 1 + \node (img1) {\includegraphics[width=0.45\textwidth]{images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 1_00000000.jpeg}}; + % Node for Image 2 with an arrow from Image 1 + \node[right=of img1] (img2) {\includegraphics[width=0.45\textwidth]{images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 2_00000000.jpeg}}; + \draw[-latex] (img1) -- (img2); + + % Second row + % Node for Image 3 below Image 1 with an arrow from Image 2 + \node[below=of img1] (img3) {\includegraphics[width=0.45\textwidth]{images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 3_00000000.jpeg}}; + % Node for Image 4 with an arrow from Image 3 + \node[right=of img3] (img4) {\includegraphics[width=0.45\textwidth]{images/diffusion/results/intermediates/Testing Intermediates 864_Sample intermediate 4_00000000.jpeg}}; + \draw[-latex] (img3) -- (img4); + + % Complex arrow from Image 2 to Image 3 + % Calculate midpoint for the horizontal segment + \coordinate (Middle) at ($(img2.south)!0.5!(img3.north)$); + \draw[-latex] (img2.south) |- (Middle) -| (img3.north); + \end{tikzpicture} + \caption{Intermediate steps of the diffusion model for example 864 from the test set. The confidence intervals shown in the plots are made using 100 samples.} + \label{fig:diffusion_intermediates} +\end{figure} + +In Figure \ref{fig:diffusion_intermediates}, multiple intermediate steps of the denoising process are shown as an example from the test set. The model starts with noisy full-day NRV samples which can be seen in the first steps. These noisy samples are then denoised in multiple steps until realistic samples are generated. This can be seen in the last image in the figure. It can be observed that the confidence intervals get more narrow over time as the noise is removed from the samples. + diff --git a/Reports/Thesis/verslag 2.synctex.gz b/Reports/Thesis/verslag 2.synctex.gz new file mode 100644 index 0000000..f4f8553 Binary files /dev/null and b/Reports/Thesis/verslag 2.synctex.gz differ diff --git a/Reports/Thesis/verslag.aux b/Reports/Thesis/verslag.aux index 63cf146..d4a71c6 100644 --- a/Reports/Thesis/verslag.aux +++ b/Reports/Thesis/verslag.aux @@ -59,38 +59,4 @@ \newlabel{fig:linear_model_sample_comparison}{{7}{26}{Comparison of the autoregressive and non-autoregressive linear model samples.\relax }{figure.caption.12}{}} \@writefile{lof}{\contentsline {figure}{\numberline {8}{\ignorespaces Samples for two examples from the test set for the autoregressive and non-autoregressive linear model. The real NRV is shown in orange.\relax }}{27}{figure.caption.13}\protected@file@percent } \newlabel{fig:linear_model_samples_comparison}{{8}{27}{Samples for two examples from the test set for the autoregressive and non-autoregressive linear model. The real NRV is shown in orange.\relax }{figure.caption.13}{}} -\@writefile{lof}{\contentsline {figure}{\numberline {9}{\ignorespaces Over/underestimation of the quantiles for the autoregressive and non-autoregressive linear models. Both the quantile performance for the training and test set are shown. The plots are generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding (only for the autoregressive model).\relax }}{28}{figure.caption.14}\protected@file@percent } -\newlabel{fig:linear_model_quantile_over_underestimation}{{9}{28}{Over/underestimation of the quantiles for the autoregressive and non-autoregressive linear models. Both the quantile performance for the training and test set are shown. The plots are generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding (only for the autoregressive model).\relax }{figure.caption.14}{}} -\@writefile{toc}{\contentsline {subsubsection}{\numberline {6.2.2}Non-Linear Model}{29}{subsubsection.6.2.2}\protected@file@percent } -\@writefile{lot}{\contentsline {table}{\numberline {5}{\ignorespaces Non-linear Quantile Regression Model Architecture\relax }}{29}{table.caption.15}\protected@file@percent } -\newlabel{tab:non_linear_model_architecture}{{5}{29}{Non-linear Quantile Regression Model Architecture\relax }{table.caption.15}{}} -\@writefile{lot}{\contentsline {table}{\numberline {6}{\ignorespaces Non-linear quantile regression model results. All the models used a dropout of 0.2 .\relax }}{30}{table.caption.16}\protected@file@percent } -\newlabel{tab:non_linear_model_results}{{6}{30}{Non-linear quantile regression model results. All the models used a dropout of 0.2 .\relax }{table.caption.16}{}} -\@writefile{lof}{\contentsline {figure}{\numberline {10}{\ignorespaces Comparison of the autoregressive and non-autoregressive non-linear model examples.\relax }}{31}{figure.caption.17}\protected@file@percent } -\newlabel{fig:non_linear_model_examples}{{10}{31}{Comparison of the autoregressive and non-autoregressive non-linear model examples.\relax }{figure.caption.17}{}} -\@writefile{lof}{\contentsline {figure}{\numberline {11}{\ignorespaces Over/underestimation of the quantiles for the autoregressive and non-autoregressive non-linear models. Both the quantile performance for the training and test set are shown. The plots are generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding (only for the autoregressive model).\relax }}{32}{figure.caption.18}\protected@file@percent } -\newlabel{fig:non-linear_model_quantile_over_underestimation}{{11}{32}{Over/underestimation of the quantiles for the autoregressive and non-autoregressive non-linear models. Both the quantile performance for the training and test set are shown. The plots are generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding (only for the autoregressive model).\relax }{figure.caption.18}{}} -\@writefile{toc}{\contentsline {subsubsection}{\numberline {6.2.3}GRU Model}{32}{subsubsection.6.2.3}\protected@file@percent } -\@writefile{lot}{\contentsline {table}{\numberline {7}{\ignorespaces GRU Model Architecture\relax }}{33}{table.caption.19}\protected@file@percent } -\newlabel{tab:gru_model_architecture}{{7}{33}{GRU Model Architecture\relax }{table.caption.19}{}} -\@writefile{lot}{\contentsline {table}{\numberline {8}{\ignorespaces Autoregressive GRU quantile regression model results. All the models used a dropout of 0.2 .\relax }}{34}{table.caption.20}\protected@file@percent } -\newlabel{tab:autoregressive_gru_model_results}{{8}{34}{Autoregressive GRU quantile regression model results. All the models used a dropout of 0.2 .\relax }{table.caption.20}{}} -\@writefile{lof}{\contentsline {figure}{\numberline {12}{\ignorespaces Comparison of the autoregressive and non-autoregressive GRU model examples.\relax }}{35}{figure.caption.21}\protected@file@percent } -\newlabel{fig:gru_model_sample_comparison}{{12}{35}{Comparison of the autoregressive and non-autoregressive GRU model examples.\relax }{figure.caption.21}{}} -\@writefile{lof}{\contentsline {figure}{\numberline {13}{\ignorespaces Over/underestimation of the quantiles for the autoregressive and non-autoregressive GRU models. Both the quantile performance for the training and test set are shown. The plots are generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding (only for the autoregressive model).\relax }}{36}{figure.caption.22}\protected@file@percent } -\newlabel{fig:gru_model_quantile_over_underestimation}{{13}{36}{Over/underestimation of the quantiles for the autoregressive and non-autoregressive GRU models. Both the quantile performance for the training and test set are shown. The plots are generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding (only for the autoregressive model).\relax }{figure.caption.22}{}} -\@writefile{toc}{\contentsline {subsection}{\numberline {6.3}Diffusion}{37}{subsection.6.3}\protected@file@percent } -\@writefile{toc}{\contentsline {section}{\numberline {7}Policies for battery optimization}{37}{section.7}\protected@file@percent } -\@writefile{toc}{\contentsline {subsection}{\numberline {7.1}Baselines}{37}{subsection.7.1}\protected@file@percent } -\@writefile{toc}{\contentsline {subsection}{\numberline {7.2}Policies using NRV predictions}{37}{subsection.7.2}\protected@file@percent } -\abx@aux@page{6}{38} -\abx@aux@page{7}{38} -\abx@aux@page{8}{38} -\abx@aux@page{9}{38} -\abx@aux@read@bbl@mdfivesum{5DC935CC8C8FAB8A3CAF97A486ED2386} -\abx@aux@read@bblrerun -\abx@aux@defaultrefcontext{0}{dumas_deep_2022}{nyt/global//global/global} -\abx@aux@defaultrefcontext{0}{lu_scenarios_2022}{nyt/global//global/global} -\abx@aux@defaultrefcontext{0}{poggi_electricity_2023}{nyt/global//global/global} -\abx@aux@defaultrefcontext{0}{weron_electricity_2014}{nyt/global//global/global} -\gdef \@abspage@last{39} +\@writefile{lof}{\contentsline {figure}{\numberline {9}{\ignorespaces Over/unde \ No newline at end of file diff --git a/Reports/Thesis/verslag.bcf b/Reports/Thesis/verslag.bcf index d5d38dd..f32af90 100644 --- a/Reports/Thesis/verslag.bcf +++ b/Reports/Thesis/verslag.bcf @@ -2818,70 +2818,4 @@ article report - author - title - - - - - - - ./references.bib - - - weron_electricity_2014 - poggi_electricity_2023 - lu_scenarios_2022 - dumas_deep_2022 - rasul_autoregressive_2021 - dumas_deep_2022 - - - - - presort - - - sortkey - - - sortname - author - editor - translator - sorttitle - title - - - sortyear - year - - - sorttitle - title - - - volume - 0 - - - - - - - - + \ No newline at end of file diff --git a/Reports/Thesis/verslag.log b/Reports/Thesis/verslag.log index cdf8736..b1a8014 100644 --- a/Reports/Thesis/verslag.log +++ b/Reports/Thesis/verslag.log @@ -1,4 +1,4 @@ -This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) (preloaded format=pdflatex 2023.9.17) 7 MAY 2024 00:43 +This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) (preloaded format=pdflatex 2023.9.17) 8 MAY 2024 17:50 entering extended mode restricted \write18 enabled. file:line:error style messages enabled. @@ -443,14 +443,195 @@ Package: varwidth 2009/03/30 ver 0.92; Variable-width minipages \sift@deathcycles=\count294 \@vwid@loff=\dimen273 \@vwid@roff=\dimen274 -)) (/usr/local/texlive/2023/texmf-dist/tex/generic/babel/babel.sty +)) (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/frontendlayer/tikz.sty (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/basiclayer/pgf.sty (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/utilities/pgfrcs.sty (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgfutil-common.tex +\pgfutil@everybye=\toks36 +\pgfutil@tempdima=\dimen275 +\pgfutil@tempdimb=\dimen276 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgfutil-latex.def +\pgfutil@abb=\box62 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgfrcs.code.tex (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/pgf.revision.tex) +Package: pgfrcs 2023-01-15 v3.1.10 (3.1.10) +)) +Package: pgf 2023-01-15 v3.1.10 (3.1.10) + (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/basiclayer/pgfcore.sty (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/systemlayer/pgfsys.sty (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/systemlayer/pgfsys.code.tex +Package: pgfsys 2023-01-15 v3.1.10 (3.1.10) + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgfkeys.code.tex +\pgfkeys@pathtoks=\toks37 +\pgfkeys@temptoks=\toks38 + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgfkeyslibraryfiltered.code.tex +\pgfkeys@tmptoks=\toks39 +)) +\pgf@x=\dimen277 +\pgf@y=\dimen278 +\pgf@xa=\dimen279 +\pgf@ya=\dimen280 +\pgf@xb=\dimen281 +\pgf@yb=\dimen282 +\pgf@xc=\dimen283 +\pgf@yc=\dimen284 +\pgf@xd=\dimen285 +\pgf@yd=\dimen286 +\w@pgf@writea=\write3 +\r@pgf@reada=\read3 +\c@pgf@counta=\count295 +\c@pgf@countb=\count296 +\c@pgf@countc=\count297 +\c@pgf@countd=\count298 +\t@pgf@toka=\toks40 +\t@pgf@tokb=\toks41 +\t@pgf@tokc=\toks42 +\pgf@sys@id@count=\count299 + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/systemlayer/pgf.cfg +File: pgf.cfg 2023-01-15 v3.1.10 (3.1.10) +) +Driver file for pgf: pgfsys-pdftex.def + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/systemlayer/pgfsys-pdftex.def +File: pgfsys-pdftex.def 2023-01-15 v3.1.10 (3.1.10) + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/systemlayer/pgfsys-common-pdf.def +File: pgfsys-common-pdf.def 2023-01-15 v3.1.10 (3.1.10) +))) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/systemlayer/pgfsyssoftpath.code.tex +File: pgfsyssoftpath.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgfsyssoftpath@smallbuffer@items=\count300 +\pgfsyssoftpath@bigbuffer@items=\count301 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/systemlayer/pgfsysprotocol.code.tex +File: pgfsysprotocol.code.tex 2023-01-15 v3.1.10 (3.1.10) +)) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcore.code.tex +Package: pgfcore 2023-01-15 v3.1.10 (3.1.10) + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmath.code.tex (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathutil.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathparser.code.tex +\pgfmath@dimen=\dimen287 +\pgfmath@count=\count302 +\pgfmath@box=\box63 +\pgfmath@toks=\toks43 +\pgfmath@stack@operand=\toks44 +\pgfmath@stack@operation=\toks45 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.basic.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.trigonometric.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.random.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.comparison.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.base.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.round.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.misc.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfunctions.integerarithmetics.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathcalc.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmathfloat.code.tex +\c@pgfmathroundto@lastzeros=\count303 +)) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfint.code.tex) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorepoints.code.tex +File: pgfcorepoints.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgf@picminx=\dimen288 +\pgf@picmaxx=\dimen289 +\pgf@picminy=\dimen290 +\pgf@picmaxy=\dimen291 +\pgf@pathminx=\dimen292 +\pgf@pathmaxx=\dimen293 +\pgf@pathminy=\dimen294 +\pgf@pathmaxy=\dimen295 +\pgf@xx=\dimen296 +\pgf@xy=\dimen297 +\pgf@yx=\dimen298 +\pgf@yy=\dimen299 +\pgf@zx=\dimen300 +\pgf@zy=\dimen301 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorepathconstruct.code.tex +File: pgfcorepathconstruct.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgf@path@lastx=\dimen302 +\pgf@path@lasty=\dimen303 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorepathusage.code.tex +File: pgfcorepathusage.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgf@shorten@end@additional=\dimen304 +\pgf@shorten@start@additional=\dimen305 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorescopes.code.tex +File: pgfcorescopes.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgfpic=\box64 +\pgf@hbox=\box65 +\pgf@layerbox@main=\box66 +\pgf@picture@serial@count=\count304 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoregraphicstate.code.tex +File: pgfcoregraphicstate.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgflinewidth=\dimen306 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoretransformations.code.tex +File: pgfcoretransformations.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgf@pt@x=\dimen307 +\pgf@pt@y=\dimen308 +\pgf@pt@temp=\dimen309 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorequick.code.tex +File: pgfcorequick.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoreobjects.code.tex +File: pgfcoreobjects.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorepathprocessing.code.tex +File: pgfcorepathprocessing.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorearrows.code.tex +File: pgfcorearrows.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgfarrowsep=\dimen310 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoreshade.code.tex +File: pgfcoreshade.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgf@max=\dimen311 +\pgf@sys@shading@range@num=\count305 +\pgf@shadingcount=\count306 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoreimage.code.tex +File: pgfcoreimage.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoreexternal.code.tex +File: pgfcoreexternal.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgfexternal@startupbox=\box67 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorelayers.code.tex +File: pgfcorelayers.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcoretransparency.code.tex +File: pgfcoretransparency.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorepatterns.code.tex +File: pgfcorepatterns.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/basiclayer/pgfcorerdf.code.tex +File: pgfcorerdf.code.tex 2023-01-15 v3.1.10 (3.1.10) +))) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/modules/pgfmoduleshapes.code.tex +File: pgfmoduleshapes.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgfnodeparttextbox=\box68 +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/modules/pgfmoduleplot.code.tex +File: pgfmoduleplot.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/compatibility/pgfcomp-version-0-65.sty +Package: pgfcomp-version-0-65 2023-01-15 v3.1.10 (3.1.10) +\pgf@nodesepstart=\dimen312 +\pgf@nodesepend=\dimen313 +) (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/compatibility/pgfcomp-version-1-18.sty +Package: pgfcomp-version-1-18 2023-01-15 v3.1.10 (3.1.10) +)) (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/utilities/pgffor.sty (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/utilities/pgfkeys.sty (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgfkeys.code.tex)) (/usr/local/texlive/2023/texmf-dist/tex/latex/pgf/math/pgfmath.sty (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/math/pgfmath.code.tex)) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/utilities/pgffor.code.tex +Package: pgffor 2023-01-15 v3.1.10 (3.1.10) +\pgffor@iter=\dimen314 +\pgffor@skip=\dimen315 +\pgffor@stack=\toks46 +\pgffor@toks=\toks47 +)) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/frontendlayer/tikz/tikz.code.tex +Package: tikz 2023-01-15 v3.1.10 (3.1.10) + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/libraries/pgflibraryplothandlers.code.tex +File: pgflibraryplothandlers.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgf@plot@mark@count=\count307 +\pgfplotmarksize=\dimen316 +) +\tikz@lastx=\dimen317 +\tikz@lasty=\dimen318 +\tikz@lastxsaved=\dimen319 +\tikz@lastysaved=\dimen320 +\tikz@lastmovetox=\dimen321 +\tikz@lastmovetoy=\dimen322 +\tikzleveldistance=\dimen323 +\tikzsiblingdistance=\dimen324 +\tikz@figbox=\box69 +\tikz@figbox@bg=\box70 +\tikz@tempbox=\box71 +\tikz@tempbox@bg=\box72 +\tikztreelevel=\count308 +\tikznumberofchildren=\count309 +\tikznumberofcurrentchild=\count310 +\tikz@fig@count=\count311 + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/modules/pgfmodulematrix.code.tex +File: pgfmodulematrix.code.tex 2023-01-15 v3.1.10 (3.1.10) +\pgfmatrixcurrentrow=\count312 +\pgfmatrixcurrentcolumn=\count313 +\pgf@matrix@numberofcolumns=\count314 +) +\tikz@expandcount=\count315 + (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/frontendlayer/tikz/libraries/tikzlibrarytopaths.code.tex +File: tikzlibrarytopaths.code.tex 2023-01-15 v3.1.10 (3.1.10) +))) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/frontendlayer/tikz/libraries/tikzlibrarypositioning.code.tex +File: tikzlibrarypositioning.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/pgf/frontendlayer/tikz/libraries/tikzlibrarycalc.code.tex +File: tikzlibrarycalc.code.tex 2023-01-15 v3.1.10 (3.1.10) +) (/usr/local/texlive/2023/texmf-dist/tex/generic/babel/babel.sty Package: babel 2023/02/13 3.86 The Babel package -\babel@savecnt=\count295 -\U@D=\dimen275 +\babel@savecnt=\count316 +\U@D=\dimen325 \l@unhyphenated=\language87 (/usr/local/texlive/2023/texmf-dist/tex/generic/babel/txtbabel.def) -\bbl@readstream=\read3 -\bbl@dirlevel=\count296 +\bbl@readstream=\read4 +\bbl@dirlevel=\count317 (/usr/local/texlive/2023/texmf-dist/tex/generic/babel-english/english.ldf Language: english 2017/06/06 v3.3r English support from the babel system Package babel Info: Hyphen rules for 'canadian' set to \l@english @@ -474,7 +655,7 @@ Package pdftexcmds Info: \pdf@ifprimitive is available. Package pdftexcmds Info: \pdfdraftmode found. ) (/usr/local/texlive/2023/texmf-dist/tex/latex/logreq/logreq.sty Package: logreq 2010/08/04 v1.0 xml request logger -\lrq@indent=\count297 +\lrq@indent=\count318 (/usr/local/texlive/2023/texmf-dist/tex/latex/logreq/logreq.def File: logreq.def 2010/08/04 v1.0 logreq spec v1.0 )) (/usr/local/texlive/2023/texmf-dist/tex/latex/base/ifthen.sty @@ -483,49 +664,49 @@ Package: ifthen 2022/04/13 v1.1d Standard LaTeX ifthen package (DPC) \Urlmuskip=\muskip17 Package: url 2013/09/16 ver 3.4 Verb mode for urls, etc. ) -\c@tabx@nest=\count298 -\c@listtotal=\count299 -\c@listcount=\count300 -\c@liststart=\count301 -\c@liststop=\count302 -\c@citecount=\count303 -\c@citetotal=\count304 -\c@multicitecount=\count305 -\c@multicitetotal=\count306 -\c@instcount=\count307 -\c@maxnames=\count308 -\c@minnames=\count309 -\c@maxitems=\count310 -\c@minitems=\count311 -\c@citecounter=\count312 -\c@maxcitecounter=\count313 -\c@savedcitecounter=\count314 -\c@uniquelist=\count315 -\c@uniquename=\count316 -\c@refsection=\count317 -\c@refsegment=\count318 -\c@maxextratitle=\count319 -\c@maxextratitleyear=\count320 -\c@maxextraname=\count321 -\c@maxextradate=\count322 -\c@maxextraalpha=\count323 -\c@abbrvpenalty=\count324 -\c@highnamepenalty=\count325 -\c@lownamepenalty=\count326 -\c@maxparens=\count327 -\c@parenlevel=\count328 -\blx@tempcnta=\count329 -\blx@tempcntb=\count330 -\blx@tempcntc=\count331 -\c@blx@maxsection=\count332 -\blx@maxsegment@0=\count333 -\blx@notetype=\count334 -\blx@parenlevel@text=\count335 -\blx@parenlevel@foot=\count336 -\blx@sectionciteorder@0=\count337 -\blx@sectionciteorderinternal@0=\count338 -\blx@entrysetcounter=\count339 -\blx@biblioinstance=\count340 +\c@tabx@nest=\count319 +\c@listtotal=\count320 +\c@listcount=\count321 +\c@liststart=\count322 +\c@liststop=\count323 +\c@citecount=\count324 +\c@citetotal=\count325 +\c@multicitecount=\count326 +\c@multicitetotal=\count327 +\c@instcount=\count328 +\c@maxnames=\count329 +\c@minnames=\count330 +\c@maxitems=\count331 +\c@minitems=\count332 +\c@citecounter=\count333 +\c@maxcitecounter=\count334 +\c@savedcitecounter=\count335 +\c@uniquelist=\count336 +\c@uniquename=\count337 +\c@refsection=\count338 +\c@refsegment=\count339 +\c@maxextratitle=\count340 +\c@maxextratitleyear=\count341 +\c@maxextraname=\count342 +\c@maxextradate=\count343 +\c@maxextraalpha=\count344 +\c@abbrvpenalty=\count345 +\c@highnamepenalty=\count346 +\c@lownamepenalty=\count347 +\c@maxparens=\count348 +\c@parenlevel=\count349 +\blx@tempcnta=\count350 +\blx@tempcntb=\count351 +\blx@tempcntc=\count352 +\c@blx@maxsection=\count353 +\blx@maxsegment@0=\count354 +\blx@notetype=\count355 +\blx@parenlevel@text=\count356 +\blx@parenlevel@foot=\count357 +\blx@sectionciteorder@0=\count358 +\blx@sectionciteorderinternal@0=\count359 +\blx@entrysetcounter=\count360 +\blx@biblioinstance=\count361 \labelnumberwidth=\skip68 \labelalphawidth=\skip69 \biblabelsep=\skip70 @@ -534,12 +715,12 @@ Package: url 2013/09/16 ver 3.4 Verb mode for urls, etc. \bibinitsep=\skip73 \bibparsep=\skip74 \bibhang=\skip75 -\blx@bcfin=\read4 -\blx@bcfout=\write3 +\blx@bcfin=\read5 +\blx@bcfout=\write4 \blx@langwohyphens=\language88 -\c@mincomprange=\count341 -\c@maxcomprange=\count342 -\c@mincompwidth=\count343 +\c@mincomprange=\count362 +\c@maxcomprange=\count363 +\c@mincompwidth=\count364 Package biblatex Info: Trying to load biblatex default data model... Package biblatex Info: ... file 'blx-dm.def' found. (/usr/local/texlive/2023/texmf-dist/tex/latex/biblatex/blx-dm.def @@ -552,84 +733,84 @@ File: apa.dbx 2022/06/22 v9.16 APA biblatex style data model ) Package biblatex Info: Trying to load biblatex custom data model... Package biblatex Info: ... file 'biblatex-dm.cfg' not found. -\c@afterword=\count344 -\c@savedafterword=\count345 -\c@annotator=\count346 -\c@savedannotator=\count347 -\c@author=\count348 -\c@savedauthor=\count349 -\c@bookauthor=\count350 -\c@savedbookauthor=\count351 -\c@commentator=\count352 -\c@savedcommentator=\count353 -\c@editor=\count354 -\c@savededitor=\count355 -\c@editora=\count356 -\c@savededitora=\count357 -\c@editorb=\count358 -\c@savededitorb=\count359 -\c@editorc=\count360 -\c@savededitorc=\count361 -\c@foreword=\count362 -\c@savedforeword=\count363 -\c@holder=\count364 -\c@savedholder=\count365 -\c@introduction=\count366 -\c@savedintroduction=\count367 -\c@namea=\count368 -\c@savednamea=\count369 -\c@nameb=\count370 -\c@savednameb=\count371 -\c@namec=\count372 -\c@savednamec=\count373 -\c@translator=\count374 -\c@savedtranslator=\count375 -\c@shortauthor=\count376 -\c@savedshortauthor=\count377 -\c@shorteditor=\count378 -\c@savedshorteditor=\count379 -\c@narrator=\count380 -\c@savednarrator=\count381 -\c@execproducer=\count382 -\c@savedexecproducer=\count383 -\c@execdirector=\count384 -\c@savedexecdirector=\count385 -\c@with=\count386 -\c@savedwith=\count387 -\c@labelname=\count388 -\c@savedlabelname=\count389 -\c@institution=\count390 -\c@savedinstitution=\count391 -\c@lista=\count392 -\c@savedlista=\count393 -\c@listb=\count394 -\c@savedlistb=\count395 -\c@listc=\count396 -\c@savedlistc=\count397 -\c@listd=\count398 -\c@savedlistd=\count399 -\c@liste=\count400 -\c@savedliste=\count401 -\c@listf=\count402 -\c@savedlistf=\count403 -\c@location=\count404 -\c@savedlocation=\count405 -\c@organization=\count406 -\c@savedorganization=\count407 -\c@origlocation=\count408 -\c@savedoriglocation=\count409 -\c@origpublisher=\count410 -\c@savedorigpublisher=\count411 -\c@publisher=\count412 -\c@savedpublisher=\count413 -\c@language=\count414 -\c@savedlanguage=\count415 -\c@origlanguage=\count416 -\c@savedoriglanguage=\count417 -\c@citation=\count418 -\c@savedcitation=\count419 -\c@pageref=\count420 -\c@savedpageref=\count421 +\c@afterword=\count365 +\c@savedafterword=\count366 +\c@annotator=\count367 +\c@savedannotator=\count368 +\c@author=\count369 +\c@savedauthor=\count370 +\c@bookauthor=\count371 +\c@savedbookauthor=\count372 +\c@commentator=\count373 +\c@savedcommentator=\count374 +\c@editor=\count375 +\c@savededitor=\count376 +\c@editora=\count377 +\c@savededitora=\count378 +\c@editorb=\count379 +\c@savededitorb=\count380 +\c@editorc=\count381 +\c@savededitorc=\count382 +\c@foreword=\count383 +\c@savedforeword=\count384 +\c@holder=\count385 +\c@savedholder=\count386 +\c@introduction=\count387 +\c@savedintroduction=\count388 +\c@namea=\count389 +\c@savednamea=\count390 +\c@nameb=\count391 +\c@savednameb=\count392 +\c@namec=\count393 +\c@savednamec=\count394 +\c@translator=\count395 +\c@savedtranslator=\count396 +\c@shortauthor=\count397 +\c@savedshortauthor=\count398 +\c@shorteditor=\count399 +\c@savedshorteditor=\count400 +\c@narrator=\count401 +\c@savednarrator=\count402 +\c@execproducer=\count403 +\c@savedexecproducer=\count404 +\c@execdirector=\count405 +\c@savedexecdirector=\count406 +\c@with=\count407 +\c@savedwith=\count408 +\c@labelname=\count409 +\c@savedlabelname=\count410 +\c@institution=\count411 +\c@savedinstitution=\count412 +\c@lista=\count413 +\c@savedlista=\count414 +\c@listb=\count415 +\c@savedlistb=\count416 +\c@listc=\count417 +\c@savedlistc=\count418 +\c@listd=\count419 +\c@savedlistd=\count420 +\c@liste=\count421 +\c@savedliste=\count422 +\c@listf=\count423 +\c@savedlistf=\count424 +\c@location=\count425 +\c@savedlocation=\count426 +\c@organization=\count427 +\c@savedorganization=\count428 +\c@origlocation=\count429 +\c@savedoriglocation=\count430 +\c@origpublisher=\count431 +\c@savedorigpublisher=\count432 +\c@publisher=\count433 +\c@savedpublisher=\count434 +\c@language=\count435 +\c@savedlanguage=\count436 +\c@origlanguage=\count437 +\c@savedoriglanguage=\count438 +\c@citation=\count439 +\c@savedcitation=\count440 +\c@pageref=\count441 +\c@savedpageref=\count442 \shorthandwidth=\skip76 \shortjournalwidth=\skip77 \shortserieswidth=\skip78 @@ -653,19 +834,19 @@ Package biblatex Info: Trying to load generic definitions... Package biblatex Info: ... file 'biblatex.def' found. (/usr/local/texlive/2023/texmf-dist/tex/latex/biblatex/biblatex.def File: biblatex.def 2023/03/05 v3.19 biblatex compatibility (PK/MW) -\c@textcitecount=\count422 -\c@textcitetotal=\count423 -\c@textcitemaxnames=\count424 -\c@biburlbigbreakpenalty=\count425 -\c@biburlbreakpenalty=\count426 -\c@biburlnumpenalty=\count427 -\c@biburlucpenalty=\count428 -\c@biburllcpenalty=\count429 +\c@textcitecount=\count443 +\c@textcitetotal=\count444 +\c@textcitemaxnames=\count445 +\c@biburlbigbreakpenalty=\count446 +\c@biburlbreakpenalty=\count447 +\c@biburlnumpenalty=\count448 +\c@biburlucpenalty=\count449 +\c@biburllcpenalty=\count450 \biburlbigskip=\muskip18 \biburlnumskip=\muskip19 \biburlucskip=\muskip20 \biburllcskip=\muskip21 -\c@smartand=\count430 +\c@smartand=\count451 ) Package biblatex Info: Trying to load bibliography style 'apa'... Package biblatex Info: ... file 'apa.bbx' found. @@ -675,8 +856,8 @@ Package biblatex Info: Trying to load bibliography style 'standard'... Package biblatex Info: ... file 'standard.bbx' found. (/usr/local/texlive/2023/texmf-dist/tex/latex/biblatex/bbx/standard.bbx File: standard.bbx 2023/03/05 v3.19 biblatex bibliography style (PK/MW) -\c@bbx:relatedcount=\count431 -\c@bbx:relatedtotal=\count432 +\c@bbx:relatedcount=\count452 +\c@bbx:relatedtotal=\count453 ) Package biblatex Info: Delimiter 'nameyeardelim' in context 'bib' already defined, overwriting. Package biblatex Info: Delimiter 'nameyeardelim' in context 'biblist' already defined, overwriting. @@ -716,8 +897,8 @@ Package biblatex Info: Document encoding is UTF8 .... Package: expl3 2023-02-22 L3 programming layer (loader) (/usr/local/texlive/2023/texmf-dist/tex/latex/l3backend/l3backend-pdftex.def File: l3backend-pdftex.def 2023-01-16 L3 backend support: PDF output (pdfTeX) -\l__color_backend_stack_int=\count433 -\l__pdf_internal_box=\box62 +\l__color_backend_stack_int=\count454 +\l__pdf_internal_box=\box73 )) Package biblatex Info: ... and expl3 (biblatex) 2023-02-22 L3 programming layer (loader) @@ -729,13 +910,13 @@ Package: xparse 2023-02-02 L3 Experimental document command parser Package: blx-case-expl3 2023/03/05 v3.19 expl3 case changing code for biblatex )) (/usr/local/texlive/2023/texmf-dist/tex/latex/csquotes/csquotes.sty Package: csquotes 2022-09-14 v5.2n context-sensitive quotations (JAW) -\csq@reset=\count434 -\csq@gtype=\count435 -\csq@glevel=\count436 -\csq@qlevel=\count437 -\csq@maxlvl=\count438 -\csq@tshold=\count439 -\csq@ltx@everypar=\toks36 +\csq@reset=\count455 +\csq@gtype=\count456 +\csq@glevel=\count457 +\csq@qlevel=\count458 +\csq@maxlvl=\count459 +\csq@tshold=\count460 +\csq@ltx@everypar=\toks48 (/usr/local/texlive/2023/texmf-dist/tex/latex/csquotes/csquotes.def File: csquotes.def 2022-09-14 v5.2n csquotes generic definitions (JAW) ) @@ -762,11 +943,11 @@ Package: refcount 2019/12/15 v3.6 Data extraction from label references (HO) ) (/usr/local/texlive/2023/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty Package: gettitlestring 2019/12/15 v1.6 Cleanup title references (HO) ) -\c@section@level=\count440 +\c@section@level=\count461 ) -\@linkdim=\dimen276 -\Hy@linkcounter=\count441 -\Hy@pagecounter=\count442 +\@linkdim=\dimen326 +\Hy@linkcounter=\count462 +\Hy@pagecounter=\count463 (/usr/local/texlive/2023/texmf-dist/tex/latex/hyperref/pd1enc.def File: pd1enc.def 2023-02-07 v7.00v Hyperref: PDFDocEncoding definition (HO) Now handling font encoding PD1 ... @@ -776,7 +957,7 @@ Package: intcalc 2019/12/15 v1.3 Expandable calculations with integers (HO) ) (/usr/local/texlive/2023/texmf-dist/tex/generic/etexcmds/etexcmds.sty Package: etexcmds 2019/12/15 v1.7 Avoid name clashes with e-TeX commands (HO) ) -\Hy@SavedSpaceFactor=\count443 +\Hy@SavedSpaceFactor=\count464 (/usr/local/texlive/2023/texmf-dist/tex/latex/hyperref/puenc.def File: puenc.def 2023-02-07 v7.00v Hyperref: PDF Unicode definition (HO) Now handling font encoding PU ... @@ -790,17 +971,17 @@ Package hyperref Info: Plain pages OFF on input line 4192. Package hyperref Info: Backreferencing OFF on input line 4197. Package hyperref Info: Implicit mode ON; LaTeX internals redefined. Package hyperref Info: Bookmarks ON on input line 4425. -\c@Hy@tempcnt=\count444 +\c@Hy@tempcnt=\count465 LaTeX Info: Redefining \url on input line 4763. -\XeTeXLinkMargin=\dimen277 +\XeTeXLinkMargin=\dimen327 (/usr/local/texlive/2023/texmf-dist/tex/generic/bitset/bitset.sty Package: bitset 2019/12/09 v1.3 Handle bit-vector datatype (HO) (/usr/local/texlive/2023/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty Package: bigintcalc 2019/12/15 v1.5 Expandable calculations on big integers (HO) )) -\Fld@menulength=\count445 -\Field@Width=\dimen278 -\Fld@charsize=\dimen279 +\Fld@menulength=\count466 +\Field@Width=\dimen328 +\Fld@charsize=\dimen329 Package hyperref Info: Hyper figures OFF on input line 6042. Package hyperref Info: Link nesting OFF on input line 6047. Package hyperref Info: Hyper index ON on input line 6050. @@ -812,19 +993,20 @@ Package hyperref Info: PDF/A mode OFF on input line 6072. Package: atbegshi-ltx 2021/01/10 v1.0c Emulation of the original atbegshi package with kernel methods ) -\Hy@abspage=\count446 -\c@Item=\count447 -\c@Hfootnote=\count448 +\Hy@abspage=\count467 +\c@Item=\count468 +\c@Hfootnote=\count469 ) Package hyperref Info: Driver (autodetected): hpdftex. (/usr/local/texlive/2023/texmf-dist/tex/latex/hyperref/hpdftex.def File: hpdftex.def 2023-02-07 v7.00v Hyperref driver for pdfTeX - (/usr/local/texlive/2023/texmf-dist/tex/latex/base/atveryend-ltx.sty + +(/usr/local/texlive/2023/texmf-dist/tex/latex/base/atveryend-ltx.sty Package: atveryend-ltx 2020/08/19 v1.0a Emulation of the original atveryend package with kernel methods ) -\Fld@listcount=\count449 -\c@bookmark@seq@number=\count450 +\Fld@listcount=\count470 +\c@bookmark@seq@number=\count471 (/usr/local/texlive/2023/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty Package: rerunfilecheck 2022-07-10 v1.10 Rerun checks for auxiliary files (HO) (/usr/local/texlive/2023/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty @@ -836,60 +1018,60 @@ Package uniquecounter Info: New unique counter `rerunfilecheck' on input line 28 ) (/usr/local/texlive/2023/texmf-dist/tex/latex/parskip/parskip.sty Package: parskip 2021-03-14 v2.0h non-zero parskip adjustments ) (/usr/local/texlive/2023/texmf-dist/tex/generic/ulem/ulem.sty -\UL@box=\box63 -\UL@hyphenbox=\box64 +\UL@box=\box74 +\UL@hyphenbox=\box75 \UL@skip=\skip91 -\UL@hook=\toks37 -\UL@height=\dimen280 -\UL@pe=\count451 -\UL@pixel=\dimen281 -\ULC@box=\box65 +\UL@hook=\toks49 +\UL@height=\dimen330 +\UL@pe=\count472 +\UL@pixel=\dimen331 +\ULC@box=\box76 Package: ulem 2019/11/18 -\ULdepth=\dimen282 +\ULdepth=\dimen332 ) Package csquotes Info: Checking for multilingual support... Package csquotes Info: ... found 'babel' package. Package csquotes Info: Adjusting default style. Package csquotes Info: Redefining alias 'default' -> 'english'. -LaTeX Font Info: Trying to load font information for T1+LinuxLibertineT-TLF on input line 127. +LaTeX Font Info: Trying to load font information for T1+LinuxLibertineT-TLF on input line 129. (/usr/local/texlive/2023/texmf-dist/tex/latex/libertine/T1LinuxLibertineT-TLF.fd File: T1LinuxLibertineT-TLF.fd 2017/03/20 (autoinst) Font definitions for T1/LinuxLibertineT-TLF. ) LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be -(Font) scaled to size 12.0pt on input line 127. +(Font) scaled to size 12.0pt on input line 129. (./verslag.aux (./sections/introduction.aux) (./sections/background.aux) (./sections/policies.aux) (./sections/literature_study.aux)) \openout1 = `verslag.aux'. -LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for TS1/cmr/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for LS1/libertinust1math/m/n on input line 127. -LaTeX Font Info: Trying to load font information for LS1+libertinust1math on input line 127. +LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for TS1/cmr/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for LS1/libertinust1math/m/n on input line 129. +LaTeX Font Info: Trying to load font information for LS1+libertinust1math on input line 129. (/usr/local/texlive/2023/texmf-dist/tex/latex/libertinust1math/ls1libertinust1math.fd File: ls1libertinust1math.fd 2016/03/23 Fontinst v1.933 font definitions for LS1/libertinust1math. ) -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for LS2/libertinust1mathsym/m/n on input line 127. -LaTeX Font Info: Trying to load font information for LS2+libertinust1mathsym on input line 127. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for LS2/libertinust1mathsym/m/n on input line 129. +LaTeX Font Info: Trying to load font information for LS2+libertinust1mathsym on input line 129. (/usr/local/texlive/2023/texmf-dist/tex/latex/libertinust1math/ls2libertinust1mathsym.fd File: ls2libertinust1mathsym.fd 2015/04/17 v1.1.2-latex LibertinusT1Mathsym LS2 font definitions ) -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for PD1/pdf/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. -LaTeX Font Info: Checking defaults for PU/pdf/m/n on input line 127. -LaTeX Font Info: ... okay on input line 127. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for PD1/pdf/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. +LaTeX Font Info: Checking defaults for PU/pdf/m/n on input line 129. +LaTeX Font Info: ... okay on input line 129. *geometry* driver: auto-detecting *geometry* detected driver: pdftex @@ -927,27 +1109,27 @@ LaTeX Font Info: ... okay on input line 127. (/usr/local/texlive/2023/texmf-dist/tex/context/base/mkii/supp-pdf.mkii [Loading MPS to PDF converter (version 2006.09.02).] -\scratchcounter=\count452 -\scratchdimen=\dimen283 -\scratchbox=\box66 -\nofMPsegments=\count453 -\nofMParguments=\count454 -\everyMPshowfont=\toks38 -\MPscratchCnt=\count455 -\MPscratchDim=\dimen284 -\MPnumerator=\count456 -\makeMPintoPDFobject=\count457 -\everyMPtoPDFconversion=\toks39 +\scratchcounter=\count473 +\scratchdimen=\dimen333 +\scratchbox=\box77 +\nofMPsegments=\count474 +\nofMParguments=\count475 +\everyMPshowfont=\toks50 +\MPscratchCnt=\count476 +\MPscratchDim=\dimen334 +\MPnumerator=\count477 +\makeMPintoPDFobject=\count478 +\everyMPtoPDFconversion=\toks51 ) (/usr/local/texlive/2023/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty Package: epstopdf-base 2020-01-24 v2.11 Base part for package epstopdf Package epstopdf-base Info: Redefining graphics rule for `.eps' on input line 485. (/usr/local/texlive/2023/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg File: epstopdf-sys.cfg 2010/07/13 v1.3 Configuration of (r)epstopdf for TeX Live )) -\c@mv@tabular=\count458 -\c@mv@boldtabular=\count459 -LaTeX Info: Command `\dddot' is already robust on input line 127. -LaTeX Info: Command `\ddddot' is already robust on input line 127. +\c@mv@tabular=\count479 +\c@mv@boldtabular=\count480 +LaTeX Info: Command `\dddot' is already robust on input line 129. +LaTeX Info: Command `\ddddot' is already robust on input line 129. Package caption Info: Begin \AtBeginDocument code. Package caption Info: hyperref package is loaded. Package caption Info: End \AtBeginDocument code. @@ -976,17 +1158,17 @@ File: english.lbx 2023/03/05 v3.19 biblatex localization (PK/MW) Package biblatex Info: Input encoding 'utf8' detected. Package biblatex Info: Automatic encoding selection. (biblatex) Assuming data encoding 'utf8'. -\openout3 = `verslag.bcf'. +\openout4 = `verslag.bcf'. Package biblatex Info: Trying to load bibliographic data... Package biblatex Info: ... file 'verslag.bbl' found. (./verslag.bbl) -Package biblatex Info: Reference section=0 on input line 127. -Package biblatex Info: Reference segment=0 on input line 127. -Package hyperref Info: Link coloring ON on input line 127. +Package biblatex Info: Reference section=0 on input line 129. +Package biblatex Info: Reference segment=0 on input line 129. +Package hyperref Info: Link coloring ON on input line 129. (./verslag.out) (./verslag.out) -\@outlinefile=\write4 -\openout4 = `verslag.out'. +\@outlinefile=\write5 +\openout5 = `verslag.out'. *geometry* verbose mode - [ newgeometry ] result: * driver: pdftex @@ -1020,114 +1202,114 @@ Package hyperref Info: Link coloring ON on input line 127. * \@reversemarginfalse * (1in=72.27pt=25.4mm, 1cm=28.453pt) -LaTeX Font Info: Trying to load font information for T1+LinuxBiolinumT-TLF on input line 135. +LaTeX Font Info: Trying to load font information for T1+LinuxBiolinumT-TLF on input line 137. (/usr/local/texlive/2023/texmf-dist/tex/latex/libertine/T1LinuxBiolinumT-TLF.fd File: T1LinuxBiolinumT-TLF.fd 2017/03/20 (autoinst) Font definitions for T1/LinuxBiolinumT-TLF. ) LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/m/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. pdfTeX warning: pdflatex (file ./ea-en.pdf): PDF inclusion: found PDF version <1.7>, but at most version <1.5> allowed - + File: ea-en.pdf Graphic file (type pdf) -Package pdftex.def Info: ea-en.pdf used on input line 135. +Package pdftex.def Info: ea-en.pdf used on input line 137. (pdftex.def) Requested size: 271.63632pt x 90.54071pt. LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/b/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/b/n' will be -(Font) scaled to size 24.88pt on input line 135. +(Font) scaled to size 24.88pt on input line 137. LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/b/n' will be -(Font) scaled to size 17.28pt on input line 135. +(Font) scaled to size 17.28pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/m/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/m/n' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/m/n' will be -(Font) scaled to size 6.0pt on input line 135. +(Font) scaled to size 6.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/m/it' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/m/it' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/m/it' will be -(Font) scaled to size 6.0pt on input line 135. +(Font) scaled to size 6.0pt on input line 137. LaTeX Font Info: Font shape `LS2/libertinust1mathsym/m/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS2/libertinust1mathsym/m/n' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS2/libertinust1mathsym/m/n' will be -(Font) scaled to size 6.0pt on input line 135. -LaTeX Font Info: Trying to load font information for LS2+libertinust1mathex on input line 135. +(Font) scaled to size 6.0pt on input line 137. +LaTeX Font Info: Trying to load font information for LS2+libertinust1mathex on input line 137. (/usr/local/texlive/2023/texmf-dist/tex/latex/libertinust1math/ls2libertinust1mathex.fd File: ls2libertinust1mathex.fd 2016/03/15 v1.0.0-latex LibertinusMath extensions LS2 font definitions ) LaTeX Font Info: Font shape `LS2/libertinust1mathex/m/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS2/libertinust1mathex/m/n' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS2/libertinust1mathex/m/n' will be -(Font) scaled to size 6.0pt on input line 135. -LaTeX Font Info: Trying to load font information for LS1+libertinust1mathbb on input line 135. +(Font) scaled to size 6.0pt on input line 137. +LaTeX Font Info: Trying to load font information for LS1+libertinust1mathbb on input line 137. (/usr/local/texlive/2023/texmf-dist/tex/latex/libertinust1math/ls1libertinust1mathbb.fd File: ls1libertinust1mathbb.fd 2016/08/22 latex LibertinusT1Mathbb LS1 font definitions ) LaTeX Font Info: Font shape `LS1/libertinust1mathbb/m/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1mathbb/m/n' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1mathbb/m/n' will be -(Font) scaled to size 6.0pt on input line 135. +(Font) scaled to size 6.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/b/n' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/b/n' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/b/n' will be -(Font) scaled to size 6.0pt on input line 135. +(Font) scaled to size 6.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/b/it' will be -(Font) scaled to size 12.0pt on input line 135. +(Font) scaled to size 12.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/b/it' will be -(Font) scaled to size 8.0pt on input line 135. +(Font) scaled to size 8.0pt on input line 137. LaTeX Font Info: Font shape `LS1/libertinust1math/b/it' will be -(Font) scaled to size 6.0pt on input line 135. +(Font) scaled to size 6.0pt on input line 137. LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/b/n' will be -(Font) scaled to size 14.4pt on input line 135. +(Font) scaled to size 14.4pt on input line 137. -Underfull \hbox (badness 10000) in paragraph at lines 135--135 +Underfull \hbox (badness 10000) in paragraph at lines 137--137 [] -Overfull \hbox (33.0pt too wide) in paragraph at lines 135--135 +Overfull \hbox (33.0pt too wide) in paragraph at lines 137--137 [][][][][][][][] [] pdfTeX warning: pdflatex (file ./ugent-en.pdf): PDF inclusion: found PDF version <1.7>, but at most version <1.5> allowed - + File: ugent-en.pdf Graphic file (type pdf) -Package pdftex.def Info: ugent-en.pdf used on input line 135. +Package pdftex.def Info: ugent-en.pdf used on input line 137. (pdftex.def) Requested size: 150.91232pt x 120.72095pt. [1 {/usr/local/texlive/2023/texmf-var/fonts/map/pdftex/updmap/pdftex.map}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_25tcsq.enc} <./ea-en.pdf> <./ugent-en.pdf>] LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/m/n' will be -(Font) scaled to size 17.28pt on input line 142. +(Font) scaled to size 17.28pt on input line 144. (./verslag.toc LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/b/n' will be (Font) scaled to size 12.0pt on input line 2. ) -\tf@toc=\write5 -\openout5 = `verslag.toc'. +\tf@toc=\write6 +\openout6 = `verslag.toc'. pdfTeX warning (ext4): destination with the same identifier (name{page.1}) has been already used, duplicate ignored \relax -l.143 \newpage +l.145 \newpage [1 {/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_nh77jq.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_76gpa5.enc}] @@ -1166,13 +1348,13 @@ LaTeX Font Info: Font shape `TS1/LinuxLibertineT-TLF/m/n' will be [5{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusMI.enc}] LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/m/n' will be (Font) scaled to size 14.4pt on input line 100. - + File: images/quantile_regression/cdf_quantiles_example.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/cdf_quantiles_example.png used on input line 107. (pdftex.def) Requested size: 364.19667pt x 218.51653pt. [6{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_naooyc.enc} <./images/quantile_regression/cdf_quantiles_example.png>] - + File: images/quantile_regression/reconstructed_cdf.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/reconstructed_cdf.png used on input line 117. @@ -1182,13 +1364,13 @@ LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be (Font) scaled to size 6.0pt on input line 127. [7{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusMR.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusEX.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusSYM.enc} <./images/quantile_regression/reconstructed_cdf.png>] [8] [9] [10] - + File: images/quantile_regression/rnn/RNN_diagram.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/rnn/RNN_diagram.png used on input line 206. (pdftex.def) Requested size: 364.19667pt x 156.63872pt. [11 <./images/quantile_regression/rnn/RNN_diagram.png>] - + File: images/diffusion/Generation-with-Diffusion-Models.png Graphic file (type png) Package pdftex.def Info: images/diffusion/Generation-with-Diffusion-Models.png used on input line 234. @@ -1201,7 +1383,7 @@ See the caption package documentation for explanation. LaTeX Warning: Reference `fig:diffusion_process' on page 14 undefined on input line 274. - + File: images/diffusion/diffusion_graphical_model.png Graphic file (type png) Package pdftex.def Info: images/diffusion/diffusion_graphical_model.png used on input line 278. @@ -1211,7 +1393,7 @@ LaTeX Font Info: Trying to load font information for U+bbm on input line 307. (/usr/local/texlive/2023/texmf-dist/tex/latex/bbm-macros/ubbm.fd File: ubbm.fd 1999/03/15 V 1.2 Font definition for bbm font - TH ) - + File: images/quantile_regression/crps_visualization.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/crps_visualization.png used on input line 325. @@ -1238,7 +1420,7 @@ LaTeX Warning: Citation 'rasul_autoregressive_2021' on page 19 undefined on inpu ] (./sections/results/linear.tex [22] [23] - + File: images/quantile_regression/nrv_mean_std_over_quarter.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/nrv_mean_std_over_quarter.png used on input line 42. @@ -1248,44 +1430,44 @@ Package pdftex.def Info: images/quantile_regression/nrv_mean_std_over_quarter.pn LaTeX Warning: Reference `fig:autoregressive_linear_model_samples' on page 25 undefined on input line 81. [25 <./images/quantile_regression/nrv_mean_std_over_quarter.png>] - + File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 86. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png used on input line 90. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 93. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png used on input line 97. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 100. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png used on input line 104. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 107. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be (Font) scaled to size 10.95pt on input line 108. - + File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png used on input line 112. @@ -1300,104 +1482,104 @@ Underfull \hbox (badness 10000) in paragraph at lines 122--123 [] - + File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png used on input line 127. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png used on input line 131. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png used on input line 134. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png used on input line 139. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg used on input line 151. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. - + File: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg used on input line 156. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. - + File: images/quantile_regression/quantile_performance/NAQR_Quantile_Performance_Training.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/NAQR_Quantile_Performance_Training.jpeg used on input line 161. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. - + File: images/quantile_regression/quantile_performance/NAQR_Quantile_Performance_Test.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/NAQR_Quantile_Performance_Test.jpeg used on input line 166. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. [27 <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png>]) (./sections/results/non-linear.tex [28 <./images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg> <./images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg> <./images/quantile_regression/quantile_performance/NAQR_Quantile_Performance_Training.jpeg> <./images/quantile_regression/quantile_performance/NAQR_Quantile_Performance_Test.jpeg>] [29{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_7grukw.enc}] - + File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 78. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 82. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 85. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 89. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 92. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 96. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_7008.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 99. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_7008.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 104. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. [30] - + File: images/quantile_regression/quantile_performance/AQR_NL_Quantile_Performance_Training.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_NL_Quantile_Performance_Training.jpeg used on input line 117. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. - + File: images/quantile_regression/quantile_performance/AQR_NL_Quantile_Performance_Test.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_NL_Quantile_Performance_Test.jpeg used on input line 122. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. - + File: images/quantile_regression/quantile_performance/NAQR_NL_Quantile_Performance_Training.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/NAQR_NL_Quantile_Performance_Training.jpeg used on input line 127. (pdftex.def) Requested size: 223.07211pt x 153.94125pt. - + File: images/quantile_regression/quantile_performance/NAQR_NL_Quantile_Performance_Test.jpeg Graphic file (type jpg) Package pdftex.def Info: images/quantile_regression/quantile_performance/NAQR_NL_Quantile_Performance_Test.jpeg used on input line 132. @@ -1408,100 +1590,35 @@ Underfull \hbox (badness 4582) in paragraph at lines 135--135 [] ) [31 <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png> <./images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png> <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_7008.png> <./images/quantile_regression/naqr_non_linear_model_samples/NAQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_7008.png>] (./sections/results/gru.tex [32 <./images/quantile_regression/quantile_performance/AQR_NL_Quantile_Performance_Training.jpeg> <./images/quantile_regression/quantile_performance/AQR_NL_Quantile_Performance_Test.jpeg> <./images/quantile_regression/quantile_performance/NAQR_NL_Quantile_Performance_Training.jpeg> <./images/quantile_regression/quantile_performance/NAQR_NL_Quantile_Performance_Test.jpeg>] [33] - + File: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 75. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 79. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 82. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 86. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 89. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - + File: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png) Package pdftex.def Info: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 93. (pdftex.def) Requested size: 223.07211pt x 112.49284pt. - -File: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_7008.png Graphic file (type png) - -Package pdftex.def Info: images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 96. -(pdftex.def) Requested size: 223.07211pt x 112.49284pt. - -File: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_7008.png Graphic file (type png) - -Package pdftex.def Info: images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 101. -(pdftex.def) Requested size: 223.07211pt x 112.49284pt. - [34] - -File: images/quantile_regression/quantile_performance/AQR_GRU_QP_Train.jpeg Graphic file (type jpg) - -Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_GRU_QP_Train.jpeg used on input line 114. -(pdftex.def) Requested size: 223.07211pt x 153.94125pt. - -File: images/quantile_regression/quantile_performance/AQR_GRU_QP_Test.jpeg Graphic file (type jpg) - -Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_GRU_QP_Test.jpeg used on input line 119. -(pdftex.def) Requested size: 223.07211pt x 153.94125pt. - -File: images/quantile_regression/quantile_performance/NAQR_GRU_QP_Train.jpeg Graphic file (type jpg) - -Package pdftex.def Info: images/quantile_regression/quantile_performance/NAQR_GRU_QP_Train.jpeg used on input line 124. -(pdftex.def) Requested size: 223.07211pt x 153.94125pt. - -File: images/quantile_regression/quantile_performance/NAQR_GRU_QP_Test.jpeg Graphic file (type jpg) - -Package pdftex.def Info: images/quantile_regression/quantile_performance/NAQR_GRU_QP_Test.jpeg used on input line 129. -(pdftex.def) Requested size: 223.07211pt x 153.94125pt. - -Underfull \hbox (badness 4582) in paragraph at lines 132--132 -[]\T1/LinuxLibertineT-TLF/m/n/12 Figure 13: |Over/underestimation of the quan-tiles for the au-tore-gres-sive and non- - [] - -) [35 <./images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_6336.png> <./images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_6336.png> <./images/quantile_regression/aqr_gru_model_examples/AQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_7008.png> <./images/quantile_regression/naqr_gru_model_examples/NAQR_GRU_NRV_Load_Wind_PV_NP_QE-Sample_7008.png>] [36 <./images/quantile_regression/quantile_performance/AQR_GRU_QP_Train.jpeg> <./images/quantile_regression/quantile_performance/AQR_GRU_QP_Test.jpeg> <./images/quantile_regression/quantile_performance/NAQR_GRU_QP_Train.jpeg> <./images/quantile_regression/quantile_performance/NAQR_GRU_QP_Test.jpeg>]) [37] [38] (./verslag.aux (./sections/introduction.aux) (./sections/background.aux) (./sections/policies.aux) (./sections/literature_study.aux)) - -LaTeX Warning: There were undefined references. - -Package rerunfilecheck Info: File `verslag.out' has not changed. -(rerunfilecheck) Checksum: 7E50B00E62AE3A64F9DC7847891FE94D;4505. - -Package biblatex Warning: Please (re)run Biber on the file: -(biblatex) verslag -(biblatex) and rerun LaTeX afterwards. - -Package logreq Info: Writing requests to 'verslag.run.xml'. -\openout1 = `verslag.run.xml'. - - ) -Here is how much of TeX's memory you used: - 27081 strings out of 476025 - 505488 string characters out of 5790017 - 1883388 words of memory out of 5000000 - 46940 multiletter control sequences out of 15000+600000 - 603223 words of font info for 88 fonts, out of 8000000 for 9000 - 1141 hyphenation exceptions out of 8191 - 83i,16n,131p,2100b,5180s stack positions out of 10000i,1000n,20000p,200000b,200000s - -Output written on verslag.pdf (39 pages, 7863303 bytes). -PDF statistics: - 575 PDF objects out of 1000 (max. 8388607) - 423 compressed objects within 5 object streams - 103 named destinations out of 1000 (max. 500000) - 486 words of extra memory for PDF output out of 10000 (max. 10000000) - + +File: images/quanti \ No newline at end of file diff --git a/Reports/Thesis/verslag.out b/Reports/Thesis/verslag.out index 6ca6d13..e69de29 100644 --- a/Reports/Thesis/verslag.out +++ b/Reports/Thesis/verslag.out @@ -1,30 +0,0 @@ -\BOOKMARK [1][-]{section.1}{\376\377\000I\000n\000t\000r\000o\000d\000u\000c\000t\000i\000o\000n}{}% 1 -\BOOKMARK [1][-]{section.2}{\376\377\000E\000l\000e\000c\000t\000r\000i\000c\000i\000t\000y\000\040\000m\000a\000r\000k\000e\000t}{}% 2 -\BOOKMARK [1][-]{section.3}{\376\377\000G\000e\000n\000e\000r\000a\000t\000i\000v\000e\000\040\000m\000o\000d\000e\000l\000i\000n\000g}{}% 3 -\BOOKMARK [2][-]{subsection.3.1}{\376\377\000Q\000u\000a\000n\000t\000i\000l\000e\000\040\000R\000e\000g\000r\000e\000s\000s\000i\000o\000n}{section.3}% 4 -\BOOKMARK [2][-]{subsection.3.2}{\376\377\000A\000u\000t\000o\000r\000e\000g\000r\000e\000s\000s\000i\000v\000e\000\040\000v\000s\000\040\000N\000o\000n\000-\000A\000u\000t\000o\000r\000e\000g\000r\000e\000s\000s\000i\000v\000e\000\040\000m\000o\000d\000e\000l\000s}{section.3}% 5 -\BOOKMARK [2][-]{subsection.3.3}{\376\377\000M\000o\000d\000e\000l\000\040\000T\000y\000p\000e\000s}{section.3}% 6 -\BOOKMARK [3][-]{subsubsection.3.3.1}{\376\377\000L\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.3.3}% 7 -\BOOKMARK [3][-]{subsubsection.3.3.2}{\376\377\000N\000o\000n\000-\000L\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.3.3}% 8 -\BOOKMARK [3][-]{subsubsection.3.3.3}{\376\377\000R\000e\000c\000u\000r\000r\000e\000n\000t\000\040\000N\000e\000u\000r\000a\000l\000\040\000N\000e\000t\000w\000o\000r\000k\000\040\000\050\000R\000N\000N\000\051}{subsection.3.3}% 9 -\BOOKMARK [2][-]{subsection.3.4}{\376\377\000D\000i\000f\000f\000u\000s\000i\000o\000n\000\040\000m\000o\000d\000e\000l\000s}{section.3}% 10 -\BOOKMARK [3][-]{subsubsection.3.4.1}{\376\377\000O\000v\000e\000r\000v\000i\000e\000w}{subsection.3.4}% 11 -\BOOKMARK [3][-]{subsubsection.3.4.2}{\376\377\000A\000p\000p\000l\000i\000c\000a\000t\000i\000o\000n\000s}{subsection.3.4}% 12 -\BOOKMARK [3][-]{subsubsection.3.4.3}{\376\377\000G\000e\000n\000e\000r\000a\000t\000i\000o\000n\000\040\000p\000r\000o\000c\000e\000s\000s}{subsection.3.4}% 13 -\BOOKMARK [2][-]{subsection.3.5}{\376\377\000E\000v\000a\000l\000u\000a\000t\000i\000o\000n}{section.3}% 14 -\BOOKMARK [1][-]{section.4}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s}{}% 15 -\BOOKMARK [2][-]{subsection.4.1}{\376\377\000B\000a\000s\000e\000l\000i\000n\000e\000s}{section.4}% 16 -\BOOKMARK [2][-]{subsection.4.2}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000b\000a\000s\000e\000d\000\040\000o\000n\000\040\000N\000R\000V\000\040\000g\000e\000n\000e\000r\000a\000t\000i\000o\000n\000s}{section.4}% 17 -\BOOKMARK [1][-]{section.5}{\376\377\000L\000i\000t\000e\000r\000a\000t\000u\000r\000e\000\040\000S\000t\000u\000d\000y}{}% 18 -\BOOKMARK [2][-]{subsection.5.1}{\376\377\000E\000l\000e\000c\000t\000r\000i\000c\000i\000t\000y\000\040\000P\000r\000i\000c\000e\000\040\000F\000o\000r\000e\000c\000a\000s\000t\000i\000n\000g}{section.5}% 19 -\BOOKMARK [2][-]{subsection.5.2}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000f\000o\000r\000\040\000B\000a\000t\000t\000e\000r\000y\000\040\000O\000p\000t\000i\000m\000i\000z\000a\000t\000i\000o\000n}{section.5}% 20 -\BOOKMARK [1][-]{section.6}{\376\377\000R\000e\000s\000u\000l\000t\000s\000\040\000\046\000\040\000D\000i\000s\000c\000u\000s\000s\000i\000o\000n}{}% 21 -\BOOKMARK [2][-]{subsection.6.1}{\376\377\000D\000a\000t\000a}{section.6}% 22 -\BOOKMARK [2][-]{subsection.6.2}{\376\377\000Q\000u\000a\000n\000t\000i\000l\000e\000\040\000R\000e\000g\000r\000e\000s\000s\000i\000o\000n}{section.6}% 23 -\BOOKMARK [3][-]{subsubsection.6.2.1}{\376\377\000L\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.6.2}% 24 -\BOOKMARK [3][-]{subsubsection.6.2.2}{\376\377\000N\000o\000n\000-\000L\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.6.2}% 25 -\BOOKMARK [3][-]{subsubsection.6.2.3}{\376\377\000G\000R\000U\000\040\000M\000o\000d\000e\000l}{subsection.6.2}% 26 -\BOOKMARK [2][-]{subsection.6.3}{\376\377\000D\000i\000f\000f\000u\000s\000i\000o\000n}{section.6}% 27 -\BOOKMARK [1][-]{section.7}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000f\000o\000r\000\040\000b\000a\000t\000t\000e\000r\000y\000\040\000o\000p\000t\000i\000m\000i\000z\000a\000t\000i\000o\000n}{}% 28 -\BOOKMARK [2][-]{subsection.7.1}{\376\377\000B\000a\000s\000e\000l\000i\000n\000e\000s}{section.7}% 29 -\BOOKMARK [2][-]{subsection.7.2}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000u\000s\000i\000n\000g\000\040\000N\000R\000V\000\040\000p\000r\000e\000d\000i\000c\000t\000i\000o\000n\000s}{section.7}% 30 diff --git a/Reports/Thesis/verslag.pdf b/Reports/Thesis/verslag.pdf index b8c47c7..8df7770 100644 Binary files a/Reports/Thesis/verslag.pdf and b/Reports/Thesis/verslag.pdf differ diff --git a/Reports/Thesis/verslag.synctex(busy) b/Reports/Thesis/verslag.synctex(busy) new file mode 100644 index 0000000..ac1d9e0 Binary files /dev/null and b/Reports/Thesis/verslag.synctex(busy) differ diff --git a/Reports/Thesis/verslag.synctex.gz b/Reports/Thesis/verslag.synctex.gz index 4ad7d4d..13d4d9f 100644 Binary files a/Reports/Thesis/verslag.synctex.gz and b/Reports/Thesis/verslag.synctex.gz differ diff --git a/Reports/Thesis/verslag.tex b/Reports/Thesis/verslag.tex index 231c046..8af2feb 100644 --- a/Reports/Thesis/verslag.tex +++ b/Reports/Thesis/verslag.tex @@ -28,6 +28,8 @@ \usepackage{caption} \usepackage{subcaption} \usepackage{booktabs} +\usepackage{tikz} +\usetikzlibrary{positioning, calc} % Electricity market % Generative Modeling @@ -181,7 +183,7 @@ \input{sections/results} - +\newpage \section{Policies for battery optimization} \subsection{Baselines} diff --git a/Reports/Thesis/verslag.toc b/Reports/Thesis/verslag.toc index f550c04..e69de29 100644 --- a/Reports/Thesis/verslag.toc +++ b/Reports/Thesis/verslag.toc @@ -1,31 +0,0 @@ -\babel@toc {english}{}\relax -\contentsline {section}{\numberline {1}Introduction}{2}{section.1}% -\contentsline {section}{\numberline {2}Electricity market}{3}{section.2}% -\contentsline {section}{\numberline {3}Generative modeling}{5}{section.3}% -\contentsline {subsection}{\numberline {3.1}Quantile Regression}{6}{subsection.3.1}% -\contentsline {subsection}{\numberline {3.2}Autoregressive vs Non-Autoregressive models}{8}{subsection.3.2}% -\contentsline {subsection}{\numberline {3.3}Model Types}{9}{subsection.3.3}% -\contentsline {subsubsection}{\numberline {3.3.1}Linear Model}{9}{subsubsection.3.3.1}% -\contentsline {subsubsection}{\numberline {3.3.2}Non-Linear Model}{10}{subsubsection.3.3.2}% -\contentsline {subsubsection}{\numberline {3.3.3}Recurrent Neural Network (RNN)}{10}{subsubsection.3.3.3}% -\contentsline {subsection}{\numberline {3.4}Diffusion models}{11}{subsection.3.4}% -\contentsline {subsubsection}{\numberline {3.4.1}Overview}{12}{subsubsection.3.4.1}% -\contentsline {subsubsection}{\numberline {3.4.2}Applications}{12}{subsubsection.3.4.2}% -\contentsline {subsubsection}{\numberline {3.4.3}Generation process}{12}{subsubsection.3.4.3}% -\contentsline {subsection}{\numberline {3.5}Evaluation}{14}{subsection.3.5}% -\contentsline {section}{\numberline {4}Policies}{17}{section.4}% -\contentsline {subsection}{\numberline {4.1}Baselines}{17}{subsection.4.1}% -\contentsline {subsection}{\numberline {4.2}Policies based on NRV generations}{18}{subsection.4.2}% -\contentsline {section}{\numberline {5}Literature Study}{19}{section.5}% -\contentsline {subsection}{\numberline {5.1}Electricity Price Forecasting}{19}{subsection.5.1}% -\contentsline {subsection}{\numberline {5.2}Policies for Battery Optimization}{20}{subsection.5.2}% -\contentsline {section}{\numberline {6}Results \& Discussion}{21}{section.6}% -\contentsline {subsection}{\numberline {6.1}Data}{21}{subsection.6.1}% -\contentsline {subsection}{\numberline {6.2}Quantile Regression}{22}{subsection.6.2}% -\contentsline {subsubsection}{\numberline {6.2.1}Linear Model}{22}{subsubsection.6.2.1}% -\contentsline {subsubsection}{\numberline {6.2.2}Non-Linear Model}{29}{subsubsection.6.2.2}% -\contentsline {subsubsection}{\numberline {6.2.3}GRU Model}{32}{subsubsection.6.2.3}% -\contentsline {subsection}{\numberline {6.3}Diffusion}{37}{subsection.6.3}% -\contentsline {section}{\numberline {7}Policies for battery optimization}{37}{section.7}% -\contentsline {subsection}{\numberline {7.1}Baselines}{37}{subsection.7.1}% -\contentsline {subsection}{\numberline {7.2}Policies using NRV predictions}{37}{subsection.7.2}% diff --git a/src/trainers/diffusion_trainer.py b/src/trainers/diffusion_trainer.py index f16eed6..1200ed9 100644 --- a/src/trainers/diffusion_trainer.py +++ b/src/trainers/diffusion_trainer.py @@ -59,13 +59,16 @@ def sample_diffusion( # evenly spaces 4 intermediate samples to append between 1 and noise_steps if intermediate_samples: - spacing = (noise_steps - 1) // 4 - if i % spacing == 0: + first_quarter_end = (noise_steps - 1) // 4 + spacing = (first_quarter_end - 1) // 4 + + # save 1, 1 + spacing, 1 + 2*spacing, 1 + 3*spacing + if i % spacing == 1 and i <= first_quarter_end: intermediate_samples_list.append(x) x = torch.clamp(x, -1.0, 1.0) if len(intermediate_samples_list) > 0: - return x, intermediate_samples_list + return x, intermediate_samples_list[-4:] return x @@ -81,7 +84,7 @@ class DiffusionTrainer: self.model = model self.device = device - self.noise_steps = 1000 + self.noise_steps = 300 self.beta_start = 0.0001 self.beta_end = 0.02 self.ts_length = 96 @@ -260,6 +263,9 @@ class DiffusionTrainer: self.model = torch.load("checkpoint.pt") self.model.to(self.device) + self.debug_plots(task, True, train_loader, train_sample_indices, -1) + self.debug_plots(task, False, test_loader, test_sample_indices, -1) + _, generated_sampels = self.test(test_loader, -1, task) # self.policy_evaluator.plot_profits_table() if self.policy_evaluator: @@ -371,7 +377,6 @@ class DiffusionTrainer: return fig - def debug_plots(self, task, training: bool, data_loader, sample_indices, epoch): for actual_idx, idx in sample_indices.items(): features, target, _ = data_loader.dataset[idx] @@ -381,69 +386,93 @@ class DiffusionTrainer: self.model.eval() with torch.no_grad(): - samples, intermediates = ( - self.sample(self.model, 100, features, True) - ) + samples, intermediates = self.sample(self.model, 100, features, True) samples = samples.cpu().numpy() samples = self.data_processor.inverse_transform(samples) target = self.data_processor.inverse_transform(target) - # list to tensor intermediate samples - intermediates = torch.stack(intermediates) + if epoch == -1: + # list to tensor intermediate samples + intermediates = torch.stack(intermediates) + + intermediate_fig1 = self.plot_from_samples( + self.data_processor.inverse_transform( + intermediates[0].cpu().numpy() + ), + target, + ) + + intermediate_fig2 = self.plot_from_samples( + self.data_processor.inverse_transform( + intermediates[1].cpu().numpy() + ), + target, + ) + + intermediate_fig3 = self.plot_from_samples( + self.data_processor.inverse_transform( + intermediates[2].cpu().numpy() + ), + target, + ) + + intermediate_fig4 = self.plot_from_samples( + self.data_processor.inverse_transform( + intermediates[3].cpu().numpy() + ), + target, + ) + + # report the intermediate figs to clearml + task.get_logger().report_matplotlib_figure( + title=( + f"Training Intermediates {actual_idx}" + if training + else f"Testing Intermediates {actual_idx}" + ), + series=f"Sample intermediate 1", + iteration=epoch, + figure=intermediate_fig1, + report_image=True, + ) + + task.get_logger().report_matplotlib_figure( + title=( + f"Training Intermediates {actual_idx}" + if training + else f"Testing Intermediates {actual_idx}" + ), + series=f"Sample intermediate 2", + iteration=epoch, + figure=intermediate_fig2, + report_image=True, + ) + + task.get_logger().report_matplotlib_figure( + title=( + f"Training Intermediates {actual_idx}" + if training + else f"Testing Intermediates {actual_idx}" + ), + series=f"Sample intermediate 3", + iteration=epoch, + figure=intermediate_fig3, + report_image=True, + ) + + task.get_logger().report_matplotlib_figure( + title=( + f"Training Intermediates {actual_idx}" + if training + else f"Testing Intermediates {actual_idx}" + ), + series=f"Sample intermediate 4", + iteration=epoch, + figure=intermediate_fig4, + report_image=True, + ) fig = self.plot_from_samples(samples, target) - intermediate_fig1 = self.plot_from_samples( - self.data_processor.inverse_transform(intermediates[0].cpu().numpy()), target - ) - - intermediate_fig2 = self.plot_from_samples( - self.data_processor.inverse_transform(intermediates[1].cpu().numpy()), target - ) - - intermediate_fig3 = self.plot_from_samples( - self.data_processor.inverse_transform(intermediates[2].cpu().numpy()), target - ) - - intermediate_fig4 = self.plot_from_samples( - self.data_processor.inverse_transform(intermediates[3].cpu().numpy()), target - ) - - - # report the intermediate figs to clearml - task.get_logger().report_matplotlib_figure( - title=f"Training Intermediates {actual_idx}" if training else f"Testing Intermediates {actual_idx}", - series=f"Sample intermediate 1", - iteration=epoch, - figure=intermediate_fig1, - report_image=True - ) - - task.get_logger().report_matplotlib_figure( - title=f"Training Intermediates {actual_idx}" if training else f"Testing Intermediates {actual_idx}", - series=f"Sample intermediate 2", - iteration=epoch, - figure=intermediate_fig2, - report_image=True - ) - - task.get_logger().report_matplotlib_figure( - title=f"Training Intermediates {actual_idx}" if training else f"Testing Intermediates {actual_idx}", - series=f"Sample intermediate 3", - iteration=epoch, - figure=intermediate_fig3, - report_image=True - ) - - task.get_logger().report_matplotlib_figure( - title=f"Training Intermediates {actual_idx}" if training else f"Testing Intermediates {actual_idx}", - series=f"Sample intermediate 4", - iteration=epoch, - figure=intermediate_fig4, - report_image=True - ) - - - task.get_logger().report_matplotlib_figure( title="Training" if training else "Testing", diff --git a/src/training_scripts/diffusion_training.py b/src/training_scripts/diffusion_training.py index b7dd770..025cc2b 100644 --- a/src/training_scripts/diffusion_training.py +++ b/src/training_scripts/diffusion_training.py @@ -2,7 +2,7 @@ from src.utils.clearml import ClearMLHelper clearml_helper = ClearMLHelper(project_name="Thesis/NrvForecast") task = clearml_helper.get_task( - task_name="Diffusion Training: hidden_sizes=[256, 256, 256], lr=0.0001, time_dim=8" + task_name="Diffusion Training: hidden_sizes=[1024, 1024, 1024, 1024] (300 steps), lr=0.0001, time_dim=8 + Load + Wind + PV + NP" ) task.execute_remotely(queue_name="default", exit_process=True) @@ -19,19 +19,16 @@ from src.policies.PolicyEvaluator import PolicyEvaluator data_config = DataConfig() data_config.NRV_HISTORY = True -data_config.LOAD_HISTORY = False -data_config.LOAD_FORECAST = False +data_config.LOAD_HISTORY = True +data_config.LOAD_FORECAST = True -data_config.PV_FORECAST = False -data_config.PV_HISTORY = False +data_config.PV_FORECAST = True +data_config.PV_HISTORY = True -data_config.WIND_FORECAST = False -data_config.WIND_HISTORY = False +data_config.WIND_FORECAST = True +data_config.WIND_HISTORY = True -data_config.QUARTER = False -data_config.DAY_OF_WEEK = False - -data_config.NOMINAL_NET_POSITION = False +data_config.NOMINAL_NET_POSITION = True data_config = task.connect(data_config, name="data_features") @@ -45,7 +42,7 @@ print("Input dim: ", inputDim) model_parameters = { "epochs": 15000, "learning_rate": 0.0001, - "hidden_sizes": [256, 256, 256], + "hidden_sizes": [1024, 1024, 1024, 1024], "time_dim": 8, }