Resolve "Data reformatters"
Incorporating the changes envision in #102 (closed). The main places where to test the new additions are:
-
examples/semiramis/daaad_pipeline_semiramis.ipynb
Here it is possible to test the generation, at the end of the notebook. All the different options, usingNone
, the names ofDataObjects
, etc. -
examples/toy_problem_overlap/toy_problem_overlap.ipynb
At the every end, after the generation, we can test theAnalysisCallback
, in order to get the ground truth values for some generateddesign parameters
.
Most of these functions are relying on many data reformatters incorporated in the src/aaad/data/utils_data.py
. All this is wrapped in function convert_to
, which works as follows:
- Receives some data, in any of the compatible formats. This is just data, i.e., no
uid
orerror
columns, as this will be removed. Then, we provide also the output data format, and theDataObjects
. Then, we receive the formatted data.
There is also an auxiliary combine
function, to merge data of design parameters and performance attributes, into a single variables, with the format specified.