1e38d9bf1e
Standardization and correlation visualization in overall cleaning script.
2022-10-06 13:27:38 +00:00
a34412a18d
E4 data yield corrections. Changes in overal cs - standardization.
2022-10-05 14:16:55 +00:00
437459648f
Errors fix: individual script - treat participants missing data.
2022-10-05 13:35:05 +00:00
53f6cc60d5
Config and cleaning script necessary changes ...
2022-10-03 13:06:39 +00:00
bbeabeee6f
Last changes before processing on the server.
2022-10-03 12:53:31 +00:00
44531c6d94
Code cleaning, reworking cleaning individual based on changes in overall script. Changes in thresholds.
2022-09-30 10:04:07 +00:00
7ac7cd5a37
Preparation of the overall cleaning script.
2022-09-29 14:33:21 +00:00
68fd69dada
Cleaning script for individuals: corrections and comments.
2022-09-29 11:55:25 +00:00
a4f0d056a0
Fillna for app foreground and activity recognition
2022-09-29 11:44:27 +00:00
6286e7a44c
firstuseafter column removed from contextual imputation
2022-09-28 12:47:08 +00:00
9b3447febd
Contextual imputation correction
2022-09-28 12:40:05 +00:00
d6adda30cf
Contextual imputation on time(first/last) features.
2022-09-28 12:37:51 +00:00
8af4ef11dc
Contextual imputation by feature type.
2022-09-28 10:02:47 +00:00
536b9494cd
Cleaning script corrections
2022-09-27 14:12:08 +00:00
f0b87c9dd0
Debugging of the empatica data yield integration.
2022-09-27 09:54:15 +00:00
7fcdb873fe
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
2022-09-27 07:50:29 +00:00
5c7bb0f4c1
Config changes
2022-09-27 07:48:32 +00:00
bd53dc1684
Empatica data yield usage in the cleaning script.
2022-09-26 15:54:00 +00:00
d9a574c550
Changes in the cleaning script and preparation of empatica data yield method.
2022-09-23 13:24:50 +00:00
19aa8707c0
Redefined cleaning steps after revision
2022-09-22 13:45:51 +00:00
247d758cb7
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
2022-09-21 07:18:01 +00:00
90ee99e4b9
Remove TODO comments
2022-09-21 07:16:00 +00:00
7493aaa643
Small changes in cleaning scrtipt and missing vals testing.
2022-09-20 12:57:55 +00:00
eaf4340afd
Small imputation and cleaning corrections.
2022-09-20 08:03:48 +00:00
a96ea508c6
Fill NaN of Empatica's SD second order feature (must be tested).
2022-09-19 07:34:02 +00:00
52e11cdcab
Configurations for new standardization path.
2022-09-19 07:25:54 +00:00
92aff93e65
Remove standardization script.
2022-09-19 07:25:16 +00:00
18b63127de
Removed all standardizaton rules and configurations.
2022-09-19 06:16:26 +00:00
62982866cd
Phone wifi visible inspection (WIP)
2022-09-16 13:24:21 +00:00
0ce6da5444
kNN imputation relocation and execution only on specific columns.
2022-09-16 11:30:08 +00:00
e3b78c8a85
Impute selected phone features with 0.
...
Wifi visible, screen, and light.
2022-09-16 10:58:57 +00:00
7d85f75d21
Changes in phone features NaN values script.
2022-09-16 09:03:30 +00:00
385e21409d
Changes in NaN values testing script.
2022-09-15 14:16:58 +00:00
18002f59e1
Doryab bluetooth and locations features fill in NaN values.
2022-09-15 10:48:59 +00:00
3cf7ca41aa
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
2022-09-14 15:38:32 +00:00
d5ab5a0394
Writing testing scripts to determine the point of manual imputation.
2022-09-14 14:13:03 +00:00
dfbb758902
Changes in AutoML params and environment.yml
2022-09-13 13:54:06 +00:00
4ec371ed96
Testing auto-sklearn
2022-09-13 09:51:03 +00:00
d27a4a71c8
Reorganisation and reordering of the cleaning script.
2022-09-12 13:44:17 +00:00
15d792089d
Changes in cleaning script:
...
- target extracted from config to remove rows where target is nan
- prepared sns.heatmap for further missing values analysis
- necessary changes in config and participant p01
- picture of heatmap which shows the values state after cleaning
2022-09-01 10:33:36 +00:00
cb351e0ff6
Unnecessary line (rows with no target value will be removed in cleaning script).
2022-09-01 10:06:57 +00:00
86299d346b
Impute phone and sms NAs with 0
2022-09-01 09:57:21 +00:00
3f7ec80c18
Preparation a) phone_calls 0 imputation b) remove rows with NaN target
2022-08-31 10:18:50 +00:00
f78aa3e7b3
Preparation for cleaning & imputation
2022-08-26 10:56:14 +00:00
a620def209
Generate standardized model input files (NOTE: commented unstandardized sections!)
2022-08-24 13:42:39 +00:00
c498ecb742
Include baseline models (+corrections), disable columns drop in cleaning function.
2022-08-23 14:12:14 +00:00
f088e9586f
Handle empty ACC.csv
2022-08-22 14:20:47 +00:00
0aa0e82673
Handle empty Empatica csv files.
2022-08-22 14:18:12 +00:00
4cfe5a3a98
Disable discarding rows if DATA_YIELD_RATIO_THRESHOLD==0.
2022-08-19 13:10:56 +00:00
607da820f2
Configuration and cleaning changes
2022-08-18 14:21:05 +00:00
Primoz