8acac50125
Add safenet when features dataframe is empty.
2022-10-25 15:26:43 +00:00
bfd637eb9c
Improve strings formatting in straw_events file.
2022-10-25 08:53:44 +00:00
0d81ad5756
Debug assignment of segments to rows
2022-10-19 13:35:04 +00:00
cea451d344
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
2022-10-18 09:15:06 +00:00
e88bbd548f
Add new daily segment and filter by segment in the cleaning script.
2022-10-18 09:15:00 +00:00
cf38d9f175
Implement ERS generating logic.
2022-10-17 15:07:33 +00:00
f3ca56cdbf
Start with ERS logic integration within Snakemake.
2022-10-14 14:46:28 +00:00
9baff159cd
Changes needed for testing and starting of the Event-Related Segments.
2022-10-12 15:51:23 +00:00
0f21273508
Bugs fix
2022-10-12 12:32:51 +00:00
55517eb737
Necessary commit before proceeding.
2022-10-12 12:23:11 +00:00
de15a52dba
Bug fix
2022-10-11 08:36:23 +00:00
1ad25bb572
Few modifications of some imputation values in cleaning script and feature extraction.
2022-10-11 08:26:17 +00:00
2dc89c083c
Small changes in cleaning overall
2022-10-07 08:52:12 +00:00
001d400729
Clean features and create input files based on all possible targets.
2022-10-06 14:28:12 +00:00
1e38d9bf1e
Standardization and correlation visualization in overall cleaning script.
2022-10-06 13:27:38 +00:00
a34412a18d
E4 data yield corrections. Changes in overal cs - standardization.
2022-10-05 14:16:55 +00:00
437459648f
Errors fix: individual script - treat participants missing data.
2022-10-05 13:35:05 +00:00
53f6cc60d5
Config and cleaning script necessary changes ...
2022-10-03 13:06:39 +00:00
bbeabeee6f
Last changes before processing on the server.
2022-10-03 12:53:31 +00:00
44531c6d94
Code cleaning, reworking cleaning individual based on changes in overall script. Changes in thresholds.
2022-09-30 10:04:07 +00:00
7ac7cd5a37
Preparation of the overall cleaning script.
2022-09-29 14:33:21 +00:00
68fd69dada
Cleaning script for individuals: corrections and comments.
2022-09-29 11:55:25 +00:00
a4f0d056a0
Fillna for app foreground and activity recognition
2022-09-29 11:44:27 +00:00
6286e7a44c
firstuseafter column removed from contextual imputation
2022-09-28 12:47:08 +00:00
9b3447febd
Contextual imputation correction
2022-09-28 12:40:05 +00:00
d6adda30cf
Contextual imputation on time(first/last) features.
2022-09-28 12:37:51 +00:00
8af4ef11dc
Contextual imputation by feature type.
2022-09-28 10:02:47 +00:00
536b9494cd
Cleaning script corrections
2022-09-27 14:12:08 +00:00
f0b87c9dd0
Debugging of the empatica data yield integration.
2022-09-27 09:54:15 +00:00
bd53dc1684
Empatica data yield usage in the cleaning script.
2022-09-26 15:54:00 +00:00
d9a574c550
Changes in the cleaning script and preparation of empatica data yield method.
2022-09-23 13:24:50 +00:00
19aa8707c0
Redefined cleaning steps after revision
2022-09-22 13:45:51 +00:00
247d758cb7
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
2022-09-21 07:18:01 +00:00
90ee99e4b9
Remove TODO comments
2022-09-21 07:16:00 +00:00
7493aaa643
Small changes in cleaning scrtipt and missing vals testing.
2022-09-20 12:57:55 +00:00
eaf4340afd
Small imputation and cleaning corrections.
2022-09-20 08:03:48 +00:00
a96ea508c6
Fill NaN of Empatica's SD second order feature (must be tested).
2022-09-19 07:34:02 +00:00
52e11cdcab
Configurations for new standardization path.
2022-09-19 07:25:54 +00:00
92aff93e65
Remove standardization script.
2022-09-19 07:25:16 +00:00
62982866cd
Phone wifi visible inspection (WIP)
2022-09-16 13:24:21 +00:00
0ce6da5444
kNN imputation relocation and execution only on specific columns.
2022-09-16 11:30:08 +00:00
e3b78c8a85
Impute selected phone features with 0.
...
Wifi visible, screen, and light.
2022-09-16 10:58:57 +00:00
18002f59e1
Doryab bluetooth and locations features fill in NaN values.
2022-09-15 10:48:59 +00:00
3cf7ca41aa
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
2022-09-14 15:38:32 +00:00
d5ab5a0394
Writing testing scripts to determine the point of manual imputation.
2022-09-14 14:13:03 +00:00
d27a4a71c8
Reorganisation and reordering of the cleaning script.
2022-09-12 13:44:17 +00:00
15d792089d
Changes in cleaning script:
...
- target extracted from config to remove rows where target is nan
- prepared sns.heatmap for further missing values analysis
- necessary changes in config and participant p01
- picture of heatmap which shows the values state after cleaning
2022-09-01 10:33:36 +00:00
cb351e0ff6
Unnecessary line (rows with no target value will be removed in cleaning script).
2022-09-01 10:06:57 +00:00
86299d346b
Impute phone and sms NAs with 0
2022-09-01 09:57:21 +00:00
3f7ec80c18
Preparation a) phone_calls 0 imputation b) remove rows with NaN target
2022-08-31 10:18:50 +00:00
Primoz