Primoz
e40f0fd8dc
Bug fixed (mixed dtype warning).
2022-12-12 11:29:59 +00:00
Primoz
3b2001f570
Modify the stress_event logic so that it includes where stressfulness is 0.
2022-12-09 16:01:46 +00:00
Primoz
87e5209a9f
Squashed commit of the following:
...
commit 8a6b52a97c
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 29 11:35:49 2022 +0000
Switch to 30_before ERS with corresponding targets.
commit 244a053730
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 29 11:19:43 2022 +0000
Change output files settings to nonstandardized.
commit be0324fd01
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Nov 28 12:44:25 2022 +0000
Fix some bugs and set categorical columns as categories dtypes.
commit 99c2fab8f9
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Nov 16 09:50:18 2022 +0000
Fix a bug in the making of the individual model (when there is no target in the participants columns).
commit 286de93bfd
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 15 11:21:51 2022 +0000
Fix some bugs and extend ERS and cleaning scripts with multiple stress event targets logic.
commit ab803ee49c
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 15 10:14:07 2022 +0000
Add additional appraisal targets.
commit 621f11b2d9
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 15 09:53:31 2022 +0000
Fix a bug related to wrong user input (duplicated events).
commit bd41f42a5d
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Nov 14 15:07:36 2022 +0000
Rename target_ to segmenting_ method.
commit a543ce372f
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Nov 14 15:04:16 2022 +0000
Add comments for event_related_script understanding.
commit 74b454b07b
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Nov 11 09:15:12 2022 +0000
Apply changes to string answers to make them language-generic.
commit 6ebe83e47e
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 10 12:42:52 2022 +0000
Improve the ERS extract method with a couple of validations.
commit 00350ef8ca
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 10 10:32:58 2022 +0000
Change config for stressfulness event target method.
commit e4985c9121
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 10 10:29:11 2022 +0000
Override stressfulness event target with extracted values from csv.
commit a668b6e8da
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 10 09:37:27 2022 +0000
Extract ERS and stress event targets to csv files (completed).
commit 9199b53ded
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Nov 9 15:11:51 2022 +0000
Get, join and start processing required ERS stress event data.
commit f3c6a66da9
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 8 15:53:43 2022 +0000
Begin with stress events in the ERS script.
commit 0b3e9226b3
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 8 14:44:24 2022 +0000
Make small corrections in ERS file.
commit 2d83f7ddec
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 8 11:32:05 2022 +0000
Begin the ERS logic for 90-minutes events.
commit 1da72a7cbe
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Nov 8 09:45:37 2022 +0000
Rename targets method in config.
commit 9f441afc16
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Nov 4 15:09:04 2022 +0000
Begin ERS logic for 90-minutes events.
commit c1c9f4d05a
Merge: 62f46ea3
7ab0280d
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Nov 4 09:11:58 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit 62f46ea376
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Nov 4 09:11:53 2022 +0000
Prepare method-based logic for ERS generating.
commit 7ab0280d7e
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Nov 4 08:58:08 2022 +0000
Correctly rename stressful event target variable.
commit eefa9f3f4d
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 3 14:49:54 2022 +0000
Add new target: stressfulness_event.
commit 5e8174dd41
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 3 13:52:45 2022 +0000
Add new target: stressfulness_period.
commit 35c1a762e7
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 3 13:51:18 2022 +0000
Improve filtering by esm_session and device_id.
commit 02264b21fd
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Nov 3 09:30:12 2022 +0000
Add logic for target selection in ERS processing.
commit 0ce8723bdb
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Nov 2 14:01:21 2022 +0000
Extend imputation logic within the cleaning script.
commit 30b38bfc02
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Oct 28 09:00:13 2022 +0000
Fix the generating procedure of ERS file for participants with multiple devices.
commit cd137af15a
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Oct 27 14:20:15 2022 +0000
Config for 30 minute EMA segments.
commit 3c0585a566
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Oct 27 14:12:56 2022 +0000
Remove obsolete comments.
commit 6b487fcf7b
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Oct 27 14:11:42 2022 +0000
Set E4 data yield to 1 if it is over 1. Optimize E4 data_yield script.
commit 5d17c92e54
Merge: a31fdd14
0d143e6a
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 14:18:20 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit a31fdd1479
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 14:18:08 2022 +0000
Start to test empatica_data_yield precieved error.
commit 936324d234
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 14:17:27 2022 +0000
Switch config for 30 minutes event related segments.
commit da0a4596f8
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 14:16:25 2022 +0000
Add additional ESM processing logic for ERS csv extraction.
commit d4d74818e6
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 14:14:32 2022 +0000
Fix a bug - missing time_segment column when df is empty
commit 14ff59914b
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 09:59:46 2022 +0000
Fix to correct dtypes.
commit 6ab0ac5329
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 26 09:57:26 2022 +0000
Optimize memory consumption with dtype definition while reading csv file.
commit 0d143e6aad
Merge: 8acac501
b92a3aa3
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 25 15:28:27 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit 8acac50125
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 25 15:26:43 2022 +0000
Add safenet when features dataframe is empty.
commit b92a3aa37a
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 25 15:25:22 2022 +0000
Remove unwanted output or other error producing code.
commit bfd637eb9c
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 25 08:53:44 2022 +0000
Improve strings formatting in straw_events file.
commit 0d81ad5756
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 19 13:35:04 2022 +0000
Debug assignment of segments to rows
commit cea451d344
Merge: e88bbd54
cf38d9f1
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 18 09:15:06 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit e88bbd548f
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 18 09:15:00 2022 +0000
Add new daily segment and filter by segment in the cleaning script.
commit cf38d9f175
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Oct 17 15:07:33 2022 +0000
Implement ERS generating logic.
commit f3ca56cdbf
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Oct 14 14:46:28 2022 +0000
Start with ERS logic integration within Snakemake.
commit 797aa98f4f
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 12 15:51:50 2022 +0000
Config for ERS testing.
commit 9baff159cd
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 12 15:51:23 2022 +0000
Changes needed for testing and starting of the Event-Related Segments.
commit 0f21273508
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 12 12:32:51 2022 +0000
Bugs fix
commit 55517eb737
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 12 12:23:11 2022 +0000
Necessary commit before proceeding.
commit de15a52dba
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 11 08:36:23 2022 +0000
Bug fix
commit 1ad25bb572
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Oct 11 08:26:17 2022 +0000
Few modifications of some imputation values in cleaning script and feature extraction.
commit 9884b383cf
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Oct 10 16:45:38 2022 +0000
Testing new data with AutoML.
commit 2dc89c083c
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Oct 7 08:52:12 2022 +0000
Small changes in cleaning overall
commit 001d400729
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Oct 6 14:28:12 2022 +0000
Clean features and create input files based on all possible targets.
commit 1e38d9bf1e
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Oct 6 13:27:38 2022 +0000
Standardization and correlation visualization in overall cleaning script.
commit a34412a18d
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 5 14:16:55 2022 +0000
E4 data yield corrections. Changes in overal cs - standardization.
commit 437459648f
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Oct 5 13:35:05 2022 +0000
Errors fix: individual script - treat participants missing data.
commit 53f6cc60d5
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Oct 3 13:06:39 2022 +0000
Config and cleaning script necessary changes ...
commit bbeabeee6f
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Oct 3 12:53:31 2022 +0000
Last changes before processing on the server.
commit 44531c6d94
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Sep 30 10:04:07 2022 +0000
Code cleaning, reworking cleaning individual based on changes in overall script. Changes in thresholds.
commit 7ac7cd5a37
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 29 14:33:21 2022 +0000
Preparation of the overall cleaning script.
commit 68fd69dada
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 29 11:55:25 2022 +0000
Cleaning script for individuals: corrections and comments.
commit a4f0d056a0
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 29 11:44:27 2022 +0000
Fillna for app foreground and activity recognition
commit 6286e7a44c
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 28 12:47:08 2022 +0000
firstuseafter column removed from contextual imputation
commit 9b3447febd
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 28 12:40:05 2022 +0000
Contextual imputation correction
commit d6adda30cf
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 28 12:37:51 2022 +0000
Contextual imputation on time(first/last) features.
commit 8af4ef11dc
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 28 10:02:47 2022 +0000
Contextual imputation by feature type.
commit 536b9494cd
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 27 14:12:08 2022 +0000
Cleaning script corrections
commit f0b87c9dd0
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 27 09:54:15 2022 +0000
Debugging of the empatica data yield integration.
commit 7fcdb873fe
Merge: 5c7bb0f4
bd53dc16
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 27 07:50:29 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit 5c7bb0f4c1
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 27 07:48:32 2022 +0000
Config changes
commit bd53dc1684
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Sep 26 15:54:00 2022 +0000
Empatica data yield usage in the cleaning script.
commit d9a574c550
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Sep 23 13:24:50 2022 +0000
Changes in the cleaning script and preparation of empatica data yield method.
commit 19aa8707c0
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 22 13:45:51 2022 +0000
Redefined cleaning steps after revision
commit 247d758cb7
Merge: 90ee99e4
7493aaa6
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 21 07:18:01 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit 90ee99e4b9
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 21 07:16:00 2022 +0000
Remove TODO comments
commit 7493aaa643
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 20 12:57:55 2022 +0000
Small changes in cleaning scrtipt and missing vals testing.
commit eaf4340afd
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 20 08:03:48 2022 +0000
Small imputation and cleaning corrections.
commit a96ea508c6
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Sep 19 07:34:02 2022 +0000
Fill NaN of Empatica's SD second order feature (must be tested).
commit 52e11cdcab
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Sep 19 07:25:54 2022 +0000
Configurations for new standardization path.
commit 92aff93e65
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Sep 19 07:25:16 2022 +0000
Remove standardization script.
commit 18b63127de
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Sep 19 06:16:26 2022 +0000
Removed all standardizaton rules and configurations.
commit 62982866cd
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Sep 16 13:24:21 2022 +0000
Phone wifi visible inspection (WIP)
commit 0ce6da5444
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Sep 16 11:30:08 2022 +0000
kNN imputation relocation and execution only on specific columns.
commit e3b78c8a85
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Sep 16 10:58:57 2022 +0000
Impute selected phone features with 0.
Wifi visible, screen, and light.
commit 7d85f75d21
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Sep 16 09:03:30 2022 +0000
Changes in phone features NaN values script.
commit 385e21409d
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 15 14:16:58 2022 +0000
Changes in NaN values testing script.
commit 18002f59e1
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 15 10:48:59 2022 +0000
Doryab bluetooth and locations features fill in NaN values.
commit 3cf7ca41aa
Merge: d27a4a71
d5ab5a03
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 14 15:38:32 2022 +0000
Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning
commit d5ab5a0394
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Sep 14 14:13:03 2022 +0000
Writing testing scripts to determine the point of manual imputation.
commit dfbb758902
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 13 13:54:06 2022 +0000
Changes in AutoML params and environment.yml
commit 4ec371ed96
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Sep 13 09:51:03 2022 +0000
Testing auto-sklearn
commit d27a4a71c8
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Sep 12 13:44:17 2022 +0000
Reorganisation and reordering of the cleaning script.
commit 15d792089d
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 1 10:33:36 2022 +0000
Changes in cleaning script:
- target extracted from config to remove rows where target is nan
- prepared sns.heatmap for further missing values analysis
- necessary changes in config and participant p01
- picture of heatmap which shows the values state after cleaning
commit cb351e0ff6
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 1 10:06:57 2022 +0000
Unnecessary line (rows with no target value will be removed in cleaning script).
commit 86299d346b
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Sep 1 09:57:21 2022 +0000
Impute phone and sms NAs with 0
commit 3f7ec80c18
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Aug 31 10:18:50 2022 +0000
Preparation a) phone_calls 0 imputation b) remove rows with NaN target
2022-12-08 16:04:39 +00:00
Primoz
f78aa3e7b3
Preparation for cleaning & imputation
2022-08-26 10:56:14 +00:00
Primoz
c498ecb742
Include baseline models (+corrections), disable columns drop in cleaning function.
2022-08-23 14:12:14 +00:00
Primoz
f088e9586f
Handle empty ACC.csv
2022-08-22 14:20:47 +00:00
Primoz
0aa0e82673
Handle empty Empatica csv files.
2022-08-22 14:18:12 +00:00
Primoz
4cfe5a3a98
Disable discarding rows if DATA_YIELD_RATIO_THRESHOLD==0.
2022-08-19 13:10:56 +00:00
Primoz
607da820f2
Configuration and cleaning changes
2022-08-18 14:21:05 +00:00
Primoz
fb577bc9ad
Squashed commit of the following:
...
commit 43ecc243cb62bb31eed85cb477ca4131555c7fe7
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 22 15:26:09 2022 +0000
Adding TODO comments
commit 2df1ebf90c3a93812b112b8ed0ee4e23cd74533f
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 21 13:59:23 2022 +0000
README update
commit 5182c2b16dff3537aad42984b8ea5214743cdb32
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 21 11:03:01 2022 +0000
Few corrections for all_cleaning
commit 3d9254c1b3bed6e95e631d4e0402548830a19534
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 21 10:28:05 2022 +0000
Adding the min overlap for corr threshold and preservation of esm cols.
commit e27c49cc8fa4c51f9fe8e593a8d25e9a032ab393
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 21 09:02:00 2022 +0000
Commenting and cleaning.
commit 31a47a5ee4569264e39d7c445525a6e64bb7700a
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Jul 20 13:49:22 2022 +0000
Environment version change.
commit 5b274ed8993f58e783bda6d82fce936764209c28
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 16:10:07 2022 +0000
Enabled cleaning for all participants + standardization files.
commit 203fdb31e0f3c647ef8c8a60cb9531831b7ab924
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 14:14:51 2022 +0000
Features cleaning fixes after testing. Visualization script for phone features values.
commit 176178d73b154c30b9eb9eb4a67514f00d6a924e
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 09:05:14 2022 +0000
Revert "Necessary config changes."
This reverts commit 6ec1ef50430d2e1f5ce4670d505d5e84ac47f0a0.
commit 26ea6512c9d512f95837e7b047fe510c1d196403
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 13:19:47 2022 +0000
Adding cleaning function condition and cleaning functionality.
commit 575c29eef9c21e6f2d7832871e73bc0941643734
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 12:51:56 2022 +0000
Translation of the cleaning individual RAPIDS function from R to py.
commit 6ec1ef50430d2e1f5ce4670d505d5e84ac47f0a0
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 12:02:18 2022 +0000
Necessary config changes.
commit b5669f51612fbd8378848615d639677851ab032f
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 15:26:00 2022 +0000
Modified snakemake rule to dynamically choose script extention.
commit 66636be1e8ae4828228b37c59b9df1faf3fc3d3d
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 14:43:08 2022 +0000
Trying to modify the snakefile rule to execute scripts in two languages depended on the provider.
commit 574778b00f3cbb368ef4bc74de15cf5070c65ea9
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 09:49:41 2022 +0000
gitignore: adding required files so that RAPIDS can be run successfully.
commit 71018ab178256970535e78961602ab8c7f0ebb14
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 08:34:19 2022 +0000
Standardization bug fixes
commit 6253c470a624e6bfbb02e0c453b652452eb2dbbc
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 14 15:28:02 2022 +0000
Seperate rules for empatica vs. nonempatica standardization.
Parameter in config that controls the creation of standardized merged files for individual and all participants..
commit 90f902778565e0896d3bae22ae8551be8b487e67
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 12 14:23:03 2022 +0000
Preparing for final csvs' standardization.
commit d25dde3998786a9a582f5cda544ee104386778f9
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 12:08:47 2022 +0000
Revert "Changes in config to be reverted."
This reverts commit bea7608e7095021fb7c53a9afa07074448fe4313.
commit 6b23e70857e63deda98eb98d190af9090626c84b
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 12:08:26 2022 +0000
Enabled standardization for rest (previously active) phone features.
Testing still needed.
commit 8ec58a6f34ba3d42e5cc71d26e6d91837472ca5f
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 09:07:55 2022 +0000
Enabled standardization for phone calls.
All steps completed and tested.
commit bea7608e7095021fb7c53a9afa07074448fe4313
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 07:47:51 2022 +0000
Changes in config to be reverted.
commit 4e84ca0e51bf709bff56fd09437b95310ec6bedd
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 8 14:11:24 2022 +0000
Standardization for the rest of the features.
commit cc581aa788e3d5c17131af8f3d5dd6b0c3b5aff7
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 8 14:11:08 2022 +0000
README update again
2022-07-22 15:31:30 +00:00
Primoz
6ba4a66deb
Squashed commit of the following:
...
commit 31a47a5ee4569264e39d7c445525a6e64bb7700a
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Jul 20 13:49:22 2022 +0000
Environment version change.
commit 5b274ed8993f58e783bda6d82fce936764209c28
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 16:10:07 2022 +0000
Enabled cleaning for all participants + standardization files.
commit 203fdb31e0f3c647ef8c8a60cb9531831b7ab924
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 14:14:51 2022 +0000
Features cleaning fixes after testing. Visualization script for phone features values.
commit 176178d73b154c30b9eb9eb4a67514f00d6a924e
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 09:05:14 2022 +0000
Revert "Necessary config changes."
This reverts commit 6ec1ef50430d2e1f5ce4670d505d5e84ac47f0a0.
commit 26ea6512c9d512f95837e7b047fe510c1d196403
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 13:19:47 2022 +0000
Adding cleaning function condition and cleaning functionality.
commit 575c29eef9c21e6f2d7832871e73bc0941643734
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 12:51:56 2022 +0000
Translation of the cleaning individual RAPIDS function from R to py.
commit 6ec1ef50430d2e1f5ce4670d505d5e84ac47f0a0
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 12:02:18 2022 +0000
Necessary config changes.
commit b5669f51612fbd8378848615d639677851ab032f
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 15:26:00 2022 +0000
Modified snakemake rule to dynamically choose script extention.
commit 66636be1e8ae4828228b37c59b9df1faf3fc3d3d
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 14:43:08 2022 +0000
Trying to modify the snakefile rule to execute scripts in two languages depended on the provider.
commit 574778b00f3cbb368ef4bc74de15cf5070c65ea9
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 09:49:41 2022 +0000
gitignore: adding required files so that RAPIDS can be run successfully.
commit 71018ab178256970535e78961602ab8c7f0ebb14
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 08:34:19 2022 +0000
Standardization bug fixes
commit 6253c470a624e6bfbb02e0c453b652452eb2dbbc
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 14 15:28:02 2022 +0000
Seperate rules for empatica vs. nonempatica standardization.
Parameter in config that controls the creation of standardized merged files for individual and all participants..
commit 90f902778565e0896d3bae22ae8551be8b487e67
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 12 14:23:03 2022 +0000
Preparing for final csvs' standardization.
commit d25dde3998786a9a582f5cda544ee104386778f9
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 12:08:47 2022 +0000
Revert "Changes in config to be reverted."
This reverts commit bea7608e7095021fb7c53a9afa07074448fe4313.
commit 6b23e70857e63deda98eb98d190af9090626c84b
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 12:08:26 2022 +0000
Enabled standardization for rest (previously active) phone features.
Testing still needed.
commit 8ec58a6f34ba3d42e5cc71d26e6d91837472ca5f
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 09:07:55 2022 +0000
Enabled standardization for phone calls.
All steps completed and tested.
commit bea7608e7095021fb7c53a9afa07074448fe4313
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 07:47:51 2022 +0000
Changes in config to be reverted.
commit 4e84ca0e51bf709bff56fd09437b95310ec6bedd
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 8 14:11:24 2022 +0000
Standardization for the rest of the features.
commit cc581aa788e3d5c17131af8f3d5dd6b0c3b5aff7
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 8 14:11:08 2022 +0000
README update again
2022-07-20 13:51:22 +00:00
Primoz
788ac31190
Bug fix: if df has no rows write an empty zscore file.
2022-07-08 10:40:45 +00:00
Primoz
5a777ac79f
Working version that integrates both phone and empatica feature calculations.
2022-07-07 15:00:47 +00:00
Primoz
0425403951
Merge branch 'master' of https://repo.ijs.si/junoslukan/rapids
2022-07-06 11:53:31 +00:00
Primoz
887fd7dc72
Merge branch 'empatica_calculating_features'
2022-07-06 11:53:21 +00:00
Primoz
d2758eef46
Set not NaN sum insted of 0 sum for HRV features windows.
2022-07-06 07:36:35 +00:00
Primoz
2d5d23b615
Testing files change and remove standardization from hrv sensors main files.
2022-07-06 07:35:39 +00:00
Primoz
505c3a86b9
Testing different EDA findPeaks parameters.
2022-06-30 15:15:37 +00:00
Primoz
c851ab0763
Fill EDA NaN values where numPeak is zero. Other small changes.
2022-06-21 14:09:49 +00:00
Primoz
dda4554d46
Various small changes.
2022-06-15 13:57:46 +00:00
Primoz
212cf300f8
Debugging EDA signal - preliminary step for imputation.
2022-06-14 15:09:14 +00:00
Primoz
9ea39dc557
Standardization as a Snakefile's rule enabled for all E4 sensors.
2022-06-13 18:17:30 +00:00
Primoz
402059871f
Making standardization as a rule. WIP: done only for BVP.
2022-06-13 14:12:03 +00:00
Primoz
094743244d
Added SO feature for sum all rows that are non zero for BVP and IBI sensors.
2022-06-13 10:51:22 +00:00
primoz
e1d7607de4
Extraction of additional SO features. Min/max has been changed to nsmallest/nlargest means.
2022-06-10 12:34:48 +00:00
primoz
f371249b99
First order features standardization WIP
2022-06-09 13:35:15 +00:00
primoz
2c7ac21465
Added standardization on SO features.
2022-06-06 13:51:15 +00:00
primoz
2acf6ff9fb
Exception handling in case of empty ibi. Changes of the method EDA uses in main.py. Other small corrections.
2022-06-03 12:34:36 +00:00
primoz
d300f0f8f0
Fixed RAPIDS bug: error when IBI.csv is empty.
2022-06-02 11:43:49 +00:00
Primoz
5532043b1f
Patching IBI with BVP - completed.
2022-05-25 19:39:47 +00:00
Primoz
bb62497ba6
Patching IBI with BVP - selecting appropriate pipeline entry point. WIP
2022-05-24 11:07:18 +00:00
Primoz
2a8f58f5c8
Patching IBI with BVP. WIP
2022-05-20 13:18:45 +00:00
Primoz
6864cfe775
Changes after thorough testing with available data.
2022-05-13 13:35:34 +00:00
Primoz
c1564f0cae
Changed wrapper method calculate_feature to its newest version (for TEMP and ACC).
2022-05-11 14:21:21 +00:00
Primoz
31e36e7400
Alternating Second order and full segment features corresponding to config settings.
2022-05-11 08:50:15 +00:00
Primoz
9cf9e1fe14
Testing and modifying the code with different E4 data.
2022-05-10 11:36:49 +00:00
Primoz
f62a1302dd
Cr-features corrections for ACC and TEMP sensors
2022-05-09 11:01:52 +00:00
Primoz
5638367999
Implementation of the second order features.
2022-04-25 13:07:03 +00:00
Primoz
66451160e9
Calculating HRV features with IBI.csv.
2022-04-20 10:44:51 +00:00
=
8c8fe1fec7
Modifications, mostly imports, after changes in cr-features module.
2022-04-19 13:24:46 +00:00
=
075c64d1e5
HRV: changed wrapper calcFeat method with specialized one.
2022-04-14 11:51:53 +00:00
junos
c05b047c2d
Correct outstanding baseline feature mistake.
2022-04-13 17:05:16 +02:00
junos
53ec52a954
Disable (SOME) feature cleaning for ESM data.
2022-04-13 16:01:31 +02:00
=
3c058e4463
Add option to calculate features within windows and store it in CSV (all sensors).
2022-04-13 13:18:23 +00:00
junos
144f0d0dcf
Account for missing baseline data.
2022-04-13 14:56:28 +02:00
junos
ed5314aa98
Merge remote-tracking branch 'origin/master'
2022-04-12 17:27:25 +02:00
junos
a6a37c7bd9
Drop NaN targets.
...
This mirrors INNER join in merge_features_and_targets_for_individual_model.py:
data = pd.concat([sensor_features, targets[["target"]]], axis=1, join="inner")
2022-04-12 17:01:49 +02:00
junos
9f5edf1c2b
Revert "Add a rule for model baselines."
...
The example was for a classification rather than regression problem.
This reverts commit 9ab0c8f289
.
# Conflicts:
# rules/models.smk
2022-04-12 16:59:42 +02:00
junos
4ad261fae5
Rename baseline features AGAIN.
...
Correct other mistakes.
2022-04-12 16:55:01 +02:00
=
74cf4ada1c
Cr-feat window length for all empaticas sensors.
2022-04-12 14:00:44 +00:00