Primoz
001d400729
Clean features and create input files based on all possible targets.
2022-10-06 14:28:12 +00:00
Primoz
6ba4a66deb
Squashed commit of the following:
...
commit 31a47a5ee4569264e39d7c445525a6e64bb7700a
Author: Primoz <sisko.primoz@gmail.com>
Date: Wed Jul 20 13:49:22 2022 +0000
Environment version change.
commit 5b274ed8993f58e783bda6d82fce936764209c28
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 16:10:07 2022 +0000
Enabled cleaning for all participants + standardization files.
commit 203fdb31e0f3c647ef8c8a60cb9531831b7ab924
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 14:14:51 2022 +0000
Features cleaning fixes after testing. Visualization script for phone features values.
commit 176178d73b154c30b9eb9eb4a67514f00d6a924e
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 19 09:05:14 2022 +0000
Revert "Necessary config changes."
This reverts commit 6ec1ef50430d2e1f5ce4670d505d5e84ac47f0a0.
commit 26ea6512c9d512f95837e7b047fe510c1d196403
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 13:19:47 2022 +0000
Adding cleaning function condition and cleaning functionality.
commit 575c29eef9c21e6f2d7832871e73bc0941643734
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 12:51:56 2022 +0000
Translation of the cleaning individual RAPIDS function from R to py.
commit 6ec1ef50430d2e1f5ce4670d505d5e84ac47f0a0
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 18 12:02:18 2022 +0000
Necessary config changes.
commit b5669f51612fbd8378848615d639677851ab032f
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 15:26:00 2022 +0000
Modified snakemake rule to dynamically choose script extention.
commit 66636be1e8ae4828228b37c59b9df1faf3fc3d3d
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 14:43:08 2022 +0000
Trying to modify the snakefile rule to execute scripts in two languages depended on the provider.
commit 574778b00f3cbb368ef4bc74de15cf5070c65ea9
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 09:49:41 2022 +0000
gitignore: adding required files so that RAPIDS can be run successfully.
commit 71018ab178256970535e78961602ab8c7f0ebb14
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 15 08:34:19 2022 +0000
Standardization bug fixes
commit 6253c470a624e6bfbb02e0c453b652452eb2dbbc
Author: Primoz <sisko.primoz@gmail.com>
Date: Thu Jul 14 15:28:02 2022 +0000
Seperate rules for empatica vs. nonempatica standardization.
Parameter in config that controls the creation of standardized merged files for individual and all participants..
commit 90f902778565e0896d3bae22ae8551be8b487e67
Author: Primoz <sisko.primoz@gmail.com>
Date: Tue Jul 12 14:23:03 2022 +0000
Preparing for final csvs' standardization.
commit d25dde3998786a9a582f5cda544ee104386778f9
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 12:08:47 2022 +0000
Revert "Changes in config to be reverted."
This reverts commit bea7608e7095021fb7c53a9afa07074448fe4313.
commit 6b23e70857e63deda98eb98d190af9090626c84b
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 12:08:26 2022 +0000
Enabled standardization for rest (previously active) phone features.
Testing still needed.
commit 8ec58a6f34ba3d42e5cc71d26e6d91837472ca5f
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 09:07:55 2022 +0000
Enabled standardization for phone calls.
All steps completed and tested.
commit bea7608e7095021fb7c53a9afa07074448fe4313
Author: Primoz <sisko.primoz@gmail.com>
Date: Mon Jul 11 07:47:51 2022 +0000
Changes in config to be reverted.
commit 4e84ca0e51bf709bff56fd09437b95310ec6bedd
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 8 14:11:24 2022 +0000
Standardization for the rest of the features.
commit cc581aa788e3d5c17131af8f3d5dd6b0c3b5aff7
Author: Primoz <sisko.primoz@gmail.com>
Date: Fri Jul 8 14:11:08 2022 +0000
README update again
2022-07-20 13:51:22 +00:00
Primoz
5532043b1f
Patching IBI with BVP - completed.
2022-05-25 19:39:47 +00:00
Primoz
2a8f58f5c8
Patching IBI with BVP. WIP
2022-05-20 13:18:45 +00:00
Primoz
9cf9e1fe14
Testing and modifying the code with different E4 data.
2022-05-10 11:36:49 +00:00
Primoz
5638367999
Implementation of the second order features.
2022-04-25 13:07:03 +00:00
=
3c058e4463
Add option to calculate features within windows and store it in CSV (all sensors).
2022-04-13 13:18:23 +00:00
Meng Li
5bad3eb8b5
Data cleaning ( #166 )
...
* Refactor data cleaning module: move it from example workflow to main directory
* Replace NAs with 0 in selected event-based features
* Add one step to drop highly correlated features
Co-authored-by: Weiyu <weiyuhuang7@gmail.com>
2021-11-19 10:34:36 -05:00
Meng Li
a3fb718aea
Refactor PHONE_LOCATIONS DORYAB provider to compute features based on location episodes
2021-09-23 17:40:06 -04:00
Meng Li
a8a178486b
Refactor PHONE_CALLS RAPIDS provider to compute features based on call episodes or events
2021-09-15 10:28:37 -04:00
Meng Li
1c57320ab3
Update segment labels and fix the bug when we do not have any labels for event segments
2021-06-29 09:49:24 -04:00
JulioV
e9cd9c94d7
Fix PID matching when joining data from participants
2021-05-11 16:49:04 -04:00
Meng Li
809845143f
Test & fix bugs of sleep intraday features
2021-04-27 14:40:14 -04:00
JulioV
9c56422529
Add calories intraday features
2021-04-20 12:00:38 -04:00
Meng Li
8414977331
Fix the bug of utils.py when one participant have multi timezones
2021-04-03 21:20:10 -04:00
Meng Li
1ea5b74eff
Fix the bug of utils.py when one participant have multi timezones
2021-03-31 19:34:14 -04:00
JulioV
d0858f8833
Fix overlapping periodic time segments
2021-03-28 15:29:07 -04:00
JulioV
4528ab3641
Replace SRC LANGUAGE and FOLDER with SCRIPT
2021-03-14 22:14:13 -04:00
JulioV
fb054b539f
Add support for multiple time zones
2021-03-11 14:35:34 -05:00
Meng Li
8377c12efb
Add sleep intraday features with RAPIDS provider
2021-02-26 17:47:01 -05:00
Meng Li
25a3492eba
Drop rows without "assigned_segments" column before feature extraction
2021-01-21 19:41:17 -05:00
Meng Li
797de54b34
Fix merge bug of fetch_provider_features() function
2021-01-21 14:58:31 -05:00
JulioV
05627296f4
Fix filter_data_by_segment bug
2020-12-12 17:10:59 -05:00
JulioV
614e759551
Refactor day segments to time segments
2020-12-02 18:41:03 -05:00
Meng Li
016bdbfe8c
Update Python feature scripts to add sensor and provider names automatically
2020-11-30 14:42:19 -05:00
Meng Li
b4a512faf3
Add analysis example workflow
2020-11-25 16:34:05 -05:00
JulioV
ced3305ddb
Update R feature scripts to add sensor and provider names automatically
2020-11-25 14:49:42 -05:00
Meng Li
d3241c79f1
Update filter_data_by_segment() function: call chunk_episodes() inside the filter function
2020-11-19 17:27:53 -05:00
Meng Li
25e1f1fbb5
Update Python chunk_episodes
2020-10-26 18:47:57 -04:00
JulioV
2fe5a0d822
Update R chunk_episodes
2020-10-26 15:10:32 -04:00
JulioV
c78ccfced7
Remove microseconds from chuncked date times
2020-10-26 15:03:31 -04:00
Meng Li
2b7bd0ae6e
Modify output format of chunk_episodes() function
2020-10-26 13:00:53 -04:00
JulioV
86509207ac
Turn off warnings for tidyverse and dplyr
2020-10-23 10:41:00 -04:00
Meng Li
8c0f6a000d
Fix chunk_episodes() bugs: set segment_start_timestamp as int
2020-10-19 19:36:26 -04:00
JulioV
24bf62a7ab
Update file names
2020-10-19 15:07:12 -04:00
JulioV
3996e0ab17
Fix bug when episodes are empty
2020-10-09 17:00:20 -04:00
Meng Li
236b1cd809
Update AR module for segments; Refactor input format
2020-10-07 18:11:06 -04:00
Meng Li
bccc9a0697
Move deduplicate_episodes() function into chunk_episodes() function; rename "time_diff" with duration
2020-09-29 18:05:25 -04:00
JulioV
10b0386c8f
Merge branch 'day_segments' of https://github.com/carissalow/rapids into day_segments
2020-09-29 17:24:41 -04:00
Meng Li
f1717e59e7
Update screen&battery episodes features with different segment format
2020-09-29 17:13:34 -04:00
JulioV
499b92e240
Fix missing R library
2020-09-29 15:35:44 -04:00
JulioV
0dafdd1340
Redo resample episodes in R, new battery episodes
2020-09-29 15:18:48 -04:00
JulioV
a6b99259f7
Fix bug when filtering by day segment and there are no rows belonging to that segment
2020-09-28 15:53:38 -04:00
JulioV
9e15f46fc3
Update day segment format
2020-09-28 11:38:47 -04:00
Meng Li
f806cb44ac
Fix the bug of screen duration features for different segments
2020-09-18 20:25:29 -04:00
JulioV
681a77f23c
Clean utils.py
2020-09-01 12:02:31 -04:00
JulioV
eda58d9d2c
Migrate wifi to new file structure
2020-08-31 18:51:06 -04:00
JulioV
011b9736d5
Refactor the function to fetch provider features
2020-08-28 17:40:23 -04:00
JulioV
b0f1477d7e
Migrate location providers to new file structure and segments
2020-08-28 13:53:00 -04:00