93baff9f83
Migrate phone keyboard sensor to new data stream
2021-03-11 14:37:22 -05:00
35968e2fd0
Migrate phone log sensor to new data stream
2021-03-11 14:37:22 -05:00
091f9c048a
Migrate phone apps notifications sensor to new data stream
2021-03-11 14:37:22 -05:00
b49dab0949
Migrate phone apps crashes sensor to new data stream
2021-03-11 14:37:22 -05:00
47e1b33816
Add hr intraday to fitbitjson_mysql
2021-03-11 14:37:22 -05:00
47f449555a
Add hr summary to fitbitjson_mysql
2021-03-11 14:37:22 -05:00
72f6b2d621
Add steps intraday to fitbitjson_mysql
2021-03-11 14:37:22 -05:00
9a276c1c66
Add steps summary to jsonfitbit_mysql
2021-03-11 14:37:22 -05:00
13290cd444
Migrate phone wifi visible sensor to new data stream
2021-03-11 14:36:52 -05:00
d42c6e9c91
Migrate phone wifi connected sensor to new data stream
2021-03-11 14:35:34 -05:00
4825962361
Migrate phone screen sensor to new data stream
2021-03-11 14:35:34 -05:00
bd4f647d37
Migrate phone messages sensor to new data stream
2021-03-11 14:35:34 -05:00
3a65b3864d
Migrate phone locations sensor to new data stream
2021-03-11 14:35:34 -05:00
7a50a52a9d
Migrate phone light sensor to new data stream
2021-03-11 14:35:34 -05:00
c1682d8cd3
Migrate phone calls sensor to new data stream
2021-03-11 14:35:34 -05:00
0e96f39599
Migrate phone bluetooth sensor to new data stream
2021-03-11 14:35:34 -05:00
6d06d2b1eb
Update MUTATION structure code & docs for AR, Apps foreground, and battery sensors
2021-03-11 14:35:34 -05:00
6970954358
Change MUTATION structure
2021-03-11 14:35:34 -05:00
58ef276179
Add stream_parameters arg to phone and empatica mutation scripts
2021-03-11 14:35:34 -05:00
1063b4ca65
Add steps summary to fitbitjson_mysql
2021-03-11 14:35:34 -05:00
f7cf316133
Migrate phone battery sensor to new data stream
2021-03-11 14:35:34 -05:00
824523e32c
Migrate phone apps foreground sensor to new data stream
2021-03-11 14:35:34 -05:00
6b13c80e40
Fix bug while checking OS in stream_schema
2021-03-11 14:35:34 -05:00
8c79cfc56f
Fix OS specific dependcies
2021-03-11 14:35:34 -05:00
7372fca0dd
Fix bug when sensor is not available for an OS
2021-03-11 14:35:34 -05:00
41711fcdb7
Rename download_data add support for py containers
2021-03-11 14:35:34 -05:00
4b33ee43ba
Replace .env with credentials.yaml
2021-03-11 14:35:34 -05:00
f65e3c8b1a
Migrate empatica sensors to new data stream
2021-03-11 14:35:34 -05:00
2eae84ff05
Add docs of AR & conversation sensors
2021-03-11 14:35:34 -05:00
fb054b539f
Add support for multiple time zones
2021-03-11 14:35:34 -05:00
6c51c6c239
Move phone_conversation to aware_mysql stream
2021-03-11 14:35:34 -05:00
ab1a3dbf79
Move phone_activity_recognition to aware_mysql stream
2021-03-11 14:35:34 -05:00
dc11cb593d
Add support for smartphone sources and schemas.
...
Initial support for accelerometer
Update docs for automatically create participants
Update docs for initial multiple time zones
2021-03-11 14:35:33 -05:00
8377c12efb
Add sleep intraday features with RAPIDS provider
2021-02-26 17:47:01 -05:00
724027e383
Small fixes to timeathome docs, add config validation
2021-02-24 17:49:22 -05:00
3d6caea6c4
Added the timeathome feature using infer_home_location.py as interim file.
2021-02-24 16:57:25 -05:00
9668dfac7a
Update docs to support Empatica
2021-02-21 17:32:41 -05:00
5f5f19866f
implement extract_empatica_data script
...
add support for all data types
Fix name comparison of zipped files
2021-02-21 17:32:41 -05:00
4b9857562b
Add support for zip input files
2021-02-21 17:32:41 -05:00
8c726f5d4f
Start empatica support
2021-02-21 17:32:41 -05:00
d8813e2d04
Fix bug when any of the rows from any sensor do not belong a time segment
2021-02-09 14:51:54 -05:00
3d0d062491
Fix HR summary bug: do not consider rows with restinghr=0
2021-02-01 17:29:30 -05:00
aefc794274
Fix location processing when certain columns don't exist
2021-02-01 11:49:22 -05:00
5f60aac5c8
Fix KeyError bug of parsing steps data
2021-01-20 11:26:28 -05:00
d0fe4d4c28
Add ALL_RESAMPLED flag and accuracy limit
2021-01-14 14:34:25 -05:00
4926497ae2
Fix bugs in Fitbit data parsing
...
- Fix the script that was breaking with an empty file
- Fix the script that was breaking when start/end dates were empty
- Ambigous and nonexistent DST times are handled now
- Remove unnecessary else clause
2021-01-06 11:43:01 -05:00
5203aa60d1
Fix bugs in create participants files script
...
- The PHONE and FITBIT flags were mixed up
- The start/end dates from the CSV file weren't being parsed correctly
2021-01-06 11:14:15 -05:00
3a80f93771
Fix segment error when device ids is empty
2021-01-06 11:12:10 -05:00
ae21c076cd
Fix conversation data bug
2020-12-04 15:23:08 -05:00
9a02e93b25
Swap RMySQL for RMariaDB
2020-12-04 14:57:13 -05:00
614e759551
Refactor day segments to time segments
2020-12-02 18:41:03 -05:00
c24cba8679
Event segments' device id can be one of any assigned to a participant
2020-12-02 17:17:55 -05:00
70991d6667
Add dates filter while parsing fitbit data
2020-11-30 12:34:14 -05:00
5f51c94ac6
Separate device data configuration and update docs
2020-11-25 19:42:11 -05:00
b4a512faf3
Add analysis example workflow
2020-11-25 16:34:05 -05:00
f02ca2624d
Add phone yield sensor
2020-11-24 19:12:16 -05:00
555811211d
Fix column check in day segment compute
2020-11-24 14:51:06 -05:00
767e838c87
Fix HR&Sleep bugs
2020-11-24 13:43:24 -05:00
deba6b9e4f
Update sleep summary features for segments
2020-11-23 12:01:00 -05:00
895b70719e
Update minimal example and fix create participants bug
2020-11-17 17:27:48 -05:00
a71efd6b85
Split FITBIT_STEPS into FITBIT_STEPS_SUMMARY and FITBIT_STEPS_INTRADAY
2020-11-11 21:16:48 -05:00
9fc36f67e2
Split FITBIT_HEARTRATE into FITBIT_HEARTRATE_SUMMARY and FITBIT_HEARTRATE_INTRADAY
2020-11-11 17:27:46 -05:00
39632c66f5
Update steps features for segments
2020-10-30 18:57:04 -04:00
c5197b6c5f
Merge branch 'master' into ds2
2020-10-28 17:50:37 -04:00
f36a7052b3
Add config update file to create participants file
2020-10-28 14:11:41 -04:00
84068ab33c
Update fitbit_parse_steps.py: add summary data
2020-10-28 13:07:35 -04:00
d5931c75d8
Refactor script to create participants files
2020-10-27 17:13:16 -04:00
b986599226
Add support to read fitbit data from csv files
2020-10-26 17:17:53 -04:00
e10e030baf
Unify AR iOS walking and running conversion
2020-10-26 15:44:09 -04:00
1d04aa6807
Add check for non-overlapping event day segments
2020-10-23 12:15:26 -04:00
86509207ac
Turn off warnings for tidyverse and dplyr
2020-10-23 10:41:00 -04:00
c41d24df45
Fix bug when there are no event segments for participants
2020-10-22 16:41:26 -04:00
47adb8bc4b
Add tz support to fitbit
2020-10-22 14:38:40 -04:00
cff83a7ceb
Implement parse fitbit data
2020-10-22 13:08:52 -04:00
c266f6dd10
Update participant files structure and fitbit download rule
2020-10-20 19:12:01 -04:00
24bf62a7ab
Update file names
2020-10-19 15:07:12 -04:00
6b1e006b82
Refactor fused location resampling
2020-10-07 11:51:31 -04:00
c0c32d9f9e
Fix bug in assign date segment when file is empty
2020-09-30 14:53:59 -04:00
9e15f46fc3
Update day segment format
2020-09-28 11:38:47 -04:00
47ab0a2ce5
Fix phone_sensed_bins when there is no data
2020-09-21 10:28:42 -04:00
3022a60fe9
Fix day segment error with no rows
2020-09-18 17:19:11 -04:00
3c27bb2d18
Refactor frequency segments and fix periodic labels
2020-09-18 16:29:48 -04:00
4dc8d38c66
Optimise assign to day segment
2020-09-16 14:54:20 -04:00
c577229f18
Optimise assign to day segment
2020-09-14 17:56:04 -04:00
a665aedbe8
Optimise assign day segment
2020-09-14 16:19:42 -04:00
132e52aeeb
Fix day segment
2020-09-14 15:14:41 -04:00
3c45f6b152
Refactor assign to day segment
2020-09-14 14:21:36 -04:00
6436bf79db
Fix overall heatmap bug
2020-09-09 11:17:05 -04:00
eda58d9d2c
Migrate wifi to new file structure
2020-08-31 18:51:06 -04:00
b0f1477d7e
Migrate location providers to new file structure and segments
2020-08-28 13:53:00 -04:00
31ec5b0da4
Finalise new day segment structure with calls as example
2020-08-26 12:09:53 -04:00
4b6ba12e62
raise exception for invalid frequency segmentation info; fixed inconsistency in frequency segmentation output columns
2020-08-20 14:51:22 -04:00
5f672b1f39
verification and creation of frequency segments
2020-08-20 14:51:22 -04:00
c2d011fb6a
Add base functions to compute_day_segments.py
2020-08-20 14:51:22 -04:00
026d056378
Simplify window workflow
2020-08-20 14:51:22 -04:00
a0b5b5982b
Setup rules and files to support multiple
2020-08-20 14:45:09 -04:00
b116accb6d
Disable error message and add prints for restore_sql_file
2020-08-18 17:39:25 -04:00
75deaf7c26
Fix sql file name for restore_sql_file.py
2020-08-18 14:32:26 -04:00
0b2abc692c
Fix restore_sql_file bug: table already exists
2020-08-18 14:18:30 -04:00
08ce250839
Unify conversation timestamp for ios
2020-08-11 16:18:06 -04:00
b04088f11f
Fix valid sensed days with 0 valid bins
2020-08-07 11:07:37 -04:00
e13b89b125
Add restore_sql_file rule; notsummarised module; diff platforms for heatmap_days_by_sensors
2020-08-03 13:09:16 -04:00
b3aa4d82e1
Overall compliance heatmap: shows all dates for all participants (only supports last certain dates previously)
2020-07-24 12:58:48 -04:00
124843f96e
Make phone_valid_sensed_days rule works for different min_valid_hours_per_day thresholds
2020-07-21 20:41:24 -04:00
be6df7ebdb
Fix missed outgoing calls unification in iOS
2020-07-20 15:16:42 -04:00
024ae1a549
Added Doryab's location features to rapids.
...
Co-authored-by: JulioV <juliovhz@gmail.com>
2020-07-16 14:26:43 -04:00
d2704296f3
Refactor valid sensed bins and days
2020-07-09 13:01:50 -04:00
06edf53016
Add support for multi-platform participants
2020-06-30 17:34:18 -04:00
36017d5dca
Refactor Snakefile and docs. Rename SMS scripts
2020-06-23 11:33:34 -04:00
3287866f4b
Update tidyr and fix resample pivot_longer bug
2020-06-12 14:51:38 -04:00
8fbafcbe0c
Fix location bug and improve fused resampling
2020-06-11 12:25:49 -04:00
9c1f2f6bbe
Update fitbit_parse_sleep.py
2020-06-05 17:28:43 -04:00
ff1bc33c34
Update fitbit_parse_heartrate.py
2020-06-04 18:07:15 -04:00
b14ddcdea6
Update fitbit_parse_steps.py
2020-06-04 18:03:40 -04:00
4c835cde37
Fixed the Duration for the Classic Sleep type in Version 1.2 of FItbit.
...
Co-authored-by: JulioV <juliovhz@gmail.com>
2020-06-03 16:40:42 -04:00
f344c14e92
Fix bug in SMS features
2020-05-29 11:41:17 -04:00
e952e27350
Adding the code to parse the FITBIT sleep data for API version 1.2
...
Co-authored-by: JulioV <juliovhz@gmail.com>
2020-05-27 14:29:28 -04:00
915bdd04b1
Parse Fitbit summary and intraday data; Extract Fitbit daily features from summary data
2020-05-15 17:51:00 -04:00
f0674122ff
Replace packrat with renv
2020-05-01 19:46:04 -04:00
490599c742
Implement AR features for iOS
...
Co-authored-by: JulioV <juliovhz@gmail.com>
2020-04-20 18:05:54 -04:00
695984586f
Add calories module for fitbit_readable_datetime.py
2020-04-15 16:01:02 -04:00
8671f8db68
Modified condition to extract feature "heartrate_zones"
...
Co-authored-by: Meng Li <AnnieLM1996@gmail.com>
Co-authored-by: JulioV <juliovhz@gmail.com>
2020-04-15 09:26:16 -05:00
fa67359b5f
Fix return in iOS battery deltas
2020-04-09 12:13:00 -04:00
e2b2643ba9
Fix bug that unified battery status for iOS client v2
2020-04-09 12:10:03 -04:00
9d27431e3b
Speed up raw csv reads and writes in R
2020-04-02 16:28:19 -04:00
c2a74b1cba
Fix fitbit_readable_datetime.py to handle empty table
2020-03-05 14:39:05 -05:00
f25dd026fd
Fix download_dataset.R to handle non sensor tables
2020-03-05 14:10:36 -05:00
2548539dc4
Fix bug when application foreground list was empty
2020-03-05 13:23:21 -05:00
e058820309
Fix encoding issues when reading participant files
2020-03-03 11:08:57 -05:00
579df6325f
Add date filter for download_dataset
2020-02-20 15:51:22 -05:00
76888b412d
Add label and dates for external files
2020-02-18 16:41:10 -05:00
6bbc916702
Add download_participants functionality
2020-02-10 16:45:34 -05:00
6c5ace5611
Fixed fitbit preprocess issue#28 and added heartrate_zone column for heartrate
2020-02-07 11:26:35 -05:00
4aec2c4032
Combine all fitbit sensors in one script and one rule
2020-01-16 17:20:04 -05:00
9d00f14f7f
Add category (genre) to foreground apps
2020-01-15 18:28:56 -05:00
34c4586e4d
Add fitbit raw data and datetime
2020-01-15 17:18:10 -05:00
545d8a5ffe
Add support for multi device participants
2019-12-17 13:41:27 -05:00
e777bf171f
Make extension upper case for resample fused location
2019-12-12 14:40:19 -05:00
3947f1ec29
Refactor resample fused location to filter fused rows earlier
2019-12-09 19:15:57 -05:00
0ba88203f4
Add resampling for fused location
2019-12-09 18:23:00 -05:00
6a79fbe1e8
Fix bug in iOS battery (different status compared to Android)
2019-12-05 16:24:05 -05:00
0bd946b53c
Delete row names from sensed bins and valid sensed days
2019-12-04 11:39:40 -05:00
15a9e33728
Add phone sensed bins (sensor row count for every n min bin)
2019-12-04 11:33:25 -05:00
bea791a106
Add unify ios and android rule and script
2019-11-12 14:57:27 -05:00
384f401062
Avoid recording row names in download dataset and readable datetime
2019-11-12 14:56:31 -05:00
2adfe8d81a
Fix timezone for US Eastern Time
2019-11-06 17:12:06 -05:00
cca1633728
Add valid sensed days
2019-11-05 12:34:22 -05:00
6eb7bc9e70
Fix quoting problem with columns containing quotes
2019-11-05 11:47:20 -05:00
2cc73985aa
Refactor readable_datetime
2019-10-31 10:05:40 -04:00
e388a757b8
Fix split local time, add minute column
2019-10-30 18:12:46 -04:00
Meng Li
JulioV
nikunjgoel95
Juseong Kim
Yasaman Sefidgar
Mingze Cao