Refactor tests module

docs/developers/testing.md

@@ -7,35 +7,33 @@ The following is a simple guide to run RAPIDS' tests. All files necessary for te
 ??? check "**Testing Overview**"
     1. You have to create a single four day test dataset for the sensor you are working on. 
     2. You will adjust your dataset with `tests/script/assign_test_timestamps.py` to fit `Fri March 6th 2020 - Mon March 9th 2020` and `Fri Oct 30th 2020 - Mon Nov 2nd 2020`. We test daylight saving times with these dates.
-    2. We have a one test participant per platform (`pids`: `android`, `ios`, `fitbit`, `empatica`, `empty`). The data `device_id` should be equal to the `pid`.
+    2. We have one test participant per platform (`pids`: `android`, `ios`, `fitbit`, `empatica`, `empty`). The data `device_id` should be equal to the `pid`.
     2. We will run this test dataset against six test pipelines, three for `frequency`, `periodic`, and `event` time segments in a `single` time zone, and the same three in `multiple` time zones.
     3. You will have to create your test data to cover as many corner cases as possible. These cases depend on the sensor you are working on.
     4. The time segments and time zones to be tested are:
 
     ??? example "Frequency"
-        - 30 minutes (`30min, 30`)
+        - 30 minutes (`30min,30`)
 
     ??? example "Periodic"
-        - morning (`morning, 06:00:00,5H 59M 59S, every_day, 0`)
-        - daily (`daily, 00:00:00,23H 59M 59S, every_day, 0`)
-        - three-day segments that repeat every day (`threeday, 00:00:00,71H 59M 59S, every_day, 0`)
-        - three-day segments that repeat every Friday (`weekend, 00:00:00,71H 59M 59S, wday, 5`)
+        - morning (`morning,06:00:00,5H 59M 59S,every_day,0`)
+        - daily (`daily,00:00:00,23H 59M 59S,every_day,0`)
+        - three-day segments that repeat every day (`threeday,00:00:00,71H 59M 59S,every_day,0`)
+        - three-day segments that repeat every Friday (`weekend,00:00:00,71H 59M 59S,wday,5`)
 
     ??? example "Event"
-        - A segment that starts 10 hours before an event (Sat Mar 07 2020 19:00:00) and lasts for 10 hours (09:00 to 19:00) (`beforeMarchEvent,1583625600000,10H,10H,-1,a748ee1a-1d0b-4ae9-9074-279a2b6ba524`)
-        - A segment that starts 1 hour after an event (Sat Mar 07 2020 19:00:00) and lasts for 10 hours (18:00 to 04:00) (`afterMarchEvent,1583625600000,10H,1H,1,a748ee1a-1d0b-4ae9-9074-279a2b6ba524`)
-        - A segment that starts 10 hours before an event (Sat Oct 31 2020 19:00:00) and lasts for 10 hours (09:00 to 19:00) (`beforeNovemberEvent,1583625600000,10H,10H,-1,a748ee1a-1d0b-4ae9-9074-279a2b6ba524`)
-        - A segment that starts 1 hour after an event (Sat Oct 31 2020 19:00:00) and lasts for 10 hours (18:00 to 04:00) (`afterNovemberEvent,1583625600000,10H,1H,1,a748ee1a-1d0b-4ae9-9074-279a2b6ba524`)
+        - A segment that starts 3 hour before an event (Sat Mar 07 2020 19:00:00 EST) and lasts for 12 hours. Note that the last part of this segment will happen during a daylight saving change on Sunday at 2am when the clock moves forward and the period 2am-3am does not exist. In this case, the segment would start on Sat Mar 07 2020 16:00:00 EST (timestamp: 1583614800000) and end on Sun Mar 08 2020 05:00:00 EST (timestamp: 1583658000000). (`beforeMarchEvent,1583625600000,12H,3H,-1,android`)
+        - A segment that starts 3 hour before an event (Sat Oct 31 2020 19:00:00 EST) and lasts for 12 hours. Note that the last part of this segment will happen during a daylight saving change on Sunday at 2am when the clock moves back and the period 1am-2am exists twice. In this case, the segment would start on Sat Oct 31 2020 16:00:00 EST (timestamp: 1604174400000) and end on Sun Nov 01 2020 03:00:00 EST (timestamp: 1604217600000). (`beforeNovemberEvent,1604185200000,12H,3H,-1,android`)
 
     ??? example "Single time zone to test"
         America/New_York
 
     ??? example "Multi time zones to test"
         - America/New_York starting at `0`
-        - America/Los_Angeles starting at `1583600400000` (Sat Mar 07 2020 12:00:00)
-        - America/New_York starting at `1583683200000` (Sun Mar 08 2020 12:00:00)
-        - America/Los_Angeles starting at `1604160000000` (Sat Oct 31 2020 12:00:00)
-        - America/New_York starting at `1604250000000` (Sun Nov 01 2020 12:00:00)
+        - America/Los_Angeles starting at `1583600400000` (Sat Mar 07 2020 12:00:00 EST)
+        - America/New_York starting at `1583683200000` (Sun Mar 08 2020 12:00:00 EST)
+        - America/Los_Angeles starting at `1604160000000` (Sat Oct 31 2020 12:00:00 EST)
+        - America/New_York starting at `1604250000000` (Sun Nov 01 2020 12:00:00 EST)
 
 ??? check "**Document your tests**"
 
@@ -85,11 +83,20 @@ The following is a simple guide to run RAPIDS' tests. All files necessary for te
 ??? check "**Add raw input data.**"
     1. Add the raw test data to the corresponding sensor CSV file in `tests/data/manual/aware_csv/SENSOR_raw.csv`. Create the CSV if it does not exist.
     2. The test data you create will have the same columns as normal raw data except `test_time` replaces `timestamp`. To make your life easier, you can place a test data row in time using the `test_time` column with the following format: `Day HH:MM:SS.XXX`, for example `Fri 22:54:30.597`.
-    2. You will convert your manual test data to actual raw test data by running `python tests/script/assign_test_timestamps.py`
-    2. The script `assign_test_timestamps.py` converts you `test_time` column into a `timestamp`. For example, `Fri 22:54:30.597` is converted to `1583553270597` (`Fri Mar 06 2020 22:54:30 GMT-0500`) and to `1604112870597` (`Fri Oct 30 2020 22:54:30 GMT-0400`). Note we respect milliseconds and our test timezones (`New_York` and `Los_Angeles`)
-    2. The `device_id` should be the `pid`
-    2. Create your participant file if it does not exist yet (`tests/data/external/participant_files/{pid}.yaml`). 
-    2. Don't forget to add the `pid` to  `[PIDS]` in the config file of the time segments you are testing (see below). 
+    2. You can convert your manual test data to actual raw test data with the following commands:
+        
+        - For the selected files: (It could be a single file name or multiple file names separated by whitespace(s))
+            ```
+            python tests/script/assign_test_timestamps.py -f file_name_1 file_name_2
+            ```
+
+        - For all files under the `tests/data/manual/aware_csv` folder: 
+            ```
+            python tests/script/assign_test_timestamps.py -a
+            ```
+    
+    2. The script `assign_test_timestamps.py` converts you `test_time` column into a `timestamp`. For example, `Fri 22:54:30.597` is converted to `1583553270597` (`Fri Mar 06 2020 22:54:30 GMT-0500`) and to `1604112870597` (`Fri Oct 30 2020 22:54:30 GMT-0400`). Note you can include milliseconds.
+    2. The `device_id` should be the same as `pid`.
 
     ??? example "Example of test data you need to create"
         The `test_time` column will be automatically converted to a timestamp that fitst our testing periods in March and November by `tests/script/assign_test_timestamps.py`
@@ -149,10 +156,6 @@ The following is a simple guide to run RAPIDS' tests. All files necessary for te
 
         The python script `tests/scripts/run_tests.py` runs the tests. It parses the involved participants and active sensor providers in the `config.yaml` file of the time segment type and time zone being tested. We test that the output file we expect exists and that its content matches the expected values.
 
-        ??? example "Example of raw data for PHONE_APPLICATIONS_FOREGROUND testing"
-            ```json hl_lines="1 2 4" linenums="1"
-            --8<---- "tests/data/external/aware_csv/phone_applications_foreground_raw.csv"
-            ```
     ??? example "Output Example"
         The following is a snippet of the output you should see after running your test.
 

tests/data/external/aware_csv/phone_applications_foreground_raw.csv

@@ -1,85 +0,0 @@
-"timestamp","device_id","package_name","application_name","is_system_app"
-1593946320761,"test01","tv.twitch.android.app","Twitch",0
-1593961974942,"test01","com.google.android.gms","Google",1
-1593958144033,"test01","tv.twitch.android.app","Twitch",0
-1593947228964,"test01","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1593951572326,"test01","com.netflix.mediaclient","Netflix",0
-1593950554868,"test01","com.supercell.clashofclans","Clash of Clans",0
-1593964799620,"test01","tv.twitch.android.app","Twitch",0
-1593974241305,"test01","com.facebook.moments","Facebook Moments",0
-1593969483540,"test01","com.facebook.moments","Facebook Moments",0
-1593977289581,"test01","com.fitbit.FitbitMobile","Fitbit",0
-1593970763367,"test01","com.netflix.mediaclient","Netflix",0
-1593964867720,"test01","com.supercell.clashofclans","Clash of Clans",0
-1593974942995,"test01","com.google.android.gm","Gmail",0
-1593986399351,"test01","com.netflix.mediaclient","Netflix",0
-1594000139073,"test01","com.google.android.gm","Gmail",0
-1593994717099,"test01","com.fitbit.FitbitMobile","Fitbit",0
-1593985854872,"test01","com.google.android.youtube","Youtube",0
-1594003154390,"test01","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1594003853415,"test01","com.google.android.gms","Google",1
-1593991680045,"test01","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1594007999202,"test01","com.aware.plugin.upmc.cancer","AWARE",0
-1593939733998,"test01","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1593933324739,"test01","tv.twitch.android.app","Twitch",0
-1593925161482,"test01","com.facebook.moments","Facebook Moments",0
-1593936918763,"test01","com.google.android.gms","Google",1
-1593924155524,"test01","com.google.android.youtube","Youtube",0
-1593922625358,"test01","com.facebook.moments","Facebook Moments",0
-1593943199317,"test01","tv.twitch.android.app","Twitch",0
-1593951550550,"test01","com.google.android.gms","Google",1
-1593981544544,"test01","com.google.android.gms","Google",1
-1593999779779,"test01","com.google.android.gms","Google",1
-1593933565565,"test01","com.google.android.gms","Google",1
-1602475200000,"test05","tv.twitch.android.app","Twitch",0
-1602475200000,"test05","com.netflix.mediaclient","Netflix",0
-1602475200000,"test05","com.google.android.gms","Google",1
-1602475200000,"test05","com.facebook.moments","Facebook Moments",0
-1602475999000,"test05","tv.twitch.android.app","Twitch",0
-1602475999000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602476999000,"test05","com.netflix.mediaclient","Netflix",0
-1602476999000,"test05","com.supercell.clashofclans","Clash of Clans",0
-1602476999000,"test05","com.netflix.mediaclient","Netflix",0
-1602476999000,"test05","com.supercell.clashofclans","Clash of Clans",0
-1602477000000,"test05","tv.twitch.android.app","Twitch",0
-1602477000000,"test05","com.facebook.moments","Facebook Moments",0
-1602477000000,"test05","com.google.android.gm","Gmail",0
-1602478000000,"test05","com.facebook.moments","Facebook Moments",0
-1602478000000,"test05","com.fitbit.FitbitMobile","Fitbit",0
-1602478799000,"test05","com.google.android.gm","Gmail",0
-1602478799000,"test05","com.netflix.mediaclient","Netflix",0
-1602478000000,"test05","com.fitbit.FitbitMobile","Fitbit",0
-1602478799000,"test05","com.google.android.gm","Gmail",0
-1602478799000,"test05","com.supercell.clashofclans","Clash of Clans",0
-1602478799000,"test05","com.netflix.mediaclient","Netflix",0
-1602478800000,"test05","com.google.android.gm","Gmail",0
-1602478800000,"test05","com.fitbit.FitbitMobile","Fitbit",0
-1602478800000,"test05","com.google.android.gm","Gmail",0
-1602478800000,"test05","com.fitbit.FitbitMobile","Fitbit",0
-1602480500000,"test05","com.netflix.mediaclient","Netflix",0
-1602480500000,"test05","com.supercell.clashofclans","Clash of Clans",0
-1602480500000,"test05","com.supercell.clashofclans","Clash of Clans",0
-1602558000000,"test05","com.google.android.youtube","Youtube",0
-1602558000000,"test05","com.google.android.youtube","Youtube",0
-1602558000000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602558799000,"test05","com.google.android.gms","Google",1
-1602558799000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602558000000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602558799000,"test05","com.google.android.gms","Google",1
-1602558799000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602559799000,"test05","com.aware.plugin.upmc.cancer","AWARE",0
-1602559799000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602559799000,"test05","com.aware.plugin.upmc.cancer","AWARE",0
-1602559799000,"test05","com.google.android.apps.youtube.creator","Youtube Video Creater",0
-1602559800000,"test05","tv.twitch.android.app","Twitch",0
-1602559800000,"test05","com.facebook.moments","Facebook Moments",0
-1602560800000,"test05","com.google.android.gms","Google",1
-1602560800000,"test05","com.google.android.youtube","Youtube",0
-1602560800000,"test05","com.google.android.gms","Google",1
-1602560800000,"test05","com.google.android.youtube","Youtube",0
-1602561599000,"test05","com.facebook.moments","Facebook Moments",0
-1602561599000,"test05","tv.twitch.android.app","Twitch",0
-1602561600000,"test05","com.google.android.gms","Google",1
-1602561600000,"test05","com.google.android.gms","Google",1
-1602563400000,"test05","com.google.android.gms","Google",1
-1602563500000,"test05","com.facebook.moments","Facebook Moments",0

tests/data/external/aware_csv/phone_battery_raw.csv

@@ -1,243 +0,0 @@
-timestamp,device_id,battery_status,battery_level,battery_scale,battery_voltage,battery_temperature,battery_adaptor,battery_health,battery_technology
-1593576490416,per_and,3,80,100,4170,23,0,2,Li-ion
-1593576683435,per_and,3,79,100,4094,23,0,2,Li-ion
-1593576930630,per_and,3,78,100,4157,23,0,2,Li-ion
-1593577058603,per_and,3,77,100,4157,23,0,2,Li-ion
-1593581260603,per_and,4,77,100,4157,23,0,2,Li-ion
-1593588030416,per_and,2,77,100,4170,23,0,2,Li-ion
-1593588230435,per_and,2,78,100,4094,23,0,2,Li-ion
-1593588635630,per_and,2,79,100,4157,23,0,2,Li-ion
-1593588635876,per_and,2,80,100,4157,23,0,2,Li-ion
-1593597450123,per_and,3,80,100,4170,23,0,2,Li-ion
-1593597589435,per_and,3,79,100,4094,23,0,2,Li-ion
-1593597739321,per_and,3,78,100,4157,23,0,2,Li-ion
-1593597872456,per_and,3,77,100,4157,23,0,2,Li-ion
-1593605072416,per_and,2,72,100,4170,23,0,2,Li-ion
-1593605232435,per_and,2,73,100,4094,23,0,2,Li-ion
-1593605392679,per_and,2,74,100,4157,23,0,2,Li-ion
-1593605587876,per_and,2,75,100,4157,23,0,2,Li-ion
-1593609187603,per_and,4,77,100,4157,23,0,2,Li-ion
-1593613397416,per_and,3,74,100,4170,23,0,2,Li-ion
-1593613583435,per_and,3,73,100,4094,23,0,2,Li-ion
-1593613783679,per_and,3,72,100,4157,23,0,2,Li-ion
-1593614058876,per_and,3,71,100,4157,23,0,2,Li-ion
-1593618958416,per_and,2,62,100,4170,23,0,2,Li-ion
-1593619168435,per_and,2,63,100,4094,23,0,2,Li-ion
-1593619477679,per_and,2,64,100,4157,23,0,2,Li-ion
-1593619687876,per_and,2,65,100,4157,23,0,2,Li-ion
-1593625927416,per_and,3,64,100,4170,23,0,2,Li-ion
-1593626099435,per_and,3,63,100,4094,23,0,2,Li-ion
-1593626229679,per_and,3,62,100,4157,23,0,2,Li-ion
-1593626419876,per_and,3,61,100,4157,23,0,2,Li-ion
-1593630629603,per_and,4,77,100,4157,23,0,2,Li-ion
-1593634407416,per_and,2,60,100,4170,23,0,2,Li-ion
-1593634677435,per_and,2,61,100,4094,23,0,2,Li-ion
-1593634887679,per_and,2,62,100,4157,23,0,2,Li-ion
-1593635087876,per_and,2,63,100,4157,23,0,2,Li-ion
-1593640563123,per_and,3,60,100,4170,23,0,2,Li-ion
-1593640781435,per_and,3,59,100,4094,23,0,2,Li-ion
-1593641054321,per_and,3,58,100,4157,23,0,2,Li-ion
-1593641244456,per_and,3,57,100,4157,23,0,2,Li-ion
-1593648183416,per_and,2,72,100,4170,23,0,2,Li-ion
-1593648312435,per_and,2,73,100,4094,23,0,2,Li-ion
-1593648444679,per_and,2,74,100,4157,23,0,2,Li-ion
-1593648634876,per_and,2,75,100,4157,23,0,2,Li-ion
-1593651044603,per_and,4,77,100,4157,23,0,2,Li-ion
-1593653404416,per_and,3,74,100,4170,23,0,2,Li-ion
-1593653534435,per_and,3,73,100,4094,23,0,2,Li-ion
-1593653723679,per_and,3,72,100,4157,23,0,2,Li-ion
-1593653867876,per_and,3,71,100,4157,23,0,2,Li-ion
-1593576490416,per_ios,4,80,100,4170,23,0,2,Li-ion
-1593576683435,per_ios,4,79,100,4094,23,0,2,Li-ion
-1593576930630,per_ios,4,78,100,4157,23,0,2,Li-ion
-1593577058603,per_ios,4,77,100,4157,23,0,2,Li-ion
-1593588030416,per_ios,2,77,100,4170,23,0,2,Li-ion
-1593588230435,per_ios,2,78,100,4094,23,0,2,Li-ion
-1593588635630,per_ios,2,79,100,4157,23,0,2,Li-ion
-1593588635876,per_ios,2,80,100,4157,23,0,2,Li-ion
-1593597450123,per_ios,4,80,100,4170,23,0,2,Li-ion
-1593597589435,per_ios,4,79,100,4094,23,0,2,Li-ion
-1593597739321,per_ios,4,78,100,4157,23,0,2,Li-ion
-1593597872456,per_ios,4,77,100,4157,23,0,2,Li-ion
-1593605072416,per_ios,2,72,100,4170,23,0,2,Li-ion
-1593605232435,per_ios,2,73,100,4094,23,0,2,Li-ion
-1593605392679,per_ios,2,74,100,4157,23,0,2,Li-ion
-1593605587876,per_ios,2,75,100,4157,23,0,2,Li-ion
-1593613397416,per_ios,4,74,100,4170,23,0,2,Li-ion
-1593613583435,per_ios,4,73,100,4094,23,0,2,Li-ion
-1593613783679,per_ios,4,72,100,4157,23,0,2,Li-ion
-1593614058876,per_ios,4,71,100,4157,23,0,2,Li-ion
-1593618958416,per_ios,2,62,100,4170,23,0,2,Li-ion
-1593619168435,per_ios,2,63,100,4094,23,0,2,Li-ion
-1593619477679,per_ios,2,64,100,4157,23,0,2,Li-ion
-1593619687876,per_ios,2,65,100,4157,23,0,2,Li-ion
-1593625927416,per_ios,4,64,100,4170,23,0,2,Li-ion
-1593626099435,per_ios,4,63,100,4094,23,0,2,Li-ion
-1593626229679,per_ios,4,62,100,4157,23,0,2,Li-ion
-1593626419876,per_ios,4,61,100,4157,23,0,2,Li-ion
-1593634407416,per_ios,2,60,100,4170,23,0,2,Li-ion
-1593634677435,per_ios,2,61,100,4094,23,0,2,Li-ion
-1593634887679,per_ios,2,62,100,4157,23,0,2,Li-ion
-1593635087876,per_ios,2,63,100,4157,23,0,2,Li-ion
-1593640563123,per_ios,4,60,100,4170,23,0,2,Li-ion
-1593640781435,per_ios,4,59,100,4094,23,0,2,Li-ion
-1593641054321,per_ios,4,58,100,4157,23,0,2,Li-ion
-1593641244456,per_ios,4,57,100,4157,23,0,2,Li-ion
-1593648183416,per_ios,2,72,100,4170,23,0,2,Li-ion
-1593648312435,per_ios,2,73,100,4094,23,0,2,Li-ion
-1593648444679,per_ios,2,74,100,4157,23,0,2,Li-ion
-1593648634876,per_ios,2,75,100,4157,23,0,2,Li-ion
-1593653404416,per_ios,4,74,100,4170,23,0,2,Li-ion
-1593653534435,per_ios,4,73,100,4094,23,0,2,Li-ion
-1593653723679,per_ios,4,72,100,4157,23,0,2,Li-ion
-1593653867876,per_ios,4,71,100,4157,23,0,2,Li-ion
-1593576490416,fre_and,3,80,100,4170,23,0,2,Li-ion
-1593576683435,fre_and,3,79,100,4094,23,0,2,Li-ion
-1593576930630,fre_and,3,78,100,4157,23,0,2,Li-ion
-1593577058603,fre_and,3,77,100,4157,23,0,2,Li-ion
-1593581260603,fre_and,4,77,100,4157,23,0,2,Li-ion
-1593588030416,fre_and,2,77,100,4170,23,0,2,Li-ion
-1593588230435,fre_and,2,78,100,4094,23,0,2,Li-ion
-1593588635630,fre_and,2,79,100,4157,23,0,2,Li-ion
-1593588635876,fre_and,2,80,100,4157,23,0,2,Li-ion
-1593597450123,fre_and,3,80,100,4170,23,0,2,Li-ion
-1593597589435,fre_and,3,79,100,4094,23,0,2,Li-ion
-1593597739321,fre_and,3,78,100,4157,23,0,2,Li-ion
-1593597872456,fre_and,3,77,100,4157,23,0,2,Li-ion
-1593605072416,fre_and,2,72,100,4170,23,0,2,Li-ion
-1593605232435,fre_and,2,73,100,4094,23,0,2,Li-ion
-1593605392679,fre_and,2,74,100,4157,23,0,2,Li-ion
-1593605587876,fre_and,2,75,100,4157,23,0,2,Li-ion
-1593609187603,fre_and,4,75,100,4157,23,0,2,Li-ion
-1593613397416,fre_and,3,74,100,4170,23,0,2,Li-ion
-1593613583435,fre_and,3,73,100,4094,23,0,2,Li-ion
-1593613783679,fre_and,3,72,100,4157,23,0,2,Li-ion
-1593614058876,fre_and,3,71,100,4157,23,0,2,Li-ion
-1593618958416,fre_and,2,62,100,4170,23,0,2,Li-ion
-1593619168435,fre_and,2,63,100,4094,23,0,2,Li-ion
-1593619477679,fre_and,2,64,100,4157,23,0,2,Li-ion
-1593619687876,fre_and,2,65,100,4157,23,0,2,Li-ion
-1593625927416,fre_and,3,64,100,4170,23,0,2,Li-ion
-1593626099435,fre_and,3,63,100,4094,23,0,2,Li-ion
-1593626229679,fre_and,3,62,100,4157,23,0,2,Li-ion
-1593626419876,fre_and,3,61,100,4157,23,0,2,Li-ion
-1593630629603,fre_and,4,77,100,4157,23,0,2,Li-ion
-1593634407416,fre_and,2,60,100,4170,23,0,2,Li-ion
-1593634677435,fre_and,2,61,100,4094,23,0,2,Li-ion
-1593634887679,fre_and,2,62,100,4157,23,0,2,Li-ion
-1593635087876,fre_and,2,63,100,4157,23,0,2,Li-ion
-1593640563123,fre_and,3,60,100,4170,23,0,2,Li-ion
-1593640781435,fre_and,3,59,100,4094,23,0,2,Li-ion
-1593641054321,fre_and,3,58,100,4157,23,0,2,Li-ion
-1593641244456,fre_and,3,57,100,4157,23,0,2,Li-ion
-1593648183416,fre_and,2,72,100,4170,23,0,2,Li-ion
-1593648312435,fre_and,2,73,100,4094,23,0,2,Li-ion
-1593648444679,fre_and,2,74,100,4157,23,0,2,Li-ion
-1593648634876,fre_and,2,75,100,4157,23,0,2,Li-ion
-1593651044603,fre_and,4,75,100,4157,23,0,2,Li-ion
-1593653404416,fre_and,3,74,100,4170,23,0,2,Li-ion
-1593653534435,fre_and,3,73,100,4094,23,0,2,Li-ion
-1593653723679,fre_and,3,72,100,4157,23,0,2,Li-ion
-1593653867876,fre_and,3,71,100,4157,23,0,2,Li-ion
-1593654001875,fre_and,2,70,100,4157,23,0,2,Li-ion
-1593654201075,fre_and,2,78,100,4157,23,0,2,Li-ion
-1593576490416,fre_ios,4,80,100,4170,23,0,2,Li-ion
-1593576683435,fre_ios,4,79,100,4094,23,0,2,Li-ion
-1593576930630,fre_ios,4,78,100,4157,23,0,2,Li-ion
-1593577058603,fre_ios,4,77,100,4157,23,0,2,Li-ion
-1593588030416,fre_ios,2,77,100,4170,23,0,2,Li-ion
-1593588230435,fre_ios,2,78,100,4094,23,0,2,Li-ion
-1593588635630,fre_ios,2,79,100,4157,23,0,2,Li-ion
-1593588635876,fre_ios,2,80,100,4157,23,0,2,Li-ion
-1593597450123,fre_ios,3,80,100,4170,23,0,2,Li-ion
-1593597589435,fre_ios,3,79,100,4094,23,0,2,Li-ion
-1593597739321,fre_ios,3,78,100,4157,23,0,2,Li-ion
-1593597872456,fre_ios,3,77,100,4157,23,0,2,Li-ion
-1593605072416,fre_ios,2,72,100,4170,23,0,2,Li-ion
-1593605232435,fre_ios,2,73,100,4094,23,0,2,Li-ion
-1593605392679,fre_ios,2,74,100,4157,23,0,2,Li-ion
-1593605587876,fre_ios,2,75,100,4157,23,0,2,Li-ion
-1593613397416,fre_ios,4,74,100,4170,23,0,2,Li-ion
-1593613583435,fre_ios,4,73,100,4094,23,0,2,Li-ion
-1593613783679,fre_ios,4,72,100,4157,23,0,2,Li-ion
-1593614058876,fre_ios,4,71,100,4157,23,0,2,Li-ion
-1593618958416,fre_ios,2,62,100,4170,23,0,2,Li-ion
-1593619168435,fre_ios,2,63,100,4094,23,0,2,Li-ion
-1593619477679,fre_ios,2,64,100,4157,23,0,2,Li-ion
-1593619687876,fre_ios,2,65,100,4157,23,0,2,Li-ion
-1593625927416,fre_ios,4,64,100,4170,23,0,2,Li-ion
-1593626099435,fre_ios,4,63,100,4094,23,0,2,Li-ion
-1593626229679,fre_ios,4,62,100,4157,23,0,2,Li-ion
-1593626419876,fre_ios,4,61,100,4157,23,0,2,Li-ion
-1593634407416,fre_ios,2,60,100,4170,23,0,2,Li-ion
-1593634677435,fre_ios,2,61,100,4094,23,0,2,Li-ion
-1593634887679,fre_ios,2,62,100,4157,23,0,2,Li-ion
-1593635087876,fre_ios,2,63,100,4157,23,0,2,Li-ion
-1593640563123,fre_ios,4,60,100,4170,23,0,2,Li-ion
-1593640781435,fre_ios,4,59,100,4094,23,0,2,Li-ion
-1593641054321,fre_ios,4,58,100,4157,23,0,2,Li-ion
-1593641244456,fre_ios,4,57,100,4157,23,0,2,Li-ion
-1593648183416,fre_ios,2,72,100,4170,23,0,2,Li-ion
-1593648312435,fre_ios,2,73,100,4094,23,0,2,Li-ion
-1593648444679,fre_ios,2,74,100,4157,23,0,2,Li-ion
-1593648634876,fre_ios,2,75,100,4157,23,0,2,Li-ion
-1593648921875,fre_ios,4,74,100,4170,23,0,2,Li-ion
-1593649577172,fre_ios,4,73,100,4170,23,0,2,Li-ion
-1593653404416,fre_ios,4,72,100,4170,23,0,2,Li-ion
-1593653534435,fre_ios,4,71,100,4094,23,0,2,Li-ion
-1593653723679,fre_ios,4,70,100,4157,23,0,2,Li-ion
-1593653867876,fre_ios,4,69,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1593662267875,per_and,3,65,100,4157,23,0,2,Li-ion
-1593662327875,per_and,3,64,100,4157,23,0,2,Li-ion
-1593662627875,per_and,3,63,100,4157,23,0,2,Li-ion
-1593662747875,per_and,3,62,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1593748547875,per_and,3,55,100,4157,23,0,2,Li-ion
-1593748787875,per_and,3,54,100,4157,23,0,2,Li-ion
-1593749207875,per_and,3,53,100,4157,23,0,2,Li-ion
-1593749387875,per_and,3,52,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1593834425001,per_and,3,60,100,4157,23,0,2,Li-ion
-1593834905001,per_and,3,59,100,4157,23,0,2,Li-ion
-1593836105001,per_and,3,58,100,4157,23,0,2,Li-ion
-1593836285001,per_and,3,57,100,4157,23,0,2,Li-ion
-1593921060001,per_and,3,41,100,4157,23,0,2,Li-ion
-1593921420001,per_and,3,40,100,4157,23,0,2,Li-ion
-1593922860001,per_and,3,39,100,4157,23,0,2,Li-ion
-1593922980001,per_and,3,38,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1587626100001,eve_and,3,90,100,4157,23,0,2,Li-ion
-1587626460001,eve_and,3,89,100,4157,23,0,2,Li-ion
-1587642600001,eve_and,3,80,100,4157,23,0,2,Li-ion
-1587643500001,eve_and,3,79,100,4157,23,0,2,Li-ion
-1587643920001,eve_and,3,78,100,4157,23,0,2,Li-ion
-1587696600001,eve_and,3,50,100,4157,23,0,2,Li-ion
-1587696780001,eve_and,3,49,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1593662267875,per_ios,4,65,100,4157,23,0,2,Li-ion
-1593662327875,per_ios,4,64,100,4157,23,0,2,Li-ion
-1593662627875,per_ios,4,63,100,4157,23,0,2,Li-ion
-1593662747875,per_ios,4,62,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1593748547875,per_ios,4,55,100,4157,23,0,2,Li-ion
-1593748787875,per_ios,4,54,100,4157,23,0,2,Li-ion
-1593749207875,per_ios,4,53,100,4157,23,0,2,Li-ion
-1593749387875,per_ios,4,52,100,4157,23,0,2,Li-ion
-NA,,NA,NA,NA,NA,NA,NA,NA,
-1593834425001,per_ios,4,60,100,4157,23,0,2,Li-ion
-1593834905001,per_ios,4,59,100,4157,23,0,2,Li-ion
-1593836105001,per_ios,4,58,100,4157,23,0,2,Li-ion
-1593836285001,per_ios,4,57,100,4157,23,0,2,Li-ion
-1593921060001,per_ios,4,41,100,4157,23,0,2,Li-ion
-1593921420001,per_ios,4,40,100,4157,23,0,2,Li-ion
-1593922860001,per_ios,4,39,100,4157,23,0,2,Li-ion
-1593922980001,per_ios,4,38,100,4157,23,0,2,Li-ion
-,,,,,,,,,
-1587626100001,eve_ios,4,90,100,4157,23,0,2,Li-ion
-1587626460001,eve_ios,4,89,100,4157,23,0,2,Li-ion
-1587642600001,eve_ios,4,80,100,4157,23,0,2,Li-ion
-1587643500001,eve_ios,4,79,100,4157,23,0,2,Li-ion
-1587643920001,eve_ios,4,78,100,4157,23,0,2,Li-ion
-1587696600001,eve_ios,4,50,100,4157,23,0,2,Li-ion
-1587696780001,eve_ios,4,49,100,4157,23,0,2,Li-ion

tests/data/external/aware_csv/phone_bluetooth_raw.csv

@@ -1,57 +0,0 @@
-"timestamp","device_id","bt_address","bt_name","bt_rssi","label"
-1593684000123,"test01","A6:93:AF:8C:36","Phone",-92,1593684000123
-1593705599321,"test01","A6:93:AF:8C:36","Phone",-79,1593684000123
-1593687638456,"test01","7E:D1:4E:80:2B","",-96,1593684000123
-1593705600654,"test01","7E:D1:4E:80:2B","",-92,1593705600654
-1593727199546,"test01","4B:2C:AA:88:1B","Smart TV",-95,1593705600654
-1593727200564,"test01","F5:F6:EC:8D:6C","Laptop",-88,1593727200564
-1593748799465,"test01","A6:93:AF:8C:36","Phone",-91,1593727200564
-1593738619645,"test01","10:6F:61:E4:A9","Speakers",-90,1593727200564
-1593747525789,"test01","7E:D1:4E:80:2B","",-84,1593727200564
-1593733518987,"test01","A6:93:AF:8C:36","Phone",-78,1593727200564
-1593662400798,"test01","7E:D1:4E:80:2B","",-76,1593662400798
-1593683999978,"test01","F5:F6:EC:8D:6C","Laptop",-97,1593662400798
-1593675299879,"test01","10:6F:61:E4:A9","Speakers",-93,1593662400798
-1593665344132,"test01","4B:2C:AA:88:1B","Smart TV",-94,1593662400798
-1593684000123,"test02","qaRo3mcQ-m0aJ-awAa-ACT9-6HcxDD26tsxe","Phone",-99,1593684000123
-1593705599132,"test02","ed0moSsY-5Qzi-4kDS-tAyj-eiTUK3LmEG9S","Laptop",-87,1593684000123
-1593687638321,"test02","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-89,1593684000123
-1593705600312,"test02","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-96,1593705600312
-1593727199456,"test02","ed0moSsY-5Qzi-4kDS-tAyj-eiTUK3LmEG9S","Laptop",-82,1593705600312
-1593727200465,"test02","skYoi2Iy-Hk69-45Ss-mMEc-mdSt0Xi4iwA5","",-79,1593727200465
-1593748799546,"test02","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-88,1593662400789
-1593738619564,"test02","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-97,1593662400789
-1593747525654,"test02","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-82,1593662400789
-1593733518645,"test02","ed0moSsY-5Qzi-4kDS-tAyj-eiTUK3LmEG9S","Laptop",-98,1593662400789
-1593662400789,"test02","skYoi2Iy-Hk69-45Ss-mMEc-mdSt0Xi4iwA5","",-84,1593662400789
-1593683999798,"test02","skYoi2Iy-Hk69-45Ss-mMEc-mdSt0Xi4iwA5","",-99,1593662400789
-1593675299879,"test02","An2oCwIE-LOSJ-teZQ-Bjls-VTgbq1wmTA1e","Speakers",-81,1593662400789
-1593665344987,"test02","An2oCwIE-LOSJ-teZQ-Bjls-VTgbq1wmTA1e","Speakers",-96,1593662400789
-1593684000123,"test05","A6:93:AF:8C:36","Phone",-92,1593684000123
-1593705599321,"test05","A6:93:AF:8C:36","Phone",-79,1593684000123
-1593687638456,"test05","7E:D1:4E:80:2B","",-96,1593684000123
-1593705600654,"test05","7E:D1:4E:80:2B","",-92,1593705600654
-1593727199546,"test05","4B:2C:AA:88:1B","Smart TV",-95,1593705600654
-1593727200564,"test05","F5:F6:EC:8D:6C","Laptop",-88,1593727200564
-1593748799465,"test05","A6:93:AF:8C:36","Phone",-91,1593727200564
-1593738619645,"test05","10:6F:61:E4:A9","Speakers",-90,1593727200564
-1593747525789,"test05","7E:D1:4E:80:2B","",-84,1593727200564
-1593733518987,"test05","A6:93:AF:8C:36","Phone",-78,1593727200564
-1593662400798,"test05","7E:D1:4E:80:2B","",-76,1593662400798
-1593683999978,"test05","F5:F6:EC:8D:6C","Laptop",-97,1593662400798
-1593675299879,"test05","10:6F:61:E4:A9","Speakers",-93,1593662400798
-1593665344132,"test05","4B:2C:AA:88:1B","Smart TV",-94,1593662400798
-1593684000123,"test06","qaRo3mcQ-m0aJ-awAa-ACT9-6HcxDD26tsxe","Phone",-99,1593684000123
-1593705599132,"test06","ed0moSsY-5Qzi-4kDS-tAyj-eiTUK3LmEG9S","Laptop",-87,1593684000123
-1593687638321,"test06","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-89,1593684000123
-1593705600312,"test06","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-96,1593705600312
-1593727199456,"test06","ed0moSsY-5Qzi-4kDS-tAyj-eiTUK3LmEG9S","Laptop",-82,1593705600312
-1593727200465,"test06","skYoi2Iy-Hk69-45Ss-mMEc-mdSt0Xi4iwA5","",-79,1593727200465
-1593748799546,"test06","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-88,1593662400789
-1593738619564,"test06","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-97,1593662400789
-1593747525654,"test06","R3cS8NPr-f43b-sIKF-fEjr-oRHjMuwzYX1V","Smart TV",-82,1593662400789
-1593733518645,"test06","ed0moSsY-5Qzi-4kDS-tAyj-eiTUK3LmEG9S","Laptop",-98,1593662400789
-1593662400789,"test06","skYoi2Iy-Hk69-45Ss-mMEc-mdSt0Xi4iwA5","",-84,1593662400789
-1593683999798,"test06","skYoi2Iy-Hk69-45Ss-mMEc-mdSt0Xi4iwA5","",-99,1593662400789
-1593675299879,"test06","An2oCwIE-LOSJ-teZQ-Bjls-VTgbq1wmTA1e","Speakers",-81,1593662400789
-1593665344987,"test06","An2oCwIE-LOSJ-teZQ-Bjls-VTgbq1wmTA1e","Speakers",-96,1593662400789

tests/data/external/aware_csv/phone_calls_raw.csv

@@ -1,273 +0,0 @@
-"timestamp","device_id","call_type","call_duration","trace"
-1591020025000,"test01",1,1299,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1591019365000,"test01",3,0,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1591009125000,"test01",2,1116,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591014777000,"test01",2,1060,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1591025270000,"test01",2,759,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1591015194000,"test01",1,667,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1591039261000,"test01",1,213,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591036173000,"test01",2,1289,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591036460000,"test01",3,0,"0AF00XrOYBKFnoU9s1lZQBMCDyVWwIUu7t9FishN"
-1591030751000,"test01",1,662,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591029194000,"test01",1,1053,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1591047100000,"test01",2,1186,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1591052691000,"test01",1,1157,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1591056859000,"test01",1,1719,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591053398000,"test01",2,1421,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1591063906000,"test01",1,1224,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1591060637000,"test01",2,1543,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1591054046000,"test01",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1590987442000,"test01",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1590984805000,"test01",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1590999462000,"test01",1,1331,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1590994337000,"test01",2,970,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1590999471000,"test01",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1590993791000,"test01",1,439,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591106425000,"test01",1,1299,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1591105765000,"test01",3,0,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1591095525000,"test01",2,1116,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591101177000,"test01",2,1060,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1591111670000,"test01",2,759,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1591101594000,"test01",1,667,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1591139091000,"test01",1,1157,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1591143259000,"test01",1,1719,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591139798000,"test01",2,1421,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1591150306000,"test01",1,1224,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1591147037000,"test01",2,1543,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1591140446000,"test01",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591020025000,"test02",1,0,"PnTE2wVL5OwyykjwekUUwhaCHEODWV5lZICBzdyL"
-1591020045000,"test02",2,20,"PnTE2wVL5OwyykjwekUUwhaCHEODWV5lZICBzdyL"
-1591021324000,"test02",4,1279,"PnTE2wVL5OwyykjwekUUwhaCHEODWV5lZICBzdyL"
-1591019365000,"test02",1,0,"BzdyLPnTE2wVL5OwyykjwekUUwhaCHEODWV5lZIC"
-1591019395000,"test02",4,30,"BzdyLPnTE2wVL5OwyykjwekUUwhaCHEODWV5lZIC"
-1591009125000,"test02",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591009145000,"test02",2,20,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591010241000,"test02",4,1096,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591014777000,"test02",3,0,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1591014797000,"test02",2,20,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1591015837000,"test02",4,1040,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1591025270000,"test02",3,0,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1591025287000,"test02",2,17,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1591026029000,"test02",4,742,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1591015194000,"test02",1,0,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1591015204000,"test02",2,10,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1591015861000,"test02",4,657,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1591039261000,"test02",1,0,"4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z"
-1591039276000,"test02",2,15,"4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z"
-1591039474000,"test02",4,198,"4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z"
-1591036173000,"test02",3,0,"Pcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXx"
-1591036183000,"test02",2,10,"Pcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXx"
-1591037462000,"test02",4,1279,"Pcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXx"
-1591036460000,"test02",3,0,"0AF00XrOYBKFnoU9s1lZQBMCDyVWwIUu7t9FishN"
-1591036490000,"test02",4,30,"0AF00XrOYBKFnoU9s1lZQBMCDyVWwIUu7t9FishN"
-1591030751000,"test02",1,0,"l0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bz"
-1591030763000,"test02",2,12,"l0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bz"
-1591031413000,"test02",4,650,"l0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bz"
-1591029194000,"test02",1,0,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1591029207000,"test02",2,13,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1591030247000,"test02",4,1040,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1591047100000,"test02",3,0,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1591047116000,"test02",2,16,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1591048286000,"test02",4,1170,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1591052691000,"test02",1,0,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1591052708000,"test02",2,17,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1591053848000,"test02",4,1140,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1591056859000,"test02",1,0,"DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3"
-1591056878000,"test02",2,19,"DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3"
-1591058578000,"test02",4,1700,"DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3"
-1591053398000,"test02",3,0,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1591053419000,"test02",2,21,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1591054819000,"test02",4,1400,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1591063906000,"test02",1,0,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1591063920000,"test02",2,14,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1591065130000,"test02",4,1210,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1591060637000,"test02",3,0,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1591060650000,"test02",2,13,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1591062180000,"test02",4,1530,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1591054046000,"test02",1,0,"7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1591054076000,"test02",4,30,"7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1590987442000,"test02",3,0,"WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0"
-1590987462000,"test02",4,20,"WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0"
-1590984805000,"test02",1,0,"Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50"
-1590984830000,"test02",4,25,"Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50"
-1590999462000,"test02",1,0,"50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi"
-1590999473000,"test02",2,11,"50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi"
-1591000793000,"test02",4,1320,"50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi"
-1590994337000,"test02",3,0,"XxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0K"
-1590994347000,"test02",2,10,"XxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0K"
-1590995307000,"test02",4,960,"XxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0K"
-1590999471000,"test02",3,0,"B9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DY"
-1590999501000,"test02",4,30,"B9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DY"
-1590993791000,"test02",1,0,"TE2wVL5ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1590993810000,"test02",2,19,"TE2wVL5ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1590994230000,"test02",4,420,"TE2wVL5ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1591106425000,"test02",1,0,"7dLniNPOwyykjwekUUwhaCHEODWV5lZICBzdyLPn"
-1591106434000,"test02",2,9,"7dLniNPOwyykjwekUUwhaCHEODWV5lZICBzdyLPn"
-1591107724000,"test02",4,1290,"7dLniNPOwyykjwekUUwhaCHEODWV5lZICBzdyLPn"
-1591105765000,"test02",1,0,"UwhaCHEODWV5lZICBzdyLPnTE2wVL5OwyykjwekU"
-1591105795000,"test02",4,30,"UwhaCHEODWV5lZICBzdyLPnTE2wVL5OwyykjwekU"
-1591095525000,"test02",3,0,"EODWV5lZICzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591095541000,"test02",2,16,"EODWV5lZICzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591096641000,"test02",4,1100,"EODWV5lZICzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591101177000,"test02",3,0,"WGP2OFzpJ7xlBAG8ScnUUS8QfrJ16VB6cakgg7IB"
-1591101187000,"test02",2,10,"WGP2OFzpJ7xlBAG8ScnUUS8QfrJ16VB6cakgg7IB"
-1591102237000,"test02",4,1050,"WGP2OFzpJ7xlBAG8ScnUUS8QfrJ16VB6cakgg7IB"
-1591111670000,"test02",3,0,"txvtyoTGl1WltUF1RgyLrcxRB4kPDTpszr6ocy2q"
-1591111679000,"test02",2,9,"txvtyoTGl1WltUF1RgyLrcxRB4kPDTpszr6ocy2q"
-1591112429000,"test02",4,750,"txvtyoTGl1WltUF1RgyLrcxRB4kPDTpszr6ocy2q"
-1591101594000,"test02",1,0,"AzHUNHHYLYNUKjrGmB7G4JGtSHqWU2rTwJsHNzFi"
-1591101601000,"test02",2,7,"AzHUNHHYLYNUKjrGmB7G4JGtSHqWU2rTwJsHNzFi"
-1591102261000,"test02",4,660,"AzHUNHHYLYNUKjrGmB7G4JGtSHqWU2rTwJsHNzFi"
-1591139091000,"test02",1,0,"NzJYHgcDihBWFeBmsAzrjVa0Xjl53p52AStkexUS"
-1591139108000,"test02",2,17,"NzJYHgcDihBWFeBmsAzrjVa0Xjl53p52AStkexUS"
-1591140248000,"test02",4,1140,"NzJYHgcDihBWFeBmsAzrjVa0Xjl53p52AStkexUS"
-1591143259000,"test02",1,0,"FeBmsAzr9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591143268000,"test02",2,9,"FeBmsAzr9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591144978000,"test02",4,1710,"FeBmsAzr9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1591139798000,"test02",3,0,"KNpGCJGvv9W0yYTCSxqJMuECsKhqaTr6uH8xd5qI"
-1591139809000,"test02",2,11,"KNpGCJGvv9W0yYTCSxqJMuECsKhqaTr6uH8xd5qI"
-1591141219000,"test02",4,1410,"KNpGCJGvv9W0yYTCSxqJMuECsKhqaTr6uH8xd5qI"
-1591150306000,"test02",1,0,"YHPbRsdHS2PekgS3LcK86nxkl3O9jzA3BWU5tJMi"
-1591150320000,"test02",2,14,"YHPbRsdHS2PekgS3LcK86nxkl3O9jzA3BWU5tJMi"
-1591151530000,"test02",4,1210,"YHPbRsdHS2PekgS3LcK86nxkl3O9jzA3BWU5tJMi"
-1591147037000,"test02",3,0,"faIKN6VylfqkD0Zk7TjnOnOjHqcE2q2yzzwfcFoZ"
-1591147050000,"test02",2,13,"faIKN6VylfqkD0Zk7TjnOnOjHqcE2q2yzzwfcFoZ"
-1591148580000,"test02",4,1530,"faIKN6VylfqkD0Zk7TjnOnOjHqcE2q2yzzwfcFoZ"
-1591140446000,"test02",3,0,"l0KXxPcvxi50ZciXg3DYB9bz4NqSk0WVf7dLniNP"
-1591140466000,"test02",4,20,"l0KXxPcvxi50ZciXg3DYB9bz4NqSk0WVf7dLniNP"
-1601564701000,"test05",1,1299,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1601572412000,"test05",3,0,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1601586664000,"test05",2,1116,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601558148000,"test05",2,1060,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1601556542000,"test05",2,759,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1601587579000,"test05",1,667,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1601560709000,"test05",1,213,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601577767000,"test05",2,1289,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601559886000,"test05",3,0,"0AF00XrOYBKFnoU9s1lZQBMCDyVWwIUu7t9FishN"
-1601572446000,"test05",1,662,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601573683000,"test05",1,1053,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1601550182000,"test05",2,1186,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1601570872000,"test05",1,1157,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1601575811000,"test05",1,1719,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601547211000,"test05",2,1421,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1601584838000,"test05",1,1224,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1601588772000,"test05",2,1543,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1601547698000,"test05",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601585755000,"test05",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601548086000,"test05",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601552567000,"test05",1,1331,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601560974000,"test05",2,970,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601570446000,"test05",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601574684000,"test05",1,439,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601579964000,"test05",1,1299,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1601553154000,"test05",3,0,"OwyykjwekUUwhaCHEODWV5lZICBzdyLPnTE2wVL5"
-1601576526000,"test05",2,1116,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601589399000,"test05",2,1060,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1601570871000,"test05",2,759,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1601561374000,"test05",1,667,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1601573260000,"test05",1,1157,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1601579886000,"test05",1,1719,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601558485000,"test05",2,1421,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1601561847000,"test05",1,1224,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1601587632000,"test05",2,1543,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1601582177000,"test05",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601564701000,"test06",1,0,"PnTE2wVL5OwyykjwekUUwhaCHEODWV5lZICBzdyL"
-1601564721000,"test06",2,20,"PnTE2wVL5OwyykjwekUUwhaCHEODWV5lZICBzdyL"
-1601566000000,"test06",4,1279,"PnTE2wVL5OwyykjwekUUwhaCHEODWV5lZICBzdyL"
-1601572412000,"test06",1,0,"BzdyLPnTE2wVL5OwyykjwekUUwhaCHEODWV5lZIC"
-1601572442000,"test06",4,30,"BzdyLPnTE2wVL5OwyykjwekUUwhaCHEODWV5lZIC"
-1601586664000,"test06",3,0,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601586684000,"test06",2,20,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601587780000,"test06",4,1096,"ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601558148000,"test06",3,0,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1601558168000,"test06",2,20,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1601559208000,"test06",4,1040,"cnUUS8QfrJ16VB6cakgg7IBWGP2OFzpJ7xlBAG8S"
-1601556542000,"test06",3,0,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1601556559000,"test06",2,17,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1601557301000,"test06",4,742,"1RgyLrcxRB4kPDTpszr6ocy2qtxvtyoTGl1WltUF"
-1601587579000,"test06",1,0,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1601587589000,"test06",2,10,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1601588246000,"test06",4,657,"JGtSHqWU2rTwJsHNzFiAzHUNHHYLYNUKjrGmB7G4"
-1601560709000,"test06",1,0,"4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z"
-1601560726000,"test06",2,15,"4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z"
-1601560924000,"test06",4,198,"4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z"
-1601577767000,"test06",3,0,"Pcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXx"
-1601577777000,"test06",2,10,"Pcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXx"
-1601579056000,"test06",4,1279,"Pcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXx"
-1601559886000,"test06",3,0,"0AF00XrOYBKFnoU9s1lZQBMCDyVWwIUu7t9FishN"
-1601559916000,"test06",4,30,"0AF00XrOYBKFnoU9s1lZQBMCDyVWwIUu7t9FishN"
-1601572446000,"test06",1,0,"l0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bz"
-1601572458000,"test06",2,12,"l0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bz"
-1601573108000,"test06",4,650,"l0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bz"
-1601573683000,"test06",1,0,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1601573696000,"test06",2,13,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1601574736000,"test06",4,1040,"6qWi08psbtFbnl0GxVYlAoG7e9X81JfYggNULsFh"
-1601550182000,"test06",3,0,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1601550198000,"test06",2,16,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1601551368000,"test06",4,1170,"6uW0vSbblda04AgPYlUMjaOBJ6vHdoeyCVy2xMcE"
-1601570872000,"test06",1,0,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1601570889000,"test06",2,17,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1601572029000,"test06",4,1140,"jVa0Xjl53p52AStkexUSNzJYHgcDihBWFeBmsAzr"
-1601575811000,"test06",1,0,"DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3"
-1601575830000,"test06",2,19,"DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3"
-1601577530000,"test06",4,1700,"DYB9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3"
-1601547211000,"test06",3,0,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1601547232000,"test06",2,21,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1601548632000,"test06",4,1400,"YTCSxqJMuECsKhqaTr6uH8xd5qIKNpGCJGvv9W0y"
-1601588772000,"test06",1,0,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1601588786000,"test06",2,14,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1601589996000,"test06",4,1210,"ekgS3LcK86nxkl3O9jzA3BWU5tJMiYHPbRsdHS2P"
-1601547698000,"test06",3,0,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1601547711000,"test06",2,13,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1601549241000,"test06",4,1530,"TjnOnOjHqcE2q2yzzwfcFoZfaIKN6VylfqkD0Zk7"
-1601585755000,"test06",1,0,"7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1601585785000,"test06",4,30,"7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1601548086000,"test06",3,0,"WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0"
-1601548106000,"test06",4,20,"WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50Z4NqSk0"
-1601552567000,"test06",1,0,"Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50"
-1601552592000,"test06",4,25,"Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi50"
-1601560974000,"test06",1,0,"50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi"
-1601560985000,"test06",2,11,"50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi"
-1601562305000,"test06",4,1320,"50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0KXxPcvxi"
-1601570446000,"test06",3,0,"XxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0K"
-1601570456000,"test06",2,10,"XxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0K"
-1601571416000,"test06",4,960,"XxPcvxi50Z4NqSk0WVf7dLniNPciXg3DYB9bzl0K"
-1601574684000,"test06",3,0,"B9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DY"
-1601574714000,"test06",4,30,"B9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNPciXg3DY"
-1601579964000,"test06",1,0,"TE2wVL5ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1601579983000,"test06",2,19,"TE2wVL5ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1601580384000,"test06",4,420,"TE2wVL5ciXg3DYB9bzl0KXxPcvxi50Z4NqSk0WVf"
-1601576526000,"test06",1,0,"7dLniNPOwyykjwekUUwhaCHEODWV5lZICBzdyLPn"
-1601576535000,"test06",2,9,"7dLniNPOwyykjwekUUwhaCHEODWV5lZICBzdyLPn"
-1601577825000,"test06",4,1290,"7dLniNPOwyykjwekUUwhaCHEODWV5lZICBzdyLPn"
-1601589399000,"test06",1,0,"UwhaCHEODWV5lZICBzdyLPnTE2wVL5OwyykjwekU"
-1601589429000,"test06",4,30,"UwhaCHEODWV5lZICBzdyLPnTE2wVL5OwyykjwekU"
-1601570871000,"test06",3,0,"EODWV5lZICzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601570887000,"test06",2,16,"EODWV5lZICzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601571987000,"test06",4,1100,"EODWV5lZICzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601561374000,"test06",3,0,"WGP2OFzpJ7xlBAG8ScnUUS8QfrJ16VB6cakgg7IB"
-1601561384000,"test06",2,10,"WGP2OFzpJ7xlBAG8ScnUUS8QfrJ16VB6cakgg7IB"
-1601562434000,"test06",4,1050,"WGP2OFzpJ7xlBAG8ScnUUS8QfrJ16VB6cakgg7IB"
-1601573260000,"test06",3,0,"txvtyoTGl1WltUF1RgyLrcxRB4kPDTpszr6ocy2q"
-1601573269000,"test06",2,9,"txvtyoTGl1WltUF1RgyLrcxRB4kPDTpszr6ocy2q"
-1601574019000,"test06",4,750,"txvtyoTGl1WltUF1RgyLrcxRB4kPDTpszr6ocy2q"
-1601579886000,"test06",1,0,"AzHUNHHYLYNUKjrGmB7G4JGtSHqWU2rTwJsHNzFi"
-1601579893000,"test06",2,7,"AzHUNHHYLYNUKjrGmB7G4JGtSHqWU2rTwJsHNzFi"
-1601580553000,"test06",4,660,"AzHUNHHYLYNUKjrGmB7G4JGtSHqWU2rTwJsHNzFi"
-1601558485000,"test06",1,0,"NzJYHgcDihBWFeBmsAzrjVa0Xjl53p52AStkexUS"
-1601558502000,"test06",2,17,"NzJYHgcDihBWFeBmsAzrjVa0Xjl53p52AStkexUS"
-1601559642000,"test06",4,1140,"NzJYHgcDihBWFeBmsAzrjVa0Xjl53p52AStkexUS"
-1601561847000,"test06",1,0,"FeBmsAzr9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601561856000,"test06",2,9,"FeBmsAzr9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601563566000,"test06",4,1710,"FeBmsAzr9bzl0KXxPcvxi50Z4NqSk0WVf7dLniNP"
-1601553154000,"test06",3,0,"KNpGCJGvv9W0yYTCSxqJMuECsKhqaTr6uH8xd5qI"
-1601553165000,"test06",2,11,"KNpGCJGvv9W0yYTCSxqJMuECsKhqaTr6uH8xd5qI"
-1601554575000,"test06",4,1410,"KNpGCJGvv9W0yYTCSxqJMuECsKhqaTr6uH8xd5qI"
-1601587632000,"test06",1,0,"YHPbRsdHS2PekgS3LcK86nxkl3O9jzA3BWU5tJMi"
-1601587646000,"test06",2,14,"YHPbRsdHS2PekgS3LcK86nxkl3O9jzA3BWU5tJMi"
-1601588856000,"test06",4,1210,"YHPbRsdHS2PekgS3LcK86nxkl3O9jzA3BWU5tJMi"
-1601582177000,"test06",3,0,"faIKN6VylfqkD0Zk7TjnOnOjHqcE2q2yzzwfcFoZ"
-1601582190000,"test06",2,13,"faIKN6VylfqkD0Zk7TjnOnOjHqcE2q2yzzwfcFoZ"
-1601583720000,"test06",4,1530,"faIKN6VylfqkD0Zk7TjnOnOjHqcE2q2yzzwfcFoZ"
-1601584838000,"test06",3,0,"l0KXxPcvxi50ZciXg3DYB9bz4NqSk0WVf7dLniNP"
-1601584858000,"test06",4,20,"l0KXxPcvxi50ZciXg3DYB9bz4NqSk0WVf7dLniNP"

tests/data/external/aware_csv/phone_light_raw.csv

@@ -1,25 +0,0 @@
-"timestamp","device_id","double_light_lux","accuracy","label"
-1593856800461,"test01",472.52,3,""
-1593863999053,"test01",37252.0,3,""
-1593871199794,"test01",90298.0,3,""
-1593878399891,"test01",114615.0,3,""
-1593878400002,"test01",97656.0,3,""
-1593885599119,"test01",90625.0,3,""
-1593892799453,"test01",24414.0,3,""
-1593899999082,"test01",10351.0,3,""
-1593900000724,"test01",15258.0,3,""
-1593907199287,"test01",1469.0,3,""
-1593921599301,"test01",84.156,3,""
-1593849599654,"test01",0.065,3,""
-1601251199000,"test05",472.52,3,""
-1601164800000,"test05",37252.0,3,""
-1601164800000,"test05",90298.0,3,""
-1601164860000,"test05",114615.0,3,""
-1601166599000,"test05",97656.0,3,""
-1601166600000,"test05",90625.0,3,""
-1601166601000,"test05",24414.0,3,""
-1601179199000,"test05",10351.0,3,""
-1601179200000,"test05",15258.0,3,""
-1601179201000,"test05",1469.0,3,""
-1601182801000,"test05",0.0,3,""
-1601182811000,"test05",0.0,3,""

tests/data/external/aware_csv/phone_messages_raw.csv

@@ -1,83 +0,0 @@
-"timestamp","device_id","message_type","trace"
-1590678031000,"test01",1,"t00s6SCQrraJw1jlkwAFTSiyAISkMPmzngCL7fbZ"
-1590662705000,"test01",1,"FoQBWR2r8GS4WmuEKIvcEkJbxskbYg6VOsbLU1Wr"
-1590662518000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590677650000,"test01",2,"vfnqxPLJGjCrsPSKkST0iqRia6UwWLfNFAHWaXRs"
-1590661734000,"test01",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590695355000,"test01",1,"5omWkSnUUoJ2T5maLRAO7SjxOLFB1CfccmPDhJOo"
-1590681732000,"test01",2,"5omWkSnUUoJ2T5maLRAO7SjxOLFB1CfccmPDhJOo"
-1590697175000,"test01",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590696483000,"test01",2,"89aUD0LNMBeDldSCjXKq4CRJzpu3ntG42XM8o0iY"
-1590688241000,"test01",1,"89aUD0LNMBeDldSCjXKq4CRJzpu3ntG42XM8o0iY"
-1590708828000,"test01",1,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1590722462000,"test01",2,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1590721378000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590712798000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590711492000,"test01",2,"FVPAjfv1ZLVs6vqxsqVeBJ1afdbUBXuZ7dByKned"
-1590657155000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590643557000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590651560000,"test01",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590649392000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590638774000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590764431000,"test01",1,"t00s6SCQrraJw1jlkwAFTSiyAISkMPmzngCL7fbZ"
-1590749105000,"test01",1,"FoQBWR2r8GS4WmuEKIvcEkJbxskbYg6VOsbLU1Wr"
-1590748918000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590764050000,"test01",2,"vfnqxPLJGjCrsPSKkST0iqRia6UwWLfNFAHWaXRs"
-1590748134000,"test01",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590795228000,"test01",1,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1590808862000,"test01",2,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1590807778000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590799198000,"test01",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1590797892000,"test01",2,"FVPAjfv1ZLVs6vqxsqVeBJ1afdbUBXuZ7dByKned"
-1590678031000,"test02",1,"CL7fbZt00s6SCQrraJw1jlkwAFTSiyAISkMPmzng"
-1590662705000,"test02",1,"VOsbLU1WrFoQBWR2r8GS4WmuEKIvcEkJbxskbYg6"
-1590662518000,"test02",1,"RGrSFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2"
-1590677650000,"test02",2,"UwWLfNFAHWaXRsvfnqxPLJGjCrsPSKkST0iqRia6"
-1590661734000,"test02",2,"C2RGrSFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyo"
-1590695355000,"test02",1,"DhJOo5omWkSnUUoJ2T5maLRAO7SjxOLFB1CfccmP"
-1590681732000,"test02",2,"5omWkSnUUoJ2T5maLRAO7SjxOLFB1CfccmPDhJOo"
-1590697175000,"test02",2,"GcxyoC2RGrSFkNCC6I3SlHwtvvetmzh3hYpAmXwH"
-1590696483000,"test02",2,"M8o0iY89aUD0LNMBeDldSCjXKq4CRJzpu3ntG42X"
-1590688241000,"test02",1,"89aUD0LNMBeDldSCjXKq4CRJzpu3ntG42XM8o0iY"
-1590708828000,"test02",1,"Zuo0OmWk15QDFjeGCKI5CVxw2bkjsacmjsjwsHwe"
-1590722462000,"test02",2,"KI5CVxw2bkjsacmjsjwsHweZuo0OmWk15QDFjeGC"
-1590721378000,"test02",1,"HGcxyoC2RGrSFkNCC6I3SlHwtvvetmzh3hYpAmXw"
-1590712798000,"test02",1,"XwHGcxyoC2RGrSFkNCC6I3SlHwtvvetmzh3hYpAm"
-1590711492000,"test02",2,"VeBJ1afdbUBXuZ7dByKnedFVPAjfv1ZLVs6vqxsq"
-1590657155000,"test02",1,"AmXwHGcxyoC2RGrSFkNCC6I3SlHwtvvetmzh3hYp"
-1590643557000,"test02",1,"YpAmXwHGcxyoC2RGrSFkNCC6I3SlHwtvvetmzh3h"
-1590651560000,"test02",2,"Hwtvvetmzh3hYpAmXwHGcxyoC2RGrSFkNCC6I3Sl"
-1590649392000,"test02",1,"I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGrSFkNCC6"
-1590638774000,"test02",1,"SlHwtvvetmzh3hYpAmXwHGcxyoC2RGrSFkNCC6I3"
-1590764431000,"test02",1,"t00s6SCQrraJw1jlkwAFTSiyAISkMPmzngCL7fbZ"
-1590749105000,"test02",1,"FoQBWR2r8GS4WmuEKIvcEkJbxskbYg6VOsbLU1Wr"
-1590748918000,"test02",1,"C6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGrSFkNC"
-1590764050000,"test02",2,"vfnqxPLJGjCrsPSKkST0iqRia6UwWLfNFAHWaXRs"
-1590748134000,"test02",2,"CC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGrSFkN"
-1590795228000,"test02",1,"HweZuo0OmWk15QDFjeGCKI5CVxw2bkjsacmjsjws"
-1590808862000,"test02",2,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1590807778000,"test02",1,"NCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGrSFk"
-1590799198000,"test02",1,"FkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGrS"
-1590797892000,"test02",2,"FVPAjfv1ZLVs6vqxsqVeBJ1afdbUBXuZ7dByKned"
-1602475200000,"test05",1,"t00s6SCQrraJw1jlkwAFTSiyAISkMPmzngCL7fbZ"
-1602475999000,"test05",1,"FoQBWR2r8GS4WmuEKIvcEkJbxskbYg6VOsbLU1Wr"
-1602475999000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602476999000,"test05",2,"vfnqxPLJGjCrsPSKkST0iqRia6UwWLfNFAHWaXRs"
-1602477000000,"test05",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602478000000,"test05",1,"5omWkSnUUoJ2T5maLRAO7SjxOLFB1CfccmPDhJOo"
-1602478000000,"test05",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602480500000,"test05",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602478799000,"test05",2,"89aUD0LNMBeDldSCjXKq4CRJzpu3ntG42XM8o0iY"
-1602478800000,"test05",1,"89aUD0LNMBeDldSCjXKq4CRJzpu3ntG42XM8o0iY"
-1602478799000,"test05",1,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1602478800000,"test05",2,"Wk15QDFjeGCKI5CVxw2bkjsacmjsjwsHweZuo0Om"
-1602558000000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602558000000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602558799000,"test05",2,"FVPAjfv1ZLVs6vqxsqVeBJ1afdbUBXuZ7dByKned"
-1602558799000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602559799000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602559800000,"test05",2,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602560800000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602561599000,"test05",1,"SFkNCC6I3SlHwtvvetmzh3hYpAmXwHGcxyoC2RGr"
-1602561600000,"test05",1,"t00s6SCQrraJw1jlkwAFTSiyAISkMPmzngCL7fbZ"
-1602563400000,"test05",2,"FoQBWR2r8GS4WmuEKIvcEkJbxskbYg6VOsbLU1Wr"

tests/data/external/aware_csv/phone_screen_raw.csv

@@ -1,43 +0,0 @@
-"timestamp","device_id","screen_status"
-1590994230386,"test01",1
-1590994230688,"test01",3
-1590994590149,"test01",0
-1590994590775,"test01",2
-1591005411491,"test01",1
-1591005411795,"test01",3
-1591005831205,"test01",0
-1591005831699,"test01",2
-1591020022531,"test01",1
-1591020024938,"test01",3
-1591021324531,"test01",0
-1591021324957,"test01",2
-1591027053231,"test01",1
-1591027053831,"test01",3
-1591027953554,"test01",0
-1591027953954,"test01",2
-1591037462155,"test01",1
-1591037462512,"test01",3
-1591038002491,"test01",0
-1591038002938,"test01",2
-1591048286712,"test01",1
-1591048287050,"test01",3
-1591049306055,"test01",0
-1591049306405,"test01",2
-1591058578480,"test01",1
-1591058578811,"test01",3
-1591059718035,"test01",0
-1591059718492,"test01",2
-1590994230688,"test02",3
-1590994590775,"test02",2
-1591005411795,"test02",3
-1591005831699,"test02",2
-1591020024938,"test02",3
-1591021324531,"test02",2
-1591027053831,"test02",3
-1591027953954,"test02",2
-1591037462512,"test02",3
-1591038002938,"test02",2
-1591048287050,"test02",3
-1591049306405,"test02",2
-1591058578811,"test02",3
-1591059718492,"test02",2

tests/data/external/aware_csv/phone_wifi_connected_raw.csv

@@ -1,91 +0,0 @@
-"timestamp","device_id","mac_address","ssid","bssid"
-1593771645547,"test01","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1593791393289,"test01","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1593779101251,"test01","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1593813989898,"test01","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1593799538019,"test01","af:13:50:8b:5f:ab","Fios-H4S9a","48:6B:8C:51:08:F2"
-1593797221589,"test01","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1593820668588,"test01","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1593831618372,"test01","af:13:50:8b:5f:ab","Fios-H4S9a","48:6B:8C:51:08:F2"
-1593821661830,"test01","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1593768441273,"test01","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1593764562099,"test01","af:13:50:8b:5f:ab","Galactica","E6:4C:9A:3F:D0:1B"
-1593765323772,"test01","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1593770400547,"test02","af:13:50:8b:5f:ab","xfinity","E6:06:DA:AF:F9:91"
-1593791999289,"test02","af:13:50:8b:5f:ab","xfinity","E6:06:DA:AF:F9:91"
-1593774038251,"test02","af:13:50:8b:5f:ab","CMU-SECURE","D0:B8:2F:EB:0E:F8"
-1593792000898,"test02","af:13:50:8b:5f:ab","","3D:12:EC:DE:96:E1"
-1593813599019,"test02","af:13:50:8b:5f:ab","eduroam","24:2B:A2:55:8A:E0"
-1593813600589,"test02","af:13:50:8b:5f:ab","xfinity","E6:06:DA:AF:F9:91"
-1593835199588,"test02","af:13:50:8b:5f:ab","CMU-SECURE","D0:B8:2F:EB:0E:F8"
-1593825019372,"test02","af:13:50:8b:5f:ab","eduroam","24:2B:A2:55:8A:E0"
-1593833925830,"test02","af:13:50:8b:5f:ab","","3D:12:EC:DE:96:E1"
-1593819918273,"test02","af:13:50:8b:5f:ab","","3D:12:EC:DE:96:E1"
-1593748800099,"test02","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7B:8A:3E:43"
-1593770399772,"test02","af:13:50:8b:5f:ab","","3D:12:EC:DE:96:E1"
-1593761699709,"test02","af:13:50:8b:5f:ab","eduroam","24:2B:A2:55:8A:E0"
-1593751744305,"test02","af:13:50:8b:5f:ab","CMU-SECURE","D0:B8:2F:EB:0E:F8"
-1602475200000,"test05","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602475999000,"test05","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602476999000,"test05","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1602477000000,"test05","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602478000000,"test05","af:13:50:8b:5f:ab","Fios-H4S9a","48:6B:8C:51:08:F2"
-1602480500000,"test05","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602478799000,"test05","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1602478800000,"test05","af:13:50:8b:5f:ab","Fios-H4S9a","48:6B:8C:51:08:F2"
-1602558000000,"test05","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602558799000,"test05","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602559799000,"test05","af:13:50:8b:5f:ab","Galactica","E6:4C:9A:3F:D0:1B"
-1602559800000,"test05","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602560800000,"test05","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602563400000,"test05","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1602561599000,"test05","af:13:50:8b:5f:ab","Galactica","E6:4C:9A:3F:D0:1B"
-1602561600000,"test05","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602475200000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602475999000,"test05","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7b:8a:3e:43"
-1602476999000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602477000000,"test05","af:13:50:8b:5f:ab","CMU-SECURE","d0:b8:2f:eb:0e:f8"
-1602478000000,"test05","af:13:50:8b:5f:ab","","3d:12:ec:de:96:e1"
-1602480500000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602478799000,"test05","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7b:8a:3e:43"
-1602478800000,"test05","af:13:50:8b:5f:ab","","3d:12:ec:de:96:e1"
-1602558000000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602558799000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602559799000,"test05","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7b:8a:3e:43"
-1602559800000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602560800000,"test05","af:13:50:8b:5f:ab","eduroam","24:2b:a2:55:8a:e0"
-1602563400000,"test05","af:13:50:8b:5f:ab","CMU-SECURE","d0:b8:2f:eb:0e:f8"
-1602561599000,"test05","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602561600000,"test05","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602475200000,"test06","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602475999000,"test06","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602476999000,"test06","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1602477000000,"test06","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602478000000,"test06","af:13:50:8b:5f:ab","Fios-H4S9a","48:6B:8C:51:08:F2"
-1602480500000,"test06","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602478799000,"test06","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1602478800000,"test06","af:13:50:8b:5f:ab","Fios-H4S9a","48:6B:8C:51:08:F2"
-1602558000000,"test06","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602558799000,"test06","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602559799000,"test06","af:13:50:8b:5f:ab","Galactica","E6:4C:9A:3F:D0:1B"
-1602559800000,"test06","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602560800000,"test06","af:13:50:8b:5f:ab","NETGEAR07","EF:E7:56:4A:F4:1D"
-1602563400000,"test06","af:13:50:8b:5f:ab","Stewart Family","0D:FB:75:AA:43:0A"
-1602561599000,"test06","af:13:50:8b:5f:ab","Galactica","E6:4C:9A:3F:D0:1B"
-1602561600000,"test06","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"
-1602475200000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602475999000,"test06","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7b:8a:3e:43"
-1602476999000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602477000000,"test06","af:13:50:8b:5f:ab","CMU-SECURE","d0:b8:2f:eb:0e:f8"
-1602478000000,"test06","af:13:50:8b:5f:ab","","3d:12:ec:de:96:e1"
-1602480500000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602478799000,"test06","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7b:8a:3e:43"
-1602478800000,"test06","af:13:50:8b:5f:ab","","3d:12:ec:de:96:e1"
-1602558000000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602558799000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602559799000,"test06","af:13:50:8b:5f:ab","WIRELESS-PITTNET","86:90:7b:8a:3e:43"
-1602559800000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602560800000,"test06","af:13:50:8b:5f:ab","eduroam","24:2b:a2:55:8a:e0"
-1602563400000,"test06","af:13:50:8b:5f:ab","CMU-SECURE","d0:b8:2f:eb:0e:f8"
-1602561599000,"test06","af:13:50:8b:5f:ab","xfinity","e6:06:da:af:f9:91"
-1602561600000,"test06","af:13:50:8b:5f:ab","HOME-1234","E0:A9:8A:1E:48:1B"

tests/data/external/aware_csv/phone_wifi_visible_raw.csv

@@ -1,47 +0,0 @@
-"timestamp","device_id","bssid","ssid","security","frequency","rssi","label"
-1593770400826,"test01","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]",5180.0,-89.0,""
-1593778094559,"test01","86:90:7b:8a:3e:43","WIRELESS-PITTNET","[WPA2-EAP-CCMP][ESS]",5805.0,-95.0,""
-1593785574027,"test01","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]",5180.0,-93.0,""
-1593791999936,"test01","d0:b8:2f:eb:0e:f8","CMU-SECURE","[WPA2-EAP-CCMP][ESS]",5765.0,-83.0,""
-1593792000442,"test01","3d:12:ec:de:96:e1","","[WPA2-EAP-CCMP][ESS]",5765.0,-97.0,""
-1593812070708,"test01","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]",5765.0,-98.0,""
-1593817199253,"test01","86:90:7b:8a:3e:43","WIRELESS-PITTNET","[WPA2-EAP-CCMP][ESS]",5765.0,-79.0,""
-1593813600578,"test01","3d:12:ec:de:96:e1","","[WPA2-EAP-CCMP][ESS]",5765.0,-80.0,""
-1593835199363,"test01","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]",5180.0,-82.0,""
-1593748800505,"test01","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]",5180.0,-92.0,""
-1593761511861,"test01","86:90:7b:8a:3e:43","WIRELESS-PITTNET","[WPA2-EAP-CCMP][ESS]",5805.0,-84.0,""
-1593760292500,"test01","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]",5765.0,-91.0,""
-1593762343842,"test01","24:2b:a2:55:8a:e0","eduroam","[WPA2-EAP-CCMP][ESS]",5805.0,-100.0,""
-1593770399830,"test01","d0:b8:2f:eb:0e:f8","CMU-SECURE","[WPA2-EAP-CCMP][ESS]",5765.0,-75.0,""
-1602475200000,"test05","E0:A9:8A:1E:48:1B","HOME-1234","[WPA2-EAP-CCMP][ESS]",5805.0,-95.0,""
-1602475999000,"test05","E0:A9:8A:1E:48:1B","HOME-1234","[WPA2-EAP-CCMP][ESS]",5180.0,-93.0,""
-1602476999000,"test05","0D:FB:75:AA:43:0A","Stewart Family","[WPA2-EAP-CCMP][ESS]",5765.0,-83.0,""
-1602477000000,"test05","EF:E7:56:4A:F4:1D","NETGEAR07","[WPA2-EAP-CCMP][ESS]",5765.0,-97.0,""
-1602478000000,"test05","48:6B:8C:51:08:F2","Fios-H4S9a","[WPA2-EAP-CCMP][ESS]",5765.0,-98.0,""
-1602480500000,"test05","E0:A9:8A:1E:48:1B","HOME-1234","[WPA2-EAP-CCMP][ESS]",5765.0,-79.0,""
-1602478799000,"test05","0D:FB:75:AA:43:0A","Stewart Family","[WPA2-EAP-CCMP][ESS]",5765.0,-80.0,""
-1602478800000,"test05","48:6B:8C:51:08:F2","Fios-H4S9a","[WPA2-EAP-CCMP][ESS]",5180.0,-82.0,""
-1602558000000,"test05","EF:E7:56:4A:F4:1D","NETGEAR07","[WPA2-EAP-CCMP][ESS]",5180.0,-92.0,""
-1602558799000,"test05","EF:E7:56:4A:F4:1D","NETGEAR07","[WPA2-EAP-CCMP][ESS]",5805.0,-84.0,""
-1602559799000,"test05","E6:4C:9A:3F:D0:1B","Galactica","[WPA2-EAP-CCMP][ESS]",5765.0,-91.0,""
-1602559800000,"test05","EF:E7:56:4A:F4:1D","NETGEAR07","[WPA2-EAP-CCMP][ESS]",5805.0,-100.0,""
-1602560800000,"test05","EF:E7:56:4A:F4:1D","NETGEAR07","[WPA2-EAP-CCMP][ESS]",5765.0,-75.0,""
-1602563400000,"test05","0D:FB:75:AA:43:0A","Stewart Family","[WPA2-EAP-CCMP][ESS]",5180.0,-93.0,""
-1602561599000,"test05","E6:4C:9A:3F:D0:1B","Galactica","[WPA2-EAP-CCMP][ESS]",5765.0,-80.0,""
-1602561600000,"test05","E0:A9:8A:1E:48:1B","HOME-1234","[WPA2-EAP-CCMP][ESS]","","",""
-1602475200000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602475999000,"test05","86:90:7b:8a:3e:43","WIRELESS-PITTNET","[WPA2-EAP-CCMP][ESS]","","",""
-1602476999000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602477000000,"test05","d0:b8:2f:eb:0e:f8","CMU-SECURE","[WPA2-EAP-CCMP][ESS]","","",""
-1602478000000,"test05","3d:12:ec:de:96:e1","","[WPA2-EAP-CCMP][ESS]","","",""
-1602480500000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602478799000,"test05","86:90:7b:8a:3e:43","WIRELESS-PITTNET","[WPA2-EAP-CCMP][ESS]","","",""
-1602478800000,"test05","3d:12:ec:de:96:e1","","[WPA2-EAP-CCMP][ESS]","","",""
-1602558000000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602558799000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602559799000,"test05","86:90:7b:8a:3e:43","WIRELESS-PITTNET","[WPA2-EAP-CCMP][ESS]","","",""
-1602559800000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602560800000,"test05","24:2b:a2:55:8a:e0","eduroam","[WPA2-EAP-CCMP][ESS]","","",""
-1602563400000,"test05","d0:b8:2f:eb:0e:f8","CMU-SECURE","[WPA2-EAP-CCMP][ESS]","","",""
-1602561599000,"test05","e6:06:da:af:f9:91","xfinity","[WPA2-EAP-CCMP][ESS]","","",""
-1602561600000,"test05","E0:A9:8A:1E:48:1B","HOME-1234","","","",""

tests/data/external/aware_csv/plugin_google_activity_recognition_raw.csv

@@ -1,56 +0,0 @@
-"timestamp","device_id","activity_name","activity_type","confidence","activities"
-1594011513359,"test01","still",3,99,"[{\"activity\":\"still\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594009169663,"test01","still",3,88,"[{\"activity\":\"still\",\"confidence\":88},{\"activity\":\"walking\",\"confidence\":7},{\"activity\":\"in_vehicle\",\"confidence\":4}{\"activity\":\"unknown\",\"confidence\":1}]"
-1594008233193,"test01","still",3,92,"[{\"activity\":\"still\",\"confidence\":92},{\"activity\":\"In_vehicle\",\"confidence\":7},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594014089214,"test01","unknown",4,92,"[{\"activity\":\"unknown\",\"confidence\":92},{\"activity\":\"walking\",\"confidence\":5},{\"activity\":\"still\",\"confidence\":2},{\"activity\":\"in_vehicle\",\"confidence\":1}]"
-1594022514638,"test01","tilting",5,91,"[{\"activity\":\"tilting\",\"confidence\":91},{\"activity\":\"on_bicycle\",\"confidence\":8},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594019642710,"test01","tilting",5,91,"[{\"activity\":\"tilting\",\"confidence\":91},{\"activity\":\"on_bicycle\",\"confidence\":8},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594021195186,"test01","tilting",5,98,"[{\"activity\":\"tilting\",\"confidence\":98},{\"activity\":\"still\",\"confidence\":1},{\"activity\":\"walking\",\"confidence\":1}]"
-1594023232802,"test01","tilting",5,86,"[{\"activity\":\"tilting\",\"confidence\":86},{\"activity\":\"walking\",\"confidence\":12},{\"activity\":\"still\",\"confidence\":2}]"
-1594029036619,"test01","still",3,88,"[{\"activity\":\"still\",\"confidence\":88},{\"activity\":\"walking\",\"confidence\":7},{\"activity\":\"in_vehicle\",\"confidence\":4}{\"activity\":\"unknown\",\"confidence\":1}]"
-1594026189418,"test01","still",3,99,"[{\"activity\":\"still\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594030960769,"test01","still",3,98,"[{\"activity\":\"still\",\"confidence\":98},{\"activity\":\"tilting\",\"confidence\":1},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594029972576,"test01","still",3,99,"[{\"activity\":\"still\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594032360318,"test01","still",3,99,"[{\"activity\":\"still\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594029680604,"test01","still",3,88,"[{\"activity\":\"still\",\"confidence\":88},{\"activity\":\"walking\",\"confidence\":7},{\"activity\":\"in_vehicle\",\"confidence\":4}{\"activity\":\"unknown\",\"confidence\":1}]"
-1594034061588,"test01","walking",7,86,"[{\"activity\":\"walking\",\"confidence\":86},{\"activity\":\"in_vehicle\",\"confidence\":9},{\"activity\":\"still\",\"confidence\":4},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594035583131,"test01","walking",7,92,"[{\"activity\":\"walking\",\"confidence\":92},{\"activity\":\"running\",\"confidence\":5},{\"activity\":\"in_vehicle\",\"confidence\":2},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594036135681,"test01","walking",7,94,"[{\"activity\":\"walking\",\"confidence\":94},{\"activity\":\"on_foot\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594034330494,"test01","walking",7,98,"[{\"activity\":\"walking\",\"confidence\":98},{\"activity\":\"running\",\"confidence\":1},{\"activity\":\"still\",\"confidence\":1}]"
-1594041009481,"test01","running",8,89,"[{\"activity\":\"running\",\"confidence\":89},{\"activity\":\"on_bicycle\",\"confidence\":7},{\"activity\":\"walking\",\"confidence\":3},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594039008555,"test01","running",8,83,"[{\"activity\":\"running\",\"confidence\":83},{\"activity\":\"on_foot\",\"confidence\":15},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594040542637,"test01","running",8,85,"[{\"activity\":\"running\",\"confidence\":85},{\"activity\":\"walking\",\"confidence\":12},{\"activity\":\"on_fooy\",\"confidence\":3}]"
-1594045170488,"test01","in_vehicle",0,92,"[{\"activity\":\"in_vehicle\",\"confidence\":92},{\"activity\":\"tilting\",\"confidence\":6},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594044861283,"test01","in_vehicle",0,91,"[{\"activity\":\"in_vehicle\",\"confidence\":91},{\"activity\":\"on_bicycle\",\"confidence\":8},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594046775997,"test01","in_vehicle",0,92,"[{\"activity\":\"in_vehicle\",\"confidence\":92},{\"activity\":\"tilting\",\"confidence\":6},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594045155284,"test01","in_vehicle",0,91,"[{\"activity\":\"in_vehicle\",\"confidence\":91},{\"activity\":\"on_bicycle\",\"confidence\":8},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594048942657,"test01","on_foot",2,89,"[{\"activity\":\"on_foot\",\"confidence\":89},{\"activity\":\"walking\",\"confidence\":7},{\"activity\":\"unknown\",\"confidence\":4}]"
-1594049953189,"test01","on_foot",2,99,"[{\"activity\":\"on_foot\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594051260258,"test01","on_foot",2,94,"[{\"activity\":\"on_foot\",\"confidence\":94},{\"activity\":\"running\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594054828512,"test01","on_foot",2,80,"[{\"activity\":\"on_foot\",\"confidence\":80},{\"activity\":\"in_vehicle\",\"confidence\":15},{\"activity\":\"running\",\"confidence\":4},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594053652847,"test01","on_foot",2,94,"[{\"activity\":\"on_foot\",\"confidence\":94},{\"activity\":\"running\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594052619496,"test01","on_foot",2,94,"[{\"activity\":\"on_foot\",\"confidence\":94},{\"activity\":\"running\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594059951546,"test01","still",3,88,"[{\"activity\":\"still\",\"confidence\":88},{\"activity\":\"walking\",\"confidence\":7},{\"activity\":\"in_vehicle\",\"confidence\":4}{\"activity\":\"unknown\",\"confidence\":1}]"
-1594063934168,"test01","still",3,98,"[{\"activity\":\"still\",\"confidence\":98},{\"activity\":\"tilting\",\"confidence\":1},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594058448212,"test01","still",3,98,"[{\"activity\":\"still\",\"confidence\":98},{\"activity\":\"tilting\",\"confidence\":1},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594073582003,"test01","in_vehicle",0,92,"[{\"activity\":\"in_vehicle\",\"confidence\":92},{\"activity\":\"tilting\",\"confidence\":6},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594073060268,"test01","in_vehicle",0,91,"[{\"activity\":\"in_vehicle\",\"confidence\":91},{\"activity\":\"on_bicycle\",\"confidence\":8},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594072009878,"test01","in_vehicle",0,98,"[{\"activity\":\"in_vehicle\",\"confidence\":98},{\"activity\":\"still\",\"confidence\":1},{\"activity\":\"walking\",\"confidence\":1}]"
-1594071273066,"test01","in_vehicle",0,88,"[{\"activity\":\"in_vehicle\",\"confidence\":88},{\"activity\":\"running\",\"confidence\":10},{\"activity\":\"still\",\"confidence\":2}]"
-1594071651364,"test01","in_vehicle",0,92,"[{\"activity\":\"in_vehicle\",\"confidence\":92},{\"activity\":\"tilting\",\"confidence\":6},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594072224460,"test01","in_vehicle",0,86,"[{\"activity\":\"in_vehicle\",\"confidence\":86},{\"activity\":\"walking\",\"confidence\":12},{\"activity\":\"still\",\"confidence\":2}]"
-1594076125576,"test01","walking",7,98,"[{\"activity\":\"walking\",\"confidence\":98},{\"activity\":\"running\",\"confidence\":1},{\"activity\":\"still\",\"confidence\":1}]"
-1594076058465,"test01","walking",7,98,"[{\"activity\":\"walking\",\"confidence\":98},{\"activity\":\"running\",\"confidence\":1},{\"activity\":\"still\",\"confidence\":1}]"
-1594076997023,"test01","walking",7,92,"[{\"activity\":\"walking\",\"confidence\":92},{\"activity\":\"running\",\"confidence\":5},{\"activity\":\"in_vehicle\",\"confidence\":2},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594076477847,"test01","walking",7,86,"[{\"activity\":\"walking\",\"confidence\":86},{\"activity\":\"in_vehicle\",\"confidence\":9},{\"activity\":\"still\",\"confidence\":4},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594078728766,"test01","on_bicycle",1,93,"[{\"activity\":\"on_bicycle\",\"confidence\":93},{\"activity\":\"in_vehicle\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594078002827,"test01","on_bicycle",1,87,"[{\"activity\":\"on_bicycle\",\"confidence\":87},{\"activity\":\"walking\",\"confidence\":12},{\"activity\":\"still\",\"confidence\":1}]"
-1594081329828,"test01","on_bicycle",1,93,"[{\"activity\":\"on_bicycle\",\"confidence\":93},{\"activity\":\"in_vehicle\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":2}]"
-1594077881253,"test01","on_bicycle",1,87,"[{\"activity\":\"on_bicycle\",\"confidence\":87},{\"activity\":\"walking\",\"confidence\":12},{\"activity\":\"still\",\"confidence\":1}]"
-1594082278338,"test01","on_foot",2,99,"[{\"activity\":\"on_foot\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594085089288,"test01","on_foot",2,80,"[{\"activity\":\"on_foot\",\"confidence\":80},{\"activity\":\"in_vehicle\",\"confidence\":15},{\"activity\":\"running\",\"confidence\":4},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594083604829,"test01","on_foot",2,80,"[{\"activity\":\"on_foot\",\"confidence\":80},{\"activity\":\"in_vehicle\",\"confidence\":15},{\"activity\":\"running\",\"confidence\":4},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594085099383,"test01","on_foot",2,94,"[{\"activity\":\"on_foot\",\"confidence\":94},{\"activity\":\"running\",\"confidence\":5},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594089833084,"test01","unknown",4,97,"[{\"activity\":\"unknown\",\"confidence\":97},{\"activity\":\"running\",\"confidence\":2},{\"activity\":\"walking\",\"confidence\":1}]"
-1594092988804,"test01","still",3,99,"[{\"activity\":\"still\",\"confidence\":99},{\"activity\":\"unknown\",\"confidence\":1}]"
-1594093445402,"test01","still",3,88,"[{\"activity\":\"still\",\"confidence\":88},{\"activity\":\"walking\",\"confidence\":7},{\"activity\":\"in_vehicle\",\"confidence\":4}{\"activity\":\"unknown\",\"confidence\":1}]"

tests/data/external/aware_csv/plugin_ios_activity_recognition_raw.csv

@@ -1,56 +0,0 @@
-"timestamp","device_id","activities","confidence","stationary","walking","running","automotive","cycling","unknown","label"
-1594011513359,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594009169663,"test02","[\"stationary\"]",0,1,0,0,0,0,0,""
-1594008233193,"test02","[\"stationary\"]",1,1,0,0,0,0,0,""
-1594014089214,"test02","",1,0,0,0,0,0,0,""
-1594022514638,"test02","",1,0,0,0,0,0,0,""
-1594019642710,"test02","",1,0,0,0,0,0,0,""
-1594021195186,"test02","",2,0,0,0,0,0,0,""
-1594023232802,"test02","",0,0,0,0,0,0,0,""
-1594029036619,"test02","[\"stationary\"]",0,1,0,0,0,0,0,""
-1594026189418,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594030960769,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594029972576,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594032360318,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594029680604,"test02","[\"stationary\"]",0,1,0,0,0,0,0,""
-1594034061588,"test02","[\"walking\"]",0,0,1,0,0,0,0,""
-1594035583131,"test02","[\"walking\"]",1,0,1,0,0,0,0,""
-1594036135681,"test02","[\"walking\"]",1,0,1,0,0,0,0,""
-1594034330494,"test02","[\"walking\"]",2,0,1,0,0,0,0,""
-1594041009481,"test02","[\"running\"]",1,0,0,1,0,0,0,""
-1594039008555,"test02","[\"running\"]",0,0,0,1,0,0,0,""
-1594040542637,"test02","[\"running\"]",0,0,0,1,0,0,0,""
-1594045170488,"test02","[\"stationary\",\"automotive\"]",1,1,0,0,1,0,0,""
-1594044861283,"test02","[\"stationary\",\"automotive\"]",1,1,0,0,1,0,0,""
-1594046775997,"test02","[\"automotive\"]",1,0,0,0,1,0,0,""
-1594045155284,"test02","[\"stationary\",\"automotive\"]",1,1,0,0,1,0,0,""
-1594048942657,"test02","[\"running\"]",1,0,0,1,0,0,0,""
-1594049953189,"test02","[\"running\"]",2,0,0,1,0,0,0,""
-1594051260258,"test02","[\"walking\"]",1,0,1,0,0,0,0,""
-1594054828512,"test02","[\"walking\"]",1,0,1,0,0,0,0,""
-1594053652847,"test02","[\"running\"]",1,0,0,1,0,0,0,""
-1594052619496,"test02","[\"running\"]",1,0,0,1,0,0,0,""
-1594059951546,"test02","[\"stationary\"]",0,1,0,0,0,0,0,""
-1594063934168,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594058448212,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594073582003,"test02","[\"stationary\",\"automotive\"]",1,1,0,0,1,0,0,""
-1594073060268,"test02","[\"stationary\",\"automotive\"]",1,1,0,0,1,0,0,""
-1594072009878,"test02","[\"stationary\",\"automotive\"]",2,1,0,0,1,0,0,""
-1594071273066,"test02","[\"stationary\",\"automotive\"]",0,1,0,0,1,0,0,""
-1594071651364,"test02","[\"automotive\"]",1,0,0,0,1,0,0,""
-1594072224460,"test02","[\"stationary\",\"automotive\"]",0,1,0,0,1,0,0,""
-1594076125576,"test02","[\"walking\"]",2,0,1,0,0,0,0,""
-1594076058465,"test02","[\"walking\"]",2,0,1,0,0,0,0,""
-1594076997023,"test02","[\"walking\"]",1,0,1,0,0,0,0,""
-1594076477847,"test02","[\"walking\"]",0,0,1,0,0,0,0,""
-1594078728766,"test02","[\"cycling\"]",1,0,0,0,0,1,0,""
-1594078002827,"test02","[\"cycling\"]",0,0,0,0,0,1,0,""
-1594081329828,"test02","[\"cycling\"]",1,0,0,0,0,1,0,""
-1594077881253,"test02","[\"cycling\"]",0,0,0,0,0,1,0,""
-1594082278338,"test02","[\"walking\"]",2,0,1,0,0,0,0,""
-1594085089288,"test02","[\"running\"]",2,0,0,1,0,0,0,""
-1594083604829,"test02","[\"running\"]",2,0,0,1,0,0,0,""
-1594085099383,"test02","[\"running\"]",1,0,0,1,0,0,0,""
-1594089833084,"test02","",2,0,0,0,0,0,0,""
-1594092988804,"test02","[\"stationary\"]",2,1,0,0,0,0,0,""
-1594093445402,"test02","[\"stationary\"]",0,1,0,0,0,0,0,""

tests/data/external/multiple_timezones.csv

@@ -0,0 +1,31 @@
+device_id,tzcode,timestamp
+android,America/New_York,0
+android,America/Los_Angeles,1583600400000
+android,America/New_York,1583683200000
+android,America/Los_Angeles,1604160000000
+android,America/New_York,1604250000000
+android,America/New_York,1604379600000
+ios,America/New_York,0
+ios,America/Los_Angeles,1583600400000
+ios,America/New_York,1583683200000
+ios,America/Los_Angeles,1604160000000
+ios,America/New_York,1604250000000
+ios,America/New_York,1604379600000
+fitbit,America/New_York,0
+fitbit,America/Los_Angeles,1583600400000
+fitbit,America/New_York,1583683200000
+fitbit,America/Los_Angeles,1604160000000
+fitbit,America/New_York,1604250000000
+fitbit,America/New_York,1604379600000
+empatica,America/New_York,0
+empatica,America/Los_Angeles,1583600400000
+empatica,America/New_York,1583683200000
+empatica,America/Los_Angeles,1604160000000
+empatica,America/New_York,1604250000000
+empatica,America/New_York,1604379600000
+empty,America/New_York,0
+empty,America/Los_Angeles,1583600400000
+empty,America/New_York,1583683200000
+empty,America/Los_Angeles,1604160000000
+empty,America/New_York,1604250000000
+empty,America/New_York,1604379600000

tests/data/external/participant_files/android.yaml

@@ -0,0 +1,16 @@
+PHONE:
+  DEVICE_IDS: [android]
+  PLATFORMS: [android]
+  LABEL: android
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03
+FITBIT:
+  DEVICE_IDS:
+  LABEL:
+  START_DATE:
+  END_DATE:
+EMPATICA:
+  DEVICE_IDS:
+  LABEL:
+  START_DATE:
+  END_DATE:

tests/data/external/participant_files/empatica.yaml

@@ -0,0 +1,16 @@
+PHONE:
+  DEVICE_IDS:
+  PLATFORMS:
+  LABEL:
+  START_DATE:
+  END_DATE:
+FITBIT:
+  DEVICE_IDS:
+  LABEL:
+  START_DATE:
+  END_DATE:
+EMPATICA:
+  DEVICE_IDS: [empatica]
+  LABEL: empatica
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03

tests/data/external/participant_files/empty.yaml

@@ -0,0 +1,16 @@
+PHONE:
+  DEVICE_IDS: [empty]
+  PLATFORMS: [android, ios]
+  LABEL: empty
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03
+FITBIT:
+  DEVICE_IDS: [empty]
+  LABEL: empty
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03
+EMPATICA:
+  DEVICE_IDS: [empty]
+  LABEL: empty
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03

tests/data/external/participant_files/eve_and.yaml

@@ -1,6 +0,0 @@
-PHONE:
-  DEVICE_IDS: [eve_and, a748ee1a-1d0b-4ae9-9074-279a2b6ba524]
-  PLATFORMS: [android]
-  LABEL: event android
-  START_DATE: 2020/01/01
-  END_DATE: 2020/08/01 

tests/data/external/participant_files/eve_emp.yaml

@@ -1,6 +0,0 @@
-PHONE:
-  DEVICE_IDS: [eve_emp, a748ee1a-1d0b-4ae9-9074-279a2b6ba524]
-  PLATFORMS: [android, ios]
-  LABEL: event emp
-  START_DATE: 2020/01/01
-  END_DATE: 2020/08/01 

tests/data/external/participant_files/eve_ios.yaml

@@ -1,6 +0,0 @@
-PHONE:
-  DEVICE_IDS: [eve_ios, a748ee1a-1d0b-4ae9-9074-279a2b6ba524]
-  PLATFORMS: [ios]
-  LABEL: event ios
-  START_DATE: 2020/01/01
-  END_DATE: 2020/08/01 

tests/data/external/participant_files/fitbit.yaml

@@ -0,0 +1,16 @@
+PHONE:
+  DEVICE_IDS:
+  PLATFORMS:
+  LABEL:
+  START_DATE:
+  END_DATE:
+FITBIT:
+  DEVICE_IDS: [fitbit]
+  LABEL: fitbit
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03
+EMPATICA:
+  DEVICE_IDS:
+  LABEL:
+  START_DATE:
+  END_DATE:

tests/data/external/participant_files/fre_and.yaml

@@ -1,11 +0,0 @@
-PHONE:
-  DEVICE_IDS: [fre_and]
-  PLATFORMS: [android]
-  LABEL: frequency android
-  START_DATE: 2020/01/01
-  END_DATE: 2021/06/01 
-FITBIT:
-  DEVICE_IDS: [fre_and]
-  LABEL: frequency android
-  START_DATE: 2020/01/01
-  END_DATE: 2020/06/01 

tests/data/external/participant_files/fre_emp.yaml

@@ -1,11 +0,0 @@
-PHONE:
-  DEVICE_IDS: [fre_emp]
-  PLATFORMS: [android, ios]
-  LABEL: frequency empty
-  START_DATE: 2020/01/01
-  END_DATE: 2021/06/01
-FITBIT:
-  DEVICE_IDS: [fre_emp]
-  LABEL: frequency empty
-  START_DATE: 2020/01/01
-  END_DATE: 2020/06/01

tests/data/external/participant_files/fre_ios.yaml

@@ -1,11 +0,0 @@
-PHONE:
-  DEVICE_IDS: [fre_ios]
-  PLATFORMS: [ios]
-  LABEL: frequency ios
-  START_DATE: 2020/01/01
-  END_DATE: 2021/06/01 
-FITBIT:
-  DEVICE_IDS: [fre_ios]
-  LABEL: frequency ios
-  START_DATE: 2020/01/01
-  END_DATE: 2020/06/01 

tests/data/external/participant_files/ios.yaml

@@ -0,0 +1,16 @@
+PHONE:
+  DEVICE_IDS: [ios]
+  PLATFORMS: [ios]
+  LABEL: ios
+  START_DATE: 2020-03-06
+  END_DATE: 2020-11-03
+FITBIT:
+  DEVICE_IDS:
+  LABEL:
+  START_DATE:
+  END_DATE:
+EMPATICA:
+  DEVICE_IDS:
+  LABEL:
+  START_DATE:
+  END_DATE:

tests/data/external/participant_files/per_and.yaml

@@ -1,11 +0,0 @@
-PHONE:
-  DEVICE_IDS: [per_and]
-  PLATFORMS: [android]
-  LABEL: periodic android
-  START_DATE: 2020/01/01
-  END_DATE: 2020/08/01 
-FITBIT:
-  DEVICE_IDS: [per_and]
-  LABEL: periodic android
-  START_DATE: 2020/01/01
-  END_DATE: 2020/06/01 

tests/data/external/participant_files/per_emp.yaml

@@ -1,11 +0,0 @@
-PHONE:
-  DEVICE_IDS: [per_emp]
-  PLATFORMS: [android, ios]
-  LABEL: periodic empty
-  START_DATE: 2020/01/01
-  END_DATE: 2021/06/01 
-FITBIT:
-  DEVICE_IDS: [per_emp]
-  LABEL: periodic empty
-  START_DATE: 2020/01/01
-  END_DATE: 2020/06/01 

tests/data/external/participant_files/per_ios.yaml

@@ -1,11 +0,0 @@
-PHONE:
-  DEVICE_IDS: [per_ios]
-  PLATFORMS: [ios]
-  LABEL: periodic ios
-  START_DATE: 2020/01/01
-  END_DATE: 2021/08/01 
-FITBIT:
-  DEVICE_IDS: [per_ios]
-  LABEL: periodic ios
-  START_DATE: 2020/01/01
-  END_DATE: 2020/06/01 

tests/data/external/timesegments_event.csv

@@ -0,0 +1,11 @@
+label,event_timestamp,length,shift,shift_direction,device_id
+beforeMarchEvent,1583625600000,12H,3H,-1,android
+beforeNovemberEvent,1604185200000,12H,3H,-1,android
+beforeMarchEvent,1583625600000,12H,3H,-1,ios
+beforeNovemberEvent,1604185200000,12H,3H,-1,ios
+beforeMarchEvent,1583625600000,12H,3H,-1,fitbit
+beforeNovemberEvent,1604185200000,12H,3H,-1,fitbit
+beforeMarchEvent,1583625600000,12H,3H,-1,empatica
+beforeNovemberEvent,1604185200000,12H,3H,-1,empatica
+beforeMarchEvent,1583625600000,12H,3H,-1,empty
+beforeNovemberEvent,1604185200000,12H,3H,-1,empty

tests/data/external/timesegments_frequency.csv

@@ -0,0 +1,2 @@
+label,length
+thirtyminutes,30

tests/data/external/timesegments_periodic.csv

@@ -0,0 +1,5 @@
+label,start_time,length,repeats_on,repeats_value
+morning,06:00:00,5H 59M 59S,every_day,0
+daily,00:00:00,23H 59M 59S,every_day,0
+threeday,00:00:00,71H 59M 59S,every_day,0
+weekend,00:00:00,71H 59M 59S,wday,5

tests/data/processed/features/event/eve_and/phone_battery.csv

@@ -1,4 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_countcharge","phone_battery_rapids_sumdurationcharge","phone_battery_rapids_maxconsumptionrate","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_countdischarge"
-"survey1#2020-04-23 03:00:20,2020-04-23 13:00:20","survey1","2020-04-23 03:00:20","2020-04-23 13:00:20",87.9985333333333,0,0,0.0384621794978634,0.0331202101231602,2
-"survey2#2020-04-23 08:00:20,2020-04-23 18:00:20","survey2","2020-04-23 08:00:20","2020-04-23 18:00:20",41.6659833333333,0,0,0.0480007872129103,0.0480007872129103,1
-"survey3#2020-04-23 13:00:20,2020-04-23 23:00:20","survey3","2020-04-23 13:00:20","2020-04-23 23:00:20",10.3498,0,0,0.0966202245454018,0.0966202245454018,1

tests/data/processed/features/event/eve_emp/phone_battery.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_countdischarge","phone_battery_rapids_sumdurationcharge","phone_battery_rapids_maxconsumptionrate","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_countcharge"

tests/data/processed/features/event/eve_ios/phone_battery.csv

@@ -1,4 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_sumdurationcharge","phone_battery_rapids_countcharge","phone_battery_rapids_countdischarge","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_maxconsumptionrate"
-"survey1#2020-04-23 03:00:20,2020-04-23 13:00:20","survey1","2020-04-23 03:00:20","2020-04-23 13:00:20",0,0,2,87.9985333333333,0.0331202101231602,0.0384621794978634
-"survey2#2020-04-23 08:00:20,2020-04-23 18:00:20","survey2","2020-04-23 08:00:20","2020-04-23 18:00:20",0,0,1,41.6659833333333,0.0480007872129103,0.0480007872129103
-"survey3#2020-04-23 13:00:20,2020-04-23 23:00:20","survey3","2020-04-23 13:00:20","2020-04-23 23:00:20",0,0,1,10.3498,0.0966202245454018,0.0966202245454018

tests/data/processed/features/frequency/fre_and/phone_applications_foreground.csv

@@ -1,7 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","apps_rapids_timeoffirstuseall","apps_rapids_timeoflastuseall","apps_rapids_frequencyentropyall","apps_rapids_countall","apps_rapids_timeoffirstuseemail","apps_rapids_timeoflastuseemail","apps_rapids_frequencyentropyemail","apps_rapids_countemail","apps_rapids_timeoffirstusesocial","apps_rapids_timeoflastusesocial","apps_rapids_frequencyentropysocial","apps_rapids_countsocial","apps_rapids_timeoffirstuseentertainment","apps_rapids_timeoflastuseentertainment","apps_rapids_frequencyentropyentertainment","apps_rapids_countentertainment","apps_rapids_timeoffirstusetop1global","apps_rapids_timeoflastusetop1global","apps_rapids_frequencyentropytop1global","apps_rapids_counttop1global","apps_rapids_timeoffirstusecom.facebook.moments","apps_rapids_timeoflastusecom.facebook.moments","apps_rapids_frequencyentropycom.facebook.moments","apps_rapids_countcom.facebook.moments"
-"thirtyminutes0000#2020-10-12 00:00:00,2020-10-12 00:29:59","thirtyminutes0000","2020-10-12 00:00:00","2020-10-12 00:29:59",0,29,1.32966134885476,6,NA,NA,NA,0,13,13,NA,1,0,29,0.693147180559945,4,13,13,NA,1,0,0,NA,1
-"thirtyminutes0001#2020-10-12 00:30:00,2020-10-12 00:59:59","thirtyminutes0001","2020-10-12 00:30:00","2020-10-12 00:59:59",30,59,1.27703425946614,7,30,59,NA,3,NA,NA,NA,0,30,59,0.693147180559945,2,NA,NA,NA,0,30,46,0,2
-"thirtyminutes0001#2020-10-13 00:30:00,2020-10-13 00:59:59","thirtyminutes0001","2020-10-13 00:30:00","2020-10-13 00:59:59",31,31,0,1,NA,NA,NA,0,NA,NA,NA,0,NA,NA,NA,0,NA,NA,NA,0,31,31,0,1
-"thirtyminutes0002#2020-10-12 01:00:00,2020-10-12 01:29:59","thirtyminutes0002","2020-10-12 01:00:00","2020-10-12 01:29:59",60,88,0.693147180559945,4,60,60,NA,2,NA,NA,NA,0,88,88,NA,2,NA,NA,NA,0,NA,NA,NA,0
-"thirtyminutes0046#2020-10-12 23:00:00,2020-10-12 23:29:59","thirtyminutes0046","2020-10-12 23:00:00","2020-10-12 23:29:59",1380,1409,NA,6,NA,NA,NA,0,1380,1409,NA,6,NA,NA,NA,0,1380,1409,NA,6,NA,NA,NA,0
-"thirtyminutes0047#2020-10-12 23:30:00,2020-10-12 23:59:59","thirtyminutes0047","2020-10-12 23:30:00","2020-10-12 23:59:59",1410,1439,0.693147180559945,4,NA,NA,NA,0,NA,NA,NA,0,1410,1439,NA,2,NA,NA,NA,0,1410,1439,NA,2

tests/data/processed/features/frequency/fre_and/phone_battery.csv

@@ -1,18 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_countdischarge","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_maxconsumptionrate","phone_battery_rapids_countcharge","phone_battery_rapids_sumdurationcharge"
-"thirtyminutes0000#2020-07-01 00:00:00,2020-07-01 00:29:59","thirtyminutes0000","2020-07-01 00:00:00","2020-07-01 00:29:59",1,21.8259833333333,0.137450851775292,0.137450851775292,0,0
-"thirtyminutes0006#2020-07-01 03:00:00,2020-07-01 03:29:59","thirtyminutes0006","2020-07-01 03:00:00","2020-07-01 03:29:59",0,0,0,0,1,9.49288333333333
-"thirtyminutes0007#2020-07-01 03:30:00,2020-07-01 03:59:59","thirtyminutes0007","2020-07-01 03:30:00","2020-07-01 03:59:59",0,0,0,0,1,29.9994666666667
-"thirtyminutes0011#2020-07-01 05:30:00,2020-07-01 05:59:59","thirtyminutes0011","2020-07-01 05:30:00","2020-07-01 05:59:59",1,2.49788333333333,0.400338953647421,0.400338953647421,0,0
-"thirtyminutes0012#2020-07-01 06:00:00,2020-07-01 06:29:59","thirtyminutes0012","2020-07-01 06:00:00","2020-07-01 06:29:59",1,29.9994666666667,0.0666678518729222,0.0666678518729222,0,0
-"thirtyminutes0016#2020-07-01 08:00:00,2020-07-01 08:29:59","thirtyminutes0016","2020-07-01 08:00:00","2020-07-01 08:29:59",0,0,0,0,1,25.4592833333333
-"thirtyminutes0020#2020-07-01 10:00:00,2020-07-01 10:29:59","thirtyminutes0020","2020-07-01 10:00:00","2020-07-01 10:29:59",1,6.70958333333333,0.298081102900081,0.298081102900081,0,0
-"thirtyminutes0021#2020-07-01 10:30:00,2020-07-01 10:59:59","thirtyminutes0021","2020-07-01 10:30:00","2020-07-01 10:59:59",1,29.9994833333333,0.0333339074172944,0.0333339074172944,0,0
-"thirtyminutes0023#2020-07-01 11:30:00,2020-07-01 11:59:59","thirtyminutes0023","2020-07-01 11:30:00","2020-07-01 11:59:59",0,0,0,0,1,4.02631666666667
-"thirtyminutes0024#2020-07-01 12:00:00,2020-07-01 12:29:59","thirtyminutes0024","2020-07-01 12:00:00","2020-07-01 12:29:59",0,0,0,0,1,29.9994666666667
-"thirtyminutes0027#2020-07-01 13:30:00,2020-07-01 13:59:59","thirtyminutes0027","2020-07-01 13:30:00","2020-07-01 13:59:59",1,7.87625,0.253927947944771,0.253927947944771,0,0
-"thirtyminutes0028#2020-07-01 14:00:00,2020-07-01 14:29:59","thirtyminutes0028","2020-07-01 14:00:00","2020-07-01 14:29:59",1,29.9994666666667,0.0333339259364611,0.0333339259364611,0,0
-"thirtyminutes0032#2020-07-01 16:00:00,2020-07-01 16:29:59","thirtyminutes0032","2020-07-01 16:00:00","2020-07-01 16:29:59",0,0,0,0,1,16.54275
-"thirtyminutes0035#2020-07-01 17:30:00,2020-07-01 17:59:59","thirtyminutes0035","2020-07-01 17:30:00","2020-07-01 17:59:59",1,3.94786666666667,0.253301361072647,0.253301361072647,0,0
-"thirtyminutes0036#2020-07-01 18:00:00,2020-07-01 18:29:59","thirtyminutes0036","2020-07-01 18:00:00","2020-07-01 18:29:59",1,29.9994666666667,0.0666678518729222,0.0666678518729222,0,0
-"thirtyminutes0040#2020-07-01 20:00:00,2020-07-01 20:29:59","thirtyminutes0040","2020-07-01 20:00:00","2020-07-01 20:29:59",0,0,0,0,1,26.9425666666667
-"thirtyminutes0043#2020-07-01 21:30:00,2020-07-01 21:59:59","thirtyminutes0043","2020-07-01 21:30:00","2020-07-01 21:59:59",1,9.95743333333333,0.301282459000479,0.301282459000479,1,19.9684

tests/data/processed/features/frequency/fre_and/phone_bluetooth.csv

@@ -1,14 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_bluetooth_rapids_countscans","phone_bluetooth_rapids_uniquedevices","phone_bluetooth_rapids_countscansmostuniquedevice"
-"thirtyminutes0000#2020-07-02 00:00:00,2020-07-02 00:29:59","thirtyminutes0000","2020-07-02 00:00:00","2020-07-02 00:29:59",1,1,1
-"thirtyminutes0001#2020-07-02 00:30:00,2020-07-02 00:59:59","thirtyminutes0001","2020-07-02 00:30:00","2020-07-02 00:59:59",1,1,1
-"thirtyminutes0007#2020-07-02 03:30:00,2020-07-02 03:59:59","thirtyminutes0007","2020-07-02 03:30:00","2020-07-02 03:59:59",1,1,1
-"thirtyminutes0011#2020-07-02 05:30:00,2020-07-02 05:59:59","thirtyminutes0011","2020-07-02 05:30:00","2020-07-02 05:59:59",1,1,1
-"thirtyminutes0012#2020-07-02 06:00:00,2020-07-02 06:29:59","thirtyminutes0012","2020-07-02 06:00:00","2020-07-02 06:29:59",1,1,1
-"thirtyminutes0014#2020-07-02 07:00:00,2020-07-02 07:29:59","thirtyminutes0014","2020-07-02 07:00:00","2020-07-02 07:29:59",1,1,1
-"thirtyminutes0023#2020-07-02 11:30:00,2020-07-02 11:59:59","thirtyminutes0023","2020-07-02 11:30:00","2020-07-02 11:59:59",1,1,1
-"thirtyminutes0024#2020-07-02 12:00:00,2020-07-02 12:29:59","thirtyminutes0024","2020-07-02 12:00:00","2020-07-02 12:29:59",1,1,1
-"thirtyminutes0035#2020-07-02 17:30:00,2020-07-02 17:59:59","thirtyminutes0035","2020-07-02 17:30:00","2020-07-02 17:59:59",1,1,1
-"thirtyminutes0036#2020-07-02 18:00:00,2020-07-02 18:29:59","thirtyminutes0036","2020-07-02 18:00:00","2020-07-02 18:29:59",1,1,1
-"thirtyminutes0039#2020-07-02 19:30:00,2020-07-02 19:59:59","thirtyminutes0039","2020-07-02 19:30:00","2020-07-02 19:59:59",1,1,1
-"thirtyminutes0042#2020-07-02 21:00:00,2020-07-02 21:29:59","thirtyminutes0042","2020-07-02 21:00:00","2020-07-02 21:29:59",1,1,1
-"thirtyminutes0047#2020-07-02 23:30:00,2020-07-02 23:59:59","thirtyminutes0047","2020-07-02 23:30:00","2020-07-02 23:59:59",2,2,1

tests/data/processed/features/frequency/fre_and/phone_calls.csv

@@ -1,19 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_calls_rapids_missed_count","phone_calls_rapids_missed_distinctcontacts","phone_calls_rapids_missed_timefirstcall","phone_calls_rapids_missed_timelastcall","phone_calls_rapids_missed_countmostfrequentcontact","phone_calls_rapids_incoming_count","phone_calls_rapids_incoming_distinctcontacts","phone_calls_rapids_incoming_meanduration","phone_calls_rapids_incoming_sumduration","phone_calls_rapids_incoming_minduration","phone_calls_rapids_incoming_maxduration","phone_calls_rapids_incoming_stdduration","phone_calls_rapids_incoming_modeduration","phone_calls_rapids_incoming_entropyduration","phone_calls_rapids_incoming_timefirstcall","phone_calls_rapids_incoming_timelastcall","phone_calls_rapids_incoming_countmostfrequentcontact","phone_calls_rapids_outgoing_count","phone_calls_rapids_outgoing_distinctcontacts","phone_calls_rapids_outgoing_meanduration","phone_calls_rapids_outgoing_sumduration","phone_calls_rapids_outgoing_minduration","phone_calls_rapids_outgoing_maxduration","phone_calls_rapids_outgoing_stdduration","phone_calls_rapids_outgoing_modeduration","phone_calls_rapids_outgoing_entropyduration","phone_calls_rapids_outgoing_timefirstcall","phone_calls_rapids_outgoing_timelastcall","phone_calls_rapids_outgoing_countmostfrequentcontact"
-"thirtyminutes0012#2020-10-01 06:00:00,2020-10-01 06:29:59","thirtyminutes0012","2020-10-01 06:00:00","2020-10-01 06:29:59",2,1,381,388,2,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1421,1421,1421,1421,NA,1421,0,373,373,1
-"thirtyminutes0014#2020-10-01 07:00:00,2020-10-01 07:29:59","thirtyminutes0014","2020-10-01 07:00:00","2020-10-01 07:29:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1186,1186,1186,1186,NA,1186,0,423,423,1
-"thirtyminutes0015#2020-10-01 07:30:00,2020-10-01 07:59:59","thirtyminutes0015","2020-10-01 07:30:00","2020-10-01 07:59:59",1,1,472,472,1,1,1,1331,1331,1331,1331,NA,1331,0,462,462,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0017#2020-10-01 08:30:00,2020-10-01 08:59:59","thirtyminutes0017","2020-10-01 08:30:00","2020-10-01 08:59:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,759,759,759,759,NA,759,0,529,529,1
-"thirtyminutes0018#2020-10-01 09:00:00,2020-10-01 09:29:59","thirtyminutes0018","2020-10-01 09:00:00","2020-10-01 09:29:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,2,2,1240.5,2481,1060,1421,255.265548008344,1060,0.682725062547722,555,561,1
-"thirtyminutes0019#2020-10-01 09:30:00,2020-10-01 09:59:59","thirtyminutes0019","2020-10-01 09:30:00","2020-10-01 09:59:59",1,1,584,584,1,1,1,213,213,213,213,NA,213,0,598,598,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0020#2020-10-01 10:00:00,2020-10-01 10:29:59","thirtyminutes0020","2020-10-01 10:00:00","2020-10-01 10:29:59",0,0,NA,NA,0,2,2,945.5,1891,667,1224,393.858477120907,667,0.649380675519282,609,617,1,1,1,970,970,970,970,NA,970,0,602,602,1
-"thirtyminutes0022#2020-10-01 11:00:00,2020-10-01 11:29:59","thirtyminutes0022","2020-10-01 11:00:00","2020-10-01 11:29:59",0,0,NA,NA,0,1,1,1299,1299,1299,1299,NA,1299,0,665,665,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0025#2020-10-01 12:30:00,2020-10-01 12:59:59","thirtyminutes0025","2020-10-01 12:30:00","2020-10-01 12:59:59",1,1,760,760,1,1,1,1157,1157,1157,1157,NA,1157,0,767,767,1,1,1,759,759,759,759,NA,759,0,767,767,1
-"thirtyminutes0026#2020-10-01 13:00:00,2020-10-01 13:29:59","thirtyminutes0026","2020-10-01 13:00:00","2020-10-01 13:29:59",1,1,793,793,1,2,2,909.5,1819,662,1157,350.017856687341,662,0.655924265162771,794,807,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0027#2020-10-01 13:30:00,2020-10-01 13:59:59","thirtyminutes0027","2020-10-01 13:30:00","2020-10-01 13:59:59",0,0,NA,NA,0,2,2,746,1492,439,1053,434.16356364854,1053,0.606236134907757,814,831,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0028#2020-10-01 14:00:00,2020-10-01 14:29:59","thirtyminutes0028","2020-10-01 14:00:00","2020-10-01 14:29:59",0,0,NA,NA,0,1,1,1719,1719,1719,1719,NA,1719,0,850,850,1,1,1,1116,1116,1116,1116,NA,1116,0,862,862,1
-"thirtyminutes0029#2020-10-01 14:30:00,2020-10-01 14:59:59","thirtyminutes0029","2020-10-01 14:30:00","2020-10-01 14:59:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1289,1289,1289,1289,NA,1289,0,882,882,1
-"thirtyminutes0030#2020-10-01 15:00:00,2020-10-01 15:29:59","thirtyminutes0030","2020-10-01 15:00:00","2020-10-01 15:29:59",0,0,NA,NA,0,2,2,1509,3018,1299,1719,296.98484809835,1719,0.683597902114995,918,919,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0031#2020-10-01 15:30:00,2020-10-01 15:59:59","thirtyminutes0031","2020-10-01 15:30:00","2020-10-01 15:59:59",1,1,956,956,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0033#2020-10-01 16:30:00,2020-10-01 16:59:59","thirtyminutes0033","2020-10-01 16:30:00","2020-10-01 16:59:59",1,1,1015,1015,1,1,1,1224,1224,1224,1224,NA,1224,0,1000,1000,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0034#2020-10-01 17:00:00,2020-10-01 17:29:59","thirtyminutes0034","2020-10-01 17:00:00","2020-10-01 17:29:59",0,0,NA,NA,0,1,1,667,667,667,667,NA,667,0,1046,1046,1,2,2,1329.5,2659,1116,1543,301.934595566656,1116,0.680385180743283,1031,1047,1
-"thirtyminutes0035#2020-10-01 17:30:00,2020-10-01 17:59:59","thirtyminutes0035","2020-10-01 17:30:00","2020-10-01 17:59:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,2,2,1301.5,2603,1060,1543,341.532575313102,1543,0.676023738060706,1066,1076,1

tests/data/processed/features/frequency/fre_and/phone_conversation.csv

@@ -1,26 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_conversation_rapids_minutessilence","phone_conversation_rapids_minutesnoise","phone_conversation_rapids_minutesvoice","phone_conversation_rapids_minutesunknown","phone_conversation_rapids_countconversation","phone_conversation_rapids_silencesensedfraction","phone_conversation_rapids_noisesensedfraction","phone_conversation_rapids_voicesensedfraction","phone_conversation_rapids_unknownsensedfraction","phone_conversation_rapids_silenceexpectedfraction","phone_conversation_rapids_noiseexpectedfraction","phone_conversation_rapids_voiceexpectedfraction","phone_conversation_rapids_unknownexpectedfraction","phone_conversation_rapids_sumconversationduration","phone_conversation_rapids_avgconversationduration","phone_conversation_rapids_sdconversationduration","phone_conversation_rapids_minconversationduration","phone_conversation_rapids_maxconversationduration","phone_conversation_rapids_timefirstconversation","phone_conversation_rapids_timelastconversation","phone_conversation_rapids_noisesumenergy","phone_conversation_rapids_noiseavgenergy","phone_conversation_rapids_noisesdenergy","phone_conversation_rapids_noiseminenergy","phone_conversation_rapids_noisemaxenergy","phone_conversation_rapids_voicesumenergy","phone_conversation_rapids_voiceavgenergy","phone_conversation_rapids_voicesdenergy","phone_conversation_rapids_voiceminenergy","phone_conversation_rapids_voicemaxenergy"
-"thirtyminutes0002#2020-07-07 01:00:00,2020-07-07 01:29:59","thirtyminutes0002","2020-07-07 01:00:00","2020-07-07 01:29:59",0.05,0.683333333333333,0.183333333333333,0.0666666666666667,1,0.0508474576271186,0.694915254237288,0.186440677966102,0.0677966101694915,0.000138888888888889,0.00189814814814815,0.000509259259259259,0.000185185185185185,1666.66666666667,1666.66666666667,NA,1666.66666666667,1666.66666666667,73,73,254984,6219.12195121951,3611.99537094887,559,11769,29248,2658.90909090909,1686.32716010538,61,4981
-"thirtyminutes0002#2020-07-08 01:00:00,2020-07-08 01:29:59","thirtyminutes0002","2020-07-08 01:00:00","2020-07-08 01:29:59",0.133333333333333,2.06666666666667,0.6,0.183333333333333,1,0.0446927374301676,0.692737430167598,0.201117318435754,0.0614525139664804,0.00037037037037037,0.00574074074074074,0.00166666666666667,0.000509259259259259,2.28333333333333,2.28333333333333,NA,2.28333333333333,2.28333333333333,77,77,738382,5954.6935483871,3538.5841001422,267,11967,116954,3248.72222222222,1789.91462862835,69,5859
-"thirtyminutes0005#2020-07-08 02:30:00,2020-07-08 02:59:59","thirtyminutes0005","2020-07-08 02:30:00","2020-07-08 02:59:59",0.133333333333333,2.13333333333333,0.583333333333333,0.133333333333333,1,0.0446927374301676,0.715083798882682,0.195530726256983,0.0446927374301676,0.00037037037037037,0.00592592592592593,0.00162037037037037,0.00037037037037037,1.4,1.4,NA,1.4,1.4,160,160,817385,6385.8203125,3632.45674751624,99,11936,112712,3220.34285714286,1755.06022928085,275,5979
-"thirtyminutes0011#2020-07-07 05:30:00,2020-07-07 05:59:59","thirtyminutes0011","2020-07-07 05:30:00","2020-07-07 05:59:59",0.65,9.61666666666667,2.66666666666667,0.75,1,0.0475030450669915,0.702801461632156,0.194884287454324,0.0548112058465286,0.00180555555555556,0.026712962962963,0.00740740740740741,0.00208333333333333,10.05,10.05,NA,10.05,10.05,359,359,3570056,6187.27209705373,3541.42211319418,31,11976,470594,2941.2125,1751.29396685232,54,5982
-"thirtyminutes0011#2020-07-08 05:30:00,2020-07-08 05:59:59","thirtyminutes0011","2020-07-08 05:30:00","2020-07-08 05:59:59",0.816666666666667,11.5333333333333,2.53333333333333,0.983333333333333,1,0.0514705882352941,0.726890756302521,0.159663865546218,0.0619747899159664,0.00226851851851852,0.032037037037037,0.00703703703703704,0.00273148148148148,14.2666666666667,14.2666666666667,NA,14.2666666666667,14.2666666666667,359,359,3977612,5747.99421965318,3407.17956872983,49,11981,485171,3191.91447368421,1753.97448743435,15,5983
-"thirtyminutes0012#2020-07-07 06:00:00,2020-07-07 06:29:59","thirtyminutes0012","2020-07-07 06:00:00","2020-07-07 06:29:59",0.0166666666666667,0.55,0.133333333333333,0.0333333333333333,NA,0.0227272727272727,0.75,0.181818181818182,0.0454545454545455,4.62962962962963e-05,0.00152777777777778,0.00037037037037037,9.25925925925926e-05,0,NA,NA,NA,0,NA,NA,205237,6219.30303030303,3486.62605971776,470,11468,18261,2282.625,1954.05621629179,18,5494
-"thirtyminutes0012#2020-07-08 06:00:00,2020-07-08 06:29:59","thirtyminutes0012","2020-07-08 06:00:00","2020-07-08 06:29:59",0.35,3.56666666666667,0.966666666666667,0.316666666666667,NA,0.0673076923076923,0.685897435897436,0.185897435897436,0.0608974358974359,0.000972222222222222,0.00990740740740741,0.00268518518518519,0.00087962962962963,0,NA,NA,NA,0,NA,NA,1329661,6213.36915887851,3654.61971833146,32,11986,193236,3331.65517241379,1766.04139102042,241,5858
-"thirtyminutes0013#2020-07-07 06:30:00,2020-07-07 06:59:59","thirtyminutes0013","2020-07-07 06:30:00","2020-07-07 06:59:59",0.133333333333333,1.25,0.533333333333333,0.0666666666666667,1,0.0672268907563025,0.630252100840336,0.26890756302521,0.0336134453781513,0.00037037037037037,0.00347222222222222,0.00148148148148148,0.000185185185185185,1.33333333333333,1.33333333333333,NA,1.33333333333333,1.33333333333333,392,392,459919,6132.25333333333,3609.22901886686,222,11920,98678,3083.6875,1557.76443284144,648,5974
-"thirtyminutes0016#2020-07-08 08:00:00,2020-07-08 08:29:59","thirtyminutes0016","2020-07-08 08:00:00","2020-07-08 08:29:59",0.1,0.716666666666667,0.15,0.0166666666666667,1,0.101694915254237,0.728813559322034,0.152542372881356,0.0169491525423729,0.000277777777777778,0.00199074074074074,0.000416666666666667,4.62962962962963e-05,0.283333333333333,0.283333333333333,NA,0.283333333333333,0.283333333333333,481,481,286820,6670.23255813954,3577.58151108239,381,11839,33052,3672.44444444444,1379.26475985497,1910,5866
-"thirtyminutes0017#2020-07-07 08:30:00,2020-07-07 08:59:59","thirtyminutes0017","2020-07-07 08:30:00","2020-07-07 08:59:59",0.15,2.81666666666667,0.783333333333333,0.216666666666667,2,0.0378151260504202,0.710084033613445,0.197478991596639,0.0546218487394958,0.000416666666666667,0.00782407407407408,0.00217592592592593,0.000601851851851852,1.6,0.8,0.0707106781186548,0.75,0.85,516,535,938565,5553.63905325444,3370.70343882599,134,11938,139223,2962.1914893617,1794.68495041061,69,5959
-"thirtyminutes0021#2020-07-07 10:30:00,2020-07-07 10:59:59","thirtyminutes0021","2020-07-07 10:30:00","2020-07-07 10:59:59",0.116666666666667,1.35,0.333333333333333,0.183333333333333,1,0.0588235294117647,0.680672268907563,0.168067226890756,0.092436974789916,0.000324074074074074,0.00375,0.000925925925925926,0.000509259259259259,1.66666666666667,1.66666666666667,NA,1.66666666666667,1.66666666666667,656,656,474758,5861.20987654321,3158.11819251611,13,11825,63061,3153.05,1392.35402617672,381,5031
-"thirtyminutes0023#2020-07-07 11:30:00,2020-07-07 11:59:59","thirtyminutes0023","2020-07-07 11:30:00","2020-07-07 11:59:59",0.0833333333333333,2.3,0.65,0.15,NA,0.0261780104712042,0.722513089005236,0.204188481675393,0.0471204188481675,0.000231481481481481,0.00638888888888889,0.00180555555555556,0.000416666666666667,0,NA,NA,NA,0,NA,NA,939738,6809.69565217391,3246.64083920798,348,11985,120596,3092.20512820513,1859.21142281072,154,5822
-"thirtyminutes0023#2020-07-08 11:30:00,2020-07-08 11:59:59","thirtyminutes0023","2020-07-08 11:30:00","2020-07-08 11:59:59",0.366666666666667,4.68333333333333,1.36666666666667,0.233333333333333,2,0.0551378446115288,0.704260651629073,0.205513784461153,0.0350877192982456,0.00101851851851852,0.0130092592592593,0.0037962962962963,0.000648148148148148,5.15,2.575,0.0824957911384304,2.51666666666667,2.63333333333333,697,719,1711922,6092.24911032028,3386.07934815594,21,11935,258424,3151.51219512195,1750.14532901955,39,5972
-"thirtyminutes0024#2020-07-07 12:00:00,2020-07-07 12:29:59","thirtyminutes0024","2020-07-07 12:00:00","2020-07-07 12:29:59",0.7,9.85,2.88333333333333,0.45,1,0.0504201680672269,0.709483793517407,0.207683073229292,0.0324129651860744,0.00194444444444444,0.0273611111111111,0.00800925925925926,0.00125,1.78333333333333,1.78333333333333,NA,1.78333333333333,1.78333333333333,733,733,3527573,5968.820642978,3557.82238983441,29,11997,517505,2991.35838150289,1791.95776038444,18,5998
-"thirtyminutes0024#2020-07-08 12:00:00,2020-07-08 12:29:59","thirtyminutes0024","2020-07-08 12:00:00","2020-07-08 12:29:59",0.316666666666667,4.35,1.03333333333333,0.25,1,0.0532212885154062,0.73109243697479,0.173669467787115,0.0420168067226891,0.00087962962962963,0.0120833333333333,0.00287037037037037,0.000694444444444444,5.36666666666667,5.36666666666667,NA,5.36666666666667,5.36666666666667,725,725,1618598,6201.52490421456,3426.75049881198,32,11990,175378,2828.67741935484,1651.7847453756,26,5753
-"thirtyminutes0025#2020-07-07 12:30:00,2020-07-07 12:59:59","thirtyminutes0025","2020-07-07 12:30:00","2020-07-07 12:59:59",0.283333333333333,1.78333333333333,0.783333333333333,0.133333333333333,1,0.0949720670391061,0.597765363128492,0.262569832402235,0.0446927374301676,0.000787037037037037,0.0049537037037037,0.00217592592592593,0.00037037037037037,2.21666666666667,2.21666666666667,NA,2.21666666666667,2.21666666666667,768,768,651511,6088.88785046729,3361.1700745905,117,11613,147681,3142.14893617021,1650.99227052576,113,5839
-"thirtyminutes0033#2020-07-07 16:30:00,2020-07-07 16:59:59","thirtyminutes0033","2020-07-07 16:30:00","2020-07-07 16:59:59",0.383333333333333,4.45,1.2,0.366666666666667,1,0.0598958333333333,0.6953125,0.1875,0.0572916666666667,0.00106481481481481,0.0123611111111111,0.00333333333333333,0.00101851851851852,1.96666666666667,1.96666666666667,NA,1.96666666666667,1.96666666666667,1010,1010,1558080,5835.50561797753,3361.14808904221,51,11957,219689,3051.23611111111,1839.39286135288,5,5973
-"thirtyminutes0033#2020-07-08 16:30:00,2020-07-08 16:59:59","thirtyminutes0033","2020-07-08 16:30:00","2020-07-08 16:59:59",0.1,1.96666666666667,0.616666666666667,0.166666666666667,NA,0.0350877192982456,0.690058479532164,0.216374269005848,0.0584795321637427,0.000277777777777778,0.00546296296296296,0.00171296296296296,0.000462962962962963,0,NA,NA,NA,0,NA,NA,705058,5975.06779661017,3287.01941917461,130,11994,106715,2884.18918918919,1589.3816903619,155,5896
-"thirtyminutes0034#2020-07-07 17:00:00,2020-07-07 17:29:59","thirtyminutes0034","2020-07-07 17:00:00","2020-07-07 17:29:59",0.766666666666667,11.3333333333333,3.4,0.85,2,0.0468909276248726,0.693170234454638,0.207951070336391,0.0519877675840979,0.00212962962962963,0.0314814814814815,0.00944444444444444,0.00236111111111111,6.45,3.225,1.04887505876005,2.48333333333333,3.96666666666667,1032,1038,4205272,6184.22352941176,3480.06016995185,15,11869,621932,3048.6862745098,1727.26067460511,37,5928
-"thirtyminutes0034#2020-07-08 17:00:00,2020-07-08 17:29:59","thirtyminutes0034","2020-07-08 17:00:00","2020-07-08 17:29:59",0.2,1.83333333333333,0.583333333333333,0.183333333333333,1,0.0714285714285714,0.654761904761905,0.208333333333333,0.0654761904761905,0.000555555555555556,0.00509259259259259,0.00162037037037037,0.000509259259259259,5.23333333333333,5.23333333333333,NA,5.23333333333333,5.23333333333333,1022,1022,706913,6426.48181818182,3597.07282557782,155,11984,112200,3205.71428571429,1996.67760176203,26,5965
-"thirtyminutes0035#2020-07-08 17:30:00,2020-07-08 17:59:59","thirtyminutes0035","2020-07-08 17:30:00","2020-07-08 17:59:59",0.0333333333333333,0.733333333333333,0.2,0.0166666666666667,1,0.0338983050847458,0.745762711864407,0.203389830508475,0.0169491525423729,9.25925925925926e-05,0.00203703703703704,0.000555555555555556,4.62962962962963e-05,0.35,0.35,NA,0.35,0.35,1079,1079,269590,6127.04545454545,3796.70145670873,137,11971,39917,3326.41666666667,1785.64887408335,541,5590
-"thirtyminutes0039#2020-07-08 19:30:00,2020-07-08 19:59:59","thirtyminutes0039","2020-07-08 19:30:00","2020-07-08 19:59:59",0.1,2.1,0.716666666666667,0.0666666666666667,NA,0.0335195530726257,0.70391061452514,0.240223463687151,0.0223463687150838,0.000277777777777778,0.00583333333333333,0.00199074074074074,0.000185185185185185,0,NA,NA,NA,0,NA,NA,737899,5856.34126984127,3586.7682415516,65,11872,138265,3215.46511627907,1685.61227181609,344,5791
-"thirtyminutes0040#2020-07-07 20:00:00,2020-07-07 20:29:59","thirtyminutes0040","2020-07-07 20:00:00","2020-07-07 20:29:59",0.0833333333333333,1.3,0.5,0.1,1,0.0420168067226891,0.65546218487395,0.252100840336134,0.0504201680672269,0.000231481481481481,0.00361111111111111,0.00138888888888889,0.000277777777777778,1.35,1.35,NA,1.35,1.35,1204,1204,505175,6476.60256410256,3468.7579061419,255,11958,89106,2970.2,1714.36781149888,116,5801
-"thirtyminutes0046#2020-07-07 23:00:00,2020-07-07 23:29:59","thirtyminutes0046","2020-07-07 23:00:00","2020-07-07 23:29:59",0.133333333333333,1.36666666666667,0.366666666666667,0.116666666666667,1,0.0672268907563025,0.689075630252101,0.184873949579832,0.0588235294117647,0.00037037037037037,0.0037962962962963,0.00101851851851852,0.000324074074074074,1.38333333333333,1.38333333333333,NA,1.38333333333333,1.38333333333333,1407,1407,451528,5506.43902439024,3323.384672502,449,11997,69623,3164.68181818182,1700.61863775576,128,5807
-"thirtyminutes0047#2020-07-07 23:30:00,2020-07-07 23:59:59","thirtyminutes0047","2020-07-07 23:30:00","2020-07-07 23:59:59",0.15,1.98333333333333,0.65,0.2,1,0.0502793296089385,0.664804469273743,0.217877094972067,0.0670391061452514,0.000416666666666667,0.00550925925925926,0.00180555555555556,0.000555555555555556,2.15,2.15,NA,2.15,2.15,1436,1436,696959,5856.79831932773,3410.93125754917,117,11685,129548,3321.74358974359,1756.63003800412,116,5961

tests/data/processed/features/frequency/fre_and/phone_light.csv

@@ -1,7 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_light_rapids_count","phone_light_rapids_maxlux","phone_light_rapids_minlux","phone_light_rapids_avglux","phone_light_rapids_medianlux","phone_light_rapids_stdlux"
-"thirtyminutes0000#2020-09-27 00:00:00,2020-09-27 00:29:59","thirtyminutes0000","2020-09-27 00:00:00","2020-09-27 00:29:59",2,15258,1469,8363.5,8363.5,9750.2954057813
-"thirtyminutes0002#2020-09-27 01:00:00,2020-09-27 01:29:59","thirtyminutes0002","2020-09-27 01:00:00","2020-09-27 01:29:59",2,0,0,0,0,0
-"thirtyminutes0039#2020-09-27 19:30:00,2020-09-27 19:59:59","thirtyminutes0039","2020-09-27 19:30:00","2020-09-27 19:59:59",1,472.52,472.52,472.52,472.52,NA
-"thirtyminutes0040#2020-09-26 20:00:00,2020-09-26 20:29:59","thirtyminutes0040","2020-09-26 20:00:00","2020-09-26 20:29:59",4,114615,37252,84955.25,93977,33392.3886474648
-"thirtyminutes0041#2020-09-26 20:30:00,2020-09-26 20:59:59","thirtyminutes0041","2020-09-26 20:30:00","2020-09-26 20:59:59",2,90625,24414,57519.5,57519.5,46818.2470891425
-"thirtyminutes0047#2020-09-26 23:30:00,2020-09-26 23:59:59","thirtyminutes0047","2020-09-26 23:30:00","2020-09-26 23:59:59",1,10351,10351,10351,10351,NA

tests/data/processed/features/frequency/fre_and/phone_messages.csv

@@ -1,8 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_messages_rapids_received_countmostfrequentcontact","phone_messages_rapids_received_count","phone_messages_rapids_received_distinctcontacts","phone_messages_rapids_received_timefirstmessage","phone_messages_rapids_received_timelastmessage","phone_messages_rapids_sent_countmostfrequentcontact","phone_messages_rapids_sent_count","phone_messages_rapids_sent_distinctcontacts","phone_messages_rapids_sent_timefirstmessage","phone_messages_rapids_sent_timelastmessage"
-"thirtyminutes0000#2020-10-12 00:00:00,2020-10-12 00:29:59","thirtyminutes0000","2020-10-12 00:00:00","2020-10-12 00:29:59",1,3,3,0,13,1,1,1,29,29
-"thirtyminutes0000#2020-10-13 00:00:00,2020-10-13 00:29:59","thirtyminutes0000","2020-10-13 00:00:00","2020-10-13 00:29:59",1,1,1,0,0,0,0,0,NA,NA
-"thirtyminutes0001#2020-10-12 00:30:00,2020-10-12 00:59:59","thirtyminutes0001","2020-10-12 00:30:00","2020-10-12 00:59:59",1,2,2,46,59,2,3,2,30,59
-"thirtyminutes0001#2020-10-13 00:30:00,2020-10-13 00:59:59","thirtyminutes0001","2020-10-13 00:30:00","2020-10-13 00:59:59",0,0,0,NA,NA,0,1,1,30,30
-"thirtyminutes0002#2020-10-12 01:00:00,2020-10-12 01:29:59","thirtyminutes0002","2020-10-12 01:00:00","2020-10-12 01:29:59",1,1,1,60,60,1,2,2,60,88
-"thirtyminutes0046#2020-10-12 23:00:00,2020-10-12 23:29:59","thirtyminutes0046","2020-10-12 23:00:00","2020-10-12 23:29:59",4,4,1,1380,1409,1,1,1,1393,1393
-"thirtyminutes0047#2020-10-12 23:30:00,2020-10-12 23:59:59","thirtyminutes0047","2020-10-12 23:30:00","2020-10-12 23:59:59",2,2,1,1426,1439,1,1,1,1410,1410

tests/data/processed/features/frequency/fre_and/phone_wifi_connected.csv

@@ -1,8 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_connected_rapids_countscans","phone_wifi_connected_rapids_uniquedevices","phone_wifi_connected_rapids_countscansmostuniquedevice"
-"thirtyminutes0000#2020-10-12 00:00:00,2020-10-12 00:29:59","thirtyminutes0000","2020-10-12 00:00:00","2020-10-12 00:29:59",6,4,2
-"thirtyminutes0000#2020-10-13 00:00:00,2020-10-13 00:29:59","thirtyminutes0000","2020-10-13 00:00:00","2020-10-13 00:29:59",2,1,2
-"thirtyminutes0001#2020-10-12 00:30:00,2020-10-12 00:59:59","thirtyminutes0001","2020-10-12 00:30:00","2020-10-12 00:59:59",6,6,1
-"thirtyminutes0001#2020-10-13 00:30:00,2020-10-13 00:59:59","thirtyminutes0001","2020-10-13 00:30:00","2020-10-13 00:59:59",2,2,1
-"thirtyminutes0002#2020-10-12 01:00:00,2020-10-12 01:29:59","thirtyminutes0002","2020-10-12 01:00:00","2020-10-12 01:29:59",4,4,1
-"thirtyminutes0046#2020-10-12 23:00:00,2020-10-12 23:29:59","thirtyminutes0046","2020-10-12 23:00:00","2020-10-12 23:29:59",6,4,2
-"thirtyminutes0047#2020-10-12 23:30:00,2020-10-12 23:59:59","thirtyminutes0047","2020-10-12 23:30:00","2020-10-12 23:59:59",6,4,2

tests/data/processed/features/frequency/fre_and/phone_wifi_visible.csv

@@ -1,8 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_visible_rapids_countscans","phone_wifi_visible_rapids_uniquedevices","phone_wifi_visible_rapids_countscansmostuniquedevice"
-"thirtyminutes0000#2020-10-12 00:00:00,2020-10-12 00:29:59","thirtyminutes0000","2020-10-12 00:00:00","2020-10-12 00:29:59",6,4,2
-"thirtyminutes0000#2020-10-13 00:00:00,2020-10-13 00:29:59","thirtyminutes0000","2020-10-13 00:00:00","2020-10-13 00:29:59",2,1,2
-"thirtyminutes0001#2020-10-12 00:30:00,2020-10-12 00:59:59","thirtyminutes0001","2020-10-12 00:30:00","2020-10-12 00:59:59",6,6,1
-"thirtyminutes0001#2020-10-13 00:30:00,2020-10-13 00:59:59","thirtyminutes0001","2020-10-13 00:30:00","2020-10-13 00:59:59",2,2,1
-"thirtyminutes0002#2020-10-12 01:00:00,2020-10-12 01:29:59","thirtyminutes0002","2020-10-12 01:00:00","2020-10-12 01:29:59",4,4,1
-"thirtyminutes0046#2020-10-12 23:00:00,2020-10-12 23:29:59","thirtyminutes0046","2020-10-12 23:00:00","2020-10-12 23:29:59",6,4,2
-"thirtyminutes0047#2020-10-12 23:30:00,2020-10-12 23:59:59","thirtyminutes0047","2020-10-12 23:30:00","2020-10-12 23:59:59",6,4,2

tests/data/processed/features/frequency/fre_emp/phone_applications_foreground.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","apps_rapids_countemail","apps_rapids_countall","apps_rapids_countentertainment","apps_rapids_countsocial","apps_rapids_counttop1global","apps_rapids_countcom.facebook.moments","apps_rapids_timeoffirstuseemail","apps_rapids_timeoffirstuseall","apps_rapids_timeoffirstuseentertainment","apps_rapids_timeoffirstusesocial","apps_rapids_timeoffirstusetop1global","apps_rapids_timeoffirstusecom.facebook.moments","apps_rapids_timeoflastuseemail","apps_rapids_timeoflastuseall","apps_rapids_timeoflastuseentertainment","apps_rapids_timeoflastusesocial","apps_rapids_timeoflastusetop1global","apps_rapids_timeoflastusecom.facebook.moments","apps_rapids_frequencyentropyemail","apps_rapids_frequencyentropyall","apps_rapids_frequencyentropyentertainment","apps_rapids_frequencyentropysocial","apps_rapids_frequencyentropytop1global","apps_rapids_frequencyentropycom.facebook.moments"

tests/data/processed/features/frequency/fre_emp/phone_battery.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_countdischarge","phone_battery_rapids_countcharge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_sumdurationcharge","phone_battery_rapids_maxconsumptionrate"

tests/data/processed/features/frequency/fre_emp/phone_bluetooth.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_bluetooth_rapids_countscans","phone_bluetooth_rapids_uniquedevices","phone_bluetooth_rapids_countscansmostuniquedevice"

tests/data/processed/features/frequency/fre_emp/phone_calls.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_calls_rapids_missed_count","phone_calls_rapids_missed_distinctcontacts","phone_calls_rapids_missed_timefirstcall","phone_calls_rapids_missed_timelastcall","phone_calls_rapids_missed_countmostfrequentcontact","phone_calls_rapids_incoming_count","phone_calls_rapids_incoming_distinctcontacts","phone_calls_rapids_incoming_meanduration","phone_calls_rapids_incoming_sumduration","phone_calls_rapids_incoming_minduration","phone_calls_rapids_incoming_maxduration","phone_calls_rapids_incoming_stdduration","phone_calls_rapids_incoming_modeduration","phone_calls_rapids_incoming_entropyduration","phone_calls_rapids_incoming_timefirstcall","phone_calls_rapids_incoming_timelastcall","phone_calls_rapids_incoming_countmostfrequentcontact","phone_calls_rapids_outgoing_count","phone_calls_rapids_outgoing_distinctcontacts","phone_calls_rapids_outgoing_meanduration","phone_calls_rapids_outgoing_sumduration","phone_calls_rapids_outgoing_minduration","phone_calls_rapids_outgoing_maxduration","phone_calls_rapids_outgoing_stdduration","phone_calls_rapids_outgoing_modeduration","phone_calls_rapids_outgoing_entropyduration","phone_calls_rapids_outgoing_timefirstcall","phone_calls_rapids_outgoing_timelastcall","phone_calls_rapids_outgoing_countmostfrequentcontact"

tests/data/processed/features/frequency/fre_emp/phone_conversation.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_conversation_rapids_minutessilence","phone_conversation_rapids_minutesnoise","phone_conversation_rapids_minutesvoice","phone_conversation_rapids_minutesunknown","phone_conversation_rapids_countconversation","phone_conversation_rapids_silencesensedfraction","phone_conversation_rapids_noisesensedfraction","phone_conversation_rapids_voicesensedfraction","phone_conversation_rapids_unknownsensedfraction","phone_conversation_rapids_silenceexpectedfraction","phone_conversation_rapids_noiseexpectedfraction","phone_conversation_rapids_voiceexpectedfraction","phone_conversation_rapids_unknownexpectedfraction","phone_conversation_rapids_sumconversationduration","phone_conversation_rapids_avgconversationduration","phone_conversation_rapids_sdconversationduration","phone_conversation_rapids_minconversationduration","phone_conversation_rapids_maxconversationduration","phone_conversation_rapids_timefirstconversation","phone_conversation_rapids_timelastconversation","phone_conversation_rapids_noisesumenergy","phone_conversation_rapids_noiseavgenergy","phone_conversation_rapids_noisesdenergy","phone_conversation_rapids_noiseminenergy","phone_conversation_rapids_noisemaxenergy","phone_conversation_rapids_voicesumenergy","phone_conversation_rapids_voiceavgenergy","phone_conversation_rapids_voicesdenergy","phone_conversation_rapids_voiceminenergy","phone_conversation_rapids_voicemaxenergy"

tests/data/processed/features/frequency/fre_emp/phone_light.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_light_rapids_count","phone_light_rapids_maxlux","phone_light_rapids_minlux","phone_light_rapids_avglux","phone_light_rapids_medianlux","phone_light_rapids_stdlux"

tests/data/processed/features/frequency/fre_emp/phone_messages.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_messages_rapids_received_countmostfrequentcontact","phone_messages_rapids_received_count","phone_messages_rapids_received_distinctcontacts","phone_messages_rapids_received_timefirstmessage","phone_messages_rapids_received_timelastmessage","phone_messages_rapids_sent_countmostfrequentcontact","phone_messages_rapids_sent_count","phone_messages_rapids_sent_distinctcontacts","phone_messages_rapids_sent_timefirstmessage","phone_messages_rapids_sent_timelastmessage"

tests/data/processed/features/frequency/fre_emp/phone_wifi_connected.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_connected_rapids_countscans","phone_wifi_connected_rapids_uniquedevices","phone_wifi_connected_rapids_countscansmostuniquedevice"

tests/data/processed/features/frequency/fre_emp/phone_wifi_visible.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_visible_rapids_countscans","phone_wifi_visible_rapids_uniquedevices","phone_wifi_visible_rapids_countscansmostuniquedevice"

tests/data/processed/features/frequency/fre_ios/phone_applications_foreground.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","apps_rapids_countemail","apps_rapids_countall","apps_rapids_countentertainment","apps_rapids_countsocial","apps_rapids_counttop1global","apps_rapids_countcom.facebook.moments","apps_rapids_timeoffirstuseemail","apps_rapids_timeoffirstuseall","apps_rapids_timeoffirstuseentertainment","apps_rapids_timeoffirstusesocial","apps_rapids_timeoffirstusetop1global","apps_rapids_timeoffirstusecom.facebook.moments","apps_rapids_timeoflastuseemail","apps_rapids_timeoflastuseall","apps_rapids_timeoflastuseentertainment","apps_rapids_timeoflastusesocial","apps_rapids_timeoflastusetop1global","apps_rapids_timeoflastusecom.facebook.moments","apps_rapids_frequencyentropyemail","apps_rapids_frequencyentropyall","apps_rapids_frequencyentropyentertainment","apps_rapids_frequencyentropysocial","apps_rapids_frequencyentropytop1global","apps_rapids_frequencyentropycom.facebook.moments"

tests/data/processed/features/frequency/fre_ios/phone_battery.csv

@@ -1,18 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_countdischarge","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_maxconsumptionrate","phone_battery_rapids_countcharge","phone_battery_rapids_sumdurationcharge"
-"thirtyminutes0000#2020-07-01 00:00:00,2020-07-01 00:29:59","thirtyminutes0000","2020-07-01 00:00:00","2020-07-01 00:29:59",1,21.8259833333333,0.137450851775292,0.137450851775292,0,0
-"thirtyminutes0006#2020-07-01 03:00:00,2020-07-01 03:29:59","thirtyminutes0006","2020-07-01 03:00:00","2020-07-01 03:29:59",0,0,0,0,1,9.49288333333333
-"thirtyminutes0007#2020-07-01 03:30:00,2020-07-01 03:59:59","thirtyminutes0007","2020-07-01 03:30:00","2020-07-01 03:59:59",0,0,0,0,1,29.9994666666667
-"thirtyminutes0011#2020-07-01 05:30:00,2020-07-01 05:59:59","thirtyminutes0011","2020-07-01 05:30:00","2020-07-01 05:59:59",1,2.49788333333333,0.400338953647421,0.400338953647421,0,0
-"thirtyminutes0012#2020-07-01 06:00:00,2020-07-01 06:29:59","thirtyminutes0012","2020-07-01 06:00:00","2020-07-01 06:29:59",1,29.9994666666667,0.0666678518729222,0.0666678518729222,0,0
-"thirtyminutes0016#2020-07-01 08:00:00,2020-07-01 08:29:59","thirtyminutes0016","2020-07-01 08:00:00","2020-07-01 08:29:59",0,0,0,0,1,25.4592833333333
-"thirtyminutes0020#2020-07-01 10:00:00,2020-07-01 10:29:59","thirtyminutes0020","2020-07-01 10:00:00","2020-07-01 10:29:59",1,6.70958333333333,0.298081102900081,0.298081102900081,0,0
-"thirtyminutes0021#2020-07-01 10:30:00,2020-07-01 10:59:59","thirtyminutes0021","2020-07-01 10:30:00","2020-07-01 10:59:59",1,29.9994833333333,0.0333339074172944,0.0333339074172944,0,0
-"thirtyminutes0023#2020-07-01 11:30:00,2020-07-01 11:59:59","thirtyminutes0023","2020-07-01 11:30:00","2020-07-01 11:59:59",0,0,0,0,1,4.02631666666667
-"thirtyminutes0024#2020-07-01 12:00:00,2020-07-01 12:29:59","thirtyminutes0024","2020-07-01 12:00:00","2020-07-01 12:29:59",0,0,0,0,1,29.9994666666667
-"thirtyminutes0027#2020-07-01 13:30:00,2020-07-01 13:59:59","thirtyminutes0027","2020-07-01 13:30:00","2020-07-01 13:59:59",1,7.87625,0.253927947944771,0.253927947944771,0,0
-"thirtyminutes0028#2020-07-01 14:00:00,2020-07-01 14:29:59","thirtyminutes0028","2020-07-01 14:00:00","2020-07-01 14:29:59",1,29.9994666666667,0.0333339259364611,0.0333339259364611,0,0
-"thirtyminutes0032#2020-07-01 16:00:00,2020-07-01 16:29:59","thirtyminutes0032","2020-07-01 16:00:00","2020-07-01 16:29:59",0,0,0,0,1,16.54275
-"thirtyminutes0035#2020-07-01 17:30:00,2020-07-01 17:59:59","thirtyminutes0035","2020-07-01 17:30:00","2020-07-01 17:59:59",1,3.94786666666667,0.253301361072647,0.253301361072647,0,0
-"thirtyminutes0036#2020-07-01 18:00:00,2020-07-01 18:29:59","thirtyminutes0036","2020-07-01 18:00:00","2020-07-01 18:29:59",1,29.9994666666667,0.0666678518729222,0.0666678518729222,0,0
-"thirtyminutes0040#2020-07-01 20:00:00,2020-07-01 20:29:59","thirtyminutes0040","2020-07-01 20:00:00","2020-07-01 20:29:59",1,14.6351666666667,0.0683285693136395,0.0683285693136395,1,12.3074
-"thirtyminutes0043#2020-07-01 21:30:00,2020-07-01 21:59:59","thirtyminutes0043","2020-07-01 21:30:00","2020-07-01 21:59:59",1,29.92585,0.100247779093994,0.100247779093994,0,0

tests/data/processed/features/frequency/fre_ios/phone_bluetooth.csv

@@ -1,14 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_bluetooth_rapids_countscans","phone_bluetooth_rapids_uniquedevices","phone_bluetooth_rapids_countscansmostuniquedevice"
-"thirtyminutes0000#2020-07-02 00:00:00,2020-07-02 00:29:59","thirtyminutes0000","2020-07-02 00:00:00","2020-07-02 00:29:59",1,1,1
-"thirtyminutes0001#2020-07-02 00:30:00,2020-07-02 00:59:59","thirtyminutes0001","2020-07-02 00:30:00","2020-07-02 00:59:59",1,1,1
-"thirtyminutes0007#2020-07-02 03:30:00,2020-07-02 03:59:59","thirtyminutes0007","2020-07-02 03:30:00","2020-07-02 03:59:59",1,1,1
-"thirtyminutes0011#2020-07-02 05:30:00,2020-07-02 05:59:59","thirtyminutes0011","2020-07-02 05:30:00","2020-07-02 05:59:59",1,1,1
-"thirtyminutes0012#2020-07-02 06:00:00,2020-07-02 06:29:59","thirtyminutes0012","2020-07-02 06:00:00","2020-07-02 06:29:59",1,1,1
-"thirtyminutes0014#2020-07-02 07:00:00,2020-07-02 07:29:59","thirtyminutes0014","2020-07-02 07:00:00","2020-07-02 07:29:59",1,1,1
-"thirtyminutes0023#2020-07-02 11:30:00,2020-07-02 11:59:59","thirtyminutes0023","2020-07-02 11:30:00","2020-07-02 11:59:59",1,1,1
-"thirtyminutes0024#2020-07-02 12:00:00,2020-07-02 12:29:59","thirtyminutes0024","2020-07-02 12:00:00","2020-07-02 12:29:59",1,1,1
-"thirtyminutes0035#2020-07-02 17:30:00,2020-07-02 17:59:59","thirtyminutes0035","2020-07-02 17:30:00","2020-07-02 17:59:59",1,1,1
-"thirtyminutes0036#2020-07-02 18:00:00,2020-07-02 18:29:59","thirtyminutes0036","2020-07-02 18:00:00","2020-07-02 18:29:59",1,1,1
-"thirtyminutes0039#2020-07-02 19:30:00,2020-07-02 19:59:59","thirtyminutes0039","2020-07-02 19:30:00","2020-07-02 19:59:59",1,1,1
-"thirtyminutes0042#2020-07-02 21:00:00,2020-07-02 21:29:59","thirtyminutes0042","2020-07-02 21:00:00","2020-07-02 21:29:59",1,1,1
-"thirtyminutes0047#2020-07-02 23:30:00,2020-07-02 23:59:59","thirtyminutes0047","2020-07-02 23:30:00","2020-07-02 23:59:59",2,1,2

tests/data/processed/features/frequency/fre_ios/phone_calls.csv

@@ -1,19 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_calls_rapids_missed_count","phone_calls_rapids_missed_distinctcontacts","phone_calls_rapids_missed_timefirstcall","phone_calls_rapids_missed_timelastcall","phone_calls_rapids_missed_countmostfrequentcontact","phone_calls_rapids_incoming_count","phone_calls_rapids_incoming_distinctcontacts","phone_calls_rapids_incoming_meanduration","phone_calls_rapids_incoming_sumduration","phone_calls_rapids_incoming_minduration","phone_calls_rapids_incoming_maxduration","phone_calls_rapids_incoming_stdduration","phone_calls_rapids_incoming_modeduration","phone_calls_rapids_incoming_entropyduration","phone_calls_rapids_incoming_timefirstcall","phone_calls_rapids_incoming_timelastcall","phone_calls_rapids_incoming_countmostfrequentcontact","phone_calls_rapids_outgoing_count","phone_calls_rapids_outgoing_distinctcontacts","phone_calls_rapids_outgoing_meanduration","phone_calls_rapids_outgoing_sumduration","phone_calls_rapids_outgoing_minduration","phone_calls_rapids_outgoing_maxduration","phone_calls_rapids_outgoing_stdduration","phone_calls_rapids_outgoing_modeduration","phone_calls_rapids_outgoing_entropyduration","phone_calls_rapids_outgoing_timefirstcall","phone_calls_rapids_outgoing_timelastcall","phone_calls_rapids_outgoing_countmostfrequentcontact"
-"thirtyminutes0012#2020-10-01 06:00:00,2020-10-01 06:29:59","thirtyminutes0012","2020-10-01 06:00:00","2020-10-01 06:29:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,3,3,976.666666666667,2930,0,1530,848.312049503798,1400,0.692333219466401,373,388,1
-"thirtyminutes0014#2020-10-01 07:00:00,2020-10-01 07:29:59","thirtyminutes0014","2020-10-01 07:00:00","2020-10-01 07:29:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1170,1170,1170,1170,NA,1170,0,423,423,1
-"thirtyminutes0015#2020-10-01 07:30:00,2020-10-01 07:59:59","thirtyminutes0015","2020-10-01 07:30:00","2020-10-01 07:59:59",1,1,462,462,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1410,1410,1410,1410,NA,1410,0,472,472,1
-"thirtyminutes0017#2020-10-01 08:30:00,2020-10-01 08:59:59","thirtyminutes0017","2020-10-01 08:30:00","2020-10-01 08:59:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,742,742,742,742,NA,742,0,529,529,1
-"thirtyminutes0018#2020-10-01 09:00:00,2020-10-01 09:29:59","thirtyminutes0018","2020-10-01 09:00:00","2020-10-01 09:29:59",0,0,NA,NA,0,1,1,1140,1140,1140,1140,NA,1140,0,561,561,1,1,1,1040,1040,1040,1040,NA,1040,0,555,555,1
-"thirtyminutes0019#2020-10-01 09:30:00,2020-10-01 09:59:59","thirtyminutes0019","2020-10-01 09:30:00","2020-10-01 09:59:59",0,0,NA,NA,0,1,1,198,198,198,198,NA,198,0,598,598,1,1,1,0,0,0,0,NA,0,NA,584,584,1
-"thirtyminutes0020#2020-10-01 10:00:00,2020-10-01 10:29:59","thirtyminutes0020","2020-10-01 10:00:00","2020-10-01 10:29:59",0,0,NA,NA,0,2,2,1515,3030,1320,1710,275.771644662754,1320,0.685005670382782,602,617,1,1,1,1050,1050,1050,1050,NA,1050,0,609,609,1
-"thirtyminutes0022#2020-10-01 11:00:00,2020-10-01 11:29:59","thirtyminutes0022","2020-10-01 11:00:00","2020-10-01 11:29:59",0,0,NA,NA,0,1,1,1279,1279,1279,1279,NA,1279,0,665,665,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0025#2020-10-01 12:30:00,2020-10-01 12:59:59","thirtyminutes0025","2020-10-01 12:30:00","2020-10-01 12:59:59",0,0,NA,NA,0,1,1,1140,1140,1140,1140,NA,1140,0,767,767,1,2,2,1030,2060,960,1100,98.9949493661167,960,0.691078758022212,760,767,1
-"thirtyminutes0026#2020-10-01 13:00:00,2020-10-01 13:29:59","thirtyminutes0026","2020-10-01 13:00:00","2020-10-01 13:29:59",1,1,793,793,1,1,1,650,650,650,650,NA,650,0,794,794,1,1,1,750,750,750,750,NA,750,0,807,807,1
-"thirtyminutes0027#2020-10-01 13:30:00,2020-10-01 13:59:59","thirtyminutes0027","2020-10-01 13:30:00","2020-10-01 13:59:59",0,0,NA,NA,0,1,1,1040,1040,1040,1040,NA,1040,0,814,814,1,1,1,0,0,0,0,NA,0,NA,831,831,1
-"thirtyminutes0028#2020-10-01 14:00:00,2020-10-01 14:29:59","thirtyminutes0028","2020-10-01 14:00:00","2020-10-01 14:29:59",0,0,NA,NA,0,2,2,1495,2990,1290,1700,289.913780286484,1700,0.68388325746694,850,862,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0029#2020-10-01 14:30:00,2020-10-01 14:59:59","thirtyminutes0029","2020-10-01 14:30:00","2020-10-01 14:59:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1279,1279,1279,1279,NA,1279,0,882,882,1
-"thirtyminutes0030#2020-10-01 15:00:00,2020-10-01 15:29:59","thirtyminutes0030","2020-10-01 15:00:00","2020-10-01 15:29:59",0,0,NA,NA,0,2,2,540,1080,420,660,169.705627484771,660,0.668711440627502,918,919,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0
-"thirtyminutes0031#2020-10-01 15:30:00,2020-10-01 15:59:59","thirtyminutes0031","2020-10-01 15:30:00","2020-10-01 15:59:59",0,0,NA,NA,0,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,1530,1530,1530,1530,NA,1530,0,956,956,1
-"thirtyminutes0033#2020-10-01 16:30:00,2020-10-01 16:59:59","thirtyminutes0033","2020-10-01 16:30:00","2020-10-01 16:59:59",1,1,1015,1015,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0,1,1,0,0,0,0,NA,0,NA,1000,1000,1
-"thirtyminutes0034#2020-10-01 17:00:00,2020-10-01 17:29:59","thirtyminutes0034","2020-10-01 17:00:00","2020-10-01 17:29:59",0,0,NA,NA,0,2,2,933.5,1867,657,1210,391.030049996161,657,0.648883578550163,1046,1047,1,1,1,1096,1096,1096,1096,NA,1096,0,1031,1031,1
-"thirtyminutes0035#2020-10-01 17:30:00,2020-10-01 17:59:59","thirtyminutes0035","2020-10-01 17:30:00","2020-10-01 17:59:59",1,1,1076,1076,1,1,1,1210,1210,1210,1210,NA,1210,0,1066,1066,1,0,0,NA,NA,NA,NA,NA,NA,NA,NA,NA,0

tests/data/processed/features/frequency/fre_ios/phone_conversation.csv

@@ -1,26 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_conversation_rapids_minutessilence","phone_conversation_rapids_minutesnoise","phone_conversation_rapids_minutesvoice","phone_conversation_rapids_minutesunknown","phone_conversation_rapids_countconversation","phone_conversation_rapids_silencesensedfraction","phone_conversation_rapids_noisesensedfraction","phone_conversation_rapids_voicesensedfraction","phone_conversation_rapids_unknownsensedfraction","phone_conversation_rapids_silenceexpectedfraction","phone_conversation_rapids_noiseexpectedfraction","phone_conversation_rapids_voiceexpectedfraction","phone_conversation_rapids_unknownexpectedfraction","phone_conversation_rapids_sumconversationduration","phone_conversation_rapids_avgconversationduration","phone_conversation_rapids_sdconversationduration","phone_conversation_rapids_minconversationduration","phone_conversation_rapids_maxconversationduration","phone_conversation_rapids_timefirstconversation","phone_conversation_rapids_timelastconversation","phone_conversation_rapids_noisesumenergy","phone_conversation_rapids_noiseavgenergy","phone_conversation_rapids_noisesdenergy","phone_conversation_rapids_noiseminenergy","phone_conversation_rapids_noisemaxenergy","phone_conversation_rapids_voicesumenergy","phone_conversation_rapids_voiceavgenergy","phone_conversation_rapids_voicesdenergy","phone_conversation_rapids_voiceminenergy","phone_conversation_rapids_voicemaxenergy"
-"thirtyminutes0002#2020-07-07 01:00:00,2020-07-07 01:29:59","thirtyminutes0002","2020-07-07 01:00:00","2020-07-07 01:29:59",0.05,0.683333333333333,0.183333333333333,0.0666666666666667,1,0.0508474576271186,0.694915254237288,0.186440677966102,0.0677966101694915,0.000138888888888889,0.00189814814814815,0.000509259259259259,0.000185185185185185,1666.66666666667,1666.66666666667,NA,1666.66666666667,1666.66666666667,73,73,254984,6219.12195121951,3611.99537094887,559,11769,29248,2658.90909090909,1686.32716010538,61,4981
-"thirtyminutes0002#2020-07-08 01:00:00,2020-07-08 01:29:59","thirtyminutes0002","2020-07-08 01:00:00","2020-07-08 01:29:59",0.133333333333333,2.06666666666667,0.6,0.183333333333333,1,0.0446927374301676,0.692737430167598,0.201117318435754,0.0614525139664804,0.00037037037037037,0.00574074074074074,0.00166666666666667,0.000509259259259259,2.28333333333333,2.28333333333333,NA,2.28333333333333,2.28333333333333,77,77,738382,5954.6935483871,3538.5841001422,267,11967,116954,3248.72222222222,1789.91462862835,69,5859
-"thirtyminutes0005#2020-07-08 02:30:00,2020-07-08 02:59:59","thirtyminutes0005","2020-07-08 02:30:00","2020-07-08 02:59:59",0.133333333333333,2.13333333333333,0.583333333333333,0.133333333333333,1,0.0446927374301676,0.715083798882682,0.195530726256983,0.0446927374301676,0.00037037037037037,0.00592592592592593,0.00162037037037037,0.00037037037037037,1.4,1.4,NA,1.4,1.4,160,160,817385,6385.8203125,3632.45674751624,99,11936,112712,3220.34285714286,1755.06022928085,275,5979
-"thirtyminutes0011#2020-07-07 05:30:00,2020-07-07 05:59:59","thirtyminutes0011","2020-07-07 05:30:00","2020-07-07 05:59:59",0.65,9.61666666666667,2.66666666666667,0.75,1,0.0475030450669915,0.702801461632156,0.194884287454324,0.0548112058465286,0.00180555555555556,0.026712962962963,0.00740740740740741,0.00208333333333333,10.05,10.05,NA,10.05,10.05,359,359,3570056,6187.27209705373,3541.42211319418,31,11976,470594,2941.2125,1751.29396685232,54,5982
-"thirtyminutes0011#2020-07-08 05:30:00,2020-07-08 05:59:59","thirtyminutes0011","2020-07-08 05:30:00","2020-07-08 05:59:59",0.816666666666667,11.5333333333333,2.53333333333333,0.983333333333333,1,0.0514705882352941,0.726890756302521,0.159663865546218,0.0619747899159664,0.00226851851851852,0.032037037037037,0.00703703703703704,0.00273148148148148,14.2666666666667,14.2666666666667,NA,14.2666666666667,14.2666666666667,359,359,3977612,5747.99421965318,3407.17956872983,49,11981,485171,3191.91447368421,1753.97448743435,15,5983
-"thirtyminutes0012#2020-07-07 06:00:00,2020-07-07 06:29:59","thirtyminutes0012","2020-07-07 06:00:00","2020-07-07 06:29:59",0.0166666666666667,0.55,0.133333333333333,0.0333333333333333,NA,0.0227272727272727,0.75,0.181818181818182,0.0454545454545455,4.62962962962963e-05,0.00152777777777778,0.00037037037037037,9.25925925925926e-05,0,NA,NA,NA,0,NA,NA,205237,6219.30303030303,3486.62605971776,470,11468,18261,2282.625,1954.05621629179,18,5494
-"thirtyminutes0012#2020-07-08 06:00:00,2020-07-08 06:29:59","thirtyminutes0012","2020-07-08 06:00:00","2020-07-08 06:29:59",0.35,3.56666666666667,0.966666666666667,0.316666666666667,NA,0.0673076923076923,0.685897435897436,0.185897435897436,0.0608974358974359,0.000972222222222222,0.00990740740740741,0.00268518518518519,0.00087962962962963,0,NA,NA,NA,0,NA,NA,1329661,6213.36915887851,3654.61971833146,32,11986,193236,3331.65517241379,1766.04139102042,241,5858
-"thirtyminutes0013#2020-07-07 06:30:00,2020-07-07 06:59:59","thirtyminutes0013","2020-07-07 06:30:00","2020-07-07 06:59:59",0.133333333333333,1.25,0.533333333333333,0.0666666666666667,1,0.0672268907563025,0.630252100840336,0.26890756302521,0.0336134453781513,0.00037037037037037,0.00347222222222222,0.00148148148148148,0.000185185185185185,1.33333333333333,1.33333333333333,NA,1.33333333333333,1.33333333333333,392,392,459919,6132.25333333333,3609.22901886686,222,11920,98678,3083.6875,1557.76443284144,648,5974
-"thirtyminutes0016#2020-07-08 08:00:00,2020-07-08 08:29:59","thirtyminutes0016","2020-07-08 08:00:00","2020-07-08 08:29:59",0.1,0.716666666666667,0.15,0.0166666666666667,1,0.101694915254237,0.728813559322034,0.152542372881356,0.0169491525423729,0.000277777777777778,0.00199074074074074,0.000416666666666667,4.62962962962963e-05,0.283333333333333,0.283333333333333,NA,0.283333333333333,0.283333333333333,481,481,286820,6670.23255813954,3577.58151108239,381,11839,33052,3672.44444444444,1379.26475985497,1910,5866
-"thirtyminutes0017#2020-07-07 08:30:00,2020-07-07 08:59:59","thirtyminutes0017","2020-07-07 08:30:00","2020-07-07 08:59:59",0.15,2.81666666666667,0.783333333333333,0.216666666666667,2,0.0378151260504202,0.710084033613445,0.197478991596639,0.0546218487394958,0.000416666666666667,0.00782407407407408,0.00217592592592593,0.000601851851851852,1.6,0.8,0.0707106781186548,0.75,0.85,516,535,938565,5553.63905325444,3370.70343882599,134,11938,139223,2962.1914893617,1794.68495041061,69,5959
-"thirtyminutes0021#2020-07-07 10:30:00,2020-07-07 10:59:59","thirtyminutes0021","2020-07-07 10:30:00","2020-07-07 10:59:59",0.116666666666667,1.35,0.333333333333333,0.183333333333333,1,0.0588235294117647,0.680672268907563,0.168067226890756,0.092436974789916,0.000324074074074074,0.00375,0.000925925925925926,0.000509259259259259,1.66666666666667,1.66666666666667,NA,1.66666666666667,1.66666666666667,656,656,474758,5861.20987654321,3158.11819251611,13,11825,63061,3153.05,1392.35402617672,381,5031
-"thirtyminutes0023#2020-07-07 11:30:00,2020-07-07 11:59:59","thirtyminutes0023","2020-07-07 11:30:00","2020-07-07 11:59:59",0.0833333333333333,2.3,0.65,0.15,NA,0.0261780104712042,0.722513089005236,0.204188481675393,0.0471204188481675,0.000231481481481481,0.00638888888888889,0.00180555555555556,0.000416666666666667,0,NA,NA,NA,0,NA,NA,939738,6809.69565217391,3246.64083920798,348,11985,120596,3092.20512820513,1859.21142281072,154,5822
-"thirtyminutes0023#2020-07-08 11:30:00,2020-07-08 11:59:59","thirtyminutes0023","2020-07-08 11:30:00","2020-07-08 11:59:59",0.366666666666667,4.68333333333333,1.36666666666667,0.233333333333333,2,0.0551378446115288,0.704260651629073,0.205513784461153,0.0350877192982456,0.00101851851851852,0.0130092592592593,0.0037962962962963,0.000648148148148148,5.15,2.575,0.0824957911384304,2.51666666666667,2.63333333333333,697,719,1711922,6092.24911032028,3386.07934815594,21,11935,258424,3151.51219512195,1750.14532901955,39,5972
-"thirtyminutes0024#2020-07-07 12:00:00,2020-07-07 12:29:59","thirtyminutes0024","2020-07-07 12:00:00","2020-07-07 12:29:59",0.7,9.85,2.88333333333333,0.45,1,0.0504201680672269,0.709483793517407,0.207683073229292,0.0324129651860744,0.00194444444444444,0.0273611111111111,0.00800925925925926,0.00125,1.78333333333333,1.78333333333333,NA,1.78333333333333,1.78333333333333,733,733,3527573,5968.820642978,3557.82238983441,29,11997,517505,2991.35838150289,1791.95776038444,18,5998
-"thirtyminutes0024#2020-07-08 12:00:00,2020-07-08 12:29:59","thirtyminutes0024","2020-07-08 12:00:00","2020-07-08 12:29:59",0.316666666666667,4.35,1.03333333333333,0.25,1,0.0532212885154062,0.73109243697479,0.173669467787115,0.0420168067226891,0.00087962962962963,0.0120833333333333,0.00287037037037037,0.000694444444444444,5.36666666666667,5.36666666666667,NA,5.36666666666667,5.36666666666667,725,725,1618598,6201.52490421456,3426.75049881198,32,11990,175378,2828.67741935484,1651.7847453756,26,5753
-"thirtyminutes0025#2020-07-07 12:30:00,2020-07-07 12:59:59","thirtyminutes0025","2020-07-07 12:30:00","2020-07-07 12:59:59",0.283333333333333,1.78333333333333,0.783333333333333,0.133333333333333,1,0.0949720670391061,0.597765363128492,0.262569832402235,0.0446927374301676,0.000787037037037037,0.0049537037037037,0.00217592592592593,0.00037037037037037,2.21666666666667,2.21666666666667,NA,2.21666666666667,2.21666666666667,768,768,651511,6088.88785046729,3361.1700745905,117,11613,147681,3142.14893617021,1650.99227052576,113,5839
-"thirtyminutes0033#2020-07-07 16:30:00,2020-07-07 16:59:59","thirtyminutes0033","2020-07-07 16:30:00","2020-07-07 16:59:59",0.383333333333333,4.45,1.2,0.366666666666667,1,0.0598958333333333,0.6953125,0.1875,0.0572916666666667,0.00106481481481481,0.0123611111111111,0.00333333333333333,0.00101851851851852,1.96666666666667,1.96666666666667,NA,1.96666666666667,1.96666666666667,1010,1010,1558080,5835.50561797753,3361.14808904221,51,11957,219689,3051.23611111111,1839.39286135288,5,5973
-"thirtyminutes0033#2020-07-08 16:30:00,2020-07-08 16:59:59","thirtyminutes0033","2020-07-08 16:30:00","2020-07-08 16:59:59",0.1,1.96666666666667,0.616666666666667,0.166666666666667,NA,0.0350877192982456,0.690058479532164,0.216374269005848,0.0584795321637427,0.000277777777777778,0.00546296296296296,0.00171296296296296,0.000462962962962963,0,NA,NA,NA,0,NA,NA,705058,5975.06779661017,3287.01941917461,130,11994,106715,2884.18918918919,1589.3816903619,155,5896
-"thirtyminutes0034#2020-07-07 17:00:00,2020-07-07 17:29:59","thirtyminutes0034","2020-07-07 17:00:00","2020-07-07 17:29:59",0.766666666666667,11.3333333333333,3.4,0.85,2,0.0468909276248726,0.693170234454638,0.207951070336391,0.0519877675840979,0.00212962962962963,0.0314814814814815,0.00944444444444444,0.00236111111111111,6.45,3.225,1.04887505876005,2.48333333333333,3.96666666666667,1032,1038,4205272,6184.22352941176,3480.06016995185,15,11869,621932,3048.6862745098,1727.26067460511,37,5928
-"thirtyminutes0034#2020-07-08 17:00:00,2020-07-08 17:29:59","thirtyminutes0034","2020-07-08 17:00:00","2020-07-08 17:29:59",0.2,1.83333333333333,0.583333333333333,0.183333333333333,1,0.0714285714285714,0.654761904761905,0.208333333333333,0.0654761904761905,0.000555555555555556,0.00509259259259259,0.00162037037037037,0.000509259259259259,5.23333333333333,5.23333333333333,NA,5.23333333333333,5.23333333333333,1022,1022,706913,6426.48181818182,3597.07282557782,155,11984,112200,3205.71428571429,1996.67760176203,26,5965
-"thirtyminutes0035#2020-07-08 17:30:00,2020-07-08 17:59:59","thirtyminutes0035","2020-07-08 17:30:00","2020-07-08 17:59:59",0.0333333333333333,0.733333333333333,0.2,0.0166666666666667,1,0.0338983050847458,0.745762711864407,0.203389830508475,0.0169491525423729,9.25925925925926e-05,0.00203703703703704,0.000555555555555556,4.62962962962963e-05,0.35,0.35,NA,0.35,0.35,1079,1079,269590,6127.04545454545,3796.70145670873,137,11971,39917,3326.41666666667,1785.64887408335,541,5590
-"thirtyminutes0039#2020-07-08 19:30:00,2020-07-08 19:59:59","thirtyminutes0039","2020-07-08 19:30:00","2020-07-08 19:59:59",0.1,2.1,0.716666666666667,0.0666666666666667,NA,0.0335195530726257,0.70391061452514,0.240223463687151,0.0223463687150838,0.000277777777777778,0.00583333333333333,0.00199074074074074,0.000185185185185185,0,NA,NA,NA,0,NA,NA,737899,5856.34126984127,3586.7682415516,65,11872,138265,3215.46511627907,1685.61227181609,344,5791
-"thirtyminutes0040#2020-07-07 20:00:00,2020-07-07 20:29:59","thirtyminutes0040","2020-07-07 20:00:00","2020-07-07 20:29:59",0.0833333333333333,1.3,0.5,0.1,1,0.0420168067226891,0.65546218487395,0.252100840336134,0.0504201680672269,0.000231481481481481,0.00361111111111111,0.00138888888888889,0.000277777777777778,1.35,1.35,NA,1.35,1.35,1204,1204,505175,6476.60256410256,3468.7579061419,255,11958,89106,2970.2,1714.36781149888,116,5801
-"thirtyminutes0046#2020-07-07 23:00:00,2020-07-07 23:29:59","thirtyminutes0046","2020-07-07 23:00:00","2020-07-07 23:29:59",0.133333333333333,1.36666666666667,0.366666666666667,0.116666666666667,1,0.0672268907563025,0.689075630252101,0.184873949579832,0.0588235294117647,0.00037037037037037,0.0037962962962963,0.00101851851851852,0.000324074074074074,1.38333333333333,1.38333333333333,NA,1.38333333333333,1.38333333333333,1407,1407,451528,5506.43902439024,3323.384672502,449,11997,69623,3164.68181818182,1700.61863775576,128,5807
-"thirtyminutes0047#2020-07-07 23:30:00,2020-07-07 23:59:59","thirtyminutes0047","2020-07-07 23:30:00","2020-07-07 23:59:59",0.15,1.98333333333333,0.65,0.2,1,0.0502793296089385,0.664804469273743,0.217877094972067,0.0670391061452514,0.000416666666666667,0.00550925925925926,0.00180555555555556,0.000555555555555556,2.15,2.15,NA,2.15,2.15,1436,1436,696959,5856.79831932773,3410.93125754917,117,11685,129548,3321.74358974359,1756.63003800412,116,5961

tests/data/processed/features/frequency/fre_ios/phone_light.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_light_rapids_count","phone_light_rapids_maxlux","phone_light_rapids_minlux","phone_light_rapids_avglux","phone_light_rapids_medianlux","phone_light_rapids_stdlux"

tests/data/processed/features/frequency/fre_ios/phone_messages.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_messages_rapids_received_countmostfrequentcontact","phone_messages_rapids_received_count","phone_messages_rapids_received_distinctcontacts","phone_messages_rapids_received_timefirstmessage","phone_messages_rapids_received_timelastmessage","phone_messages_rapids_sent_countmostfrequentcontact","phone_messages_rapids_sent_count","phone_messages_rapids_sent_distinctcontacts","phone_messages_rapids_sent_timefirstmessage","phone_messages_rapids_sent_timelastmessage"

tests/data/processed/features/frequency/fre_ios/phone_wifi_connected.csv

@@ -1,8 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_connected_rapids_countscans","phone_wifi_connected_rapids_uniquedevices","phone_wifi_connected_rapids_countscansmostuniquedevice"
-"thirtyminutes0000#2020-10-12 00:00:00,2020-10-12 00:29:59","thirtyminutes0000","2020-10-12 00:00:00","2020-10-12 00:29:59",6,4,2
-"thirtyminutes0000#2020-10-13 00:00:00,2020-10-13 00:29:59","thirtyminutes0000","2020-10-13 00:00:00","2020-10-13 00:29:59",2,1,2
-"thirtyminutes0001#2020-10-12 00:30:00,2020-10-12 00:59:59","thirtyminutes0001","2020-10-12 00:30:00","2020-10-12 00:59:59",6,6,1
-"thirtyminutes0001#2020-10-13 00:30:00,2020-10-13 00:59:59","thirtyminutes0001","2020-10-13 00:30:00","2020-10-13 00:59:59",2,2,1
-"thirtyminutes0002#2020-10-12 01:00:00,2020-10-12 01:29:59","thirtyminutes0002","2020-10-12 01:00:00","2020-10-12 01:29:59",4,4,1
-"thirtyminutes0046#2020-10-12 23:00:00,2020-10-12 23:29:59","thirtyminutes0046","2020-10-12 23:00:00","2020-10-12 23:29:59",6,4,2
-"thirtyminutes0047#2020-10-12 23:30:00,2020-10-12 23:59:59","thirtyminutes0047","2020-10-12 23:30:00","2020-10-12 23:59:59",6,4,2

tests/data/processed/features/frequency/fre_ios/phone_wifi_visible.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_visible_rapids_countscans","phone_wifi_visible_rapids_uniquedevices","phone_wifi_visible_rapids_countscansmostuniquedevice"

tests/data/processed/features/periodic/per_and/phone_applications_foreground.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","apps_rapids_timeoffirstuseall","apps_rapids_timeoflastuseall","apps_rapids_frequencyentropyall","apps_rapids_countall","apps_rapids_timeoffirstuseemail","apps_rapids_timeoflastuseemail","apps_rapids_frequencyentropyemail","apps_rapids_countemail","apps_rapids_timeoffirstuseentertainment","apps_rapids_timeoflastuseentertainment","apps_rapids_frequencyentropyentertainment","apps_rapids_countentertainment","apps_rapids_timeoffirstusesocial","apps_rapids_timeoflastusesocial","apps_rapids_frequencyentropysocial","apps_rapids_countsocial","apps_rapids_timeoffirstusetop1global","apps_rapids_timeoflastusetop1global","apps_rapids_frequencyentropytop1global","apps_rapids_counttop1global","apps_rapids_timeoffirstusecom.facebook.moments","apps_rapids_timeoflastusecom.facebook.moments","apps_rapids_frequencyentropycom.facebook.moments","apps_rapids_countcom.facebook.moments"
-"afternoon#2020-07-05 12:00:00,2020-07-05 17:59:59","afternoon","2020-07-05 12:00:00","2020-07-05 17:59:59",721,889,1.03972077083992,4,889,889,NA,1,721,721,NA,1,NA,NA,NA,0,NA,NA,NA,0,798,877,NA,2
-"daily#2020-07-05 00:00:00,2020-07-05 23:59:59","daily","2020-07-05 00:00:00","2020-07-05 23:59:59",17,1359,1.54438198091684,17,889,1308,NA,2,195,721,0.598269588585257,7,302,1359,NA,4,195,719,NA,5,17,877,NA,4
-"evening#2020-07-05 18:00:00,2020-07-05 23:59:59","evening","2020-07-05 18:00:00","2020-07-05 23:59:59",1168,1359,0.636514168294813,3,1308,1308,NA,1,NA,NA,NA,0,1168,1359,NA,2,NA,NA,NA,0,NA,NA,NA,0
-"morning#2020-07-05 06:00:00,2020-07-05 11:59:59","morning","2020-07-05 06:00:00","2020-07-05 11:59:59",412,719,0.950270539233235,5,NA,NA,NA,0,412,719,0.562335144618808,4,427,427,NA,1,412,719,NA,3,NA,NA,NA,0
-"night#2020-07-05 00:00:00,2020-07-05 05:59:59","night","2020-07-05 00:00:00","2020-07-05 05:59:59",17,359,1.05492016798614,5,NA,NA,NA,0,195,359,NA,2,302,302,NA,1,195,359,NA,2,17,59,NA,2

tests/data/processed/features/periodic/per_and/phone_battery.csv

@@ -1,28 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_countdischarge","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_maxconsumptionrate","phone_battery_rapids_countcharge","phone_battery_rapids_sumdurationcharge"
-"afternoon#2020-07-01 12:00:00,2020-07-01 17:59:59","afternoon","2020-07-01 12:00:00","2020-07-01 17:59:59",2,42.1548666666667,0.165910502035002,0.253301361072647,2,79.4708833333333
-"daily#2020-07-01 00:00:00,2020-07-01 23:59:59","daily","2020-07-01 00:00:00","2020-07-01 23:59:59",7,237.018466666667,0.130692687348499,0.454125732277743,5,199.701516666667
-"daily#2020-07-02 00:00:00,2020-07-02 23:59:59","daily","2020-07-02 00:00:00","2020-07-02 23:59:59",2,39.9993166666667,0.146926011409736,0.237981913374584,0,0
-"daily#2020-07-03 00:00:00,2020-07-03 23:59:59","daily","2020-07-03 00:00:00","2020-07-03 23:59:59",2,52.7136833333333,0.0638377410315164,0.0774207534071583,0,0
-"daily#2020-07-04 00:00:00,2020-07-04 23:59:59","daily","2020-07-04 00:00:00","2020-07-04 23:59:59",2,57.0823666666667,0.0763541574430664,0.111113168762384,0,0
-"daily#2020-07-05 00:00:00,2020-07-05 23:59:59","daily","2020-07-05 00:00:00","2020-07-05 23:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"evening#2020-07-01 18:00:00,2020-07-01 23:59:59","evening","2020-07-01 18:00:00","2020-07-01 23:59:59",3,77.33265,0.195705802039367,0.454125732277743,1,37.5236666666667
-"evening#2020-07-02 18:00:00,2020-07-02 23:59:59","evening","2020-07-02 18:00:00","2020-07-02 23:59:59",1,4.202,0.237981913374584,0.237981913374584,0,0
-"evening#2020-07-03 18:00:00,2020-07-03 23:59:59","evening","2020-07-03 18:00:00","2020-07-03 23:59:59",1,12.9164333333333,0.0774207534071583,0.0774207534071583,0,0
-"evening#2020-07-04 18:00:00,2020-07-04 23:59:59","evening","2020-07-04 18:00:00","2020-07-04 23:59:59",1,8.99983333333333,0.111113168762384,0.111113168762384,0,0
-"morning#2020-07-01 06:00:00,2020-07-01 11:59:59","morning","2020-07-01 06:00:00","2020-07-01 11:59:59",2,75.56395,0.065515964597609,0.0731286084397727,2,42.61665
-"night#2020-07-01 00:00:00,2020-07-01 05:59:59","night","2020-07-01 00:00:00","2020-07-01 05:59:59",2,41.9669666666667,0.23817390645112,0.400338953647421,1,40.0903
-"night#2020-07-02 00:00:00,2020-07-02 05:59:59","night","2020-07-02 00:00:00","2020-07-02 05:59:59",1,35.7973166666667,0.0558701094448886,0.0558701094448886,0,0
-"night#2020-07-03 00:00:00,2020-07-03 05:59:59","night","2020-07-03 00:00:00","2020-07-03 05:59:59",1,39.79725,0.0502547286558745,0.0502547286558745,0,0
-"night#2020-07-04 00:00:00,2020-07-04 05:59:59","night","2020-07-04 00:00:00","2020-07-04 05:59:59",1,48.0825333333333,0.0415951461237483,0.0415951461237483,0,0
-"night#2020-07-05 00:00:00,2020-07-05 05:59:59","night","2020-07-05 00:00:00","2020-07-05 05:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"threeday#2020-07-01 00:00:00,2020-07-03 23:59:59","threeday","2020-07-01 00:00:00","2020-07-03 23:59:59",9,329.7315,0.0761417190406398,0.0809973837845038,5,199.701516666667
-"threeday#2020-07-02 00:00:00,2020-07-04 23:59:59","threeday","2020-07-02 00:00:00","2020-07-04 23:59:59",4,149.7954,0.0710868450815781,0.111113168762384,0,0
-"threeday#2020-07-03 00:00:00,2020-07-05 23:59:59","threeday","2020-07-03 00:00:00","2020-07-05 23:59:59",3,162.7952,0.0492745931499224,0.0502547286558745,0,0
-"threeday#2020-07-04 00:00:00,2020-07-06 23:59:59","threeday","2020-07-04 00:00:00","2020-07-06 23:59:59",2,110.0815,0.0449915246814979,0.0483879032392475,0,0
-"threeday#2020-07-05 00:00:00,2020-07-07 23:59:59","threeday","2020-07-05 00:00:00","2020-07-07 23:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"two_weeks_overlapping#2020-07-01 00:00:00,2020-07-14 23:59:59","two_weeks_overlapping","2020-07-01 00:00:00","2020-07-14 23:59:59",10,439.813016666667,0.0705423768752492,0.0809973837845038,5,199.701516666667
-"two_weeks_overlapping#2020-07-02 00:00:00,2020-07-15 23:59:59","two_weeks_overlapping","2020-07-02 00:00:00","2020-07-15 23:59:59",4,202.794533333333,0.0554055287007939,0.0681829545643943,0,0
-"two_weeks_overlapping#2020-07-03 00:00:00,2020-07-16 23:59:59","two_weeks_overlapping","2020-07-03 00:00:00","2020-07-16 23:59:59",3,162.7952,0.0492745931499224,0.0502547286558745,0,0
-"two_weeks_overlapping#2020-07-04 00:00:00,2020-07-17 23:59:59","two_weeks_overlapping","2020-07-04 00:00:00","2020-07-17 23:59:59",2,110.0815,0.0449915246814979,0.0483879032392475,0,0
-"two_weeks_overlapping#2020-07-05 00:00:00,2020-07-18 23:59:59","two_weeks_overlapping","2020-07-05 00:00:00","2020-07-18 23:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"weekends#2020-07-03 00:00:00,2020-07-05 23:59:59","weekends","2020-07-03 00:00:00","2020-07-05 23:59:59",3,162.7952,0.0492745931499224,0.0502547286558745,0,0

tests/data/processed/features/periodic/per_and/phone_bluetooth.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_bluetooth_rapids_countscans","phone_bluetooth_rapids_uniquedevices","phone_bluetooth_rapids_countscansmostuniquedevice"
-"afternoon#2020-07-02 12:00:00,2020-07-02 17:59:59","afternoon","2020-07-02 12:00:00","2020-07-02 17:59:59",2,2,1
-"daily#2020-07-02 00:00:00,2020-07-02 23:59:59","daily","2020-07-02 00:00:00","2020-07-02 23:59:59",14,5,4
-"evening#2020-07-02 18:00:00,2020-07-02 23:59:59","evening","2020-07-02 18:00:00","2020-07-02 23:59:59",5,4,2
-"morning#2020-07-02 06:00:00,2020-07-02 11:59:59","morning","2020-07-02 06:00:00","2020-07-02 11:59:59",3,2,2
-"night#2020-07-02 00:00:00,2020-07-02 05:59:59","night","2020-07-02 00:00:00","2020-07-02 05:59:59",4,4,1

tests/data/processed/features/periodic/per_and/phone_calls.csv

@@ -1,9 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_calls_rapids_missed_count","phone_calls_rapids_missed_distinctcontacts","phone_calls_rapids_missed_timefirstcall","phone_calls_rapids_missed_timelastcall","phone_calls_rapids_missed_countmostfrequentcontact","phone_calls_rapids_incoming_count","phone_calls_rapids_incoming_distinctcontacts","phone_calls_rapids_incoming_meanduration","phone_calls_rapids_incoming_sumduration","phone_calls_rapids_incoming_minduration","phone_calls_rapids_incoming_maxduration","phone_calls_rapids_incoming_stdduration","phone_calls_rapids_incoming_modeduration","phone_calls_rapids_incoming_entropyduration","phone_calls_rapids_incoming_timefirstcall","phone_calls_rapids_incoming_timelastcall","phone_calls_rapids_incoming_countmostfrequentcontact","phone_calls_rapids_outgoing_count","phone_calls_rapids_outgoing_distinctcontacts","phone_calls_rapids_outgoing_meanduration","phone_calls_rapids_outgoing_sumduration","phone_calls_rapids_outgoing_minduration","phone_calls_rapids_outgoing_maxduration","phone_calls_rapids_outgoing_stdduration","phone_calls_rapids_outgoing_modeduration","phone_calls_rapids_outgoing_entropyduration","phone_calls_rapids_outgoing_timefirstcall","phone_calls_rapids_outgoing_timelastcall","phone_calls_rapids_outgoing_countmostfrequentcontact"
-"afternoon#2020-06-01 12:00:00,2020-06-01 17:59:59","afternoon","2020-06-01 12:00:00","2020-06-01 17:59:59",1,1,874,874,1,3,2,642.666666666667,1928,213,1053,420.333597673721,1053,0.941278069255821,753,921,2,2,2,1237.5,2475,1186,1289,72.8319984622144,1289,0.692482998176928,869,1051,1
-"daily#2020-06-01 00:00:00,2020-06-01 23:59:59","daily","2020-06-01 00:00:00","2020-06-01 23:59:59",6,3,13,1167,4,10,6,976.4,9764,213,1719,465.141603289913,439,2.18820020272087,163,1331,5,8,6,1168,9344,759,1543,250.842010607702,970,2.05922274128194,172,1277,3
-"daily#2020-06-02 00:00:00,2020-06-02 23:59:59","daily","2020-06-02 00:00:00","2020-06-02 23:59:59",2,2,589,1167,1,5,5,1213.2,6066,667,1719,375.767481296612,667,1.56941860966338,519,1331,1,5,5,1179.8,5899,759,1543,310.478179587552,1116,1.58127936063292,418,1277,1
-"evening#2020-06-01 18:00:00,2020-06-01 23:59:59","evening","2020-06-01 18:00:00","2020-06-01 23:59:59",1,1,1167,1167,1,3,3,1366.66666666667,4100,1157,1719,306.963081384934,1157,1.08260122332248,1144,1331,1,2,2,1482,2964,1421,1543,86.2670273047588,1421,0.692468534923961,1156,1277,1
-"evening#2020-06-02 18:00:00,2020-06-02 23:59:59","evening","2020-06-02 18:00:00","2020-06-02 23:59:59",1,1,1167,1167,1,3,3,1366.66666666667,4100,1157,1719,306.963081384934,1157,1.08260122332248,1144,1331,1,2,2,1482,2964,1421,1543,86.2670273047588,1421,0.692468534923961,1156,1277,1
-"morning#2020-06-01 06:00:00,2020-06-01 11:59:59","morning","2020-06-01 06:00:00","2020-06-01 11:59:59",1,1,589,589,1,2,2,983,1966,667,1299,446.891485709898,667,0.640802774623272,519,600,1,3,3,978.333333333333,2935,759,1116,192.000868053593,1116,1.08558305836162,418,687,1
-"morning#2020-06-02 06:00:00,2020-06-02 11:59:59","morning","2020-06-02 06:00:00","2020-06-02 11:59:59",1,1,589,589,1,2,2,983,1966,667,1299,446.891485709898,667,0.640802774623272,519,600,1,3,3,978.333333333333,2935,759,1116,192.000868053593,1116,1.08558305836162,418,687,1
-"night#2020-06-01 00:00:00,2020-06-01 05:59:59","night","2020-06-01 00:00:00","2020-06-01 05:59:59",3,1,13,257,3,2,1,885,1770,439,1331,630.7392488184,439,0.560434787927257,163,257,2,1,1,970,970,970,970,NA,970,0,172,172,1

tests/data/processed/features/periodic/per_and/phone_conversation.csv

@@ -1,11 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_conversation_rapids_minutessilence","phone_conversation_rapids_minutesnoise","phone_conversation_rapids_minutesvoice","phone_conversation_rapids_minutesunknown","phone_conversation_rapids_countconversation","phone_conversation_rapids_silencesensedfraction","phone_conversation_rapids_noisesensedfraction","phone_conversation_rapids_voicesensedfraction","phone_conversation_rapids_unknownsensedfraction","phone_conversation_rapids_silenceexpectedfraction","phone_conversation_rapids_noiseexpectedfraction","phone_conversation_rapids_voiceexpectedfraction","phone_conversation_rapids_unknownexpectedfraction","phone_conversation_rapids_sumconversationduration","phone_conversation_rapids_avgconversationduration","phone_conversation_rapids_sdconversationduration","phone_conversation_rapids_minconversationduration","phone_conversation_rapids_maxconversationduration","phone_conversation_rapids_timefirstconversation","phone_conversation_rapids_timelastconversation","phone_conversation_rapids_noisesumenergy","phone_conversation_rapids_noiseavgenergy","phone_conversation_rapids_noisesdenergy","phone_conversation_rapids_noiseminenergy","phone_conversation_rapids_noisemaxenergy","phone_conversation_rapids_voicesumenergy","phone_conversation_rapids_voiceavgenergy","phone_conversation_rapids_voicesdenergy","phone_conversation_rapids_voiceminenergy","phone_conversation_rapids_voicemaxenergy"
-"afternoon#2020-07-07 12:00:00,2020-07-07 17:59:59","afternoon","2020-07-07 12:00:00","2020-07-07 17:59:59",2.13333333333333,27.4166666666667,8.26666666666667,1.8,5,0.0538493899873791,0.692048801009676,0.208666386201094,0.0454354228018511,0.00592592592592593,0.0761574074074074,0.022962962962963,0.005,12.4379500031471,2.48759000062943,0.869095100149537,1.7806666692098,3.96938333511353,733,1038,9942436,6044.03404255319,3481.15148889292,15,11997,1506807,3037.91733870968,1754.92051540106,5,5998
-"afternoon#2020-07-08 12:00:00,2020-07-08 17:59:59","afternoon","2020-07-08 12:00:00","2020-07-08 17:59:59",0.65,8.88333333333333,2.43333333333333,0.616666666666667,3,0.0516556291390728,0.705960264900662,0.193377483443709,0.0490066225165563,0.00180555555555556,0.0246759259259259,0.00675925925925926,0.00171296296296296,10.9306666652362,3.64355555507872,2.86167904998861,0.340166664123535,5.36541666984558,725,1079,3300159,6191.66791744841,3457.36750549971,32,11994,434210,2974.04109589041,1728.00992524573,26,5965
-"daily#2020-07-07 00:00:00,2020-07-07 23:59:59","daily","2020-07-07 00:00:00","2020-07-07 23:59:59",3.7,50.6333333333333,15.0666666666667,3.68333333333333,14,0.0506271379703535,0.692816419612315,0.206157354618016,0.0503990877993159,0.0102777777777778,0.140648148148148,0.0418518518518518,0.0102314814814815,32.6724333286285,2.33374523775918,2.37483782469835,0.718016664187113,10.0464333335559,73,1436,18439355,6069.57044107966,3468.92936877742,13,11997,2734745,3025.16039823009,1740.00534289166,5,5998
-"daily#2020-07-08 00:00:00,2020-07-08 23:59:59","daily","2020-07-08 00:00:00","2020-07-08 23:59:59",2.65,35.6833333333333,9.35,2.55,9,0.0527538155275382,0.710351692103517,0.186131386861314,0.0507631055076311,0.00736111111111111,0.0991203703703704,0.0259722222222222,0.00708333333333333,34.3204833308856,3.81338703676506,4.31994487064644,0.290083332856496,14.2620333313942,77,1079,12899840,6025.14712751051,3479.79867896124,21,11994,1772024,3158.688057041,1734.43700437943,15,5983
-"evening#2020-07-07 18:00:00,2020-07-07 23:59:59","evening","2020-07-07 18:00:00","2020-07-07 23:59:59",0.366666666666667,4.65,1.51666666666667,0.416666666666667,3,0.052757793764988,0.669064748201439,0.218225419664269,0.0599520383693046,0.00101851851851852,0.0129166666666667,0.00421296296296296,0.00115740740740741,4.88070000012716,1.62690000004239,0.447887881340764,1.35104999939601,2.14368333419164,1204,1436,1653662,5927.10394265233,3410.01360257296,117,11997,288277,3167.87912087912,1716.97773773935,116,5961
-"evening#2020-07-08 18:00:00,2020-07-08 23:59:59","evening","2020-07-08 18:00:00","2020-07-08 23:59:59",0.1,2.1,0.716666666666667,0.0666666666666667,NA,0.0335195530726257,0.70391061452514,0.240223463687151,0.0223463687150838,0.000277777777777778,0.00583333333333333,0.00199074074074074,0.000185185185185185,0,NA,NA,NA,0,NA,NA,737899,5856.34126984127,3586.7682415516,65,11872,138265,3215.46511627907,1685.61227181609,344,5791
-"morning#2020-07-07 06:00:00,2020-07-07 11:59:59","morning","2020-07-07 06:00:00","2020-07-07 11:59:59",0.5,8.26666666666667,2.43333333333333,0.65,4,0.0421940928270042,0.69760900140647,0.205344585091421,0.0548523206751055,0.00138888888888889,0.022962962962963,0.00675925925925926,0.00180555555555556,4.58933332761129,1.14733333190282,0.42892803694051,0.749316664536794,1.66509999831518,392,656,3018217,6085.11491935484,3372.11073498322,13,11985,439819,3012.45890410959,1708.97915132947,18,5974
-"morning#2020-07-08 06:00:00,2020-07-08 11:59:59","morning","2020-07-08 06:00:00","2020-07-08 11:59:59",0.816666666666667,8.96666666666667,2.48333333333333,0.566666666666667,3,0.0636363636363636,0.698701298701299,0.193506493506494,0.0441558441558441,0.00226851851851852,0.0249074074074074,0.00689814814814815,0.00157407407407407,5.44793333212535,1.81597777737512,1.32280782143747,0.290083332856496,2.63854999939601,481,719,3328403,6186.62267657993,3507.24281146226,21,11986,484712,3253.10067114094,1731.83020181106,39,5972
-"night#2020-07-07 00:00:00,2020-07-07 05:59:59","night","2020-07-07 00:00:00","2020-07-07 05:59:59",0.7,10.3,2.85,0.816666666666667,2,0.0477272727272727,0.702272727272727,0.194318181818182,0.0556818181818182,0.00194444444444444,0.0286111111111111,0.00791666666666667,0.00226851851851852,10.764449997743,5.38222499887148,6.59618668464427,0.718016664187113,10.0464333335559,73,359,3825040,6189.38511326861,3543.18152922148,31,11976,499842,2923.05263157895,1743.75373754829,54,5982
-"night#2020-07-08 00:00:00,2020-07-08 05:59:59","night","2020-07-08 00:00:00","2020-07-08 05:59:59",1.08333333333333,15.7333333333333,3.71666666666667,1.3,3,0.049618320610687,0.720610687022901,0.170229007633588,0.0595419847328244,0.00300925925925926,0.0437037037037037,0.0103240740740741,0.00361111111111111,17.9418833335241,5.98062777784136,7.18578728163615,1.39351666768392,14.2620333313942,77,359,5533379,5861.63029661017,3459.01595983081,49,11981,714837,3205.54708520179,1752.09560659939,15,5983

tests/data/processed/features/periodic/per_and/phone_light.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_light_rapids_count","phone_light_rapids_maxlux","phone_light_rapids_minlux","phone_light_rapids_avglux","phone_light_rapids_medianlux","phone_light_rapids_stdlux"
-"afternoon#2020-07-04 12:00:00,2020-07-04 17:59:59","afternoon","2020-07-04 12:00:00","2020-07-04 17:59:59",4,97656,10351,55761.5,57519.5,44778.6855136831
-"daily#2020-07-04 00:00:00,2020-07-04 23:59:59","daily","2020-07-04 00:00:00","2020-07-04 23:59:59",12,114615,0.065,40207.8950833333,19836,44686.694225665
-"evening#2020-07-04 18:00:00,2020-07-04 23:59:59","evening","2020-07-04 18:00:00","2020-07-04 23:59:59",3,15258,84.156,5603.71866666667,1469,8389.47610244199
-"morning#2020-07-04 06:00:00,2020-07-04 11:59:59","morning","2020-07-04 06:00:00","2020-07-04 11:59:59",4,114615,472.52,60659.38,63775,51510.5823438666
-"night#2020-07-04 00:00:00,2020-07-04 05:59:59","night","2020-07-04 00:00:00","2020-07-04 05:59:59",1,0.065,0.065,0.065,0.065,NA

tests/data/processed/features/periodic/per_and/phone_messages.csv

@@ -1,9 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_messages_rapids_received_countmostfrequentcontact","phone_messages_rapids_received_count","phone_messages_rapids_received_distinctcontacts","phone_messages_rapids_received_timefirstmessage","phone_messages_rapids_received_timelastmessage","phone_messages_rapids_sent_countmostfrequentcontact","phone_messages_rapids_sent_count","phone_messages_rapids_sent_distinctcontacts","phone_messages_rapids_sent_timefirstmessage","phone_messages_rapids_sent_timelastmessage"
-"afternoon#2020-05-28 12:00:00,2020-05-28 17:59:59","afternoon","2020-05-28 12:00:00","2020-05-28 17:59:59",1,2,2,830,949,1,3,3,722,979
-"daily#2020-05-28 00:00:00,2020-05-28 23:59:59","daily","2020-05-28 00:00:00","2020-05-28 23:59:59",7,12,6,6,1382,3,8,6,219,1401
-"daily#2020-05-29 00:00:00,2020-05-29 23:59:59","daily","2020-05-29 00:00:00","2020-05-29 23:59:59",3,6,4,401,1382,1,4,4,388,1401
-"evening#2020-05-28 18:00:00,2020-05-28 23:59:59","evening","2020-05-28 18:00:00","2020-05-28 23:59:59",2,3,2,1173,1382,1,2,2,1218,1401
-"evening#2020-05-29 18:00:00,2020-05-29 23:59:59","evening","2020-05-29 18:00:00","2020-05-29 23:59:59",2,3,2,1173,1382,1,2,2,1218,1401
-"morning#2020-05-28 06:00:00,2020-05-28 11:59:59","morning","2020-05-28 06:00:00","2020-05-28 11:59:59",1,3,3,401,660,1,2,2,388,654
-"morning#2020-05-29 06:00:00,2020-05-29 11:59:59","morning","2020-05-29 06:00:00","2020-05-29 11:59:59",1,3,3,401,660,1,2,2,388,654
-"night#2020-05-28 00:00:00,2020-05-28 05:59:59","night","2020-05-28 00:00:00","2020-05-28 05:59:59",4,4,1,6,312,1,1,1,219,219

tests/data/processed/features/periodic/per_and/phone_screen.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_screen_rapids_countepisodeunlock","phone_screen_rapids_sumdurationunlock","phone_screen_rapids_maxdurationunlock","phone_screen_rapids_mindurationunlock","phone_screen_rapids_avgdurationunlock","phone_screen_rapids_stddurationunlock","phone_screen_rapids_firstuseafter00unlock"
-"afternoon#2020-06-01 12:00:00,2020-06-01 17:59:59","afternoon","2020-06-01 12:00:00","2020-06-01 17:59:59",3,30.1075666666667,12.5590333333333,8.54901666666667,10.0358555555556,2.19671507852149,720
-"daily#2020-06-01 00:00:00,2020-06-01 23:59:59","daily","2020-06-01 00:00:00","2020-06-01 23:59:59",7,94.6051166666667,21.6595333333333,5.99093333333333,13.5150166666667,6.19231359641098,170.5
-"evening#2020-06-01 18:00:00,2020-06-01 23:59:59","evening","2020-06-01 18:00:00","2020-06-01 23:59:59",2,27.4208833333333,18.9867666666667,8.43411666666667,13.7104416666667,7.46185037448822,1080
-"morning#2020-06-01 06:00:00,2020-06-01 11:59:59","morning","2020-06-01 06:00:00","2020-06-01 11:59:59",3,27.949,21.6595333333333,2.4361,9.31633333333333,10.7129874862762,360
-"night#2020-06-01 00:00:00,2020-06-01 05:59:59","night","2020-06-01 00:00:00","2020-06-01 05:59:59",2,9.12761666666667,5.99093333333333,3.13668333333333,4.56380833333333,2.0182595302017,170.5

tests/data/processed/features/periodic/per_and/phone_wifi_connected.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_connected_rapids_countscans","phone_wifi_connected_rapids_uniquedevices","phone_wifi_connected_rapids_countscansmostuniquedevice"
-"afternoon#2020-07-03 12:00:00,2020-07-03 17:59:59","afternoon","2020-07-03 12:00:00","2020-07-03 17:59:59",2,2,1
-"daily#2020-07-03 00:00:00,2020-07-03 23:59:59","daily","2020-07-03 00:00:00","2020-07-03 23:59:59",12,5,4
-"evening#2020-07-03 18:00:00,2020-07-03 23:59:59","evening","2020-07-03 18:00:00","2020-07-03 23:59:59",4,3,2
-"morning#2020-07-03 06:00:00,2020-07-03 11:59:59","morning","2020-07-03 06:00:00","2020-07-03 11:59:59",3,2,2
-"night#2020-07-03 00:00:00,2020-07-03 05:59:59","night","2020-07-03 00:00:00","2020-07-03 05:59:59",3,2,2

tests/data/processed/features/periodic/per_and/phone_wifi_visible.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_visible_rapids_countscans","phone_wifi_visible_rapids_uniquedevices","phone_wifi_visible_rapids_countscansmostuniquedevice"
-"afternoon#2020-07-03 12:00:00,2020-07-03 17:59:59","afternoon","2020-07-03 12:00:00","2020-07-03 17:59:59",2,2,1
-"daily#2020-07-03 00:00:00,2020-07-03 23:59:59","daily","2020-07-03 00:00:00","2020-07-03 23:59:59",14,5,6
-"evening#2020-07-03 18:00:00,2020-07-03 23:59:59","evening","2020-07-03 18:00:00","2020-07-03 23:59:59",3,3,1
-"morning#2020-07-03 06:00:00,2020-07-03 11:59:59","morning","2020-07-03 06:00:00","2020-07-03 11:59:59",4,3,2
-"night#2020-07-03 00:00:00,2020-07-03 05:59:59","night","2020-07-03 00:00:00","2020-07-03 05:59:59",5,4,2

tests/data/processed/features/periodic/per_emp/phone_applications_foreground.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","apps_rapids_timeoffirstuseall","apps_rapids_timeoflastuseall","apps_rapids_frequencyentropyall","apps_rapids_countall","apps_rapids_timeoffirstuseemail","apps_rapids_timeoflastuseemail","apps_rapids_frequencyentropyemail","apps_rapids_countemail","apps_rapids_timeoffirstuseentertainment","apps_rapids_timeoflastuseentertainment","apps_rapids_frequencyentropyentertainment","apps_rapids_countentertainment","apps_rapids_timeoffirstusesocial","apps_rapids_timeoflastusesocial","apps_rapids_frequencyentropysocial","apps_rapids_countsocial","apps_rapids_timeoffirstusetop1global","apps_rapids_timeoflastusetop1global","apps_rapids_frequencyentropytop1global","apps_rapids_counttop1global","apps_rapids_timeoffirstusecom.facebook.moments","apps_rapids_timeoflastusecom.facebook.moments","apps_rapids_frequencyentropycom.facebook.moments","apps_rapids_countcom.facebook.moments"

tests/data/processed/features/periodic/per_emp/phone_battery.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_sumdurationcharge","phone_battery_rapids_countcharge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_countdischarge","phone_battery_rapids_maxconsumptionrate"

tests/data/processed/features/periodic/per_emp/phone_bluetooth.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_bluetooth_rapids_countscans","phone_bluetooth_rapids_uniquedevices","phone_bluetooth_rapids_countscansmostuniquedevice"

tests/data/processed/features/periodic/per_emp/phone_calls.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_calls_rapids_missed_count","phone_calls_rapids_missed_distinctcontacts","phone_calls_rapids_missed_timefirstcall","phone_calls_rapids_missed_timelastcall","phone_calls_rapids_missed_countmostfrequentcontact","phone_calls_rapids_incoming_count","phone_calls_rapids_incoming_distinctcontacts","phone_calls_rapids_incoming_meanduration","phone_calls_rapids_incoming_sumduration","phone_calls_rapids_incoming_minduration","phone_calls_rapids_incoming_maxduration","phone_calls_rapids_incoming_stdduration","phone_calls_rapids_incoming_modeduration","phone_calls_rapids_incoming_entropyduration","phone_calls_rapids_incoming_timefirstcall","phone_calls_rapids_incoming_timelastcall","phone_calls_rapids_incoming_countmostfrequentcontact","phone_calls_rapids_outgoing_count","phone_calls_rapids_outgoing_distinctcontacts","phone_calls_rapids_outgoing_meanduration","phone_calls_rapids_outgoing_sumduration","phone_calls_rapids_outgoing_minduration","phone_calls_rapids_outgoing_maxduration","phone_calls_rapids_outgoing_stdduration","phone_calls_rapids_outgoing_modeduration","phone_calls_rapids_outgoing_entropyduration","phone_calls_rapids_outgoing_timefirstcall","phone_calls_rapids_outgoing_timelastcall","phone_calls_rapids_outgoing_countmostfrequentcontact"

tests/data/processed/features/periodic/per_emp/phone_conversation.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_conversation_rapids_minutessilence","phone_conversation_rapids_minutesnoise","phone_conversation_rapids_minutesvoice","phone_conversation_rapids_minutesunknown","phone_conversation_rapids_countconversation","phone_conversation_rapids_silencesensedfraction","phone_conversation_rapids_noisesensedfraction","phone_conversation_rapids_voicesensedfraction","phone_conversation_rapids_unknownsensedfraction","phone_conversation_rapids_silenceexpectedfraction","phone_conversation_rapids_noiseexpectedfraction","phone_conversation_rapids_voiceexpectedfraction","phone_conversation_rapids_unknownexpectedfraction","phone_conversation_rapids_sumconversationduration","phone_conversation_rapids_avgconversationduration","phone_conversation_rapids_sdconversationduration","phone_conversation_rapids_minconversationduration","phone_conversation_rapids_maxconversationduration","phone_conversation_rapids_timefirstconversation","phone_conversation_rapids_timelastconversation","phone_conversation_rapids_noisesumenergy","phone_conversation_rapids_noiseavgenergy","phone_conversation_rapids_noisesdenergy","phone_conversation_rapids_noiseminenergy","phone_conversation_rapids_noisemaxenergy","phone_conversation_rapids_voicesumenergy","phone_conversation_rapids_voiceavgenergy","phone_conversation_rapids_voicesdenergy","phone_conversation_rapids_voiceminenergy","phone_conversation_rapids_voicemaxenergy"

tests/data/processed/features/periodic/per_emp/phone_light.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_light_rapids_count","phone_light_rapids_maxlux","phone_light_rapids_minlux","phone_light_rapids_avglux","phone_light_rapids_medianlux","phone_light_rapids_stdlux"

tests/data/processed/features/periodic/per_emp/phone_messages.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_messages_rapids_received_countmostfrequentcontact","phone_messages_rapids_received_count","phone_messages_rapids_received_distinctcontacts","phone_messages_rapids_received_timefirstmessage","phone_messages_rapids_received_timelastmessage","phone_messages_rapids_sent_countmostfrequentcontact","phone_messages_rapids_sent_count","phone_messages_rapids_sent_distinctcontacts","phone_messages_rapids_sent_timefirstmessage","phone_messages_rapids_sent_timelastmessage"

tests/data/processed/features/periodic/per_emp/phone_screen.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_screen_rapids_mindurationunlock","phone_screen_rapids_stddurationunlock","phone_screen_rapids_countepisodeunlock","phone_screen_rapids_maxdurationunlock","phone_screen_rapids_avgdurationunlock","phone_screen_rapids_sumdurationunlock","phone_screen_rapids_firstuseafter00unlock"

tests/data/processed/features/periodic/per_emp/phone_wifi_connected.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_connected_rapids_countscans","phone_wifi_connected_rapids_uniquedevices","phone_wifi_connected_rapids_countscansmostuniquedevice"

tests/data/processed/features/periodic/per_emp/phone_wifi_visible.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_visible_rapids_countscans","phone_wifi_visible_rapids_uniquedevices","phone_wifi_visible_rapids_countscansmostuniquedevice"

tests/data/processed/features/periodic/per_ios/phone_applications_foreground.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","apps_rapids_timeoffirstuseall","apps_rapids_timeoflastuseall","apps_rapids_frequencyentropyall","apps_rapids_countall","apps_rapids_timeoffirstuseemail","apps_rapids_timeoflastuseemail","apps_rapids_frequencyentropyemail","apps_rapids_countemail","apps_rapids_timeoffirstuseentertainment","apps_rapids_timeoflastuseentertainment","apps_rapids_frequencyentropyentertainment","apps_rapids_countentertainment","apps_rapids_timeoffirstusesocial","apps_rapids_timeoflastusesocial","apps_rapids_frequencyentropysocial","apps_rapids_countsocial","apps_rapids_timeoffirstusetop1global","apps_rapids_timeoflastusetop1global","apps_rapids_frequencyentropytop1global","apps_rapids_counttop1global","apps_rapids_timeoffirstusecom.facebook.moments","apps_rapids_timeoflastusecom.facebook.moments","apps_rapids_frequencyentropycom.facebook.moments","apps_rapids_countcom.facebook.moments"

tests/data/processed/features/periodic/per_ios/phone_battery.csv

@@ -1,28 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_battery_rapids_countdischarge","phone_battery_rapids_sumdurationdischarge","phone_battery_rapids_avgconsumptionrate","phone_battery_rapids_maxconsumptionrate","phone_battery_rapids_countcharge","phone_battery_rapids_sumdurationcharge"
-"afternoon#2020-07-01 12:00:00,2020-07-01 17:59:59","afternoon","2020-07-01 12:00:00","2020-07-01 17:59:59",2,42.1548666666667,0.165910502035002,0.253301361072647,2,79.4708833333333
-"daily#2020-07-01 00:00:00,2020-07-01 23:59:59","daily","2020-07-01 00:00:00","2020-07-01 23:59:59",7,237.018466666667,0.130692687348499,0.454125732277743,5,199.701516666667
-"daily#2020-07-02 00:00:00,2020-07-02 23:59:59","daily","2020-07-02 00:00:00","2020-07-02 23:59:59",2,39.9993166666667,0.146926011409736,0.237981913374584,0,0
-"daily#2020-07-03 00:00:00,2020-07-03 23:59:59","daily","2020-07-03 00:00:00","2020-07-03 23:59:59",2,52.7136833333333,0.0638377410315164,0.0774207534071583,0,0
-"daily#2020-07-04 00:00:00,2020-07-04 23:59:59","daily","2020-07-04 00:00:00","2020-07-04 23:59:59",2,57.0823666666667,0.0763541574430664,0.111113168762384,0,0
-"daily#2020-07-05 00:00:00,2020-07-05 23:59:59","daily","2020-07-05 00:00:00","2020-07-05 23:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"evening#2020-07-01 18:00:00,2020-07-01 23:59:59","evening","2020-07-01 18:00:00","2020-07-01 23:59:59",3,77.33265,0.195705802039367,0.454125732277743,1,37.5236666666667
-"evening#2020-07-02 18:00:00,2020-07-02 23:59:59","evening","2020-07-02 18:00:00","2020-07-02 23:59:59",1,4.202,0.237981913374584,0.237981913374584,0,0
-"evening#2020-07-03 18:00:00,2020-07-03 23:59:59","evening","2020-07-03 18:00:00","2020-07-03 23:59:59",1,12.9164333333333,0.0774207534071583,0.0774207534071583,0,0
-"evening#2020-07-04 18:00:00,2020-07-04 23:59:59","evening","2020-07-04 18:00:00","2020-07-04 23:59:59",1,8.99983333333333,0.111113168762384,0.111113168762384,0,0
-"morning#2020-07-01 06:00:00,2020-07-01 11:59:59","morning","2020-07-01 06:00:00","2020-07-01 11:59:59",2,75.56395,0.065515964597609,0.0731286084397727,2,42.61665
-"night#2020-07-01 00:00:00,2020-07-01 05:59:59","night","2020-07-01 00:00:00","2020-07-01 05:59:59",2,41.9669666666667,0.23817390645112,0.400338953647421,1,40.0903
-"night#2020-07-02 00:00:00,2020-07-02 05:59:59","night","2020-07-02 00:00:00","2020-07-02 05:59:59",1,35.7973166666667,0.0558701094448886,0.0558701094448886,0,0
-"night#2020-07-03 00:00:00,2020-07-03 05:59:59","night","2020-07-03 00:00:00","2020-07-03 05:59:59",1,39.79725,0.0502547286558745,0.0502547286558745,0,0
-"night#2020-07-04 00:00:00,2020-07-04 05:59:59","night","2020-07-04 00:00:00","2020-07-04 05:59:59",1,48.0825333333333,0.0415951461237483,0.0415951461237483,0,0
-"night#2020-07-05 00:00:00,2020-07-05 05:59:59","night","2020-07-05 00:00:00","2020-07-05 05:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"threeday#2020-07-01 00:00:00,2020-07-03 23:59:59","threeday","2020-07-01 00:00:00","2020-07-03 23:59:59",9,329.7315,0.0761417190406398,0.0809973837845038,5,199.701516666667
-"threeday#2020-07-02 00:00:00,2020-07-04 23:59:59","threeday","2020-07-02 00:00:00","2020-07-04 23:59:59",4,149.7954,0.0710868450815781,0.111113168762384,0,0
-"threeday#2020-07-03 00:00:00,2020-07-05 23:59:59","threeday","2020-07-03 00:00:00","2020-07-05 23:59:59",3,162.7952,0.0492745931499224,0.0502547286558745,0,0
-"threeday#2020-07-04 00:00:00,2020-07-06 23:59:59","threeday","2020-07-04 00:00:00","2020-07-06 23:59:59",2,110.0815,0.0449915246814979,0.0483879032392475,0,0
-"threeday#2020-07-05 00:00:00,2020-07-07 23:59:59","threeday","2020-07-05 00:00:00","2020-07-07 23:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"two_weeks_overlapping#2020-07-01 00:00:00,2020-07-14 23:59:59","two_weeks_overlapping","2020-07-01 00:00:00","2020-07-14 23:59:59",10,439.813016666667,0.0705423768752492,0.0809973837845038,5,199.701516666667
-"two_weeks_overlapping#2020-07-02 00:00:00,2020-07-15 23:59:59","two_weeks_overlapping","2020-07-02 00:00:00","2020-07-15 23:59:59",4,202.794533333333,0.0554055287007939,0.0681829545643943,0,0
-"two_weeks_overlapping#2020-07-03 00:00:00,2020-07-16 23:59:59","two_weeks_overlapping","2020-07-03 00:00:00","2020-07-16 23:59:59",3,162.7952,0.0492745931499224,0.0502547286558745,0,0
-"two_weeks_overlapping#2020-07-04 00:00:00,2020-07-17 23:59:59","two_weeks_overlapping","2020-07-04 00:00:00","2020-07-17 23:59:59",2,110.0815,0.0449915246814979,0.0483879032392475,0,0
-"two_weeks_overlapping#2020-07-05 00:00:00,2020-07-18 23:59:59","two_weeks_overlapping","2020-07-05 00:00:00","2020-07-18 23:59:59",1,52.9991166666667,0.0377364779979038,0.0377364779979038,0,0
-"weekends#2020-07-03 00:00:00,2020-07-05 23:59:59","weekends","2020-07-03 00:00:00","2020-07-05 23:59:59",3,162.7952,0.0492745931499224,0.0502547286558745,0,0

tests/data/processed/features/periodic/per_ios/phone_bluetooth.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_bluetooth_rapids_countscans","phone_bluetooth_rapids_uniquedevices","phone_bluetooth_rapids_countscansmostuniquedevice"
-"afternoon#2020-07-02 12:00:00,2020-07-02 17:59:59","afternoon","2020-07-02 12:00:00","2020-07-02 17:59:59",2,2,1
-"daily#2020-07-02 00:00:00,2020-07-02 23:59:59","daily","2020-07-02 00:00:00","2020-07-02 23:59:59",14,5,5
-"evening#2020-07-02 18:00:00,2020-07-02 23:59:59","evening","2020-07-02 18:00:00","2020-07-02 23:59:59",5,3,3
-"morning#2020-07-02 06:00:00,2020-07-02 11:59:59","morning","2020-07-02 06:00:00","2020-07-02 11:59:59",3,3,1
-"night#2020-07-02 00:00:00,2020-07-02 05:59:59","night","2020-07-02 00:00:00","2020-07-02 05:59:59",4,2,2

tests/data/processed/features/periodic/per_ios/phone_calls.csv

@@ -1,9 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_calls_rapids_missed_count","phone_calls_rapids_missed_distinctcontacts","phone_calls_rapids_missed_timefirstcall","phone_calls_rapids_missed_timelastcall","phone_calls_rapids_missed_countmostfrequentcontact","phone_calls_rapids_incoming_count","phone_calls_rapids_incoming_distinctcontacts","phone_calls_rapids_incoming_meanduration","phone_calls_rapids_incoming_sumduration","phone_calls_rapids_incoming_minduration","phone_calls_rapids_incoming_maxduration","phone_calls_rapids_incoming_stdduration","phone_calls_rapids_incoming_modeduration","phone_calls_rapids_incoming_entropyduration","phone_calls_rapids_incoming_timefirstcall","phone_calls_rapids_incoming_timelastcall","phone_calls_rapids_incoming_countmostfrequentcontact","phone_calls_rapids_outgoing_count","phone_calls_rapids_outgoing_distinctcontacts","phone_calls_rapids_outgoing_meanduration","phone_calls_rapids_outgoing_sumduration","phone_calls_rapids_outgoing_minduration","phone_calls_rapids_outgoing_maxduration","phone_calls_rapids_outgoing_stdduration","phone_calls_rapids_outgoing_modeduration","phone_calls_rapids_outgoing_entropyduration","phone_calls_rapids_outgoing_timefirstcall","phone_calls_rapids_outgoing_timelastcall","phone_calls_rapids_outgoing_countmostfrequentcontact"
-"afternoon#2020-06-01 12:00:00,2020-06-01 17:59:59","afternoon","2020-06-01 12:00:00","2020-06-01 17:59:59",0,0,NA,NA,0,3,3,629.333333333333,1888,198,1040,421.38027164704,1040,0.932593293857646,753,921,1,3,3,816.333333333333,2449,0,1279,709.062996731132,1279,0.692360538889388,869,1051,1
-"daily#2020-06-01 00:00:00,2020-06-01 23:59:59","daily","2020-06-01 00:00:00","2020-06-01 23:59:59",3,3,13,1167,1,10,10,961.4,9614,198,1700,464.326800624062,420,2.18431625877259,163,1331,1,11,11,837.909090909091,9217,0,1530,577.720772440364,0,2.0585997872903,57,1277,1
-"daily#2020-06-02 00:00:00,2020-06-02 23:59:59","daily","2020-06-02 00:00:00","2020-06-02 23:59:59",1,1,589,589,0,5,5,1202,6010,660,1710,375.326524508993,660,1.56885323664414,519,1331,0,6,6,973.333333333333,5840,0,1530,551.313582878807,1100,1.58092421564451,418,1277,0
-"evening#2020-06-01 18:00:00,2020-06-01 23:59:59","evening","2020-06-01 18:00:00","2020-06-01 23:59:59",1,1,1167,1167,1,3,3,1350,4050,1140,1700,305.122926047847,1140,1.08239814505043,1144,1331,1,2,2,1465,2930,1400,1530,91.9238815542512,1400,0.692333219466401,1156,1277,1
-"evening#2020-06-02 18:00:00,2020-06-02 23:59:59","evening","2020-06-02 18:00:00","2020-06-02 23:59:59",0,0,NA,NA,0,3,3,1353.33333333333,4060,1140,1710,310.859024854247,1140,1.08186609729599,1144,1331,0,3,3,980,2940,0,1530,850.823130856232,1410,0.692484030888463,1156,1277,0
-"morning#2020-06-01 06:00:00,2020-06-01 11:59:59","morning","2020-06-01 06:00:00","2020-06-01 11:59:59",1,1,589,589,1,2,2,968,1936,657,1279,439.820417898033,657,0.640867990789142,519,600,1,3,3,959.333333333333,2878,742,1096,190.287501779106,1096,1.08529592058152,418,687,1
-"morning#2020-06-02 06:00:00,2020-06-02 11:59:59","morning","2020-06-02 06:00:00","2020-06-02 11:59:59",1,1,589,589,0,2,2,975,1950,660,1290,445.477272147525,660,0.640266157864261,519,600,0,3,3,966.666666666667,2900,750,1100,189.296944860009,1100,1.08563855912214,418,687,0
-"night#2020-06-01 00:00:00,2020-06-01 05:59:59","night","2020-06-01 00:00:00","2020-06-01 05:59:59",1,1,13,13,1,2,2,870,1740,420,1320,636.396103067893,420,0.552951978816239,163,257,1,3,3,320,960,0,960,554.256258422041,0,0,57,257,1

tests/data/processed/features/periodic/per_ios/phone_conversation.csv

@@ -1,11 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_conversation_rapids_minutessilence","phone_conversation_rapids_minutesnoise","phone_conversation_rapids_minutesvoice","phone_conversation_rapids_minutesunknown","phone_conversation_rapids_countconversation","phone_conversation_rapids_silencesensedfraction","phone_conversation_rapids_noisesensedfraction","phone_conversation_rapids_voicesensedfraction","phone_conversation_rapids_unknownsensedfraction","phone_conversation_rapids_silenceexpectedfraction","phone_conversation_rapids_noiseexpectedfraction","phone_conversation_rapids_voiceexpectedfraction","phone_conversation_rapids_unknownexpectedfraction","phone_conversation_rapids_sumconversationduration","phone_conversation_rapids_avgconversationduration","phone_conversation_rapids_sdconversationduration","phone_conversation_rapids_minconversationduration","phone_conversation_rapids_maxconversationduration","phone_conversation_rapids_timefirstconversation","phone_conversation_rapids_timelastconversation","phone_conversation_rapids_noisesumenergy","phone_conversation_rapids_noiseavgenergy","phone_conversation_rapids_noisesdenergy","phone_conversation_rapids_noiseminenergy","phone_conversation_rapids_noisemaxenergy","phone_conversation_rapids_voicesumenergy","phone_conversation_rapids_voiceavgenergy","phone_conversation_rapids_voicesdenergy","phone_conversation_rapids_voiceminenergy","phone_conversation_rapids_voicemaxenergy"
-"afternoon#2020-07-07 12:00:00,2020-07-07 17:59:59","afternoon","2020-07-07 12:00:00","2020-07-07 17:59:59",2.13333333333333,27.4166666666667,8.26666666666667,1.8,5,0.0538493899873791,0.692048801009676,0.208666386201094,0.0454354228018511,0.00592592592592593,0.0761574074074074,0.022962962962963,0.005,12.4166666666667,2.48333333333333,0.870105357605235,1.78333333333333,3.96666666666667,733,1038,9942436,6044.03404255319,3481.15148889292,15,11997,1506807,3037.91733870968,1754.92051540106,5,5998
-"afternoon#2020-07-08 12:00:00,2020-07-08 17:59:59","afternoon","2020-07-08 12:00:00","2020-07-08 17:59:59",0.65,8.88333333333333,2.43333333333333,0.616666666666667,3,0.0516556291390728,0.705960264900662,0.193377483443709,0.0490066225165563,0.00180555555555556,0.0246759259259259,0.00675925925925926,0.00171296296296296,10.95,3.65,2.85866130285566,0.35,5.36666666666667,725,1079,3300159,6191.66791744841,3457.36750549971,32,11994,434210,2974.04109589041,1728.00992524573,26,5965
-"daily#2020-07-07 00:00:00,2020-07-07 23:59:59","daily","2020-07-07 00:00:00","2020-07-07 23:59:59",3.7,50.6333333333333,15.0666666666667,3.68333333333333,14,0.0506271379703535,0.692816419612315,0.206157354618016,0.0503990877993159,0.0102777777777778,0.140648148148148,0.0418518518518518,0.0102314814814815,32.6666666666667,2.33333333333333,2.37545317313934,0.716666666666667,10.05,73,1436,18439355,6069.57044107966,3468.92936877742,13,11997,2734745,3025.16039823009,1740.00534289166,5,5998
-"daily#2020-07-08 00:00:00,2020-07-08 23:59:59","daily","2020-07-08 00:00:00","2020-07-08 23:59:59",2.65,35.6833333333333,9.35,2.55,10,0.0527538155275382,0.710351692103517,0.186131386861314,0.0507631055076311,0.00736111111111111,0.0991203703703704,0.0259722222222222,0.00708333333333333,35.95,3.595,4.13312462137333,0.283333333333333,14.2666666666667,77,1198,12899840,6025.14712751051,3479.79867896124,21,11994,1772024,3158.688057041,1734.43700437943,15,5983
-"evening#2020-07-07 18:00:00,2020-07-07 23:59:59","evening","2020-07-07 18:00:00","2020-07-07 23:59:59",0.366666666666667,4.65,1.51666666666667,0.416666666666667,3,0.052757793764988,0.669064748201439,0.218225419664269,0.0599520383693046,0.00101851851851852,0.0129166666666667,0.00421296296296296,0.00115740740740741,4.88333333333333,1.62777777777778,0.452564707875918,1.35,2.15,1204,1436,1653662,5927.10394265233,3410.01360257296,117,11997,288277,3167.87912087912,1716.97773773935,116,5961
-"evening#2020-07-08 18:00:00,2020-07-08 23:59:59","evening","2020-07-08 18:00:00","2020-07-08 23:59:59",0.1,2.1,0.716666666666667,0.0666666666666667,1,0.0335195530726257,0.70391061452514,0.240223463687151,0.0223463687150838,0.000277777777777778,0.00583333333333333,0.00199074074074074,0.000185185185185185,1.61666666666667,1.61666666666667,NA,1.61666666666667,1.61666666666667,1198,1198,737899,5856.34126984127,3586.7682415516,65,11872,138265,3215.46511627907,1685.61227181609,344,5791
-"morning#2020-07-07 06:00:00,2020-07-07 11:59:59","morning","2020-07-07 06:00:00","2020-07-07 11:59:59",0.5,8.26666666666667,2.43333333333333,0.65,4,0.0421940928270042,0.69760900140647,0.205344585091421,0.0548523206751055,0.00138888888888889,0.022962962962963,0.00675925925925926,0.00180555555555556,4.6,1.15,0.4283906144146,0.75,1.66666666666667,392,656,3018217,6085.11491935484,3372.11073498322,13,11985,439819,3012.45890410959,1708.97915132947,18,5974
-"morning#2020-07-08 06:00:00,2020-07-08 11:59:59","morning","2020-07-08 06:00:00","2020-07-08 11:59:59",0.816666666666667,8.96666666666667,2.48333333333333,0.566666666666667,3,0.0636363636363636,0.698701298701299,0.193506493506494,0.0441558441558441,0.00226851851851852,0.0249074074074074,0.00689814814814815,0.00157407407407407,5.43333333333333,1.81111111111111,1.32437965911648,0.283333333333333,2.63333333333333,481,719,3328403,6186.62267657993,3507.24281146226,21,11986,484712,3253.10067114094,1731.83020181106,39,5972
-"night#2020-07-07 00:00:00,2020-07-07 05:59:59","night","2020-07-07 00:00:00","2020-07-07 05:59:59",0.7,10.3,2.85,0.816666666666667,2,0.0477272727272727,0.702272727272727,0.194318181818182,0.0556818181818182,0.00194444444444444,0.0286111111111111,0.00791666666666667,0.00226851851851852,10.7666666666667,5.38333333333333,6.59966329107444,0.716666666666667,10.05,73,359,3825040,6189.38511326861,3543.18152922148,31,11976,499842,2923.05263157895,1743.75373754829,54,5982
-"night#2020-07-08 00:00:00,2020-07-08 05:59:59","night","2020-07-08 00:00:00","2020-07-08 05:59:59",1.08333333333333,15.7333333333333,3.71666666666667,1.3,3,0.049618320610687,0.720610687022901,0.170229007633588,0.0595419847328244,0.00300925925925926,0.0437037037037037,0.0103240740740741,0.00361111111111111,17.95,5.98333333333333,7.18716062000689,1.4,14.2666666666667,77,359,5533379,5861.63029661017,3459.01595983081,49,11981,714837,3205.54708520179,1752.09560659939,15,5983

tests/data/processed/features/periodic/per_ios/phone_light.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_light_rapids_count","phone_light_rapids_maxlux","phone_light_rapids_minlux","phone_light_rapids_avglux","phone_light_rapids_medianlux","phone_light_rapids_stdlux"

tests/data/processed/features/periodic/per_ios/phone_messages.csv

@@ -1,9 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_messages_rapids_received_countmostfrequentcontact","phone_messages_rapids_received_count","phone_messages_rapids_received_distinctcontacts","phone_messages_rapids_received_timefirstmessage","phone_messages_rapids_received_timelastmessage","phone_messages_rapids_sent_countmostfrequentcontact","phone_messages_rapids_sent_count","phone_messages_rapids_sent_distinctcontacts","phone_messages_rapids_sent_timefirstmessage","phone_messages_rapids_sent_timelastmessage"
-"afternoon#2020-05-28 12:00:00,2020-05-28 17:59:59","afternoon","2020-05-28 12:00:00","2020-05-28 17:59:59",1,2,2,830,949,1,3,3,722,979
-"daily#2020-05-28 00:00:00,2020-05-28 23:59:59","daily","2020-05-28 00:00:00","2020-05-28 23:59:59",1,12,12,6,1382,1,8,8,219,1401
-"daily#2020-05-29 00:00:00,2020-05-29 23:59:59","daily","2020-05-29 00:00:00","2020-05-29 23:59:59",0,6,6,401,1382,0,4,4,388,1401
-"evening#2020-05-28 18:00:00,2020-05-28 23:59:59","evening","2020-05-28 18:00:00","2020-05-28 23:59:59",1,3,3,1173,1382,1,2,2,1218,1401
-"evening#2020-05-29 18:00:00,2020-05-29 23:59:59","evening","2020-05-29 18:00:00","2020-05-29 23:59:59",0,3,3,1173,1382,0,2,2,1218,1401
-"morning#2020-05-28 06:00:00,2020-05-28 11:59:59","morning","2020-05-28 06:00:00","2020-05-28 11:59:59",1,3,3,401,660,1,2,2,388,654
-"morning#2020-05-29 06:00:00,2020-05-29 11:59:59","morning","2020-05-29 06:00:00","2020-05-29 11:59:59",0,3,3,401,660,0,2,2,388,654
-"night#2020-05-28 00:00:00,2020-05-28 05:59:59","night","2020-05-28 00:00:00","2020-05-28 05:59:59",1,4,4,6,312,1,1,1,219,219

tests/data/processed/features/periodic/per_ios/phone_screen.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_screen_rapids_countepisodeunlock","phone_screen_rapids_sumdurationunlock","phone_screen_rapids_maxdurationunlock","phone_screen_rapids_mindurationunlock","phone_screen_rapids_avgdurationunlock","phone_screen_rapids_stddurationunlock","phone_screen_rapids_firstuseafter00unlock"
-"afternoon#2020-06-01 12:00:00,2020-06-01 17:59:59","afternoon","2020-06-01 12:00:00","2020-06-01 17:59:59",3,30.12165,12.5656833333333,8.54901666666667,10.04055,2.19878364051077,720
-"daily#2020-06-01 00:00:00,2020-06-01 23:59:59","daily","2020-06-01 00:00:00","2020-06-01 23:59:59",7,94.6513,21.6595333333333,6.00135,13.5216142857143,6.18978625297673,170.5
-"evening#2020-06-01 18:00:00,2020-06-01 23:59:59","evening","2020-06-01 18:00:00","2020-06-01 23:59:59",2,27.4343333333333,18.9943833333333,8.43995,13.7171666666667,7.46311138158133,1080
-"morning#2020-06-01 06:00:00,2020-06-01 11:59:59","morning","2020-06-01 06:00:00","2020-06-01 11:59:59",3,27.9572333333333,21.6595333333333,2.4361,9.31907777777778,10.7108890878153,360
-"night#2020-06-01 00:00:00,2020-06-01 05:59:59","night","2020-06-01 00:00:00","2020-06-01 05:59:59",2,9.13803333333333,6.00135,3.13668333333333,4.56901666666667,2.02562522583906,170.5

tests/data/processed/features/periodic/per_ios/phone_wifi_connected.csv

@@ -1,6 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_connected_rapids_countscans","phone_wifi_connected_rapids_uniquedevices","phone_wifi_connected_rapids_countscansmostuniquedevice"
-"afternoon#2020-07-03 12:00:00,2020-07-03 17:59:59","afternoon","2020-07-03 12:00:00","2020-07-03 17:59:59",2,2,1
-"daily#2020-07-03 00:00:00,2020-07-03 23:59:59","daily","2020-07-03 00:00:00","2020-07-03 23:59:59",14,5,4
-"evening#2020-07-03 18:00:00,2020-07-03 23:59:59","evening","2020-07-03 18:00:00","2020-07-03 23:59:59",5,4,2
-"morning#2020-07-03 06:00:00,2020-07-03 11:59:59","morning","2020-07-03 06:00:00","2020-07-03 11:59:59",3,2,2
-"night#2020-07-03 00:00:00,2020-07-03 05:59:59","night","2020-07-03 00:00:00","2020-07-03 05:59:59",4,4,1

tests/data/processed/features/periodic/per_ios/phone_wifi_visible.csv

@@ -1 +0,0 @@
-"local_segment","local_segment_label","local_segment_start_datetime","local_segment_end_datetime","phone_wifi_visible_rapids_countscans","phone_wifi_visible_rapids_uniquedevices","phone_wifi_visible_rapids_countscansmostuniquedevice"

tests/scripts/assign_test_timestamps.py

@@ -0,0 +1,48 @@
+import numpy as np
+import pandas as pd
+import argparse, glob
+
+DayOfWeek2Date = {"Fri": ["2020-03-06", "2020-10-30"],
+                  "Sat": ["2020-03-07", "2020-10-31"],
+                  "Sun": ["2020-03-08", "2020-11-01"],
+                  "Mon": ["2020-03-09", "2020-11-02"]}
+
+def assign_test_timestamps(file_path):
+    data = pd.read_csv(file_path)
+    data[["day_of_week","time"]] = data["test_time"].str.split(pat=" ", n=1, expand=True)
+
+    data_with_timestamps = pd.DataFrame()
+
+    # 0 is for March and 1 is for Nov
+    for i in [0, 1]:
+        data["datetime"] = pd.to_datetime(data.apply(lambda row: DayOfWeek2Date[row["day_of_week"]][i] + " " + row["time"], axis=1))
+        data_with_timestamps = pd.concat([data_with_timestamps, data], axis=0)
+
+    # Convert datetime with timezone to timestamp
+    data_with_timestamps.insert(0, "timestamp", data_with_timestamps["datetime"].dt.tz_localize(tz="America/New_York").astype(np.int64) // 10**6)
+
+    # Discard useless columns
+    for col in ["test_time", "day_of_week", "time", "datetime"]:
+        del data_with_timestamps[col]
+    
+    return data_with_timestamps
+
+
+
+parser = argparse.ArgumentParser()
+parser.add_argument("-f", "--files", nargs="+", help="Assign timestamps to the selected files, it could be a single file name or multiple file names separated by whitespace(s) (e.g. phone_battery_raw.csv)")
+parser.add_argument("-a", "--all", action="store_true", help="Assign timestamps to all files under the tests/data/manual/aware_csv folder")
+
+args = parser.parse_args()
+if args.all:
+    for file_path in glob.glob("tests/data/manual/aware_csv/*"):
+        data_with_timestamps = assign_test_timestamps(file_path)
+        data_with_timestamps.to_csv(file_path.replace("manual", "external"), index=False)
+        print(file_path + " was processed.")
+
+if args.files:
+    for file_name in args.files:
+        file_path = "tests/data/manual/aware_csv/" + file_name
+        data_with_timestamps = assign_test_timestamps(file_path)
+        data_with_timestamps.to_csv(file_path.replace("manual", "external"), index=False)
+        print(file_path + " was processed.")

tests/scripts/run_tests.py

@@ -15,7 +15,7 @@ class RapidsTests(unittest.TestCase):
     # actual files for each sensor listed in the config file. Added for Travis.
 
     # Initialize string of file path for both expected and actual metric values
-        segment = self.configs['TIME_SEGMENTS']['TYPE'].lower()
+        segment = 'stz_' + self.configs['TIME_SEGMENTS']['TYPE'].lower() if self.configs['TIMEZONE']['TYPE'] == 'SINGLE' else 'mtz_' + self.configs['TIME_SEGMENTS']['TYPE'].lower()
         act_str = "data/processed/features/{pid}/{sensor_key}.csv"
         exp_str = "tests/data/processed/features/"+segment+"/{pid}/{sensor_key}.csv"
 
@@ -60,42 +60,72 @@ class RapidsTests(unittest.TestCase):
                 pd.testing.assert_frame_equal(df_exp, df_act, obj=df_exp)
 
 
-class TestFrequency(RapidsTests):
+class TestStzFrequency(RapidsTests):
     @classmethod
     def setUpClass(cls):
         # Runs once to Setup env
         # global configs 
-        with open(r'tests/settings/frequency_config.yaml') as file:
+        with open(r'tests/settings/stz_frequency_config.yaml') as file:
+            cls.configs = yaml.full_load(file)
+
+class TestMtzFrequency(RapidsTests):
+    @classmethod
+    def setUpClass(cls):
+        # Runs once to Setup env
+        # global configs 
+        with open(r'tests/settings/mtz_frequency_config.yaml') as file:
             cls.configs = yaml.full_load(file)
 
 
-class TestPeriodic(RapidsTests):
+class TestStzPeriodic(RapidsTests):
     @classmethod
     def setUpClass(cls):
         # Runs once to Setup env
         # global configs 
-        with open(r'tests/settings/periodic_config.yaml') as file:
+        with open(r'tests/settings/stz_periodic_config.yaml') as file:
             cls.configs = yaml.full_load(file)
 
-class TestEvent(RapidsTests):
+class TestMtzPeriodic(RapidsTests):
     @classmethod
     def setUpClass(cls):
         # Runs once to Setup env
         # global configs 
-        with open(r'tests/settings/event_config.yaml') as file:
+        with open(r'tests/settings/mtz_periodic_config.yaml') as file:
+            cls.configs = yaml.full_load(file)
+
+class TestStzEvent(RapidsTests):
+    @classmethod
+    def setUpClass(cls):
+        # Runs once to Setup env
+        # global configs 
+        with open(r'tests/settings/stz_event_config.yaml') as file:
+            cls.configs = yaml.full_load(file)
+
+class TestMtzEvent(RapidsTests):
+    @classmethod
+    def setUpClass(cls):
+        # Runs once to Setup env
+        # global configs 
+        with open(r'tests/settings/mtz_event_config.yaml') as file:
             cls.configs = yaml.full_load(file)
 
 
 def run_some_tests(test_type):
     # Run only the tests in the specified classes
-    if test_type == "frequency":
-        test_class = TestFrequency
-    elif test_type == "periodic":
-        test_class = TestPeriodic
-    elif test_type == "event":
-        test_class = TestEvent
+    if test_type == "stz_frequency":
+        test_class = TestStzFrequency
+    elif test_type == "mtz_frequency":
+        test_class = TestMtzFrequency
+    elif test_type == "stz_periodic":
+        test_class = TestStzPeriodic
+    elif test_type == "mtz_periodic":
+        test_class = TestMtzPeriodic
+    elif test_type == "stz_event":
+        test_class = TestStzEvent
+    elif test_type == "mtz_event":
+        test_class = TestMtzEvent
     else:
-        raise ValueError("Only frequency, periodic, and event are valid arguments")
+        raise ValueError("Only stz_frequency, mtz_frequency, stz_periodic, mtz_periodic, stz_event, and mtz_event are valid arguments")
     loader = unittest.TestLoader()
 
     suite = loader.loadTestsFromTestCase(test_class)

tests/scripts/run_tests.sh

@@ -1,14 +1,23 @@
 #!/bin/bash
 
 run_pipeline() {
-    if [ "$TYPE" == 'frequency' ]
+    if [ "$TYPE" == 'stz_frequency' ]
     then
-        CONFIG_FILE="./tests/settings/frequency_config.yaml"
-    elif [ "$TYPE" == 'event' ]
+        CONFIG_FILE="./tests/settings/stz_frequency_config.yaml"
+    elif [ "$TYPE" == 'mtz_frequency' ]
+    then
+        CONFIG_FILE="./tests/settings/mtz_frequency_config.yaml"
+    elif [ "$TYPE" == 'stz_event' ]
     then 
-        CONFIG_FILE="./tests/settings/event_config.yaml"
+        CONFIG_FILE="./tests/settings/stz_event_config.yaml"
+    elif [ "$TYPE" == 'mtz_event' ]
+    then
+        CONFIG_FILE="./tests/settings/mtz_event_config.yaml"
+    elif [ "$TYPE" == 'stz_periodic' ]
+    then
+        CONFIG_FILE="./tests/settings/stz_periodic_config.yaml"
     else
-        CONFIG_FILE="./tests/settings/periodic_config.yaml"
+        CONFIG_FILE="./tests/settings/mtz_periodic_config.yaml"
     fi
 
     echo "Copying participant files"
@@ -24,7 +33,7 @@ run_pipeline() {
 }
 
 display_usage() {
-    echo "Usage: run_test.sh [-t|--type] [periodic | frequency | event] [-a|--action] [ all | run | both]"
+    echo "Usage: run_test.sh [-t|--type] [all | stz_periodic | mtz_periodic | stz_frequency | mtz_frequency | stz_event | mtz_event] [-a|--action] [test | run | both]"
     exit 1
 }
 
@@ -53,22 +62,31 @@ done
 
 if { [ "$TYPE" == 'all' ]; }
 then
-    TYPE="frequency"
+    TYPE="stz_frequency"
     run_pipeline
-    python tests/scripts/run_tests.py frequency
-    TYPE="periodic"
+    python tests/scripts/run_tests.py stz_frequency
+    TYPE="mtz_frequency"
     run_pipeline
-    python tests/scripts/run_tests.py periodic
-    TYPE="event"
+    python tests/scripts/run_tests.py mtz_frequency
+    TYPE="stz_periodic"
     run_pipeline
-    python tests/scripts/run_tests.py event
+    python tests/scripts/run_tests.py stz_periodic
+    TYPE="mtz_periodic"
+    run_pipeline
+    python tests/scripts/run_tests.py mtz_periodic
+    TYPE="stz_event"
+    run_pipeline
+    python tests/scripts/run_tests.py stz_event
+    TYPE="mtz_event"
+    run_pipeline
+    python tests/scripts/run_tests.py mtz_event
 else
     if { [ "$ACTION" != 'test' ] && [ "$ACTION" != 'run' ] && [ "$ACTION" != 'both' ]; }
     then
         display_usage
     fi
 
-    if { [ "$TYPE" != 'frequency' ] && [ "$TYPE" != 'periodic' ] && [ "$TYPE" != 'event' ]; }
+    if { [ "$TYPE" != 'stz_frequency' ] && [ "$TYPE" != 'mtz_frequency' ] && [ "$TYPE" != 'stz_periodic' ] && [ "$TYPE" != 'mtz_periodic' ] && [ "$TYPE" != 'stz_event' ] && [ "$TYPE" != 'mtz_event' ]; }
     then
         display_usage
     fi

tests/settings/mtz_event_config.yaml

@@ -0,0 +1,543 @@
+########################################################################################################################
+#                                              GLOBAL CONFIGURATION                                                    #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#participant-files
+PIDS: [android, ios, fitbit, empatica, empty]
+
+# See https://www.rapids.science/latest/setup/configuration/#automatic-creation-of-participant-files
+CREATE_PARTICIPANT_FILES:
+  CSV_FILE_PATH: "data/external/example_participants.csv" # see docs for required format
+  PHONE_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: device_id # column name
+    IGNORED_DEVICE_IDS: []
+  FITBIT_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: fitbit_id # column name
+    IGNORED_DEVICE_IDS: []
+  EMPATICA_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: empatica_id # column name
+    IGNORED_DEVICE_IDS: []
+
+# See https://www.rapids.science/latest/setup/configuration/#time-segments
+TIME_SEGMENTS: &time_segments
+  TYPE: EVENT # FREQUENCY, PERIODIC, EVENT
+  FILE: "tests/data/external/timesegments_event.csv"
+  INCLUDE_PAST_PERIODIC_SEGMENTS: FALSE # Only relevant if TYPE=PERIODIC, see docs
+
+# See https://www.rapids.science/latest/setup/configuration/#timezone-of-your-study
+TIMEZONE: 
+    TYPE: MULTIPLE
+    SINGLE:
+      TZCODE: America/New_York
+    MULTIPLE:
+      TZCODES_FILE: tests/data/external/multiple_timezones.csv
+      IF_MISSING_TZCODE: STOP
+      DEFAULT_TZCODE: America/New_York
+      FITBIT: 
+        ALLOW_MULTIPLE_TZ_PER_DEVICE: False
+        INFER_FROM_SMARTPHONE_TZ: False
+
+########################################################################################################################
+#                                                 PHONE                                                                #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#data-stream-configuration
+PHONE_DATA_STREAMS:
+  USE: aware_csv
+  
+  # AVAILABLE:
+  aware_mysql: 
+    DATABASE_GROUP: MY_GROUP
+
+  aware_csv:
+    FOLDER: tests/data/external/aware_csv
+  
+  aware_influxdb: 
+    DATABASE_GROUP: MY_GROUP
+
+# Sensors ------
+
+# https://www.rapids.science/latest/features/phone-accelerometer/
+PHONE_ACCELEROMETER:
+  CONTAINER: accelerometer
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxmagnitude", "minmagnitude", "avgmagnitude", "medianmagnitude", "stdmagnitude"]
+      SRC_SCRIPT: src/features/phone_accelerometer/rapids/main.py
+    
+    PANDA:
+      COMPUTE: False
+      VALID_SENSED_MINUTES: False
+      FEATURES:
+        exertional_activity_episode: ["sumduration", "maxduration", "minduration", "avgduration", "medianduration", "stdduration"]
+        nonexertional_activity_episode: ["sumduration", "maxduration", "minduration", "avgduration", "medianduration", "stdduration"]
+      SRC_SCRIPT: src/features/phone_accelerometer/panda/main.py
+
+# See https://www.rapids.science/latest/features/phone-activity-recognition/
+PHONE_ACTIVITY_RECOGNITION:
+  CONTAINER: 
+    ANDROID: plugin_google_activity_recognition
+    IOS: plugin_ios_activity_recognition
+  EPISODE_THRESHOLD_BETWEEN_ROWS: 5 # minutes. Max time difference for two consecutive rows to be considered within the same AR episode.
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["count", "mostcommonactivity", "countuniqueactivities", "durationstationary", "durationmobile", "durationvehicle"]
+      ACTIVITY_CLASSES:
+        STATIONARY: ["still", "tilting"]
+        MOBILE: ["on_foot", "walking", "running", "on_bicycle"]
+        VEHICLE: ["in_vehicle"]
+      SRC_SCRIPT: src/features/phone_activity_recognition/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-applications-crashes/
+PHONE_APPLICATIONS_CRASHES:
+  CONTAINER: applications_crashes
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-applications-foreground/
+PHONE_APPLICATIONS_FOREGROUND:
+  CONTAINER: applications_foreground
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      SINGLE_CATEGORIES: ["all", "email"]
+      MULTIPLE_CATEGORIES:
+        social: ["socialnetworks", "socialmediatools"]
+        entertainment: ["entertainment", "gamingknowledge", "gamingcasual", "gamingadventure", "gamingstrategy", "gamingtoolscommunity", "gamingroleplaying", "gamingaction", "gaminglogic", "gamingsports", "gamingsimulation"]
+      SINGLE_APPS: ["top1global", "com.facebook.moments", "com.google.android.youtube", "com.twitter.android"] # There's no entropy for single apps
+      EXCLUDED_CATEGORIES: []
+      EXCLUDED_APPS: ["com.fitbit.FitbitMobile", "com.aware.plugin.upmc.cancer"]
+      FEATURES: ["count", "timeoffirstuse", "timeoflastuse", "frequencyentropy"]
+      SRC_SCRIPT: src/features/phone_applications_foreground/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-applications-notifications/
+PHONE_APPLICATIONS_NOTIFICATIONS:
+  CONTAINER: applications_notifications
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-battery/
+PHONE_BATTERY:
+  CONTAINER: phone_battery_raw.csv
+  EPISODE_THRESHOLD_BETWEEN_ROWS: 30 # minutes. Max time difference for two consecutive rows to be considered within the same battery episode.
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: True
+      FEATURES: ["countdischarge", "sumdurationdischarge", "countcharge", "sumdurationcharge", "avgconsumptionrate", "maxconsumptionrate"]
+      SRC_SCRIPT: src/features/phone_battery/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-bluetooth/
+PHONE_BLUETOOTH:
+  CONTAINER: phone_bluetooth_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_bluetooth/rapids/main.R
+
+    DORYAB:
+      COMPUTE: False
+      FEATURES: 
+        ALL: 
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+        OWN: 
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+        OTHERS:
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+      SRC_SCRIPT: src/features/phone_bluetooth/doryab/main.py
+
+# See https://www.rapids.science/latest/features/phone-calls/
+PHONE_CALLS:
+  CONTAINER: phone_calls_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      CALL_TYPES: [missed, incoming, outgoing]
+      FEATURES:
+        missed:  [count, distinctcontacts, timefirstcall, timelastcall, countmostfrequentcontact]
+        incoming: [count, distinctcontacts, meanduration, sumduration, minduration, maxduration, stdduration, modeduration, entropyduration, timefirstcall, timelastcall, countmostfrequentcontact]
+        outgoing: [count, distinctcontacts, meanduration, sumduration, minduration, maxduration, stdduration, modeduration, entropyduration, timefirstcall, timelastcall, countmostfrequentcontact]
+      SRC_SCRIPT: src/features/phone_calls/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-conversation/
+PHONE_CONVERSATION:
+  CONTAINER: 
+    ANDROID: phone_conversation_raw.csv
+    IOS: phone_conversation_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["minutessilence", "minutesnoise", "minutesvoice", "minutesunknown","sumconversationduration","avgconversationduration",
+    "sdconversationduration","minconversationduration","maxconversationduration","timefirstconversation","timelastconversation","noisesumenergy",
+    "noiseavgenergy","noisesdenergy","noiseminenergy","noisemaxenergy","voicesumenergy",
+    "voiceavgenergy","voicesdenergy","voiceminenergy","voicemaxenergy","silencesensedfraction","noisesensedfraction",
+    "voicesensedfraction","unknownsensedfraction","silenceexpectedfraction","noiseexpectedfraction","voiceexpectedfraction",
+    "unknownexpectedfraction","countconversation"]
+      RECORDING_MINUTES: 1
+      PAUSED_MINUTES : 3
+      SRC_SCRIPT: src/features/phone_conversation/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-data-yield/
+PHONE_DATA_YIELD:
+  SENSORS: []
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: [ratiovalidyieldedminutes, ratiovalidyieldedhours]
+      MINUTE_RATIO_THRESHOLD_FOR_VALID_YIELDED_HOURS: 0.5 # 0 to 1, minimum percentage of valid minutes in an hour to be considered valid.
+      SRC_SCRIPT: src/features/phone_data_yield/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-keyboard/
+PHONE_KEYBOARD:
+  CONTAINER: keyboard
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-light/
+PHONE_LIGHT:
+  CONTAINER: phone_light_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["count", "maxlux", "minlux", "avglux", "medianlux", "stdlux"]
+      SRC_SCRIPT: src/features/phone_light/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-locations/
+PHONE_LOCATIONS:
+  CONTAINER: locations
+  LOCATIONS_TO_USE: ALL_RESAMPLED # ALL, GPS, ALL_RESAMPLED, OR FUSED_RESAMPLED
+  FUSED_RESAMPLED_CONSECUTIVE_THRESHOLD: 30 # minutes, only replicate location samples to the next sensed bin if the phone did not stop collecting data for more than this threshold
+  FUSED_RESAMPLED_TIME_SINCE_VALID_LOCATION: 720 # minutes, only replicate location samples to consecutive sensed bins if they were logged within this threshold after a valid location row
+  HOME_INFERENCE:
+    DBSCAN_EPS: 10 # meters
+    DBSCAN_MINSAMPLES: 5
+    THRESHOLD_STATIC : 1 # km/h
+    CLUSTERING_ALGORITHM: DBSCAN #DBSCAN,OPTICS
+  
+  PROVIDERS:
+    DORYAB:
+      COMPUTE: False
+      FEATURES: ["locationvariance","loglocationvariance","totaldistance","averagespeed","varspeed", "numberofsignificantplaces","numberlocationtransitions","radiusgyration","timeattop1location","timeattop2location","timeattop3location","movingtostaticratio","outlierstimepercent","maxlengthstayatclusters","minlengthstayatclusters","meanlengthstayatclusters","stdlengthstayatclusters","locationentropy","normalizedlocationentropy","timeathome"]
+      ACCURACY_LIMIT: 100 # meters, drops location coordinates with an accuracy higher than this. This number means there's a 68% probability the true location is within this radius
+      DBSCAN_EPS: 10 # meters
+      DBSCAN_MINSAMPLES: 5
+      THRESHOLD_STATIC : 1 # km/h
+      MAXIMUM_ROW_GAP: 300
+      MAXIMUM_ROW_DURATION: 60
+      MINUTES_DATA_USED: False
+      CLUSTER_ON: PARTICIPANT_DATASET # PARTICIPANT_DATASET,TIME_SEGMENT
+      CLUSTERING_ALGORITHM: DBSCAN #DBSCAN,OPTICS
+      RADIUS_FOR_HOME: 100  
+      SRC_SCRIPT: src/features/phone_locations/doryab/main.py
+
+    BARNETT:
+      COMPUTE: False
+      FEATURES: ["hometime","disttravelled","rog","maxdiam","maxhomedist","siglocsvisited","avgflightlen","stdflightlen","avgflightdur","stdflightdur","probpause","siglocentropy","circdnrtn","wkenddayrtn"]
+      ACCURACY_LIMIT: 100 # meters, drops location coordinates with an accuracy higher than this. This number means there's a 68% probability the true location is within this radius
+      IF_MULTIPLE_TIMEZONES: USE_MOST_COMMON
+      MINUTES_DATA_USED: False # Use this for quality control purposes, how many minutes of data (location coordinates gruped by minute) were used to compute features
+      SRC_SCRIPT: src/features/phone_locations/barnett/main.R
+
+# See https://www.rapids.science/latest/features/phone-log/
+PHONE_LOG:
+  CONTAINER: 
+    ANDROID: aware_log
+    IOS: ios_aware_log
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-messages/
+PHONE_MESSAGES:
+  CONTAINER: phone_messages_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      MESSAGES_TYPES : [received, sent]
+      FEATURES: 
+        received: [count, distinctcontacts, timefirstmessage, timelastmessage, countmostfrequentcontact]
+        sent: [count, distinctcontacts, timefirstmessage, timelastmessage, countmostfrequentcontact]
+      SRC_SCRIPT: src/features/phone_messages/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-screen/
+PHONE_SCREEN:
+  CONTAINER: screen
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      REFERENCE_HOUR_FIRST_USE: 0
+      IGNORE_EPISODES_SHORTER_THAN: 0 # in minutes, set to 0 to disable
+      IGNORE_EPISODES_LONGER_THAN: 0 # in minutes, set to 0 to disable
+      FEATURES: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration", "firstuseafter"] # "episodepersensedminutes" needs to be added later
+      EPISODE_TYPES: ["unlock"]
+      SRC_SCRIPT: src/features/phone_screen/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-wifi-connected/
+PHONE_WIFI_CONNECTED:
+  CONTAINER: phone_wifi_connected_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_wifi_connected/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-wifi-visible/
+PHONE_WIFI_VISIBLE:
+  CONTAINER: phone_wifi_visible_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_wifi_visible/rapids/main.R
+
+
+
+########################################################################################################################
+#                                                 FITBIT                                                               #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#data-stream-configuration
+FITBIT_DATA_STREAMS:
+  USE: fitbitjson_mysql
+  
+  # AVAILABLE:
+  fitbitjson_mysql: 
+    DATABASE_GROUP: MY_GROUP
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+  
+  fitbitparsed_mysql: 
+    DATABASE_GROUP: MY_GROUP
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+  fitbitjson_csv: 
+    FOLDER: data/external/fitbit_csv
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+  fitbitparsed_csv: 
+    FOLDER: data/external/fitbit_csv
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+# Sensors ------
+
+# See https://www.rapids.science/latest/features/fitbit-data-yield/
+FITBIT_DATA_YIELD:
+  SENSOR: FITBIT_HEARTRATE_INTRADAY
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: [ratiovalidyieldedminutes, ratiovalidyieldedhours]
+      MINUTE_RATIO_THRESHOLD_FOR_VALID_YIELDED_HOURS: 0.5 #  0 to 1, minimum percentage of valid minutes in an hour to be considered valid.
+      SRC_SCRIPT: src/features/fitbit_data_yield/rapids/main.R
+
+
+# See https://www.rapids.science/latest/features/fitbit-heartrate-summary/
+FITBIT_HEARTRATE_SUMMARY:
+  CONTAINER: heartrate_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxrestinghr", "minrestinghr", "avgrestinghr", "medianrestinghr", "moderestinghr", "stdrestinghr", "diffmaxmoderestinghr", "diffminmoderestinghr", "entropyrestinghr"] # calories features' accuracy depend on the accuracy of the participants fitbit profile (e.g. height, weight) use these with care: ["sumcaloriesoutofrange", "maxcaloriesoutofrange", "mincaloriesoutofrange", "avgcaloriesoutofrange", "mediancaloriesoutofrange", "stdcaloriesoutofrange", "entropycaloriesoutofrange", "sumcaloriesfatburn", "maxcaloriesfatburn", "mincaloriesfatburn", "avgcaloriesfatburn", "mediancaloriesfatburn", "stdcaloriesfatburn", "entropycaloriesfatburn", "sumcaloriescardio", "maxcaloriescardio", "mincaloriescardio", "avgcaloriescardio", "mediancaloriescardio", "stdcaloriescardio", "entropycaloriescardio", "sumcaloriespeak", "maxcaloriespeak", "mincaloriespeak", "avgcaloriespeak", "mediancaloriespeak", "stdcaloriespeak", "entropycaloriespeak"]
+      SRC_SCRIPT: src/features/fitbit_heartrate_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-heartrate-intraday/
+FITBIT_HEARTRATE_INTRADAY:
+  CONTAINER: heartrate_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxhr", "minhr", "avghr", "medianhr", "modehr", "stdhr", "diffmaxmodehr", "diffminmodehr", "entropyhr", "minutesonoutofrangezone", "minutesonfatburnzone", "minutesoncardiozone", "minutesonpeakzone"]
+      SRC_SCRIPT: src/features/fitbit_heartrate_intraday/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-sleep-summary/
+FITBIT_SLEEP_SUMMARY:
+  CONTAINER: sleep_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["firstwaketime", "lastwaketime", "firstbedtime", "lastbedtime", "countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
+      SLEEP_TYPES: ["main", "nap", "all"]
+      SRC_SCRIPT: src/features/fitbit_sleep_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-sleep-intraday/
+FITBIT_SLEEP_INTRADAY:
+  CONTAINER: sleep_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES:
+        LEVELS_AND_TYPES: [countepisode, sumduration, maxduration, minduration, avgduration, medianduration, stdduration]
+        RATIOS_TYPE: [count, duration]
+        RATIOS_SCOPE: [ACROSS_LEVELS, ACROSS_TYPES, WITHIN_LEVELS, WITHIN_TYPES]
+        ROUTINE: [starttimefirstmainsleep, endtimelastmainsleep, starttimefirstnap, endtimelastnap]
+      SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
+        CLASSIC: [awake, restless, asleep]
+        STAGES: [wake, deep, light, rem]
+        UNIFIED: [awake, asleep]
+      SLEEP_TYPES: [main, nap, all]
+      LAST_NIGHT_END: 0 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight
+      ROUTINE_REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
+      SRC_SCRIPT: src/features/fitbit_sleep_intraday/rapids/main.py
+  
+    PRICE:
+      COMPUTE: False
+      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, stdstarttimeofepisodemain, stdendtimeofepisodemain, stdmidpointofepisodemain, socialjetlag, rmssdmeanstarttimeofepisodemain, rmssdmeanendtimeofepisodemain, rmssdmeanmidpointofepisodemain, rmssdmedianstarttimeofepisodemain, rmssdmedianendtimeofepisodemain, rmssdmedianmidpointofepisodemain]
+      SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
+        CLASSIC: [awake, restless, asleep]
+        STAGES: [wake, deep, light, rem]
+        UNIFIED: [awake, asleep]
+      DAY_TYPES: [WEEKEND, WEEK, ALL]
+      LAST_NIGHT_END: 660 # number of minutes after the midnight (11:00) 11*60
+      SRC_SCRIPT: src/features/fitbit_sleep_intraday/price/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-steps-summary/
+FITBIT_STEPS_SUMMARY:
+  CONTAINER: steps_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxsumsteps", "minsumsteps", "avgsumsteps", "mediansumsteps", "stdsumsteps"]
+      SRC_SCRIPT: src/features/fitbit_steps_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-steps-intraday/
+FITBIT_STEPS_INTRADAY:
+  CONTAINER: steps_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES:
+        STEPS: ["sum", "max", "min", "avg", "std"]
+        SEDENTARY_BOUT: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration"]
+        ACTIVE_BOUT: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration"]
+      THRESHOLD_ACTIVE_BOUT: 10 # steps
+      INCLUDE_ZERO_STEP_ROWS: False
+      SRC_SCRIPT: src/features/fitbit_steps_intraday/rapids/main.py
+
+########################################################################################################################
+#                                                 EMPATICA                                                             #
+########################################################################################################################
+
+EMPATICA_DATA_STREAMS:
+  USE: empatica_zip
+  
+  # AVAILABLE:
+  empatica_zip: 
+    FOLDER: data/external/empatica
+
+# Sensors ------
+
+# See https://www.rapids.science/latest/features/empatica-accelerometer/
+EMPATICA_ACCELEROMETER:
+  CONTAINER: ACC
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxmagnitude", "minmagnitude", "avgmagnitude", "medianmagnitude", "stdmagnitude"]
+      SRC_SCRIPT: src/features/empatica_accelerometer/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-heartrate/
+EMPATICA_HEARTRATE:
+  CONTAINER: HR
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxhr", "minhr", "avghr", "medianhr", "modehr", "stdhr", "diffmaxmodehr", "diffminmodehr", "entropyhr"]
+      SRC_SCRIPT: src/features/empatica_heartrate/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-temperature/
+EMPATICA_TEMPERATURE:
+  CONTAINER: TEMP
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxtemp", "mintemp", "avgtemp", "mediantemp", "modetemp", "stdtemp", "diffmaxmodetemp", "diffminmodetemp", "entropytemp"]
+      SRC_SCRIPT: src/features/empatica_temperature/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-electrodermal-activity/
+EMPATICA_ELECTRODERMAL_ACTIVITY:
+  CONTAINER: EDA
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxeda", "mineda", "avgeda", "medianeda", "modeeda", "stdeda", "diffmaxmodeeda", "diffminmodeeda", "entropyeda"]
+      SRC_SCRIPT: src/features/empatica_electrodermal_activity/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-blood-volume-pulse/
+EMPATICA_BLOOD_VOLUME_PULSE:
+  CONTAINER: BVP
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxbvp", "minbvp", "avgbvp", "medianbvp", "modebvp", "stdbvp", "diffmaxmodebvp", "diffminmodebvp", "entropybvp"]
+      SRC_SCRIPT: src/features/empatica_blood_volume_pulse/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-inter-beat-interval/
+EMPATICA_INTER_BEAT_INTERVAL:
+  CONTAINER: IBI
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxibi", "minibi", "avgibi", "medianibi", "modeibi", "stdibi", "diffmaxmodeibi", "diffminmodeibi", "entropyibi"]
+      SRC_SCRIPT: src/features/empatica_inter_beat_interval/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-tags/
+EMPATICA_TAGS:
+  CONTAINER: TAGS
+  PROVIDERS:  # None implemented yet
+
+
+########################################################################################################################
+#                                                 PLOTS                                                                #
+########################################################################################################################
+
+# Data quality ------
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#1-histograms-of-phone-data-yield
+HISTOGRAM_PHONE_DATA_YIELD:
+  PLOT: False
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#2-heatmaps-of-overall-data-yield
+HEATMAP_PHONE_DATA_YIELD_PER_PARTICIPANT_PER_TIME_SEGMENT:
+  PLOT: False
+  TIME: ABSOLUTE_TIME # ABSOLUTE_TIME or RELATIVE_TIME
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#3-heatmap-of-recorded-phone-sensors
+HEATMAP_SENSORS_PER_MINUTE_PER_TIME_SEGMENT:
+  PLOT: False
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#4-heatmap-of-sensor-row-count
+HEATMAP_SENSOR_ROW_COUNT_PER_TIME_SEGMENT:
+  PLOT: False
+  SENSORS: [PHONE_ACCELEROMETER, PHONE_ACTIVITY_RECOGNITION, PHONE_APPLICATIONS_FOREGROUND, PHONE_BATTERY, PHONE_BLUETOOTH, PHONE_CALLS, PHONE_CONVERSATION, PHONE_LIGHT, PHONE_LOCATIONS, PHONE_MESSAGES, PHONE_SCREEN, PHONE_WIFI_CONNECTED, PHONE_WIFI_VISIBLE]
+
+# Features ------
+
+# See https://www.rapids.science/latest/visualizations/feature-visualizations/#1-heatmap-correlation-matrix
+HEATMAP_FEATURE_CORRELATION_MATRIX:
+  PLOT: False
+  MIN_ROWS_RATIO: 0.5
+  CORR_THRESHOLD: 0.1
+  CORR_METHOD: "pearson" # choose from {"pearson", "kendall", "spearman"}
+

tests/settings/mtz_frequency_config.yaml

@@ -0,0 +1,543 @@
+########################################################################################################################
+#                                              GLOBAL CONFIGURATION                                                    #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#participant-files
+PIDS: [android, ios, fitbit, empatica, empty]
+
+# See https://www.rapids.science/latest/setup/configuration/#automatic-creation-of-participant-files
+CREATE_PARTICIPANT_FILES:
+  CSV_FILE_PATH: "data/external/example_participants.csv" # see docs for required format
+  PHONE_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: device_id # column name
+    IGNORED_DEVICE_IDS: []
+  FITBIT_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: fitbit_id # column name
+    IGNORED_DEVICE_IDS: []
+  EMPATICA_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: empatica_id # column name
+    IGNORED_DEVICE_IDS: []
+
+# See https://www.rapids.science/latest/setup/configuration/#time-segments
+TIME_SEGMENTS: &time_segments
+  TYPE: FREQUENCY # FREQUENCY, PERIODIC, EVENT
+  FILE: "tests/data/external/timesegments_frequency.csv"
+  INCLUDE_PAST_PERIODIC_SEGMENTS: FALSE # Only relevant if TYPE=PERIODIC, see docs
+
+# See https://www.rapids.science/latest/setup/configuration/#timezone-of-your-study
+TIMEZONE: 
+    TYPE: MULTIPLE
+    SINGLE:
+      TZCODE: America/New_York
+    MULTIPLE:
+      TZCODES_FILE: tests/data/external/multiple_timezones.csv
+      IF_MISSING_TZCODE: STOP
+      DEFAULT_TZCODE: America/New_York
+      FITBIT: 
+        ALLOW_MULTIPLE_TZ_PER_DEVICE: False
+        INFER_FROM_SMARTPHONE_TZ: False
+
+########################################################################################################################
+#                                                 PHONE                                                                #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#data-stream-configuration
+PHONE_DATA_STREAMS:
+  USE: aware_csv
+  
+  # AVAILABLE:
+  aware_mysql: 
+    DATABASE_GROUP: MY_GROUP
+
+  aware_csv:
+    FOLDER: tests/data/external/aware_csv
+  
+  aware_influxdb: 
+    DATABASE_GROUP: MY_GROUP
+
+# Sensors ------
+
+# https://www.rapids.science/latest/features/phone-accelerometer/
+PHONE_ACCELEROMETER:
+  CONTAINER: accelerometer
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxmagnitude", "minmagnitude", "avgmagnitude", "medianmagnitude", "stdmagnitude"]
+      SRC_SCRIPT: src/features/phone_accelerometer/rapids/main.py
+    
+    PANDA:
+      COMPUTE: False
+      VALID_SENSED_MINUTES: False
+      FEATURES:
+        exertional_activity_episode: ["sumduration", "maxduration", "minduration", "avgduration", "medianduration", "stdduration"]
+        nonexertional_activity_episode: ["sumduration", "maxduration", "minduration", "avgduration", "medianduration", "stdduration"]
+      SRC_SCRIPT: src/features/phone_accelerometer/panda/main.py
+
+# See https://www.rapids.science/latest/features/phone-activity-recognition/
+PHONE_ACTIVITY_RECOGNITION:
+  CONTAINER: 
+    ANDROID: plugin_google_activity_recognition
+    IOS: plugin_ios_activity_recognition
+  EPISODE_THRESHOLD_BETWEEN_ROWS: 5 # minutes. Max time difference for two consecutive rows to be considered within the same AR episode.
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["count", "mostcommonactivity", "countuniqueactivities", "durationstationary", "durationmobile", "durationvehicle"]
+      ACTIVITY_CLASSES:
+        STATIONARY: ["still", "tilting"]
+        MOBILE: ["on_foot", "walking", "running", "on_bicycle"]
+        VEHICLE: ["in_vehicle"]
+      SRC_SCRIPT: src/features/phone_activity_recognition/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-applications-crashes/
+PHONE_APPLICATIONS_CRASHES:
+  CONTAINER: applications_crashes
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-applications-foreground/
+PHONE_APPLICATIONS_FOREGROUND:
+  CONTAINER: applications_foreground
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      SINGLE_CATEGORIES: ["all", "email"]
+      MULTIPLE_CATEGORIES:
+        social: ["socialnetworks", "socialmediatools"]
+        entertainment: ["entertainment", "gamingknowledge", "gamingcasual", "gamingadventure", "gamingstrategy", "gamingtoolscommunity", "gamingroleplaying", "gamingaction", "gaminglogic", "gamingsports", "gamingsimulation"]
+      SINGLE_APPS: ["top1global", "com.facebook.moments", "com.google.android.youtube", "com.twitter.android"] # There's no entropy for single apps
+      EXCLUDED_CATEGORIES: []
+      EXCLUDED_APPS: ["com.fitbit.FitbitMobile", "com.aware.plugin.upmc.cancer"]
+      FEATURES: ["count", "timeoffirstuse", "timeoflastuse", "frequencyentropy"]
+      SRC_SCRIPT: src/features/phone_applications_foreground/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-applications-notifications/
+PHONE_APPLICATIONS_NOTIFICATIONS:
+  CONTAINER: applications_notifications
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-battery/
+PHONE_BATTERY:
+  CONTAINER: phone_battery_raw.csv
+  EPISODE_THRESHOLD_BETWEEN_ROWS: 30 # minutes. Max time difference for two consecutive rows to be considered within the same battery episode.
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: TRUE
+      FEATURES: ["countdischarge", "sumdurationdischarge", "countcharge", "sumdurationcharge", "avgconsumptionrate", "maxconsumptionrate"]
+      SRC_SCRIPT: src/features/phone_battery/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-bluetooth/
+PHONE_BLUETOOTH:
+  CONTAINER: phone_bluetooth_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_bluetooth/rapids/main.R
+
+    DORYAB:
+      COMPUTE: False
+      FEATURES: 
+        ALL: 
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+        OWN: 
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+        OTHERS:
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+      SRC_SCRIPT: src/features/phone_bluetooth/doryab/main.py
+
+# See https://www.rapids.science/latest/features/phone-calls/
+PHONE_CALLS:
+  CONTAINER: phone_calls_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      CALL_TYPES: [missed, incoming, outgoing]
+      FEATURES:
+        missed:  [count, distinctcontacts, timefirstcall, timelastcall, countmostfrequentcontact]
+        incoming: [count, distinctcontacts, meanduration, sumduration, minduration, maxduration, stdduration, modeduration, entropyduration, timefirstcall, timelastcall, countmostfrequentcontact]
+        outgoing: [count, distinctcontacts, meanduration, sumduration, minduration, maxduration, stdduration, modeduration, entropyduration, timefirstcall, timelastcall, countmostfrequentcontact]
+      SRC_SCRIPT: src/features/phone_calls/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-conversation/
+PHONE_CONVERSATION:
+  CONTAINER: 
+    ANDROID: phone_conversation_raw.csv
+    IOS: phone_conversation_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["minutessilence", "minutesnoise", "minutesvoice", "minutesunknown","sumconversationduration","avgconversationduration",
+    "sdconversationduration","minconversationduration","maxconversationduration","timefirstconversation","timelastconversation","noisesumenergy",
+    "noiseavgenergy","noisesdenergy","noiseminenergy","noisemaxenergy","voicesumenergy",
+    "voiceavgenergy","voicesdenergy","voiceminenergy","voicemaxenergy","silencesensedfraction","noisesensedfraction",
+    "voicesensedfraction","unknownsensedfraction","silenceexpectedfraction","noiseexpectedfraction","voiceexpectedfraction",
+    "unknownexpectedfraction","countconversation"]
+      RECORDING_MINUTES: 1
+      PAUSED_MINUTES : 3
+      SRC_SCRIPT: src/features/phone_conversation/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-data-yield/
+PHONE_DATA_YIELD:
+  SENSORS: []
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: [ratiovalidyieldedminutes, ratiovalidyieldedhours]
+      MINUTE_RATIO_THRESHOLD_FOR_VALID_YIELDED_HOURS: 0.5 # 0 to 1, minimum percentage of valid minutes in an hour to be considered valid.
+      SRC_SCRIPT: src/features/phone_data_yield/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-keyboard/
+PHONE_KEYBOARD:
+  CONTAINER: keyboard
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-light/
+PHONE_LIGHT:
+  CONTAINER: phone_light_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["count", "maxlux", "minlux", "avglux", "medianlux", "stdlux"]
+      SRC_SCRIPT: src/features/phone_light/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-locations/
+PHONE_LOCATIONS:
+  CONTAINER: locations
+  LOCATIONS_TO_USE: ALL_RESAMPLED # ALL, GPS, ALL_RESAMPLED, OR FUSED_RESAMPLED
+  FUSED_RESAMPLED_CONSECUTIVE_THRESHOLD: 30 # minutes, only replicate location samples to the next sensed bin if the phone did not stop collecting data for more than this threshold
+  FUSED_RESAMPLED_TIME_SINCE_VALID_LOCATION: 720 # minutes, only replicate location samples to consecutive sensed bins if they were logged within this threshold after a valid location row
+  HOME_INFERENCE:
+    DBSCAN_EPS: 10 # meters
+    DBSCAN_MINSAMPLES: 5
+    THRESHOLD_STATIC : 1 # km/h
+    CLUSTERING_ALGORITHM: DBSCAN #DBSCAN,OPTICS
+  
+  PROVIDERS:
+    DORYAB:
+      COMPUTE: False
+      FEATURES: ["locationvariance","loglocationvariance","totaldistance","averagespeed","varspeed", "numberofsignificantplaces","numberlocationtransitions","radiusgyration","timeattop1location","timeattop2location","timeattop3location","movingtostaticratio","outlierstimepercent","maxlengthstayatclusters","minlengthstayatclusters","meanlengthstayatclusters","stdlengthstayatclusters","locationentropy","normalizedlocationentropy","timeathome"]
+      ACCURACY_LIMIT: 100 # meters, drops location coordinates with an accuracy higher than this. This number means there's a 68% probability the true location is within this radius
+      DBSCAN_EPS: 10 # meters
+      DBSCAN_MINSAMPLES: 5
+      THRESHOLD_STATIC : 1 # km/h
+      MAXIMUM_ROW_GAP: 300
+      MAXIMUM_ROW_DURATION: 60
+      MINUTES_DATA_USED: False
+      CLUSTER_ON: PARTICIPANT_DATASET # PARTICIPANT_DATASET,TIME_SEGMENT
+      CLUSTERING_ALGORITHM: DBSCAN #DBSCAN,OPTICS
+      RADIUS_FOR_HOME: 100  
+      SRC_SCRIPT: src/features/phone_locations/doryab/main.py
+
+    BARNETT:
+      COMPUTE: False
+      FEATURES: ["hometime","disttravelled","rog","maxdiam","maxhomedist","siglocsvisited","avgflightlen","stdflightlen","avgflightdur","stdflightdur","probpause","siglocentropy","circdnrtn","wkenddayrtn"]
+      ACCURACY_LIMIT: 100 # meters, drops location coordinates with an accuracy higher than this. This number means there's a 68% probability the true location is within this radius
+      IF_MULTIPLE_TIMEZONES: USE_MOST_COMMON
+      MINUTES_DATA_USED: False # Use this for quality control purposes, how many minutes of data (location coordinates gruped by minute) were used to compute features
+      SRC_SCRIPT: src/features/phone_locations/barnett/main.R
+
+# See https://www.rapids.science/latest/features/phone-log/
+PHONE_LOG:
+  CONTAINER: 
+    ANDROID: aware_log
+    IOS: ios_aware_log
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-messages/
+PHONE_MESSAGES:
+  CONTAINER: phone_messages_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      MESSAGES_TYPES : [received, sent]
+      FEATURES: 
+        received: [count, distinctcontacts, timefirstmessage, timelastmessage, countmostfrequentcontact]
+        sent: [count, distinctcontacts, timefirstmessage, timelastmessage, countmostfrequentcontact]
+      SRC_SCRIPT: src/features/phone_messages/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-screen/
+PHONE_SCREEN:
+  CONTAINER: screen
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      REFERENCE_HOUR_FIRST_USE: 0
+      IGNORE_EPISODES_SHORTER_THAN: 0 # in minutes, set to 0 to disable
+      IGNORE_EPISODES_LONGER_THAN: 0 # in minutes, set to 0 to disable
+      FEATURES: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration", "firstuseafter"] # "episodepersensedminutes" needs to be added later
+      EPISODE_TYPES: ["unlock"]
+      SRC_SCRIPT: src/features/phone_screen/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-wifi-connected/
+PHONE_WIFI_CONNECTED:
+  CONTAINER: phone_wifi_connected_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_wifi_connected/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-wifi-visible/
+PHONE_WIFI_VISIBLE:
+  CONTAINER: phone_wifi_visible_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_wifi_visible/rapids/main.R
+
+
+
+########################################################################################################################
+#                                                 FITBIT                                                               #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#data-stream-configuration
+FITBIT_DATA_STREAMS:
+  USE: fitbitjson_mysql
+  
+  # AVAILABLE:
+  fitbitjson_mysql: 
+    DATABASE_GROUP: MY_GROUP
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+  
+  fitbitparsed_mysql: 
+    DATABASE_GROUP: MY_GROUP
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+  fitbitjson_csv: 
+    FOLDER: data/external/fitbit_csv
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+  fitbitparsed_csv: 
+    FOLDER: data/external/fitbit_csv
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+# Sensors ------
+
+# See https://www.rapids.science/latest/features/fitbit-data-yield/
+FITBIT_DATA_YIELD:
+  SENSOR: FITBIT_HEARTRATE_INTRADAY
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: [ratiovalidyieldedminutes, ratiovalidyieldedhours]
+      MINUTE_RATIO_THRESHOLD_FOR_VALID_YIELDED_HOURS: 0.5 #  0 to 1, minimum percentage of valid minutes in an hour to be considered valid.
+      SRC_SCRIPT: src/features/fitbit_data_yield/rapids/main.R
+
+
+# See https://www.rapids.science/latest/features/fitbit-heartrate-summary/
+FITBIT_HEARTRATE_SUMMARY:
+  CONTAINER: heartrate_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxrestinghr", "minrestinghr", "avgrestinghr", "medianrestinghr", "moderestinghr", "stdrestinghr", "diffmaxmoderestinghr", "diffminmoderestinghr", "entropyrestinghr"] # calories features' accuracy depend on the accuracy of the participants fitbit profile (e.g. height, weight) use these with care: ["sumcaloriesoutofrange", "maxcaloriesoutofrange", "mincaloriesoutofrange", "avgcaloriesoutofrange", "mediancaloriesoutofrange", "stdcaloriesoutofrange", "entropycaloriesoutofrange", "sumcaloriesfatburn", "maxcaloriesfatburn", "mincaloriesfatburn", "avgcaloriesfatburn", "mediancaloriesfatburn", "stdcaloriesfatburn", "entropycaloriesfatburn", "sumcaloriescardio", "maxcaloriescardio", "mincaloriescardio", "avgcaloriescardio", "mediancaloriescardio", "stdcaloriescardio", "entropycaloriescardio", "sumcaloriespeak", "maxcaloriespeak", "mincaloriespeak", "avgcaloriespeak", "mediancaloriespeak", "stdcaloriespeak", "entropycaloriespeak"]
+      SRC_SCRIPT: src/features/fitbit_heartrate_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-heartrate-intraday/
+FITBIT_HEARTRATE_INTRADAY:
+  CONTAINER: heartrate_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxhr", "minhr", "avghr", "medianhr", "modehr", "stdhr", "diffmaxmodehr", "diffminmodehr", "entropyhr", "minutesonoutofrangezone", "minutesonfatburnzone", "minutesoncardiozone", "minutesonpeakzone"]
+      SRC_SCRIPT: src/features/fitbit_heartrate_intraday/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-sleep-summary/
+FITBIT_SLEEP_SUMMARY:
+  CONTAINER: sleep_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["firstwaketime", "lastwaketime", "firstbedtime", "lastbedtime", "countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
+      SLEEP_TYPES: ["main", "nap", "all"]
+      SRC_SCRIPT: src/features/fitbit_sleep_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-sleep-intraday/
+FITBIT_SLEEP_INTRADAY:
+  CONTAINER: sleep_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES:
+        LEVELS_AND_TYPES: [countepisode, sumduration, maxduration, minduration, avgduration, medianduration, stdduration]
+        RATIOS_TYPE: [count, duration]
+        RATIOS_SCOPE: [ACROSS_LEVELS, ACROSS_TYPES, WITHIN_LEVELS, WITHIN_TYPES]
+        ROUTINE: [starttimefirstmainsleep, endtimelastmainsleep, starttimefirstnap, endtimelastnap]
+      SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
+        CLASSIC: [awake, restless, asleep]
+        STAGES: [wake, deep, light, rem]
+        UNIFIED: [awake, asleep]
+      SLEEP_TYPES: [main, nap, all]
+      LAST_NIGHT_END: 0 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight
+      ROUTINE_REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
+      SRC_SCRIPT: src/features/fitbit_sleep_intraday/rapids/main.py
+  
+    PRICE:
+      COMPUTE: False
+      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, stdstarttimeofepisodemain, stdendtimeofepisodemain, stdmidpointofepisodemain, socialjetlag, rmssdmeanstarttimeofepisodemain, rmssdmeanendtimeofepisodemain, rmssdmeanmidpointofepisodemain, rmssdmedianstarttimeofepisodemain, rmssdmedianendtimeofepisodemain, rmssdmedianmidpointofepisodemain]
+      SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
+        CLASSIC: [awake, restless, asleep]
+        STAGES: [wake, deep, light, rem]
+        UNIFIED: [awake, asleep]
+      DAY_TYPES: [WEEKEND, WEEK, ALL]
+      LAST_NIGHT_END: 660 # number of minutes after the midnight (11:00) 11*60
+      SRC_SCRIPT: src/features/fitbit_sleep_intraday/price/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-steps-summary/
+FITBIT_STEPS_SUMMARY:
+  CONTAINER: steps_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxsumsteps", "minsumsteps", "avgsumsteps", "mediansumsteps", "stdsumsteps"]
+      SRC_SCRIPT: src/features/fitbit_steps_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-steps-intraday/
+FITBIT_STEPS_INTRADAY:
+  CONTAINER: steps_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES:
+        STEPS: ["sum", "max", "min", "avg", "std"]
+        SEDENTARY_BOUT: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration"]
+        ACTIVE_BOUT: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration"]
+      THRESHOLD_ACTIVE_BOUT: 10 # steps
+      INCLUDE_ZERO_STEP_ROWS: False
+      SRC_SCRIPT: src/features/fitbit_steps_intraday/rapids/main.py
+
+########################################################################################################################
+#                                                 EMPATICA                                                             #
+########################################################################################################################
+
+EMPATICA_DATA_STREAMS:
+  USE: empatica_zip
+  
+  # AVAILABLE:
+  empatica_zip: 
+    FOLDER: data/external/empatica
+
+# Sensors ------
+
+# See https://www.rapids.science/latest/features/empatica-accelerometer/
+EMPATICA_ACCELEROMETER:
+  CONTAINER: ACC
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxmagnitude", "minmagnitude", "avgmagnitude", "medianmagnitude", "stdmagnitude"]
+      SRC_SCRIPT: src/features/empatica_accelerometer/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-heartrate/
+EMPATICA_HEARTRATE:
+  CONTAINER: HR
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxhr", "minhr", "avghr", "medianhr", "modehr", "stdhr", "diffmaxmodehr", "diffminmodehr", "entropyhr"]
+      SRC_SCRIPT: src/features/empatica_heartrate/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-temperature/
+EMPATICA_TEMPERATURE:
+  CONTAINER: TEMP
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxtemp", "mintemp", "avgtemp", "mediantemp", "modetemp", "stdtemp", "diffmaxmodetemp", "diffminmodetemp", "entropytemp"]
+      SRC_SCRIPT: src/features/empatica_temperature/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-electrodermal-activity/
+EMPATICA_ELECTRODERMAL_ACTIVITY:
+  CONTAINER: EDA
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxeda", "mineda", "avgeda", "medianeda", "modeeda", "stdeda", "diffmaxmodeeda", "diffminmodeeda", "entropyeda"]
+      SRC_SCRIPT: src/features/empatica_electrodermal_activity/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-blood-volume-pulse/
+EMPATICA_BLOOD_VOLUME_PULSE:
+  CONTAINER: BVP
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxbvp", "minbvp", "avgbvp", "medianbvp", "modebvp", "stdbvp", "diffmaxmodebvp", "diffminmodebvp", "entropybvp"]
+      SRC_SCRIPT: src/features/empatica_blood_volume_pulse/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-inter-beat-interval/
+EMPATICA_INTER_BEAT_INTERVAL:
+  CONTAINER: IBI
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxibi", "minibi", "avgibi", "medianibi", "modeibi", "stdibi", "diffmaxmodeibi", "diffminmodeibi", "entropyibi"]
+      SRC_SCRIPT: src/features/empatica_inter_beat_interval/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-tags/
+EMPATICA_TAGS:
+  CONTAINER: TAGS
+  PROVIDERS:  # None implemented yet
+
+
+########################################################################################################################
+#                                                 PLOTS                                                                #
+########################################################################################################################
+
+# Data quality ------
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#1-histograms-of-phone-data-yield
+HISTOGRAM_PHONE_DATA_YIELD:
+  PLOT: False
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#2-heatmaps-of-overall-data-yield
+HEATMAP_PHONE_DATA_YIELD_PER_PARTICIPANT_PER_TIME_SEGMENT:
+  PLOT: False
+  TIME: ABSOLUTE_TIME # ABSOLUTE_TIME or RELATIVE_TIME
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#3-heatmap-of-recorded-phone-sensors
+HEATMAP_SENSORS_PER_MINUTE_PER_TIME_SEGMENT:
+  PLOT: False
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#4-heatmap-of-sensor-row-count
+HEATMAP_SENSOR_ROW_COUNT_PER_TIME_SEGMENT:
+  PLOT: False
+  SENSORS: [PHONE_ACCELEROMETER, PHONE_ACTIVITY_RECOGNITION, PHONE_APPLICATIONS_FOREGROUND, PHONE_BATTERY, PHONE_BLUETOOTH, PHONE_CALLS, PHONE_CONVERSATION, PHONE_LIGHT, PHONE_LOCATIONS, PHONE_MESSAGES, PHONE_SCREEN, PHONE_WIFI_CONNECTED, PHONE_WIFI_VISIBLE]
+
+# Features ------
+
+# See https://www.rapids.science/latest/visualizations/feature-visualizations/#1-heatmap-correlation-matrix
+HEATMAP_FEATURE_CORRELATION_MATRIX:
+  PLOT: False
+  MIN_ROWS_RATIO: 0.5
+  CORR_THRESHOLD: 0.1
+  CORR_METHOD: "pearson" # choose from {"pearson", "kendall", "spearman"}
+

tests/settings/mtz_periodic_config.yaml

@@ -0,0 +1,543 @@
+########################################################################################################################
+#                                              GLOBAL CONFIGURATION                                                    #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#participant-files
+PIDS: [android, ios, fitbit, empatica, empty]
+
+# See https://www.rapids.science/latest/setup/configuration/#automatic-creation-of-participant-files
+CREATE_PARTICIPANT_FILES:
+  CSV_FILE_PATH: "data/external/example_participants.csv" # see docs for required format
+  PHONE_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: device_id # column name
+    IGNORED_DEVICE_IDS: []
+  FITBIT_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: fitbit_id # column name
+    IGNORED_DEVICE_IDS: []
+  EMPATICA_SECTION:
+    ADD: True
+    DEVICE_ID_COLUMN: empatica_id # column name
+    IGNORED_DEVICE_IDS: []
+
+# See https://www.rapids.science/latest/setup/configuration/#time-segments
+TIME_SEGMENTS: &time_segments
+  TYPE: PERIODIC # FREQUENCY, PERIODIC, EVENT
+  FILE: "tests/data/external/timesegments_periodic.csv"
+  INCLUDE_PAST_PERIODIC_SEGMENTS: FALSE # Only relevant if TYPE=PERIODIC, see docs
+
+# See https://www.rapids.science/latest/setup/configuration/#timezone-of-your-study
+TIMEZONE: 
+    TYPE: MULTIPLE
+    SINGLE:
+      TZCODE: America/New_York
+    MULTIPLE:
+      TZCODES_FILE: tests/data/external/multiple_timezones.csv
+      IF_MISSING_TZCODE: STOP
+      DEFAULT_TZCODE: America/New_York
+      FITBIT: 
+        ALLOW_MULTIPLE_TZ_PER_DEVICE: False
+        INFER_FROM_SMARTPHONE_TZ: False
+
+########################################################################################################################
+#                                                 PHONE                                                                #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#data-stream-configuration
+PHONE_DATA_STREAMS:
+  USE: aware_csv
+  
+  # AVAILABLE:
+  aware_mysql: 
+    DATABASE_GROUP: MY_GROUP
+
+  aware_csv:
+    FOLDER: tests/data/external/aware_csv
+  
+  aware_influxdb: 
+    DATABASE_GROUP: MY_GROUP
+
+# Sensors ------
+
+# https://www.rapids.science/latest/features/phone-accelerometer/
+PHONE_ACCELEROMETER:
+  CONTAINER: accelerometer
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxmagnitude", "minmagnitude", "avgmagnitude", "medianmagnitude", "stdmagnitude"]
+      SRC_SCRIPT: src/features/phone_accelerometer/rapids/main.py
+    
+    PANDA:
+      COMPUTE: False
+      VALID_SENSED_MINUTES: False
+      FEATURES:
+        exertional_activity_episode: ["sumduration", "maxduration", "minduration", "avgduration", "medianduration", "stdduration"]
+        nonexertional_activity_episode: ["sumduration", "maxduration", "minduration", "avgduration", "medianduration", "stdduration"]
+      SRC_SCRIPT: src/features/phone_accelerometer/panda/main.py
+
+# See https://www.rapids.science/latest/features/phone-activity-recognition/
+PHONE_ACTIVITY_RECOGNITION:
+  CONTAINER: 
+    ANDROID: plugin_google_activity_recognition
+    IOS: plugin_ios_activity_recognition
+  EPISODE_THRESHOLD_BETWEEN_ROWS: 5 # minutes. Max time difference for two consecutive rows to be considered within the same AR episode.
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["count", "mostcommonactivity", "countuniqueactivities", "durationstationary", "durationmobile", "durationvehicle"]
+      ACTIVITY_CLASSES:
+        STATIONARY: ["still", "tilting"]
+        MOBILE: ["on_foot", "walking", "running", "on_bicycle"]
+        VEHICLE: ["in_vehicle"]
+      SRC_SCRIPT: src/features/phone_activity_recognition/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-applications-crashes/
+PHONE_APPLICATIONS_CRASHES:
+  CONTAINER: applications_crashes
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-applications-foreground/
+PHONE_APPLICATIONS_FOREGROUND:
+  CONTAINER: applications_foreground
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      SINGLE_CATEGORIES: ["all", "email"]
+      MULTIPLE_CATEGORIES:
+        social: ["socialnetworks", "socialmediatools"]
+        entertainment: ["entertainment", "gamingknowledge", "gamingcasual", "gamingadventure", "gamingstrategy", "gamingtoolscommunity", "gamingroleplaying", "gamingaction", "gaminglogic", "gamingsports", "gamingsimulation"]
+      SINGLE_APPS: ["top1global", "com.facebook.moments", "com.google.android.youtube", "com.twitter.android"] # There's no entropy for single apps
+      EXCLUDED_CATEGORIES: []
+      EXCLUDED_APPS: ["com.fitbit.FitbitMobile", "com.aware.plugin.upmc.cancer"]
+      FEATURES: ["count", "timeoffirstuse", "timeoflastuse", "frequencyentropy"]
+      SRC_SCRIPT: src/features/phone_applications_foreground/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-applications-notifications/
+PHONE_APPLICATIONS_NOTIFICATIONS:
+  CONTAINER: applications_notifications
+  APPLICATION_CATEGORIES:
+    CATALOGUE_SOURCE: FILE # FILE (genres are read from CATALOGUE_FILE) or GOOGLE (genres are scrapped from the Play Store)
+    CATALOGUE_FILE: "data/external/stachl_application_genre_catalogue.csv"
+    UPDATE_CATALOGUE_FILE: False # if CATALOGUE_SOURCE is equal to FILE, whether or not to update CATALOGUE_FILE, if CATALOGUE_SOURCE is equal to GOOGLE all scraped genres will be saved to CATALOGUE_FILE
+    SCRAPE_MISSING_CATEGORIES: False # whether or not to scrape missing genres, only effective if CATALOGUE_SOURCE is equal to FILE. If CATALOGUE_SOURCE is equal to GOOGLE, all genres are scraped anyway
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-battery/
+PHONE_BATTERY:
+  CONTAINER: phone_battery_raw.csv
+  EPISODE_THRESHOLD_BETWEEN_ROWS: 30 # minutes. Max time difference for two consecutive rows to be considered within the same battery episode.
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: True
+      FEATURES: ["countdischarge", "sumdurationdischarge", "countcharge", "sumdurationcharge", "avgconsumptionrate", "maxconsumptionrate"]
+      SRC_SCRIPT: src/features/phone_battery/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-bluetooth/
+PHONE_BLUETOOTH:
+  CONTAINER: phone_bluetooth_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_bluetooth/rapids/main.R
+
+    DORYAB:
+      COMPUTE: False
+      FEATURES: 
+        ALL: 
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+        OWN: 
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+        OTHERS:
+            DEVICES: ["countscans", "uniquedevices", "meanscans", "stdscans"]
+            SCANS_MOST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+            SCANS_LEAST_FREQUENT_DEVICE: ["withinsegments", "acrosssegments", "acrossdataset"]
+      SRC_SCRIPT: src/features/phone_bluetooth/doryab/main.py
+
+# See https://www.rapids.science/latest/features/phone-calls/
+PHONE_CALLS:
+  CONTAINER: phone_calls_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      CALL_TYPES: [missed, incoming, outgoing]
+      FEATURES:
+        missed:  [count, distinctcontacts, timefirstcall, timelastcall, countmostfrequentcontact]
+        incoming: [count, distinctcontacts, meanduration, sumduration, minduration, maxduration, stdduration, modeduration, entropyduration, timefirstcall, timelastcall, countmostfrequentcontact]
+        outgoing: [count, distinctcontacts, meanduration, sumduration, minduration, maxduration, stdduration, modeduration, entropyduration, timefirstcall, timelastcall, countmostfrequentcontact]
+      SRC_SCRIPT: src/features/phone_calls/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-conversation/
+PHONE_CONVERSATION:
+  CONTAINER: 
+    ANDROID: phone_conversation_raw.csv
+    IOS: phone_conversation_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["minutessilence", "minutesnoise", "minutesvoice", "minutesunknown","sumconversationduration","avgconversationduration",
+    "sdconversationduration","minconversationduration","maxconversationduration","timefirstconversation","timelastconversation","noisesumenergy",
+    "noiseavgenergy","noisesdenergy","noiseminenergy","noisemaxenergy","voicesumenergy",
+    "voiceavgenergy","voicesdenergy","voiceminenergy","voicemaxenergy","silencesensedfraction","noisesensedfraction",
+    "voicesensedfraction","unknownsensedfraction","silenceexpectedfraction","noiseexpectedfraction","voiceexpectedfraction",
+    "unknownexpectedfraction","countconversation"]
+      RECORDING_MINUTES: 1
+      PAUSED_MINUTES : 3
+      SRC_SCRIPT: src/features/phone_conversation/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-data-yield/
+PHONE_DATA_YIELD:
+  SENSORS: []
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: [ratiovalidyieldedminutes, ratiovalidyieldedhours]
+      MINUTE_RATIO_THRESHOLD_FOR_VALID_YIELDED_HOURS: 0.5 # 0 to 1, minimum percentage of valid minutes in an hour to be considered valid.
+      SRC_SCRIPT: src/features/phone_data_yield/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-keyboard/
+PHONE_KEYBOARD:
+  CONTAINER: keyboard
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-light/
+PHONE_LIGHT:
+  CONTAINER: phone_light_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["count", "maxlux", "minlux", "avglux", "medianlux", "stdlux"]
+      SRC_SCRIPT: src/features/phone_light/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-locations/
+PHONE_LOCATIONS:
+  CONTAINER: locations
+  LOCATIONS_TO_USE: ALL_RESAMPLED # ALL, GPS, ALL_RESAMPLED, OR FUSED_RESAMPLED
+  FUSED_RESAMPLED_CONSECUTIVE_THRESHOLD: 30 # minutes, only replicate location samples to the next sensed bin if the phone did not stop collecting data for more than this threshold
+  FUSED_RESAMPLED_TIME_SINCE_VALID_LOCATION: 720 # minutes, only replicate location samples to consecutive sensed bins if they were logged within this threshold after a valid location row
+  HOME_INFERENCE:
+    DBSCAN_EPS: 10 # meters
+    DBSCAN_MINSAMPLES: 5
+    THRESHOLD_STATIC : 1 # km/h
+    CLUSTERING_ALGORITHM: DBSCAN #DBSCAN,OPTICS
+  
+  PROVIDERS:
+    DORYAB:
+      COMPUTE: False
+      FEATURES: ["locationvariance","loglocationvariance","totaldistance","averagespeed","varspeed", "numberofsignificantplaces","numberlocationtransitions","radiusgyration","timeattop1location","timeattop2location","timeattop3location","movingtostaticratio","outlierstimepercent","maxlengthstayatclusters","minlengthstayatclusters","meanlengthstayatclusters","stdlengthstayatclusters","locationentropy","normalizedlocationentropy","timeathome"]
+      ACCURACY_LIMIT: 100 # meters, drops location coordinates with an accuracy higher than this. This number means there's a 68% probability the true location is within this radius
+      DBSCAN_EPS: 10 # meters
+      DBSCAN_MINSAMPLES: 5
+      THRESHOLD_STATIC : 1 # km/h
+      MAXIMUM_ROW_GAP: 300
+      MAXIMUM_ROW_DURATION: 60
+      MINUTES_DATA_USED: False
+      CLUSTER_ON: PARTICIPANT_DATASET # PARTICIPANT_DATASET,TIME_SEGMENT
+      CLUSTERING_ALGORITHM: DBSCAN #DBSCAN,OPTICS
+      RADIUS_FOR_HOME: 100  
+      SRC_SCRIPT: src/features/phone_locations/doryab/main.py
+
+    BARNETT:
+      COMPUTE: False
+      FEATURES: ["hometime","disttravelled","rog","maxdiam","maxhomedist","siglocsvisited","avgflightlen","stdflightlen","avgflightdur","stdflightdur","probpause","siglocentropy","circdnrtn","wkenddayrtn"]
+      ACCURACY_LIMIT: 100 # meters, drops location coordinates with an accuracy higher than this. This number means there's a 68% probability the true location is within this radius
+      IF_MULTIPLE_TIMEZONES: USE_MOST_COMMON
+      MINUTES_DATA_USED: False # Use this for quality control purposes, how many minutes of data (location coordinates gruped by minute) were used to compute features
+      SRC_SCRIPT: src/features/phone_locations/barnett/main.R
+
+# See https://www.rapids.science/latest/features/phone-log/
+PHONE_LOG:
+  CONTAINER: 
+    ANDROID: aware_log
+    IOS: ios_aware_log
+  PROVIDERS: # None implemented yet but this sensor can be used in PHONE_DATA_YIELD
+
+# See https://www.rapids.science/latest/features/phone-messages/
+PHONE_MESSAGES:
+  CONTAINER: phone_messages_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      MESSAGES_TYPES : [received, sent]
+      FEATURES: 
+        received: [count, distinctcontacts, timefirstmessage, timelastmessage, countmostfrequentcontact]
+        sent: [count, distinctcontacts, timefirstmessage, timelastmessage, countmostfrequentcontact]
+      SRC_SCRIPT: src/features/phone_messages/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-screen/
+PHONE_SCREEN:
+  CONTAINER: screen
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      REFERENCE_HOUR_FIRST_USE: 0
+      IGNORE_EPISODES_SHORTER_THAN: 0 # in minutes, set to 0 to disable
+      IGNORE_EPISODES_LONGER_THAN: 0 # in minutes, set to 0 to disable
+      FEATURES: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration", "firstuseafter"] # "episodepersensedminutes" needs to be added later
+      EPISODE_TYPES: ["unlock"]
+      SRC_SCRIPT: src/features/phone_screen/rapids/main.py
+
+# See https://www.rapids.science/latest/features/phone-wifi-connected/
+PHONE_WIFI_CONNECTED:
+  CONTAINER: phone_wifi_connected_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_wifi_connected/rapids/main.R
+
+# See https://www.rapids.science/latest/features/phone-wifi-visible/
+PHONE_WIFI_VISIBLE:
+  CONTAINER: phone_wifi_visible_raw.csv
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: FALSE
+      FEATURES: ["countscans", "uniquedevices", "countscansmostuniquedevice"]
+      SRC_SCRIPT: src/features/phone_wifi_visible/rapids/main.R
+
+
+
+########################################################################################################################
+#                                                 FITBIT                                                               #
+########################################################################################################################
+
+# See https://www.rapids.science/latest/setup/configuration/#data-stream-configuration
+FITBIT_DATA_STREAMS:
+  USE: fitbitjson_mysql
+  
+  # AVAILABLE:
+  fitbitjson_mysql: 
+    DATABASE_GROUP: MY_GROUP
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+  
+  fitbitparsed_mysql: 
+    DATABASE_GROUP: MY_GROUP
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+  fitbitjson_csv: 
+    FOLDER: data/external/fitbit_csv
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+  fitbitparsed_csv: 
+    FOLDER: data/external/fitbit_csv
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
+
+# Sensors ------
+
+# See https://www.rapids.science/latest/features/fitbit-data-yield/
+FITBIT_DATA_YIELD:
+  SENSOR: FITBIT_HEARTRATE_INTRADAY
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: [ratiovalidyieldedminutes, ratiovalidyieldedhours]
+      MINUTE_RATIO_THRESHOLD_FOR_VALID_YIELDED_HOURS: 0.5 #  0 to 1, minimum percentage of valid minutes in an hour to be considered valid.
+      SRC_SCRIPT: src/features/fitbit_data_yield/rapids/main.R
+
+
+# See https://www.rapids.science/latest/features/fitbit-heartrate-summary/
+FITBIT_HEARTRATE_SUMMARY:
+  CONTAINER: heartrate_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxrestinghr", "minrestinghr", "avgrestinghr", "medianrestinghr", "moderestinghr", "stdrestinghr", "diffmaxmoderestinghr", "diffminmoderestinghr", "entropyrestinghr"] # calories features' accuracy depend on the accuracy of the participants fitbit profile (e.g. height, weight) use these with care: ["sumcaloriesoutofrange", "maxcaloriesoutofrange", "mincaloriesoutofrange", "avgcaloriesoutofrange", "mediancaloriesoutofrange", "stdcaloriesoutofrange", "entropycaloriesoutofrange", "sumcaloriesfatburn", "maxcaloriesfatburn", "mincaloriesfatburn", "avgcaloriesfatburn", "mediancaloriesfatburn", "stdcaloriesfatburn", "entropycaloriesfatburn", "sumcaloriescardio", "maxcaloriescardio", "mincaloriescardio", "avgcaloriescardio", "mediancaloriescardio", "stdcaloriescardio", "entropycaloriescardio", "sumcaloriespeak", "maxcaloriespeak", "mincaloriespeak", "avgcaloriespeak", "mediancaloriespeak", "stdcaloriespeak", "entropycaloriespeak"]
+      SRC_SCRIPT: src/features/fitbit_heartrate_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-heartrate-intraday/
+FITBIT_HEARTRATE_INTRADAY:
+  CONTAINER: heartrate_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxhr", "minhr", "avghr", "medianhr", "modehr", "stdhr", "diffmaxmodehr", "diffminmodehr", "entropyhr", "minutesonoutofrangezone", "minutesonfatburnzone", "minutesoncardiozone", "minutesonpeakzone"]
+      SRC_SCRIPT: src/features/fitbit_heartrate_intraday/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-sleep-summary/
+FITBIT_SLEEP_SUMMARY:
+  CONTAINER: sleep_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["firstwaketime", "lastwaketime", "firstbedtime", "lastbedtime", "countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
+      SLEEP_TYPES: ["main", "nap", "all"]
+      SRC_SCRIPT: src/features/fitbit_sleep_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-sleep-intraday/
+FITBIT_SLEEP_INTRADAY:
+  CONTAINER: sleep_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES:
+        LEVELS_AND_TYPES: [countepisode, sumduration, maxduration, minduration, avgduration, medianduration, stdduration]
+        RATIOS_TYPE: [count, duration]
+        RATIOS_SCOPE: [ACROSS_LEVELS, ACROSS_TYPES, WITHIN_LEVELS, WITHIN_TYPES]
+        ROUTINE: [starttimefirstmainsleep, endtimelastmainsleep, starttimefirstnap, endtimelastnap]
+      SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
+        CLASSIC: [awake, restless, asleep]
+        STAGES: [wake, deep, light, rem]
+        UNIFIED: [awake, asleep]
+      SLEEP_TYPES: [main, nap, all]
+      LAST_NIGHT_END: 0 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight
+      ROUTINE_REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
+      SRC_SCRIPT: src/features/fitbit_sleep_intraday/rapids/main.py
+  
+    PRICE:
+      COMPUTE: False
+      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, stdstarttimeofepisodemain, stdendtimeofepisodemain, stdmidpointofepisodemain, socialjetlag, rmssdmeanstarttimeofepisodemain, rmssdmeanendtimeofepisodemain, rmssdmeanmidpointofepisodemain, rmssdmedianstarttimeofepisodemain, rmssdmedianendtimeofepisodemain, rmssdmedianmidpointofepisodemain]
+      SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
+        CLASSIC: [awake, restless, asleep]
+        STAGES: [wake, deep, light, rem]
+        UNIFIED: [awake, asleep]
+      DAY_TYPES: [WEEKEND, WEEK, ALL]
+      LAST_NIGHT_END: 660 # number of minutes after the midnight (11:00) 11*60
+      SRC_SCRIPT: src/features/fitbit_sleep_intraday/price/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-steps-summary/
+FITBIT_STEPS_SUMMARY:
+  CONTAINER: steps_summary
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES: ["maxsumsteps", "minsumsteps", "avgsumsteps", "mediansumsteps", "stdsumsteps"]
+      SRC_SCRIPT: src/features/fitbit_steps_summary/rapids/main.py
+
+# See https://www.rapids.science/latest/features/fitbit-steps-intraday/
+FITBIT_STEPS_INTRADAY:
+  CONTAINER: steps_intraday
+  PROVIDERS:
+    RAPIDS:
+      COMPUTE: False
+      FEATURES:
+        STEPS: ["sum", "max", "min", "avg", "std"]
+        SEDENTARY_BOUT: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration"]
+        ACTIVE_BOUT: ["countepisode", "sumduration", "maxduration", "minduration", "avgduration", "stdduration"]
+      THRESHOLD_ACTIVE_BOUT: 10 # steps
+      INCLUDE_ZERO_STEP_ROWS: False
+      SRC_SCRIPT: src/features/fitbit_steps_intraday/rapids/main.py
+
+########################################################################################################################
+#                                                 EMPATICA                                                             #
+########################################################################################################################
+
+EMPATICA_DATA_STREAMS:
+  USE: empatica_zip
+  
+  # AVAILABLE:
+  empatica_zip: 
+    FOLDER: data/external/empatica
+
+# Sensors ------
+
+# See https://www.rapids.science/latest/features/empatica-accelerometer/
+EMPATICA_ACCELEROMETER:
+  CONTAINER: ACC
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxmagnitude", "minmagnitude", "avgmagnitude", "medianmagnitude", "stdmagnitude"]
+      SRC_SCRIPT: src/features/empatica_accelerometer/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-heartrate/
+EMPATICA_HEARTRATE:
+  CONTAINER: HR
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxhr", "minhr", "avghr", "medianhr", "modehr", "stdhr", "diffmaxmodehr", "diffminmodehr", "entropyhr"]
+      SRC_SCRIPT: src/features/empatica_heartrate/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-temperature/
+EMPATICA_TEMPERATURE:
+  CONTAINER: TEMP
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxtemp", "mintemp", "avgtemp", "mediantemp", "modetemp", "stdtemp", "diffmaxmodetemp", "diffminmodetemp", "entropytemp"]
+      SRC_SCRIPT: src/features/empatica_temperature/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-electrodermal-activity/
+EMPATICA_ELECTRODERMAL_ACTIVITY:
+  CONTAINER: EDA
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxeda", "mineda", "avgeda", "medianeda", "modeeda", "stdeda", "diffmaxmodeeda", "diffminmodeeda", "entropyeda"]
+      SRC_SCRIPT: src/features/empatica_electrodermal_activity/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-blood-volume-pulse/
+EMPATICA_BLOOD_VOLUME_PULSE:
+  CONTAINER: BVP
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxbvp", "minbvp", "avgbvp", "medianbvp", "modebvp", "stdbvp", "diffmaxmodebvp", "diffminmodebvp", "entropybvp"]
+      SRC_SCRIPT: src/features/empatica_blood_volume_pulse/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-inter-beat-interval/
+EMPATICA_INTER_BEAT_INTERVAL:
+  CONTAINER: IBI
+  PROVIDERS:
+    DBDP:
+      COMPUTE: False
+      FEATURES: ["maxibi", "minibi", "avgibi", "medianibi", "modeibi", "stdibi", "diffmaxmodeibi", "diffminmodeibi", "entropyibi"]
+      SRC_SCRIPT: src/features/empatica_inter_beat_interval/dbdp/main.py
+
+# See https://www.rapids.science/latest/features/empatica-tags/
+EMPATICA_TAGS:
+  CONTAINER: TAGS
+  PROVIDERS:  # None implemented yet
+
+
+########################################################################################################################
+#                                                 PLOTS                                                                #
+########################################################################################################################
+
+# Data quality ------
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#1-histograms-of-phone-data-yield
+HISTOGRAM_PHONE_DATA_YIELD:
+  PLOT: False
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#2-heatmaps-of-overall-data-yield
+HEATMAP_PHONE_DATA_YIELD_PER_PARTICIPANT_PER_TIME_SEGMENT:
+  PLOT: False
+  TIME: ABSOLUTE_TIME # ABSOLUTE_TIME or RELATIVE_TIME
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#3-heatmap-of-recorded-phone-sensors
+HEATMAP_SENSORS_PER_MINUTE_PER_TIME_SEGMENT:
+  PLOT: False
+
+# See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#4-heatmap-of-sensor-row-count
+HEATMAP_SENSOR_ROW_COUNT_PER_TIME_SEGMENT:
+  PLOT: False
+  SENSORS: [PHONE_ACCELEROMETER, PHONE_ACTIVITY_RECOGNITION, PHONE_APPLICATIONS_FOREGROUND, PHONE_BATTERY, PHONE_BLUETOOTH, PHONE_CALLS, PHONE_CONVERSATION, PHONE_LIGHT, PHONE_LOCATIONS, PHONE_MESSAGES, PHONE_SCREEN, PHONE_WIFI_CONNECTED, PHONE_WIFI_VISIBLE]
+
+# Features ------
+
+# See https://www.rapids.science/latest/visualizations/feature-visualizations/#1-heatmap-correlation-matrix
+HEATMAP_FEATURE_CORRELATION_MATRIX:
+  PLOT: False
+  MIN_ROWS_RATIO: 0.5
+  CORR_THRESHOLD: 0.1
+  CORR_METHOD: "pearson" # choose from {"pearson", "kendall", "spearman"}
+

tests/settings/stz_event_config.yaml

@@ -3,7 +3,7 @@
 ########################################################################################################################
 
 # See https://www.rapids.science/latest/setup/configuration/#participant-files
-PIDS: [eve_and, eve_ios, eve_emp]
+PIDS: [android, ios, fitbit, empatica, empty]
 
 # See https://www.rapids.science/latest/setup/configuration/#automatic-creation-of-participant-files
 CREATE_PARTICIPANT_FILES:
@@ -24,7 +24,7 @@ CREATE_PARTICIPANT_FILES:
 # See https://www.rapids.science/latest/setup/configuration/#time-segments
 TIME_SEGMENTS: &time_segments
   TYPE: EVENT # FREQUENCY, PERIODIC, EVENT
-  FILE: "data/external/timesegments_event.csv"
+  FILE: "tests/data/external/timesegments_event.csv"
   INCLUDE_PAST_PERIODIC_SEGMENTS: FALSE # Only relevant if TYPE=PERIODIC, see docs
 
 # See https://www.rapids.science/latest/setup/configuration/#timezone-of-your-study
@@ -324,19 +324,19 @@ FITBIT_DATA_STREAMS:
   # AVAILABLE:
   fitbitjson_mysql: 
     DATABASE_GROUP: MY_GROUP
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
   
   fitbitparsed_mysql: 
     DATABASE_GROUP: MY_GROUP
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
   fitbitjson_csv: 
     FOLDER: data/external/fitbit_csv
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
   fitbitparsed_csv: 
     FOLDER: data/external/fitbit_csv
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
 # Sensors ------
 
@@ -375,7 +375,7 @@ FITBIT_SLEEP_SUMMARY:
   PROVIDERS:
     RAPIDS:
       COMPUTE: False
-      FEATURES: ["countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
+      FEATURES: ["firstwaketime", "lastwaketime", "firstbedtime", "lastbedtime", "countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
       SLEEP_TYPES: ["main", "nap", "all"]
       SRC_SCRIPT: src/features/fitbit_sleep_summary/rapids/main.py
 
@@ -386,31 +386,30 @@ FITBIT_SLEEP_INTRADAY:
     RAPIDS:
       COMPUTE: False
       FEATURES:
-        LEVELS_AND_TYPES_COMBINING_ALL: True
         LEVELS_AND_TYPES: [countepisode, sumduration, maxduration, minduration, avgduration, medianduration, stdduration]
         RATIOS_TYPE: [count, duration]
         RATIOS_SCOPE: [ACROSS_LEVELS, ACROSS_TYPES, WITHIN_LEVELS, WITHIN_TYPES]
         ROUTINE: [starttimefirstmainsleep, endtimelastmainsleep, starttimefirstnap, endtimelastnap]
       SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
         CLASSIC: [awake, restless, asleep]
         STAGES: [wake, deep, light, rem]
         UNIFIED: [awake, asleep]
-      SLEEP_TYPES: [main, nap]
-      INCLUDE_SLEEP_LATER_THAN: 0 # a number ranged from 0 (midnight) to 1439 (23:59)
-      REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
+      SLEEP_TYPES: [main, nap, all]
+      LAST_NIGHT_END: 0 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight
+      ROUTINE_REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
       SRC_SCRIPT: src/features/fitbit_sleep_intraday/rapids/main.py
   
     PRICE:
       COMPUTE: False
-      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, "stdstarttimeofepisodemain", "stdendtimeofepisodemain", "stdmidpointofepisodemain", socialjetlag, meanssdstarttimeofepisodemain, meanssdendtimeofepisodemain, meanssdmidpointofepisodemain, medianssdstarttimeofepisodemain, medianssdendtimeofepisodemain, medianssdmidpointofepisodemain]
+      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, stdstarttimeofepisodemain, stdendtimeofepisodemain, stdmidpointofepisodemain, socialjetlag, rmssdmeanstarttimeofepisodemain, rmssdmeanendtimeofepisodemain, rmssdmeanmidpointofepisodemain, rmssdmedianstarttimeofepisodemain, rmssdmedianendtimeofepisodemain, rmssdmedianmidpointofepisodemain]
       SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
         CLASSIC: [awake, restless, asleep]
         STAGES: [wake, deep, light, rem]
         UNIFIED: [awake, asleep]
       DAY_TYPES: [WEEKEND, WEEK, ALL]
-      GROUP_EPISODES_WITHIN: # by default: today's 6pm to tomorrow's noon
-        START_TIME: 1080 # number of minutes after the midnight (18:00) 18*60
-        LENGTH: 1080 # in minutes (18 hours) 18*60
+      LAST_NIGHT_END: 660 # number of minutes after the midnight (11:00) 11*60
       SRC_SCRIPT: src/features/fitbit_sleep_intraday/price/main.py
 
 # See https://www.rapids.science/latest/features/fitbit-steps-summary/
@@ -522,6 +521,7 @@ HISTOGRAM_PHONE_DATA_YIELD:
 # See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#2-heatmaps-of-overall-data-yield
 HEATMAP_PHONE_DATA_YIELD_PER_PARTICIPANT_PER_TIME_SEGMENT:
   PLOT: False
+  TIME: ABSOLUTE_TIME # ABSOLUTE_TIME or RELATIVE_TIME
 
 # See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#3-heatmap-of-recorded-phone-sensors
 HEATMAP_SENSORS_PER_MINUTE_PER_TIME_SEGMENT:

tests/settings/stz_frequency_config.yaml

@@ -3,7 +3,7 @@
 ########################################################################################################################
 
 # See https://www.rapids.science/latest/setup/configuration/#participant-files
-PIDS: [fre_and, fre_ios, fre_emp]
+PIDS: [android, ios, fitbit, empatica, empty]
 
 # See https://www.rapids.science/latest/setup/configuration/#automatic-creation-of-participant-files
 CREATE_PARTICIPANT_FILES:
@@ -24,7 +24,7 @@ CREATE_PARTICIPANT_FILES:
 # See https://www.rapids.science/latest/setup/configuration/#time-segments
 TIME_SEGMENTS: &time_segments
   TYPE: FREQUENCY # FREQUENCY, PERIODIC, EVENT
-  FILE: "data/external/timesegments_frequency.csv"
+  FILE: "tests/data/external/timesegments_frequency.csv"
   INCLUDE_PAST_PERIODIC_SEGMENTS: FALSE # Only relevant if TYPE=PERIODIC, see docs
 
 # See https://www.rapids.science/latest/setup/configuration/#timezone-of-your-study
@@ -324,19 +324,19 @@ FITBIT_DATA_STREAMS:
   # AVAILABLE:
   fitbitjson_mysql: 
     DATABASE_GROUP: MY_GROUP
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
   
   fitbitparsed_mysql: 
     DATABASE_GROUP: MY_GROUP
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
   fitbitjson_csv: 
     FOLDER: data/external/fitbit_csv
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
   fitbitparsed_csv: 
     FOLDER: data/external/fitbit_csv
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
 # Sensors ------
 
@@ -375,7 +375,7 @@ FITBIT_SLEEP_SUMMARY:
   PROVIDERS:
     RAPIDS:
       COMPUTE: False
-      FEATURES: ["countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
+      FEATURES: ["firstwaketime", "lastwaketime", "firstbedtime", "lastbedtime", "countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
       SLEEP_TYPES: ["main", "nap", "all"]
       SRC_SCRIPT: src/features/fitbit_sleep_summary/rapids/main.py
 
@@ -386,31 +386,30 @@ FITBIT_SLEEP_INTRADAY:
     RAPIDS:
       COMPUTE: False
       FEATURES:
-        LEVELS_AND_TYPES_COMBINING_ALL: True
         LEVELS_AND_TYPES: [countepisode, sumduration, maxduration, minduration, avgduration, medianduration, stdduration]
         RATIOS_TYPE: [count, duration]
         RATIOS_SCOPE: [ACROSS_LEVELS, ACROSS_TYPES, WITHIN_LEVELS, WITHIN_TYPES]
         ROUTINE: [starttimefirstmainsleep, endtimelastmainsleep, starttimefirstnap, endtimelastnap]
       SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
         CLASSIC: [awake, restless, asleep]
         STAGES: [wake, deep, light, rem]
         UNIFIED: [awake, asleep]
-      SLEEP_TYPES: [main, nap]
-      INCLUDE_SLEEP_LATER_THAN: 0 # a number ranged from 0 (midnight) to 1439 (23:59)
-      REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
+      SLEEP_TYPES: [main, nap, all]
+      LAST_NIGHT_END: 0 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight
+      ROUTINE_REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
       SRC_SCRIPT: src/features/fitbit_sleep_intraday/rapids/main.py
   
     PRICE:
       COMPUTE: False
-      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, "stdstarttimeofepisodemain", "stdendtimeofepisodemain", "stdmidpointofepisodemain", socialjetlag, meanssdstarttimeofepisodemain, meanssdendtimeofepisodemain, meanssdmidpointofepisodemain, medianssdstarttimeofepisodemain, medianssdendtimeofepisodemain, medianssdmidpointofepisodemain]
+      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, stdstarttimeofepisodemain, stdendtimeofepisodemain, stdmidpointofepisodemain, socialjetlag, rmssdmeanstarttimeofepisodemain, rmssdmeanendtimeofepisodemain, rmssdmeanmidpointofepisodemain, rmssdmedianstarttimeofepisodemain, rmssdmedianendtimeofepisodemain, rmssdmedianmidpointofepisodemain]
       SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
         CLASSIC: [awake, restless, asleep]
         STAGES: [wake, deep, light, rem]
         UNIFIED: [awake, asleep]
       DAY_TYPES: [WEEKEND, WEEK, ALL]
-      GROUP_EPISODES_WITHIN: # by default: today's 6pm to tomorrow's noon
-        START_TIME: 1080 # number of minutes after the midnight (18:00) 18*60
-        LENGTH: 1080 # in minutes (18 hours) 18*60
+      LAST_NIGHT_END: 660 # number of minutes after the midnight (11:00) 11*60
       SRC_SCRIPT: src/features/fitbit_sleep_intraday/price/main.py
 
 # See https://www.rapids.science/latest/features/fitbit-steps-summary/
@@ -522,6 +521,7 @@ HISTOGRAM_PHONE_DATA_YIELD:
 # See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#2-heatmaps-of-overall-data-yield
 HEATMAP_PHONE_DATA_YIELD_PER_PARTICIPANT_PER_TIME_SEGMENT:
   PLOT: False
+  TIME: ABSOLUTE_TIME # ABSOLUTE_TIME or RELATIVE_TIME
 
 # See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#3-heatmap-of-recorded-phone-sensors
 HEATMAP_SENSORS_PER_MINUTE_PER_TIME_SEGMENT:

tests/settings/stz_periodic_config.yaml

@@ -3,7 +3,7 @@
 ########################################################################################################################
 
 # See https://www.rapids.science/latest/setup/configuration/#participant-files
-PIDS: [per_and, per_emp, per_ios]
+PIDS: [android, ios, fitbit, empatica, empty]
 
 # See https://www.rapids.science/latest/setup/configuration/#automatic-creation-of-participant-files
 CREATE_PARTICIPANT_FILES:
@@ -24,7 +24,7 @@ CREATE_PARTICIPANT_FILES:
 # See https://www.rapids.science/latest/setup/configuration/#time-segments
 TIME_SEGMENTS: &time_segments
   TYPE: PERIODIC # FREQUENCY, PERIODIC, EVENT
-  FILE: "data/external/timesegments_periodic.csv"
+  FILE: "tests/data/external/timesegments_periodic.csv"
   INCLUDE_PAST_PERIODIC_SEGMENTS: FALSE # Only relevant if TYPE=PERIODIC, see docs
 
 # See https://www.rapids.science/latest/setup/configuration/#timezone-of-your-study
@@ -324,19 +324,19 @@ FITBIT_DATA_STREAMS:
   # AVAILABLE:
   fitbitjson_mysql: 
     DATABASE_GROUP: MY_GROUP
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
   
   fitbitparsed_mysql: 
     DATABASE_GROUP: MY_GROUP
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
   fitbitjson_csv: 
     FOLDER: data/external/fitbit_csv
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
   fitbitparsed_csv: 
     FOLDER: data/external/fitbit_csv
-    SLEEP_SUMMARY_EPISODE_DAY_ANCHOR: end # summary sleep episodes are considered as events based on either the start timestamp or end timestamp.
+    SLEEP_SUMMARY_LAST_NIGHT_END: 660 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight. By default, 660 (11:00).
 
 # Sensors ------
 
@@ -375,7 +375,7 @@ FITBIT_SLEEP_SUMMARY:
   PROVIDERS:
     RAPIDS:
       COMPUTE: False
-      FEATURES: ["countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
+      FEATURES: ["firstwaketime", "lastwaketime", "firstbedtime", "lastbedtime", "countepisode", "avgefficiency", "sumdurationafterwakeup", "sumdurationasleep", "sumdurationawake", "sumdurationtofallasleep", "sumdurationinbed", "avgdurationafterwakeup", "avgdurationasleep", "avgdurationawake", "avgdurationtofallasleep", "avgdurationinbed"]
       SLEEP_TYPES: ["main", "nap", "all"]
       SRC_SCRIPT: src/features/fitbit_sleep_summary/rapids/main.py
 
@@ -386,31 +386,30 @@ FITBIT_SLEEP_INTRADAY:
     RAPIDS:
       COMPUTE: False
       FEATURES:
-        LEVELS_AND_TYPES_COMBINING_ALL: True
         LEVELS_AND_TYPES: [countepisode, sumduration, maxduration, minduration, avgduration, medianduration, stdduration]
         RATIOS_TYPE: [count, duration]
         RATIOS_SCOPE: [ACROSS_LEVELS, ACROSS_TYPES, WITHIN_LEVELS, WITHIN_TYPES]
         ROUTINE: [starttimefirstmainsleep, endtimelastmainsleep, starttimefirstnap, endtimelastnap]
       SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
         CLASSIC: [awake, restless, asleep]
         STAGES: [wake, deep, light, rem]
         UNIFIED: [awake, asleep]
-      SLEEP_TYPES: [main, nap]
-      INCLUDE_SLEEP_LATER_THAN: 0 # a number ranged from 0 (midnight) to 1439 (23:59)
-      REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
+      SLEEP_TYPES: [main, nap, all]
+      LAST_NIGHT_END: 0 # a number ranged from 0 (midnight) to 1439 (23:59) which denotes number of minutes after the midnight
+      ROUTINE_REFERENCE_TIME: MIDNIGHT # chosen from "MIDNIGHT" and "START_OF_THE_SEGMENT"
       SRC_SCRIPT: src/features/fitbit_sleep_intraday/rapids/main.py
   
     PRICE:
       COMPUTE: False
-      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, "stdstarttimeofepisodemain", "stdendtimeofepisodemain", "stdmidpointofepisodemain", socialjetlag, meanssdstarttimeofepisodemain, meanssdendtimeofepisodemain, meanssdmidpointofepisodemain, medianssdstarttimeofepisodemain, medianssdendtimeofepisodemain, medianssdmidpointofepisodemain]
+      FEATURES: [avgduration, avgratioduration, avgstarttimeofepisodemain, avgendtimeofepisodemain, avgmidpointofepisodemain, stdstarttimeofepisodemain, stdendtimeofepisodemain, stdmidpointofepisodemain, socialjetlag, rmssdmeanstarttimeofepisodemain, rmssdmeanendtimeofepisodemain, rmssdmeanmidpointofepisodemain, rmssdmedianstarttimeofepisodemain, rmssdmedianendtimeofepisodemain, rmssdmedianmidpointofepisodemain]
       SLEEP_LEVELS:
+        INCLUDE_ALL_GROUPS: True
         CLASSIC: [awake, restless, asleep]
         STAGES: [wake, deep, light, rem]
         UNIFIED: [awake, asleep]
       DAY_TYPES: [WEEKEND, WEEK, ALL]
-      GROUP_EPISODES_WITHIN: # by default: today's 6pm to tomorrow's noon
-        START_TIME: 1080 # number of minutes after the midnight (18:00) 18*60
-        LENGTH: 1080 # in minutes (18 hours) 18*60
+      LAST_NIGHT_END: 660 # number of minutes after the midnight (11:00) 11*60
       SRC_SCRIPT: src/features/fitbit_sleep_intraday/price/main.py
 
 # See https://www.rapids.science/latest/features/fitbit-steps-summary/
@@ -522,6 +521,7 @@ HISTOGRAM_PHONE_DATA_YIELD:
 # See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#2-heatmaps-of-overall-data-yield
 HEATMAP_PHONE_DATA_YIELD_PER_PARTICIPANT_PER_TIME_SEGMENT:
   PLOT: False
+  TIME: ABSOLUTE_TIME # ABSOLUTE_TIME or RELATIVE_TIME
 
 # See https://www.rapids.science/latest/visualizations/data-quality-visualizations/#3-heatmap-of-recorded-phone-sensors
 HEATMAP_SENSORS_PER_MINUTE_PER_TIME_SEGMENT: